Research Labs
BACK TO LABS
January 2026· Computer Vision

Vision Transformer (ViT) from Scratch

PyTorchTransformersAttentionCIFAR-10ViT

Experiment abstract

From-scratch implementation of the Vision Transformer (ViT) in PyTorch. Includes patch embedding, multi-head self-attention, positional encoding, and classification head — trained on CIFAR-10.