🎮 Interactive 3D Modules
Explore LLM concepts through interactive 3D visualizations. Drag, rotate, and interact with the models to see how they work.
Transformer Architecture
Explore the full Transformer model in 3D — see how data flows through attention layers and feed-forward networks.
Interactive 3DTokenization
Watch BPE tokenization happen in real-time — see how text breaks into tokens.
Interactive 3DWord Embeddings
Visualize word vectors in 3D space — see how similar words cluster together.
Interactive 3DAttention Mechanisms
Compare attention variants visually — MHA, MQA, GQA side by side.
Interactive 3DKV Cache
See how KV Cache speeds up inference — visualize the caching mechanism.
Interactive 3DTraining Pipeline
Walk through the LLM training process — data, loss, optimization in 3D.
Interactive 3DLoRA Fine-tuning
Visualize how LoRA works — see the low-rank decomposition in action.
Interactive 3DRLHF Alignment
Explore reinforcement learning from human feedback in 3D.
Interactive 3DRAG
See Retrieval-Augmented Generation in action — retrieval, augmentation, generation.
Interactive 3DMixture of Experts
Visualize the MoE architecture — see how experts are selected and combined.
Interactive 3DQuantization
Watch model weights compress — see the trade-off between size and precision.
Interactive 3D