https://antonch.me/en/tags/tokenization/Recent content in Tokenization on Anton Chirikalov's BlogHugo -- 0.164.0en-USFri, 10 Jul 2026 00:00:00 +0000https://antonch.me/en/posts/transformer-anatomy-part-1/Fri, 10 Jul 2026 00:00:00 +0000https://antonch.me/en/posts/transformer-anatomy-part-1/A technical walkthrough: how the tokenizer slices a prompt, how a token becomes a vector, why position is encoded as rotation (RoPE), and how attention works — where the Q, K, V matrices come from and what they do