transformer 8
- Spitting the Details: The Tweaks That Made LLaMA
- Reading Both Ways: BERT and the End of Left-to-Right
- The Right Half: Decoder-Only Transformers
- FlashAttention
- Deja Vu, but Make It Linear: The KV Cache
- Where Do Facts Go to Live? MLPs, Superposition, and a Basketball Player Named Michael
- Attention Is a Third of What You Need: QKV, Dot Products, and the Other Two-Thirds
- Transformers: More Than Meets the Eye