Attention Head Wiki

Attention Heads

• Induction Heads
• Duplicate Token Heads
• Previous Token Heads