Category
1 article in this category.
Written by me.
Attention has no built-in sense of order. Read how rotary position embedding encodes relative distance, and why it matters for long context.