Category
3 articles in this category.
Written by me.
Agent memory is a design problem about what to store and retrieve. Read the three types, a worked design, and why more memory can hurt.
An agent needs to remember across steps and sessions. Read the three memory types, a worked design, and why more memory can hurt.
Every token in a conversation carries cached attention state. Read how the KV cache grows, a worked memory calculation, and the mitigations.