Retrieval Memory Outperforms Full Context on Large Histories—But Small Conversations Tell a Different Story

This benchmark reveals the practical inflection point for agent memory adoption: while retrieval-based approaches dramatically outperform full-context baselines on large conversation histories (14.2-point accuracy gain with 39× fewer tokens), they still lose on smaller datasets. Developers now have concrete data on exactly when memory engines become worth the engineering complexity.