LatentPress stores conversational histories and long documents as continuous memory tokens a frozen decoder reads through its input-embedding interface—no text reconstruction at inference. A small reader-matched writer (4.2M–26.2M adapter params, ~0.1% of the decoder) compresses 4–16×. On LongMemEval it reaches 0.504 accuracy at 7.70× compression vs 0.490 uncompressed, beating text summaries and OCR; writing is ~43ms per conversation and reading is 5–9× faster than raw context—useful for long-context agent memory.
Key Takeaways
- ✓Rep: continuous memory tokens read via embedding interface; no text reconstruction.
- ✓Compression: 4–16×; LongMemEval 0.504 at 7.70× vs 0.490 uncompressed.
- ✓Speed: ~43ms write per conversation; reading 5–9× faster than raw context for long-context agents.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.