AI Coding Live News

Letta releases FrontierMemory 1.0, a benchmark that scores agent memory by downstream task success; Opus 5.5 and GLM-5.3 tie for first at 73.3%

On October 21 Letta released FrontierMemory 1.0. Instead of quizzing agents on facts such as birthdays or hobbies, it gives an agent a set of past trajectories, has it write memory or skills, and scores that memory by how many coding and knowledge-work tasks a task agent then solves. Version 1.0 has 15 tasks adapted from public benchmarks such as DeepSWE, SkillsBench and APEX-Agents. On the model board (memory written in Letta Dream, tasks run in Letta Code) Opus 5.5 and GLM-5.3 both score 73.3% and Grok 4.7 scores 33.3%; on the harness board Letta's own Letta Dream ranks first. All numbers are Letta's own.

Letta releases FrontierMemory 1.0, a benchmark that scores agent memory by downstream task success; Opus 5.5 and GLM-5.3 tie for first at 73.3%

Key Takeaways

  • Model board (vendor-run, top effort): Opus 5.5 73.3% (about $2.80 per task), GLM-5.3 73.3% ($3.58), Kimi K3 66.7%, GPT-6.1 Sol 60.0% ($0.77, cheapest), Gemini 4 Argon 60.0%, Muse Wonder 46.7%, Grok 4.7 33.3%
  • Harness board: Letta Dream 73.3%, Prime Agent 60.0%, OpenAI Agents SDK 40.0%, Claude Managed Agents 33.3%, Hermes Agent 26.7%
  • Version 1.0 has 15 tasks; only 219 of 665 source trajectories are relevant, so the agent has to find the useful experience itself
  • Letta says 53% of the source tasks it kept had broken verifiers, which it repaired; memory generation is capped at 6 hours with no web access
  • Memory comes in three kinds (task conventions, user preferences, environment facts); outside models and harnesses can be submitted
Read full story

DAEDALUS: Bootstrapping Reusable Agent Memory via Self-Generated Tasks and Autonomous Dual-Agent Practice Without Human Oracles

LLM agents operating in novel API or terminal environments frequently repeat identical errors due to an absence of procedural memory. Existing memory bootstrapping approaches rely heavily on curated prompt playbooks or oracle verifiers that require extensive domain foresight. Illuin Technology releases DAEDALUS (arXiv:2610.08048), an autonomous dual-agent framework bootstrapping reusable memory entirely from self-generated practice without human oracles. DAEDALUS pairs an Explorer agent—which probes the execution environment to formulate curriculum-style tasks—with a Solver agent. When the solver stumbles, it extracts candidate heuristics that are committed into a persistent memory bank only after proving their efficacy across repeated verification trials. Across AppWorld, tau^2-bench, and AutomationBench, DAEDALUS boosts average success rates by up to 15.9 percentage points and raises Pass^5 rates by 2.2x over memory-less baselines, with generated procedural memories transferring seamlessly across heterogeneous foundation model families.

Key Takeaways

  • Illuin Technology open-sources DAEDALUS, bootstrapping reusable procedural memory without human labels or oracle verifiers
  • Employs an Explorer-Solver dual-agent self-play architecture to synthesize verified operational heuristics from failure traces
  • Lifts task completion by up to 15.9 points and doubles Pass^5 by 2.2x across AppWorld, tau^2-bench, and AutomationBench
Read full story
Linked Models & Agents:

Engram: Pre-Registered Agent Memory Trial Shows Raw Turn Selection Matches LLM Fact Extraction at 3,061x Lower Cost

Conversational memory for LLM agents traditionally divides into two opposing camps: expensive pipeline extraction that distills dialogues into structured factual memory stores versus raw conversational turn retrieval. Literature has reported contradictory findings. Researchers conducted a pre-registered, double-blind controlled study on held-out LoCoMo and LongMemEval benchmarks (arXiv:2609.34227). The investigation reveals that under constrained context budgets, selecting raw conversational turns via a lightweight typed decision model (Jev) is statistically non-inferior to full LLM fact extraction pipelines (95% one-sided bound -3.0 points vs. -5 margin)—while reducing write-time computational costs by a massive 3,061 times. Furthermore, the authors resolve literature contradictions by proving that reranking gains scale inversely with token budgets, while aggressive reranking degrades an agent's correct abstention reliability. All study protocols, data, and code are open-sourced at github.com/ris3abh/Engram.

Key Takeaways

  • Presents Engram, the first pre-registered double-blind study testing raw-turn selection against LLM fact extraction for agent memory
  • Shows raw turns selected via typed decision model Jev are statistically non-inferior to LLM fact extraction at 3,061x lower write cost
  • Proves reranking gains decay sharply as token budgets expand, while aggressive reranking degrades an agent's correct abstention rate
Read full story
Linked Models & Agents:

RealCompanion: Auditing Human Understanding Over 120-Day Real-World Conversations Exposes Agent Memory Benchmarks

In long-term companion AI and memory-augmented agent research, standard evaluations rely on synthetic personas and generated queries that artificially predetermine relevance and leak retrieval cues. Researchers introduce RealCompanion (arXiv:2610.01780), releasing a landmark dataset derived from ten genuine human relationships with an AI companion spanning up to 120 days and 27,218 real messages, meticulously annotated with ground-truth reasoning traces. The empirical analysis yields three foundational findings: First, historical memory is rarely required and temporally distant—95.9% of user interactions are satisfied by immediate context, with only 2.2% genuinely necessitating historical memory retrieval; pooled evaluation scores create an illusion of competence where 96% of evidence gains come from queries needing no recall. Second, contemporary memory detectors fail entirely on unprompted human text; synthetic benchmarks leak intent cues, and merely tagging inputs as 'memories' inflates agent retrieval by 10 to 14 points. Third, distinct memory architectures reconstruct human personas with identical F1 accuracy across a staggering 31-fold disparity in computational cost.

RealCompanion: Auditing Human Understanding Over 120-Day Real-World Conversations Exposes Agent Memory Benchmarks

Key Takeaways

  • Releases RealCompanion over 120 days and 27,218 real messages, puncturing synthetic benchmark illusions in agent memory
  • Reveals extreme long-tail memory demands: only 2.2% of authentic messages require recall, while 95.9% rely strictly on recency
  • Demonstrates that contemporary memory detectors fail on natural speech, and identical F1 persona accuracy spans a 31x cost gap
Read full story
Linked Models & Agents:
ADSponsored

MemoryAthena: Adaptive Routing Over Latent and Generated Memories for LLM Agents

Challenging the assumption that agent memory must rely solely on external explicit retrieval tables, researchers unveiled MemoryAthena. By establishing three memory pathways—direct Engram retrieval (E), cue-conditioned generation (GE), and causal backbone generation (GH)—governed by a lightweight 201M causal routing head trained on counterfactual token likelihood advantages, MemoryAthena raises five-task QA accuracy from 37.65 to 39.28 while boosting general NLP averages to 79.13.

MemoryAthena: Adaptive Routing Over Latent and Generated Memories for LLM Agents

Key Takeaways

  • Three-Way Memory Architecture: Combines direct table retrieval (E), cue-guided generation (GE), and table-free causal backbone generation (GH) into a unified memory fabric.
  • Counterfactual Causal Routing Head: Keeps the foundational LLM backbone and memory tables frozen, training a 201M routing head on counterfactual future-token likelihood advantages.
  • Empirical Accuracy Gains: Boosts five-task long-horizon QA benchmarks from 37.65 to 39.28 and lifts six-task general NLP evaluations from 76.73 to 79.13.
Read full story
Linked Models & Agents:

CoreSpeed launches: one MCP endpoint for apps, cross-agent memory, and media/web/social tools

CoreSpeed (@CoreSpeedHQ) launched: connect apps through one MCP endpoint with built-in cross-agent memory, media generation, web and social research tools, plus agent identities, budgets, and activity logs. Start at https://corespeed.io.

Key Takeaways

  • One MCP endpoint wires apps and toolchains.
  • Built-in cross-agent memory, media gen, and web/social research.
  • Includes agent identities, budgets, and activity logs.
Read full story
Linked Models & Agents:

LatentPress: compress long chats/docs into continuous memory tokens for frozen LLMs

LatentPress stores conversational histories and long documents as continuous memory tokens a frozen decoder reads through its input-embedding interface—no text reconstruction at inference. A small reader-matched writer (4.2M–26.2M adapter params, ~0.1% of the decoder) compresses 4–16×. On LongMemEval it reaches 0.504 accuracy at 7.70× compression vs 0.490 uncompressed, beating text summaries and OCR; writing is ~43ms per conversation and reading is 5–9× faster than raw context—useful for long-context agent memory.

Key Takeaways

  • Rep: continuous memory tokens read via embedding interface; no text reconstruction.
  • Compression: 4–16×; LongMemEval 0.504 at 7.70× vs 0.490 uncompressed.
  • Speed: ~43ms write per conversation; reading 5–9× faster than raw context for long-context agents.
Read full story
Linked Models & Agents: