Back to home

Compare

Comparing: Let AI Decide What to Remember — MemPO Uses RL to Cure Agent Amnesia & 让 AI 自己决定'该记什么' — MemPO 论文想用强化学习根治 Agent 健忘症

AEN
MemPOAgent MemoryReinforcement Learning·

Let AI Decide What to Remember — MemPO Uses RL to Cure Agent Amnesia

What this is

We notice that the MemPO paper's diagnosis is direct: there are already plenty of studies using Reinforcement Learning (RL—in plain terms, a training method that "rewards correct behavior and penalizes mistakes") for Agent memory management, but none of them has a mechanism telling the model "what to remember this time." The result is memory filled with noise.

The mainstream approach is bolting on an external memory module (most commonly a vector database—one that retrieves by "semantic similarity"), storing history in it and retrieving later. MemPO takes the opposite path: no external module. Instead, the model writes a short note at the start of each conversation turn, learning as it records. The model-generated note serves as both memory and reasoning—essentially end-to-end training (a unified pipeline that learns directly from input to output) teaching the AI "what's worth remembering, and how to record it."

Industry view

Academia finds this line of thinking interesting: it mirrors how humans use notebooks to assist thinking—"remembering" and "thinking" are two sides of the same coin. But it is worth staying alert: the skepticism is just as clear—

First, RL training is expensive and unstable; the paper uses only 16 samples per batch, and generalization (whether the method still holds up on new scenarios) remains an open question. Second, the paper runs on academic benchmarks (standard test sets), far from real production environments; the latency, cost, and long-context problems Agent deployment must solve—none have been touched. Third, the big players are currently betting on retrieval-based memory—Anthropic and OpenAI have both shipped features for "letting AI remember user preferences." MemPO-style "training-based memory" won't be commercialized anytime soon.

Impact on regular people

For enterprise IT: Not usable short-term, but it confirms that Agent "memory" is a genuine bottleneck. When evaluating Agent vendors, ask clearly whether their memory approach is retrieval-based (mature) or training-based (still in the lab).

For individual professionals: Run a long project on ChatGPT or Claude today, and "lost context" is a common pain point. If this kind of research succeeds, AI assistants could truly remember your project background across weeks, rather than forcing you to re-explain each time.

For the consumer market: No short-term impact—this is underlying research. But the signal it sends is clear: the "AI assistants becoming more human-like" direction continues, and the "knowing you better" experience will land gradually.

Source: juejin.cn
BZH
MemPOAgent 记忆强化学习·

让 AI 自己决定'该记什么' — MemPO 论文想用强化学习根治 Agent 健忘症

这是什么

我们注意到,MemPO 这篇论文的判断很直接:现在用强化学习(Reinforcement Learning,简单说就是"做对奖励、做错扣分"的训练方法)做 Agent 记忆管理的研究不少,但都没有机制告诉模型"这次该记什么",结果记忆里堆的全是噪声。

主流做法是外挂一个记忆模块(最常见的是向量数据库,即按"语义相似度"查找的数据库),把历史存进去再检索。MemPO 走了相反的路:不要外挂,让模型自己在每轮对话开头写一段笔记,边记边学。模型写的笔记既是记忆,也是推理的一部分,相当于端到端(从输入直接学到输出的一体化训练)教会 AI "什么值得记、怎么记"。

行业怎么看

学术界认为这条思路有意思:它和人类用笔记本辅助思考的模式很像,"记住"和"思考"本就是一件事的两个面。但值得我们警觉的是,质疑声音同样明确——

第一,强化学习训练贵且不稳定,论文里每批只用 16 个样本,泛化能力(在新场景上是否还管用)仍是悬而未决的问题。第二,论文跑的是学术 benchmark(标准测试题),离真实生产环境差得远;Agent 落地要解决的延迟、成本、长上下文处理,一个都没碰。第三,大厂目前押注的是检索式记忆——Anthropic、OpenAI 都上线了"让 AI 记住用户偏好"的功能,MemPO 这种"训练式记忆"短期内很难商业化。

对普通人的影响

对企业 IT:短期用不上,但说明 Agent 的"记忆"是真实瓶颈。评估 Agent 供应商时,要问清他们的记忆方案是检索式(成熟)还是训练式(还在实验室)。

对个人职场:现在用 ChatGPT 或 Claude 跑长项目,"上下文丢了"是常见痛点。这类研究若跑通,AI 助手将来可能真正跨周记得你的项目背景,而不是每次重新解释。

对消费市场:短期无感,这是底层研究。但它释放的信号很清晰:AI 助手"更像人"的方向还在继续,"越来越懂你"的体验会逐步落地。

Source: juejin.cn