Topic
forgetting
Sequential DPO Study Reveals Non-Uniform Forgetting Across Multiple Preference Objectives
A study by Bhandari et al. on sequential Direct Preference Optimization (DPO) finds that later training objectives do not uniformly degrade earlier preferences. Using Llama-3.1-8B-Instruct, the research reveals that forgetting patterns vary from stability to positive transfer depending on objective compatibility and signal strength, offering guidance for multi-objective AI alignment in enterprises.
Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models
A new research paper from arXiv shows that reinforcement learning with verifiable rewards (RLVR) can cause large reasoning models to forget foundational capabilities like perception and faithfulness. The authors propose RECAP, a replay strategy with dynamic objective reweighting that preserves general knowledge while maintaining reasoning gains.
Agent Memory Forgetting Study Reveals Control-Plane Trade-offs for Enterprise AI Systems
A new architectural study of AI agent memory, based on 13 system configurations and a 385-case adversarial benchmark, reveals that forgetting failures—not recall failures—are the dominant cause of production errors. The research introduces ForgetEval, a benchmark for evaluating forgetting, and an Adapter Protocol for integrating heterogeneous memory stores. Three placement regimes for LLM intervention are compared, with a mutation-time hook achieving 91.7-93.2% overall accuracy at $0.17 per run.