Topic
continual learning
AL-GNN: New Privacy-Preserving Continual Graph Learning Eliminates Replay Buffers and Backpropagation
Researchers propose AL-GNN, a continual graph learning framework that uses analytic learning to avoid replay buffers and backpropagation. It achieves 10% higher average performance on CoraFull, reduces forgetting by over 30% on Reddit, and cuts training time by nearly 50% while preserving data privacy.
Robot Learning Reveals Emergent 'Self' Subnetwork in Continual Learning Studies
A new arXiv paper proposes a method to quantify an emergent 'self' in robots by identifying invariant subnetworks that persist during continual learning. The study finds that robots learning variable tasks develop a stable subnetwork that, when preserved, aids adaptation, and when damaged, impairs performance—validated across three robot platforms.
ReGrad: A New AI Paradigm for Continual Learning Without Catastrophic Forgetting
A new paper introduces ReGrad (Retrievable Gradients), a paradigm for continual post-training that pre-computes document-specific gradients, stores them in a Gradient Bank, and retrieves query-relevant gradients at inference time for temporary weight adaptation. The method uses bi-level meta-learning to reshape gradients into generalizable signals, outperforming CPT and RAG baselines in experiments.