Artificial Intelligence #machine learning#continual learning
ReGrad: A New AI Paradigm for Continual Learning Without Catastrophic Forgetting
A new paper introduces ReGrad (Retrievable Gradients), a paradigm for continual post-training that pre-computes document-specific gradients, stores them in a Gradient Bank, and retrieves query-relevant gradients at inference time for temporary weight adaptation. The method uses bi-level meta-learning to reshape gradients into generalizable signals, outperforming CPT and RAG baselines in experiments.
Jun 16, 2026 1 source