All terms
Training
Continual Learning
Training a model on a stream of new tasks while retaining what it learned before.
Definition
Continual learning, also called lifelong learning, aims to let a model acquire new skills or knowledge from a stream of tasks while keeping its performance on earlier ones. The main obstacle is catastrophic forgetting, where updates for new tasks overwrite weights important to old ones. Mitigations include experience replay, regularizing toward prior weights, and modular or parameter-isolated architectures.