Computer Sciences Commons^™

Brain-Inspired Continual Learning: Robust Feature Distillation And Re-Consolidation For Class Incremental Learning, Hikmat Khan, Nidhal Carla Bouaynaya, Ghulam Rasool

Henry M. Rowan College of Engineering Faculty Scholarship

Artificial intelligence and neuroscience have a long and intertwined history. Advancements in neuroscience research have significantly influenced the development of artificial intelligence systems that have the potential to retain knowledge akin to humans. Building upon foundational insights from neuroscience and existing research in adversarial and continual learning fields, we introduce a novel framework that comprises two key concepts: feature distillation and re-consolidation. The framework distills continual learning (CL) robust features and rehearses them while learning the next task, aiming to replicate the mammalian brain's process of consolidating memories through rehearsing the distilled version of the waking experiences. Furthermore, the proposed …