Incremental learning is the key to creating a new learning paradigm for building a real sense of intelligent systems. This book offers a foundation of incremental learning and is filled with state of art methods and applications. The book puts the focus on incremental learning not only for a single task but also for multiple tasks. Incremental learning provides a general learning paradigm to build fully automated and autonomous intelligent systems that can improve the performance without any human intervention. Incremental learning includes several crucial learning schemes such as on-line learning, continuous learning, and multi-task learning.