ContCap: A scalable framework for continual image captioning

Understand

While advanced image captioning systems are increasingly describing images coherently and exactly, recent progress in continual learning allows deep learning models to avoid catastrophic forgetting.

• However, the domain where image captioning working with continual learning has not yet been explored.
• We define the task in which we consolidate continual learning and image captioning as continual image captioning.
• In this work, we propose ContCap, a framework generating captions over a series of new tasks coming, seamlessly integrating continual learning into image captioning besides addressing catastrophic forgetting.