A Roadmap for Big Model

Understand

With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm.

• Researchers have achieved various outcomes in the construction of BMs and the BM application in many fields.
• At present, there is a lack of research work that sorts out the overall progress of BMs and guides the follow-up research.
• In this paper, we cover not only the BM technologies themselves but also the prerequisites for BM training and applications with BMs, dividing the BM review into four parts: Resource, Models, Key Technologies and Application.