A Survey of Large Language Models

Understand

Language is essentially a complex, intricate system of human expressions governed by grammatical rules.

• It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language.
• As a major approach, language modeling has been widely studied for language understanding and generation in the past two decades, evolving from statistical language models to neural language models.
• Recently, pre-trained language models (PLMs) have been proposed by pre-training Transformer models over large-scale corpora, showing strong capabilities in solving various NLP tasks.