MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models

Understand

Existing pre-trained large language models have shown unparalleled generative capabilities.

• However, they are not controllable.
• In this paper, we propose MEGATRON-CNTRL, a novel framework that uses large-scale language models and adds control to text generation by incorporating an external knowledge base.
• Our framework consists of a keyword predictor, a knowledge retriever, a contextual knowledge ranker, and a conditional text generator.