Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models

Understand

By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently.

• As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design choices lead to failures to generate factual, relevant, and up-to-date knowledge.
• To this end, we propose Knowledge Card, a modular framework to plug in new factual and relevant knowledge into general-purpose LLMs.
• We first introduce knowledge cards -- specialized language models trained on corpora from specific domains and sources.