FLAME: Empowering Frozen LLMs for Knowledge Graph Completion

Understand

Traditional knowledge graph completion (KGC) methods rely solely on structural information and struggle with sparsity, while Large Language Models (LLMs) address these limitations through rich world knowledge and strong context modeling.

• Fine-tuning LLMs is effective but costly, while non-fine-tuned LLMs are efficient but suboptimal.
• To address this trade-off, we propose \textbf{FLAME}, a framework that extracts context-aware hidden states from intermediate layers of frozen LLMs to train data-efficient KGC classifiers.
• We bridge LLM-KG semantic gaps via subgraph-based entity descriptions and employ sliced mutual information (SMI) to quantify task-relevant information in representations.