Are Missing Links Predictable? An Inferential Benchmark for Knowledge Graph Completion

Understand

We present InferWiki, a Knowledge Graph Completion (KGC) dataset that improves upon existing benchmarks in inferential ability, assumptions, and patterns.

• First, each testing sample is predictable with supportive data in the training set.
• To ensure it, we propose to utilize rule-guided train/test generation, instead of conventional random split.
• Second, InferWiki initiates the evaluation following the open-world assumption and improves the inferential difficulty of the closed-world assumption, by providing manually annotated negative and unknown triples.