Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisis

Understand

Data-driven systems need to be evaluated to establish trust in the scientific approach and its applicability.

• In particular, this is true for Knowledge Graph (KG) Question Answering (QA), where complex data structures are made accessible via natural-language interfaces.
• Evaluating the capabilities of these systems has been a driver for the community for more than ten years while establishing different KGQA benchmark datasets.
• However, comparing different approaches is cumbersome.