Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoning

Understand

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering.

• However, most MKGs are still far from complete, which motivates the flourishing of MKG reasoning models.
• Recently, with the development of general artificial architectures, the pretrained transformer models have drawn increasing attention, especially for multimodal scenarios.
• However, the research of multimodal pretrained transformer (MPT) for knowledge graph reasoning (KGR) is still at an early stage.