Logic Tensor Networks for Semantic Image Interpretation

Understand

Semantic Image Interpretation (SII) is the task of extracting structured semantic descriptions from images.

• It is widely agreed that the combined use of visual data and background knowledge is of great importance for SII.
• Recently, Statistical Relational Learning (SRL) approaches have been developed for reasoning under uncertainty and learning in the presence of data and rich knowledge.
• Logic Tensor Networks (LTNs) are an SRL framework which integrates neural networks with first-order fuzzy logic to allow (i) efficient learning from noisy data in the presence of logical constraints, and (ii) reasoning with logical formulas describing general properties of the data.