Introspective Perception: Learning to Predict Failures in Vision Systems

Understand

As robots aspire for long-term autonomous operations in complex dynamic environments, the ability to reliably take mission-critical decisions in ambiguous situations becomes critical.

• This motivates the need to build systems that have situational awareness to assess how qualified they are at that moment to make a decision.
• We call this self-evaluating capability as introspection.
• In this paper, we take a small step in this direction and propose a generic framework for introspective behavior in perception systems.