Every Mistake Counts in Assembly

Understand

One promising use case of AI assistants is to help with complex procedures like cooking, home repair, and assembly tasks.

• Can we teach the assistant to interject after the user makes a mistake? This paper targets the problem of identifying ordering mistakes in assembly procedures.
• We propose a system that can detect ordering mistakes by utilizing a learned knowledge base.
• Our framework constructs a knowledge base with spatial and temporal beliefs based on observed mistakes.