Learning to Detect Touches on Cluttered Tables

Understand

We present a novel self-contained camera-projector tabletop system with a lamp form-factor that brings digital intelligence to our tables.

• We propose a real-time, on-device, learning-based touch detection algorithm that makes any tabletop interactive.
• The top-down configuration and learning-based algorithm makes our method robust to the presence of clutter, a main limitation of existing camera-projector tabletop systems.
• Our research prototype enables a set of experiences that combine hand interactions and objects present on the table.