Decomposition Betters Tracking Everything Everywhere

Understand

Recent studies on motion estimation have advocated an optimized motion representation that is globally consistent across the entire video, preferably for every pixel.

• This is challenging as a uniform representation may not account for the complex and diverse motion and appearance of natural videos.
• We address this problem and propose a new test-time optimization method, named DecoMotion, for estimating per-pixel and long-range motion.
• DecoMotion explicitly decomposes video content into static scenes and dynamic objects, either of which uses a quasi-3D canonical volume to represent.