CoCoGesture: Toward Coherent Co-speech 3D Gesture Generation in the Wild

Understand

Deriving co-speech 3D gestures has seen tremendous progress in virtual avatar animation.

• Yet, the existing methods often produce stiff and unreasonable gestures with unseen human speech inputs due to the limited 3D speech-gesture data.
• In this paper, we propose CoCoGesture, a novel framework enabling vivid and diverse gesture synthesis from unseen human speech prompts.
• Our key insight is built upon the custom-designed pretrain-fintune training paradigm.