TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing

Understand

We introduce TreeMeshGPT, an autoregressive Transformer designed to generate high-quality artistic meshes aligned with input point clouds.

• Instead of the conventional next-token prediction in autoregressive Transformer, we propose a novel Autoregressive Tree Sequencing where the next input token is retrieved from a dynamically growing tree structure that is built upon the triangle adjacency of faces within the mesh.
• Our sequencing enables the mesh to extend locally from the last generated triangular face at each step, and therefore reduces training difficulty and improves mesh quality.
• Our approach represents each triangular face with two tokens, achieving a compression rate of approximately 22% compared to the naive face tokenization.