Scalable Autoregressive Image Generation with Mamba

Understand

We introduce AiM, an autoregressive (AR) image generative model based on Mamba architecture.

• AiM employs Mamba, a novel state-space model characterized by its exceptional performance for long-sequence modeling with linear time complexity, to supplant the commonly utilized Transformers in AR image generation models, aiming to achieve both superior generation quality and enhanced inference speed.
• Unlike existing methods that adapt Mamba to handle two-dimensional signals via multi-directional scan, AiM directly utilizes the next-token prediction paradigm for autoregressive image generation.
• This approach circumvents the need for extensive modifications to enable Mamba to learn 2D spatial representations.