Autoregressive Models in Vision: A Survey

Understand

Autoregressive modeling has been a huge success in the field of natural language processing (NLP).

• Recently, autoregressive models have emerged as a significant area of focus in computer vision, where they excel in producing high-quality visual content.
• Autoregressive models in NLP typically operate on subword tokens.
• However, the representation strategy in computer vision can vary in different levels, i.e., pixel-level, token-level, or scale-level, reflecting the diverse and hierarchical nature of visual data compared to the sequential structure of language.