2022

Discovering the Hidden Vocabulary of DALLE-2

Daras, Giannis, Dimakis, Alexandros G.

Understand

We discover that DALLE-2 seems to have a hidden vocabulary that can be used to generate images with absurd prompts.

  • For example, it seems that \texttt{Apoploe vesrreaitais} means birds and \texttt{Contarra ccetnxniams luryca tanniounons} (sometimes) means bugs or pests.
  • We find that these prompts are often consistent in isolation but also sometimes in combinations.
  • We present our black-box method to discover words that seem random but have some correspondence to visual concepts.

Built on

  • Zero-shot text-to-image generation, 2021

    Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever · 2021

    Earlier work this paper cites.

  • Classifier-free diffusion guidance

    Jonathan Ho and Tim Salimans · 2021

    Earlier work this paper cites.

Similar

  • Learning transferable visual models from natural language supervision, 2021

    Original

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021

    Cited alongside, same era.

  • Hierarchical text-conditional image generation with clip latents, 2022

    Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen · 2022

    Cited alongside, same era.

Then

  • A very preliminary analysis of dall-e 2, 2022

    Gary Marcus, Ernest Davis, and Scott Aaronson · 2022

    Closest in time.

  • Photorealistic text-to-image diffusion models with deep language understanding, 2022

    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, and Mohammad Norouzi · 2022

    Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…