Fetching the paper…
Reading the bibliography…
Pretraining language models with next-token prediction on massive text corpora has delivered phenomenal zero-shot, few-shot, transfer learning and multi-tasking capabilities on both generative and discriminative language tasks.
Large scale adversarial representation learning
Jeff Donahue and Karen Simonyan · 1907
Earlier work this paper cites.
The emergence of deepfake technology: A review
Mika Westerlund · 1927
Earlier work this paper cites.
Improved baselines with momentum contrastive learning
Xinlei Chen, Haoqi Fan, Ross Girshick, and Kaiming He · 2003
Earlier work this paper cites.
Big self-supervised models are strong semi-supervised learners
Ting Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi, and Geoffrey Hinton · 2006
Earlier work this paper cites.
Principled hybrids of generative and discriminative models
Julia A Lasserre, Christopher M Bishop, and Thomas P Minka · 2006
Earlier work this paper cites.
NCP-VAE: variational autoencoders with noise contrastive priors
Jyoti Aneja, Alexander G. Schwing, Jan Kautz, and Arash Vahdat · 2010
Earlier work this paper cites.
Image representations learned with unsupervised pre-training contain human-like biases
Ryan Steed and Aylin Caliskan · 2010
Earlier work this paper cites.
A note on data biases in generative models
Patrick Esser, Robin Rombach, and Björn Ommer · 2012
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Generative adversarial nets
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P. Kingma and Max Welling · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
Karen Simonyan and Andrew Zisserman · 2014
Earlier work this paper cites.
Semi-supervised sequence learning
Andrew M Dai and Quoc V Le · 2015
Earlier work this paper cites.
Unsupervised visual representation learning by context prediction
Carl Doersch, Abhinav Gupta, and Alexei A Efros · 2015
Earlier work this paper cites.
Jeff Donahue, Philipp Krähenbühl, and Trevor Darrell · 2016
Earlier work this paper cites.
Perceptual losses for real-time style transfer and super-resolution
Justin Johnson, Alexandre Alahi, and Li Fei-Fei · 2016
Earlier work this paper cites.
Unsupervised representation learning with deep convolutional generative adversarial networks
Alec Radford, Luke Metz, and Soumith Chintala · 2016
Earlier work this paper cites.
Conditional image generation with pixelcnn decoders
Aäron van den Oord, Nal Kalchbrenner, Lasse Espeholt, Koray Kavukcuoglu, Oriol Vinyals, and Alex Graves · 2016
Earlier work this paper cites.
Adversarial feature learning
Jeff Donahue, Philipp Krähenbühl, and Trevor Darrell · 2017
Earlier work this paper cites.
beta-vae: Learning basic visual concepts with a constrained variational framework
Irina Higgins, Loïc Matthey, Arka Pal, Christopher Burgess, Xavier Glorot, Matthew Botvinick, Shakir Mohamed, and Alexander Lerchner · 2017
Earlier work this paper cites.
Image-to-image translation with conditional adversarial networks
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros · 2017
Earlier work this paper cites.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2017
Cited alongside, same era.
Neural discrete representation learning
Aaron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu · 2017
Cited alongside, same era.
Neural discrete representation learning
Aäron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017
Cited alongside, same era.
Pixelsnail: An improved autoregressive generative model
Xi Chen, Nikhil Mishra, Mostafa Rohaninejad, and Pieter Abbeel · 2018
Cited alongside, same era.
Pioneer networks: Progressively growing generative autoencoder
Unsupervised learning of visual features by contrasting cluster assignments
Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, and Armand Joulin · 2020
Later among the works it cites.
An image is worth 16x16 words: Transformers for image recognition at scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al · 2020
Later among the works it cites.
Bootstrap your own latent: A new approach to self-supervised learning
Jean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec, Pierre H Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Daniel Guo, Mohammad Gheshlaghi Azar, et al · 2020
Later among the works it cites.
Momentum contrast for unsupervised visual representation learning
Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ari Heljakka, Arno Solin, and Juho Kannala · 2018
Cited alongside, same era.
Progressive growing of GANs for improved quality, stability, and variation
Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen · 2018
Cited alongside, same era.
Glow: Generative flow with invertible 1x1 convolutions
Durk P Kingma and Prafulla Dhariwal · 2018
Cited alongside, same era.
Image transformer
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, and Dustin Tran · 2018
Cited alongside, same era.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever · 2018
Cited alongside, same era.
Adafactor: Adaptive learning rates with sublinear memory cost
Noam Shazeer and Mitchell Stern · 2018
Cited alongside, same era.
Representation learning with contrastive predictive coding
Aäron van den Oord, Yazhe Li, and Oriol Vinyals · 2018
Cited alongside, same era.
Data-efficient image recognition with contrastive predictive coding
Olivier Henaff · 2020
Later among the works it cites.
The curious case of neural text degeneration
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi · 2020
Later among the works it cites.
Analyzing and improving the image quality of stylegan
Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila · 2020
Later among the works it cites.
Pulse: Self-supervised photo upsampling via latent space exploration of generative models
Sachit Menon, Alex Damian, McCourt Hu, Nikhil Ravi, and Cynthia Rudin · 2020
Later among the works it cites.
Adversarial latent autoencoders
Stanislav Pidhorskyi, Donald A Adjeroh, and Gianfranco Doretto · 2020
Later among the works it cites.
A u-net based discriminator for generative adversarial networks
Edgar Schonfeld, Bernt Schiele, and Anna Khoreva · 2020
Later among the works it cites.
NVAE: A deep hierarchical variational autoencoder
Arash Vahdat and Jan Kautz · 2020
Later among the works it cites.
Beit: BERT pre-training of image transformers
Hangbo Bao, Li Dong, and Furu Wei · 2021
Closest in time.
Emerging properties in self-supervised vision transformers
Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, and Armand Joulin · 2021
Closest in time.
Very deep {vae}s generalize autoregressive models and can outperform them on images
Rewon Child · 2021
Closest in time.
On the genealogy of machine learning datasets: A critical history of imagenet
Emily Denton, Alex Hanna, Razvan Amironesei, Andrew Smart, and Hilary Nicole · 2021
Closest in time.
Diffusion models beat gans on image synthesis
Prafulla Dhariwal and Alex Nichol · 2021
Closest in time.
Taming transformers for high-resolution image synthesis
Patrick Esser, Robin Rombach, and Björn Ommer · 2021
Closest in time.
Generating images with sparse representations
Charlie Nash, Jacob Menick, S. Dieleman, and P. Battaglia · 2021
Closest in time.
Improved denoising diffusion probabilistic models
Alexander Quinn Nichol and Prafulla Dhariwal · 2021
Closest in time.
Dual contradistinctive generative autoencoder
Gaurav Parmar, Dacheng Li, Kwonjoon Lee, and Zhuowen Tu · 2021
Closest in time.
Zero-shot text-to-image generation
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever · 2021
Closest in time.
{VAEBM}: A symbiosis between variational autoencoders and energy-based models
Zhisheng Xiao, Karsten Kreis, Jan Kautz, and Arash Vahdat · 2021
Closest in time.