Fetching the paper…
Reading the bibliography…
Many common methods for learning a world model for pixel-based environments use generative architectures trained with pixel-level reconstruction objectives.
Unsupervised state representation learning in atari
A. Anand, E. Racah, S. Ozair, Y. Bengio, M.-A. Côté, and R. D. Hjelm · 1906
Earlier work this paper cites.
Video representation learning by dense predictive coding
T. Han, W. Xie, and A. Zisserman · 1909
Earlier work this paper cites.
Momentum contrast for unsupervised visual representation learning
K. He, H. Fan, Y. Wu, S. Xie, and R. Girshick · 1911
Earlier work this paper cites.
Dream to control: Learning behaviors by latent imagination
D. Hafner, T. Lillicrap, J. Ba, and M. Norouzi · 1912
Earlier work this paper cites.
Slow feature analysis: Unsupervised learning of invariances
L. Wiskott and T. J. Sejnowski · 2002
Earlier work this paper cites.
Watching the world go by: Representation learning from unlabeled videos
D. Gordon, K. Ehsani, D. Fox, and A. Farhadi · 2003
Earlier work this paper cites.
Curl: Contrastive unsupervised representations for reinforcement learning
A. Srinivas, M. Laskin, and P. Abbeel · 2004
Earlier work this paper cites.
What makes for good views for contrastive learning?
Y. Tian, C. Sun, B. Poole, D. Krishnan, C. Schmid, and P. Isola · 2005
Earlier work this paper cites.
T. Wang and P. Isola · 2005
Earlier work this paper cites.
Unsupervised learning of visual features by contrasting cluster assignments
M. Caron, I. Misra, J. Mairal, P. Goyal, P. Bojanowski, and A. Joulin · 2006
Earlier work this paper cites.
Bootstrap your own latent: A new approach to self-supervised learning
J.-B. Grill, F. Strub, F. Altché, C. Tallec, P. H. Richemond, E. Buchatskaya, C. Doersch, B. A. Pires, Z. D. Guo, M. G. Azar, B. Piot, K. Kavukcuoglu, R. Munos, and M. Valko · 2006
Earlier work this paper cites.
Learning invariant representations for reinforcement learning without reconstruction
A. Zhang, R. McAllister, R. Calandra, Y. Gal, and S. Levine · 2006
Earlier work this paper cites.
Representation learning with video deep infomax
R. D. Hjelm and P. Bachman · 2007
Cited alongside, same era.
Data-efficient reinforcement learning with self-predictive representations
M. Schwarzer, A. Anand, R. Goel, R. D. Hjelm, A. Courville, and P. Bachman · 2007
Cited alongside, same era.
Spatiotemporal contrastive video representation learning
R. Qian, T. Meng, B. Gong, M.-H. Yang, H. Wang, S. Belongie, and Y. Cui · 2008
Cited alongside, same era.
Decoupling representation learning from reinforcement learning
A. Stooke, K. Lee, P. Abbeel, and M. Laskin · 2009
Cited alongside, same era.
Mastering atari with discrete world models
D. Hafner, T. Lillicrap, M. Norouzi, and J. Ba · 2020
Later among the works it cites.
Temporal contrastive pretraining for video action recognition
G. LORRE, J. RABARISOA, A. ORCESI, S. AINOUZ, and S. CANU · 2020
Later among the works it cites.
Vicreg: Variance-invariance-covariance regularization for self-supervised learning
A. Bardes, J. Ponce, and Y. LeCun · 2021
Later among the works it cites.
Understanding dimensional collapse in contrastive self-supervised learning
L. Jing, P. Vincent, Y. LeCun, and Y. Tian · 2021
Later among the works it cites.
Videomoco: Contrastive video representation learning with temporally adversarial examples
T. Pan, Y. Song, T. Yang, W. Jiang, and W. Liu · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
T. Chen, C. Luo, and L. Li · 2011
Cited alongside, same era.
Exploring simple siamese representation learning
X. Chen and K. He · 2011
Cited alongside, same era.
On the properties of neural machine translation: Encoder-decoder approaches
K. Cho, B. van Merrienboer, D. Bahdanau, and Y. Bengio · 2014
Cited alongside, same era.
Action-conditional video prediction using deep networks in atari games
J. Oh, X. Guo, H. Lee, R. Lewis, and S. Singh · 2015
Cited alongside, same era.
Time-contrastive networks: Self-supervised learning from video
P. Sermanet, C. Lynch, Y. Chebotar, J. Hsu, E. Jang, S. Schaal, and S. Levine · 2018
Cited alongside, same era.
Learning deep representations by mutual information estimation and maximization
R. D. Hjelm, A. Fedorov, S. Lavoie-Marchildon, K. Grewal, P. Bachman, A. Trischler, and Y. Bengio · 2019
Cited alongside, same era.
Representation learning with contrastive predictive coding
A. v. d. Oord, Y. Li, and O. Vinyals · 2019
Cited alongside, same era.
A simple framework for contrastive learning of visual representations
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton · 2020
Cited alongside, same era.
Can contrastive learning avoid shortcut solutions?
J. Robinson, L. Sun, K. Yu, K. Batmanghelich, S. Jegelka, and S. Sra · 2021
Later among the works it cites.
Pytorch simclr: A simple framework for contrastive learning of visual representations
T. Silva · 2021
Later among the works it cites.
Barlow twins: Self-supervised learning via redundancy reduction
J. Zbontar, L. Jing, I. Misra, Y. LeCun, and S. Deny · 2021
Later among the works it cites.
A path towards autonomous machine intelligence version 0.9. 2, 2022-06-27
Y. LeCun · 2022
Closest in time.
Challenges and opportunities in offline reinforcement learning from visual observations
C. Lu, P. J. Ball, T. G. J. Rudner, J. Parker-Holder, M. A. Osborne, and Y. W. Teh · 2022
Closest in time.
Light-weight probing of unsupervised representations for reinforcement learning
W. Zhang, A. GX-Chen, V. Sobal, Y. LeCun, and N. Carion · 2022
Closest in time.