Fetching the paper…
Reading the bibliography…
The ability to predict future states of the environment is a central pillar of intelligence.
Learning invariance from transformation sequences
Földiák, Peter · 1991
Earlier work this paper cites.
Learning long-term dependencies with gradient descent is difficult
Bengio, Yoshua, Simard, Patrice, and Frasconi, Paolo · 1994
Earlier work this paper cites.
Long short-term memory
Hochreiter, Sepp and Schmidhuber, Jurgen · 1997
Earlier work this paper cites.
Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects
Rao, Rajesh P. N. and Ballard, Dana H · 1999
Earlier work this paper cites.
Predictive sequence learning in recurrent neocortical circuits
Rao, Rajesh P. N. and Sejnowski, Terrence J · 2000
Earlier work this paper cites.
Effects of temporal association on recognition memory
Wallis, Guy and Bulthoff, Heinrich H · 2001
Earlier work this paper cites.
Learning invariance from transformation sequences
Wiskott, Laurenz and Sejnowski, Terrence J · 2002
Earlier work this paper cites.
Greedy layer-wise training of deep networks
Bengio, Yoshua, Lamblin, Pascal, Popovici, Dan, and Larochelle, Hugo · 2006
Earlier work this paper cites.
Predictive codes for forthcoming perception in the frontal cortex
Summerfield, Christopher, Egner, Tobias, Greene, Matthew, Koechlin, Etienne, Mangels, Jennifer, and Hirsch, Joy · 2006
Earlier work this paper cites.
Unsupervised learning of image transformations
Memisevic, Roland and Hinton, Geoffrey · 2007
Earlier work this paper cites.
Extracting and composing robust features with denoising autoencoders
Vincent, Pascal, Larochelle, Hugo, Bengio, Yoshua, and Manzagol, Pierre-Antoine · 2008
Earlier work this paper cites.
What is the best multi-stage architecture for object recognition?
Jarrett, Kevin, Kavukcuoglu, Koray, Ranzato, Marc’Aurelio, and LeCun, Yann · 2009
Earlier work this paper cites.
Deep learning from temporal coherence in video
Mohabi, Hossein, Collobert, Ronan, and Weston, Jason · 2009
Earlier work this paper cites.
A high-throughput screening approach to discovering good forms of biologically inspired visual representation
Pinto, Nicolas, Doukhan, David, DiCarlo, James J., and Cox, David D · 2009
Earlier work this paper cites.
The recurrent temporal restricted boltzmann machine
Sutskever, Ilya, Hinton, Geoffrey E., and Taylor, Graham W · 2009
Cited alongside, same era.
Factored conditional restricted boltzmann machines for modeling motion style
Taylor, Graham W. and Hinton, Geoffrey · 2009
Cited alongside, same era.
Why does unsupervised pre-training help deep learning?
Erhan, Dumitru, Bengio, Yoshua, Courville, Aaron, Manzagol, Pierre-Antoine, Vincent, Pascal, and Bengio, Samy · 2010
Cited alongside, same era.
On random weights and unsupervised feature learning
Saxe, Andrew, Bhand, Maneesh, Chen, Zhenghao, Koh, Pang Wei, Suresh, Bipin, and Ng, Andrew Y · 2010
Cited alongside, same era.
Quickly generating representative samples from an rbm-derived process
Breuleux, Olivier, Bengio, Yoshua, and Vincent, Pascal · 2011
Cited alongside, same era.
How prediction errors shape perception, attention and motivation
Den Ouden, Hanneke EM, Kok, Peter, and De Lange, Floris P · 2012
Conditional generative adversarial nets
Mirza, Mehdi and Osindero, Simon · 2014
Later among the works it cites.
Structured recurrent temporal restricted boltzmann machines
Mittelman, Roni, Kuipers, Benjamin, Savarese, Silvio, and Lee, Honglak · 2014
Later among the works it cites.
Video (language) modeling: a baseline for generative models of natural videos
Ranzato, Marc’Aurelio, Szlam, Arthur, Bruna, Joan, Mathieu, Michaël, Collobert, Ronan, and Chopra, Sumit · 2014
Later among the works it cites.
Sequence to sequence learning with neural networks
Sutskever, Ilya, Vinyals, Oriol, and Le, Quoc V. V · 2014
Later among the works it cites.
Zhao, Mingmin, Zhuang, Chengxu, Wang, Yizhou, and Lee, Tai Sing · 2014
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Prediction as a candidate for learning deep hierarchical models of data
Palm, Rasmus Berg · 2012
Cited alongside, same era.
Lecture 6.5 - rmsprop, coursera
Tieleman, Tijmen and Hinton, Geoffrey · 2012
Cited alongside, same era.
Deep predictive coding networks
Chalasani, Rakesh and Principe, Jose C · 2013
Cited alongside, same era.
Generating sequences with recurrent neural networks
Graves, Alex · 2013
Cited alongside, same era.
Learning hierarchical category structure in deep neural networks
Saxe, Andrew M., Mcclelland, James L., and Ganguli, Surya · 2013
Cited alongside, same era.
Conditional generative adversarial nets for convolutional face generation
Gauthier, Jon · 2014
Cited alongside, same era.
Later among the works it cites.
The eyescream project, neuralnets dreaming natural images, 2015
Chintala, Soumith, Denton, Emily L., Szlam, Arthur, and Fergus, Robert · 2015
Closest in time.
Keras, 2015
Chollet, François · 2015
Closest in time.
Deep generative image models using a laplacian pyramid of adversarial networks
Denton, Emily L., Chintala, Soumith, Szlam, Arthur, and Fergus, Robert · 2015
Closest in time.
Inverting convolutional networks with convolutional networks
Dosovitskiy, Alexey and Brox, Thomas · 2015
Closest in time.
Recurrent network models for kinematic tracking
Fragkiadaki, Katerina, Levine, Sergey, and Malik, Jitendra · 2015
Closest in time.
Deep temporal sigmoid belief networks for sequence modeling
Gan, Zhe, Li, Chunyuan, Henao, Ricardo, Carlson, David, and Carin, Lawrence · 2015
Closest in time.
Deep convolutional inverse graphics network
Kulkarni, Tejas D., Whitney, Will, Kohli, Pushmeet, and Tenenbaum, Joshua B · 2015
Closest in time.
Unsupervised learning of video representations using lstms
Srivastava, Nitish, Mansimov, Elman, and Salakhutdinov, Ruslan · 2015
Closest in time.
Unsupervised learning of visual representations using videos
Wang, Xiaolong and Gupta, Abhinav · 2015
Closest in time.