Stochastic Gradient Estimate Variance in Contrastive Divergence and Persistent Contrastive Divergence

Information processing in dynamical systems: Foundations of harmony theory

Smolensky, Paul · 1986

Earlier work this paper cites.

Parametric inference for imperfectly observed gibbsian fields

Original

Younes, Laurent · 1989

Earlier work this paper cites.

Gradient-based learning applied to document recognition

LeCun, Yann, Bottou, Léon, Bengio, Yoshua, and Haffner, Patrick · 1998

Earlier work this paper cites.

Training products of experts by minimizing contrastive divergence

Hinton, Geoffrey E · 2002

Earlier work this paper cites.

An analysis of contrastive divergence learning in Gaussian Boltzmann machines

Williams, Christopher KI and Agakov, Felix V · 2002

Earlier work this paper cites.

On contrastive divergence learning

Carreira-Perpinan, Miguel A and Hinton, Geoffrey E · 2005

Cited alongside, same era.

Reducing the dimensionality of data with neural networks

Hinton, Geoffrey E and Salakhutdinov, Ruslan R · 2006

Cited alongside, same era.

Training restricted Boltzmann machines using approximations to the likelihood gradient

Tieleman, Tijmen · 2008

Cited alongside, same era.

Justifying and generalizing contrastive divergence

Bengio, Yoshua and Delalleau, Olivier · 2009

Cited alongside, same era.

Learning multiple layers of features from tiny images

Krizhevsky, Alex and Hinton, Geoffrey · 2009

Cited alongside, same era.

Parallel tempering is efficient for learning restricted boltzmann machines

Cho, KyungHyun, Raiko, Tapani, and Ilin, Alexander · 2010

Later among the works it cites.

Inductive principles for restricted Boltzmann machine learning

Marlin, Benjamin M, Swersky, Kevin, Chen, Bo, and Freitas, Nando D · 2010

Later among the works it cites.

A tutorial on stochastic approximation algorithms for training restricted boltzmann machines and deep belief nets

Swersky, Kevin, Chen, Bo, Marlin, Ben, and de Freitas, Nando · 2010

Later among the works it cites.

Enhanced gradient and adaptive learning rate for training restricted Boltzmann machines

Cho, KyungHyun, Raiko, Tapani, and Ilin, Alexander · 2011

Later among the works it cites.