Fetching the paper…

Reading the bibliography…

2017

Genetic Algorithms for Evolving Deep Neural Networks

David, Eli, Greental, Iddo

Original
PDF
Post on X

Understand

In recent years, deep learning methods applying unsupervised learning to train deep layers of neural networks have achieved remarkable results in numerous fields.

In the past, many genetic algorithms based methods have been successfully applied to training neural networks.
In this paper, we extend previous work and propose a GA-assisted method for deep learning.
Our experimental results indicate that this GA-assisted approach improves the performance of a deep autoencoder, producing a sparser neural network.

Genetic Algorithms for Evolving Deep Neural Networks · Around

Built on

J.D. Schaffer, D. Whitley, and L.J. Eshelman. Combinations of genetic algorithms and neural networks: a survey of the state of the art
1992
Earlier work this paper cites.
Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition
1998
Earlier work this paper cites.
G.E. Hinton, S. Osindero, and Y.W. Teh. A fast learning algorithm for deep belief nets
2006
Earlier work this paper cites.
G.E. Hinton and R. Salakhutdinov. Reducing the dimensionality of data with neural networks
2006
Earlier work this paper cites.
Y. Bengio and Y. LeCun. Scaling learning algorithms towards AI
2007
Earlier work this paper cites.

Similar

Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layer-wise training of deep networks
2007
Cited alongside, same era.
M. Ranzato, C.S. Poultney, S. Chopra, and Y. LeCun. Efficient learning of sparse representations with an energy-based model
2007
Cited alongside, same era.
H. Lee, C. Ekanadham, and A. Ng. Sparse deep belief net model for visual area V2
2008
Cited alongside, same era.
Y. Bengio. Learning deep architectures for AI
2009
Cited alongside, same era.

Then

P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P. Manzagol. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
2010
Later among the works it cites.
X. Glorot, A. Bordes and Y Bengio. Deep sparse rectifier neural networks,
2011
Later among the works it cites.
G.E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors
Original
2012
Later among the works it cites.
L. Wan, M.D. Zeiler, S. Zhang, Y. LeCun, and R. Fergus. Regularization of neural networks using dropconnect
2013
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…