Fetching the paper…
Reading the bibliography…
Deep neural networks have been successfully used in diverse emerging domains to solve real world complex problems with may more deep learning(DL) architectures, being developed to date.
D. L. Elliott, “A Better Activation Function for Artifical Neural Networks,” 1993. [Online]. Available: https://drum.lib.umd.edu/handle/1903/5355
1903
Earlier work this paper cites.
C. Dugas, Y. Bengio, F. Bélisle, C. Nadeau, and R. Garcia, “Incorporating Second-Order Functional Knowledge for Better Option Pricing,” in Advances in Neural Information Processing Systems (NIPS) , vol. 13, 2001, pp. 472–478. [Online]. Available: https://papers.nips.cc/paper/1920-incorporating-second-order-functional-knowledge-for-better-option-pricing
1920
Earlier work this paper cites.
Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel, “Backpropagation Applied to Handwritten Zip Code Recognition,” Neural Computation , vol. 1, no. 4, pp. 541–551, 1989. [Online]. Available: https://doi.org/10.1162/neco.1989.1.4.541
1989
Earlier work this paper cites.
Y. LeCun, “Backpropagation Applied to Handwritten Zip Code Recognition,,” Neural Computing , vol. 1, no. 4, pp. 541–551, 1989
1989
Earlier work this paper cites.
R. M. Neal, “Connectionist learning of belief networks,” Artificial Intelligence , vol. 56, no. 1, pp. 71–113, 1992. [Online]. Available: https://doi.org/10.1016/0004-3702(92)90065-6
1992
Earlier work this paper cites.
Y. Bengio, P. Simard, and P. Frasconi, “Learning long-term dependencies with gradient descent is difficult,” IEEE Transactions on Neural Networks , vol. 5, no. 2, pp. 157–166, 1994. [Online]. Available: https://doi.org/10.1109/72.279181
1994
Earlier work this paper cites.
J. Han and C. Moraga, “The influence of the sigmoid function parameters on the speed of backpropagation learning,,” in Natural to Artificial Neural Computation. IWANN 1995. Lecture Notes in Computer Science . Berlin, Heidelberg: Springer, 1995, pp. 195–201
1995
Earlier work this paper cites.
S. Agatonovic-Kustrin and R. Beresford, “Basic concepts of artificial neural network (ANN) modeling and its application in pharmaceutical research,” Journal of Pharmaceutical and Biomedical Analysis , vol. 22, no. 5, pp. 717–727, 2000. [Online]. Available: https://doi.org/10.1016/S0731-7085
2000
Earlier work this paper cites.
J. Turian, J. Bergstra, and Y. Bengio, “Quadratic features and deep architectures for chunking,” in Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, , vol. Companion Volume:, 2009, pp. 245–248. [Online]. Available: https://dl.acm.org/citation.cfm
2009
Earlier work this paper cites.
X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks,” in International Conference on Artificial Intelligence and Statistics , vol. 9. PLMR, 2010, pp. 249–256. [Online]. Available: http://proceedings.mlr.press/v9/glorot10a/glorot10a.pdf?hc_location=ufi
2010
Earlier work this paper cites.
V. Nair and G. E. Hinton, “Rectified linear units improve restricted boltzmann machines,” Haifa, 2010, pp. 807–814. [Online]. Available: https://dl.acm.org/citation.cfm
2010
Earlier work this paper cites.
X. Glorot, A. Bordes, and Y. Bengio, “Deep Sparse Rectifier Neural Networks,” in International Conference on Machine Learning , 2011. [Online]. Available: http://proceedings.mlr.press/v15/glorot11a/glorot11a.pdf
2011
Earlier work this paper cites.
B. Karlik and A. Vehbi, “Performance Analysis of Various Activation Functions in Generalized MLP Architectures of Neural Networks,” International Journal of Artificial Intelligence and Expert Systems (IJAE) , vol. 1, no. 4, pp. 111–122, 2011. [Online]. Available: http://www.cscjournals.org/library/manuscriptinfo.php
2011
Earlier work this paper cites.
R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, and P. Kuksa, “Natural Language Processing (Almost) from Scratch,,” Journal of Machine Learning Research , vol. 12, pp. 2493–2537, 2011
2011
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” 2012. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/summary
2012
Earlier work this paper cites.
L. Deng, “A tutorial survey of architectures, algorithms, and applications for deep learning,” APSIPA Transactions on Signal and Information Processing , vol. 3, 2014. [Online]. Available: https://doi.org/10.1017/atsip.2013.9
2013
Earlier work this paper cites.
R. Pascanu, T. Mikolov, and Y. Bengio, “On the difficulty of training recurrent neural networks,” in Proceedings of the 30th International Conference on International Conference on Machine Learning , vol. 28, 2013, pp. III–1310. [Online]. Available: https://dl.acm.org/citation.cfm
2013
Earlier work this paper cites.
J. Bergstra, D. Yamins, and D. D. Cox, “Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures,,” in Machine Learning research , 2013. [Online]. Available: http://proceedings.mlr.press/v28/bergstra13.pdf
2013
Earlier work this paper cites.
A. Graves, A. Mohamed, and undefined G. Hinton, “Speech recognition with deep recurrent neural networks,,” in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing . IEEE, 2013, pp. 6645–6649
2013
Earlier work this paper cites.
A. A. Cruz-Roa, J. A. Ovalle, A. Madabhushi, and F. G. Osorio, “A Deep Learning Architecture for Image Representation,” Springer , pp. 403–410, 2013. [Online]. Available: https://doi.org/10.1007/978-3-642-40763-5_50
2013
Earlier work this paper cites.
A. Maas, A. Hannun, and A. Ng, “Rectifier Nonlinearities Improve Neural Network Acoustic Models,” in International Conference on Machine Learning (icml) , 2013
2013
Earlier work this paper cites.
2013
Earlier work this paper cites.
M. D. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q. V. Le, and G. E. Hinton, “On rectified linear units for speech processing,” in International Conference on Acoustics, Speech and Signal Processing . IEEE, 2013, pp. 3517–3521, IEEE. https://doi.org/10.1109/ICASSP.2013.6638312
2013
Earlier work this paper cites.
G. E. Dahl, T. N. Sainath, and G. E. Hinton, “Improving deep neural networks for LVCSR using rectified linear units and dropout,” in International Conference on Acoustics, Speech and Signal Processing . IEEE, 2013
2013
Earlier work this paper cites.
2013
Earlier work this paper cites.
I. J. Goodfellow, D. Warde-Farley, M. Mirza, A. Courville, and Y. Bengio, “Maxout networks,” 2013, p. 1319. [Online]. Available: https://dl.acm.org/citation.cfm
2013
Earlier work this paper cites.
2013
Earlier work this paper cites.
N. Jones, “Computer science: The learning machines,,” Nature , vol. 505, no. 7482, pp. 146–148, 1 2014
2014
Earlier work this paper cites.
N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and undefined R. Salakhutdinov, “Dropout: A Simple Way to Prevent Neural Networks from Overfitting,,” Journal of Machine Learning Research , vol. 15, pp. 1929–1958, 2014
2014
Cited alongside, same era.
T. N. Sainath, B. Kingsbury, G. Saon, H. Soltau, A. Mohamed, G. Dahl, and B. Ramabhadran, “Deep Convolutional Neural Networks for Large-scale Speech Tasks,” Neural Networks , vol. 64, pp. 39–48, 2015. [Online]. Available: https://doi.org/10.1016/J.NEUNET.2014.08.005
2014
Cited alongside, same era.
P. O. Pinheiro and R. Collobert, “Recurrent Convolutional Neural Networks for Scene Labeling,” in International Conference on Machine Learning , 2014. [Online]. Available: http://proceedings.mlr.press/v32/pinheiro14.pdf
2014
Cited alongside, same era.
2016
Later among the works it cites.
2016
Later among the works it cites.
V. Golkov, A. Dosovitskiy, J. I. Sperl, M. I. Menzel, M. Czisch, P. Sämann, and D. Cremers, “q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans,” IEEE Transactions on Medical Imaging , vol. 35, no. 5, pp. 1344–1351, 2016. [Online]. Available: https://doi.org/10.1109/TMI.2016.2551324
2016
Later among the works it cites.
Z. Deng, Z. Wang, and undefined S. Wang, “Stochastic area pooling for generic convolutional neural network,,” Front. Artif. Intell. Appl , vol. 285, pp. 1760–1761, 2016
2016
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2014
Cited alongside, same era.
A. Senior and X. Lei, “Fine context, low-rank, softplus deep neural networks for mobile speech recognition,” in International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2014, pp. 7644–7648, IEEE. https://doi.org/10.1109/ICASSP.2014.6855087
2014
Cited alongside, same era.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature , vol. 521, no. 7553, pp. 436–444, 2015. [Online]. Available: https://doi.org/10.1038/nature14539
2015
Cited alongside, same era.
2015
Cited alongside, same era.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, “Going deeper with convolutions,,” in Conference on Computer Vision and Pattern Recognition (CVPR) , vol. 2015. IEEE, 2015, pp. 1–9
2015
Cited alongside, same era.
S. Ioffe and C. Szegedy, “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift,,” in Proceedings of the 32nd International Conference on Machine Learning, PMLR . JMLR, 2015, pp. 448–456
2015
Cited alongside, same era.
2015
Cited alongside, same era.
2015
Cited alongside, same era.
A. Karpathy and L. Fei-Fei, “Deep Visual-Semantic Alignments for Generating Image Descriptions,” in Computer Vision and Pattern Recognition (CVPR) . IEEE, 2015, pp. 3128–3137. [Online]. Available: https://www.cv-foundation.org/openaccess/content_cvpr_2015/html/Karpathy_Deep_Visual-Semantic_Alignments_2015_CVPR_paper.html
2015
Cited alongside, same era.
Later among the works it cites.
2017
Later among the works it cites.
S. M. Noor, J. Ren, S. Marshall, and K. Michael, “Hyperspectral Image Enhancement and Mixture Deep-Learning Classification of Corneal Epithelium Injuries,” Sensors. Multidisciplinary Digital Publishing Institute , vol. 17, no. 11, p. 2644, 2017
2017
Later among the works it cites.
2017
Later among the works it cites.
L. Lazimul and D.Binoy, “Fingerprint liveness detection using convolutional neural network and fingerprint image enhancement,” 2017. [Online]. Available: 10.1109/ICECDS.2017.8389533
2017
Later among the works it cites.
A. L. Xar, Y. Demir, C. Neyt, and G. Zelis, “Object recognition and detection with deep learning for autonomous driving applications,,” Modeling and Simulation International , vol. 93, no. 9, pp. 759–769, 2017. [Online]. Available: 10.1177/0037549717709932
2017
Later among the works it cites.
2017
Later among the works it cites.
Y. N. Dauphin, A. Fan, M. Auli, and D. Grangier, “Language Modeling with Gated Convolutional Networks,,” arXiv , 2017
2017
Later among the works it cites.
2017
Later among the works it cites.
J. Fu, H. Zheng, and T. Mei, “Look closer to see better: Recurrent attention convolutional neural network for fine-grained image recognition,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, 2017, pp. 4476–4484. [Online]. Available: https://doi.org/10.1109/CVPR.2017.476
2017
Later among the works it cites.
G. Huang, Z. Liu, L. der Maaten, and K. Q. Weinberger, “Densely Connected Convolutional Networks,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, 2017, pp. 2261–2269. [Online]. Available: https://doi.org/10.1109/CVPR.2017.243
2017
Later among the works it cites.
S. Xie, R. Girshick, P. Dollár, Z. Tu, and K. He, “Aggregated residual transformations for deep neural networks,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, 1 2017, pp. 5987–5995. [Online]. Available: https://doi.org/10.1109/CVPR.2017.634
2017
Later among the works it cites.
2017
Later among the works it cites.
2018
Closest in time.
2018
Closest in time.
C. Bircanoglu and N. Arica, “A comparison of activation functions in artificial neural networks,,” in Signal Processing and Communications Applications Conference (SIU) , vol. 26. IEEE‘, 2018, pp. 1–4
2018
Closest in time.
2018
Closest in time.
Y. Liu and J. Zhang, “Deep Learning in Machine Translation,” in in Deep Learning in Natural Language Processing . Singapore: Springer, 2018, pp. 147–183
2018
Closest in time.
W. Ping, K. Peng, A. Gibiansky, S. O. Arik, A. Kannan, S. Narang, and J. Miller, “Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning,” in International Conference on Learning Representations - ICLR , vol. 79, 2018, pp. 1094–1099. [Online]. Available: https://doi.org/10.1001/jam
2018
Closest in time.
H. Jung and Y. S. Heo, “Fingerprint liveness map construction using convolutional neural network,” Electronics Letters , vol. 54, no. 9, pp. 564–566, 2018. [Online]. Available: 10.1049/el.2018.0621
2018
Closest in time.
2018
Closest in time.
J. Lehman, J. Chen, J. Clune, and K. O. Stanley, “Safe mutations for deep and recurrent neural networks through output gradients.” New York, New York, USA: ACM Press, 2018, pp. 117–124. [Online]. Available: https://doi.org/10.1145/3205455.3205473
2018
Closest in time.
2018
Closest in time.