Fetching the paper…
Reading the bibliography…
Inspired by the diversity of biological neurons, quadratic artificial neurons can play an important role in deep learning models.
M. S. Birman and M. Z. Solomyak, “Piecewise-polynomial approximations of functions of the classes w_pˆ α \alpha ,” Matematicheskii Sbornik
1967
Earlier work this paper cites.
A. G. Ivakhnenko, “Polynomial theory of complex systems,” IEEE transactions on Systems, Man, and Cybernetics
1971
Earlier work this paper cites.
T. Poggio, “On optimal nonlinear associative recall,” Biological Cybernetics
1975
Earlier work this paper cites.
C. A. Hall and W. W. Meyer, “Optimal error bounds for cubic spline interpolation,” Journal of Approximation Theory
1976
Earlier work this paper cites.
C. L. Giles and T. Maxwell, “Learning, invariance, and generalization in high-order neural networks,” Applied optics
1987
Earlier work this paper cites.
R. P. Lippmann, “Pattern classification using neural networks,” IEEE communications magazine
1989
Earlier work this paper cites.
Y. Shin and J. Ghosh, “The pi-sigma network: An efficient higher-order neural network for pattern classification and function approximation,” in IJCNN-91-Seattle international joint conference on neural networks
1991
Earlier work this paper cites.
R. Remmert, “The fundamental theorem of algebra,” in Numbers
1991
Earlier work this paper cites.
J. P. Boyd, “Defeating the runge phenomenon for equispaced polynomial interpolation via tikhonov regularization,” Applied Mathematics Letters
1992
Earlier work this paper cites.
S. Milenkovic, Z. Obradovic, and V. Litovski, “Annealing based dynamic learning in second-order neural networks,” in Proceedings of International Conference on Neural Networks (ICNN’96)
1996
Earlier work this paper cites.
Y. I. Alber, A. N. Iusem, and M. V. Solodov, “On the projected subgradient method for nonsmooth convex optimization in a hilbert space,” Mathematical Programming
1998
Earlier work this paper cites.
S. Redlapalli, M. M. Gupta, and K.-Y. Song, “Development of quadratic neural unit with applications to pattern classification,” in Fourth International Symposium on Uncertainty Modeling and Analysis, 2003. ISUMA 2003
2003
Earlier work this paper cites.
J.-P. Thivierge, “Neural diversity creates a rich repertoire of brain activity,” Communicative & integrative biology
2008
Earlier work this paper cites.
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition
2009
Earlier work this paper cites.
Springer Science & Business Media, 2013
R.-H. Wang, Multivariate spline functions and their applications · 2013
Earlier work this paper cites.
Springer Science & Business Media, 2013
D. Eisenbud, Commutative algebra: with a view toward algebraic geometry · 2013
Earlier work this paper cites.
2014
Earlier work this paper cites.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980
2014
Earlier work this paper cites.
2014
Cited alongside, same era.
D. Eigen, C. Puhrsch, and R. Fergus, “Depth map prediction from a single image using a multi-scale deep network,” Advances in neural information processing systems
2014
Cited alongside, same era.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” nature
2015
Cited alongside, same era.
J. Schmidhuber, “Deep learning in neural networks: An overview,” Neural networks
2015
Cited alongside, same era.
K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpassing human-level performance on imagenet classification,” in Proceedings of the IEEE international conference on computer vision
2015
Cited alongside, same era.
T. Nguyen, A. Kashani, T. Ngo, and S. Bordas, “Deep neural network with high-order neuron for the prediction of foamed concrete strength,” Computer-Aided Civil and Infrastructure Engineering
2019
Later among the works it cites.
X. Li and F. Orabona, “On the convergence of stochastic gradient descent with adaptive stepsizes,” in The 22nd International Conference on Artificial Intelligence and Statistics
2019
Later among the works it cites.
S. Chen, M. Jiang, J. Yang, and Q. Zhao, “Air: Attention with reasoning capability,” in ECCV
2020
Later among the works it cites.
F. Fan, J. Xiong, and G. Wang, “Universal approximation with quadratic deep networks,” Neural Networks
2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition
2016
Cited alongside, same era.
G. Zoumpourlis, A. Doumanoglou, N. Vretos, and P. Daras, “Non-linear convolution filters for cnn-based learning,” in Proceedings of the IEEE International Conference on Computer Vision
2017
Cited alongside, same era.
S. K. Kumar, “On weight initialization in deep neural networks,” arXiv preprint arXiv:1704.08863
2017
Cited alongside, same era.
2017
Cited alongside, same era.
2018
Cited alongside, same era.
C. Liu, B. Zoph, M. Neumann, J. Shlens, W. Hua, L.-J. Li, L. Fei-Fei, A. Yuille, J. Huang, and K. Murphy, “Progressive neural architecture search,” in Proceedings of the European conference on computer vision (ECCV)
2018
Cited alongside, same era.
S. Du and J. Lee, “On the power of over-parametrization in neural networks with quadratic activation,” in International Conference on Machine Learning
2018
Cited alongside, same era.
2020
Later among the works it cites.
2020
Later among the works it cites.
Y. Jiang, F. Yang, H. Zhu, D. Zhou, and X. Zeng, “Nonlinear cnn: improving cnns with quadratic convolutions,” Neural Computing and Applications
2020
Later among the works it cites.
M. Goyal, R. Goyal, and B. Lall, “Improved polynomial neural networks with normalised activations,” in 2020 International Joint Conference on Neural Networks (IJCNN)
2020
Later among the works it cites.
J. W. Siegel and J. Xu, “Approximation rates for neural networks with general activation functions,” Neural Networks
2020
Later among the works it cites.
F. Fuchs, Y. Song, E. Kaufmann, D. Scaramuzza, and P. Duerr, “Super-human performance in gran turismo sport using deep reinforcement learning,” IEEE Robotics and Automation Letters
2021
Closest in time.
2021
Closest in time.
G. Chrysos, S. Moschoglou, G. Bouritsas, J. Deng, Y. Panagakis, and S. P. Zafeiriou, “Deep polynomial neural networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence
2021
Closest in time.
P. Mantini and S. K. Shah, “Cqnn: Convolutional quadratic neural networks,” in 2020 25th International Conference on Pattern Recognition (ICPR)
2021
Closest in time.
J. Bu and A. Karpatne, “Quadratic residual networks: A new class of neural networks for solving forward and inverse problems in physics involving pdes,” in Proceedings of the 2021 SIAM International Conference on Data Mining (SDM)
2021
Closest in time.
H. Chen, Y. Wang, T. Guo, C. Xu, Y. Deng, Z. Liu, S. Ma, C. Xu, C. Xu, and W. Gao, “Pre-trained image processing transformer,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
2021
Closest in time.
M. Song, S. Lim, and W. Kim, “Monocular depth estimation using laplacian pyramid-based depth residuals,” IEEE transactions on circuits and systems for video technology
2021
Closest in time.
Z. Xu, F. Yu, J. Xiong, and X. Chen, “Quadralib: A performant quadratic neural network library for architecture optimization and design exploration,” Proceedings of Machine Learning and Systems
2022
Closest in time.
J. Xu, X. Liu, Y. Bai, J. Jiang, K. Wang, X. Chen, and X. Ji, “Multi-camera collaborative depth prediction via consistent structure estimation,” in Proceedings of the 30th ACM International Conference on Multimedia
2022
Closest in time.