Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs

Shannon, C.E.: Communication in the presence of noise. Proceedings of the IRE 37

1949

Earlier work this paper cites.

Hopfield, J.J.: Neurons with graded response have collective computational properties like those of two-state neurons. Proceedings of the national academy of sciences 81

1984

Earlier work this paper cites.

Hopfield, J.J., Tank, D.W.: Computing with neural circuits: A model. Science 233

1986

Earlier work this paper cites.

Williams, R.J.: The logic of activation functions. Parallel distributed processing: Explorations in the microstructure of cognition 1

1986

Earlier work this paper cites.

Murray, A., Smith, A., Butler, Z.: Bit-serial neural networks. In: Neural Information Processing Systems. pp. 573–583 (1987)

1987

Earlier work this paper cites.

Baum, E.B., Wilczek, F.: Supervised learning of probability distributions by neural networks. In: Neural information processing systems. vol. 12, pp. 52–61. New York, NY (1988)

1988

Earlier work this paper cites.

Feldman, J.A., Fanty, M.A., Goodard, N.H.: Computing with structured neural networks. Computer 21

1988

Earlier work this paper cites.

Gallant, A.R., White, H.: There exists a neural network that does not make avoidable mistakes. In: ICNN. pp. 657–664 (1988)

1988

Earlier work this paper cites.

DasGupta, B., Schnitger, G.: The power of approximation: A comparison of activation functions. In: NIPS. pp. 615–622. Denver, CO (1992)

1992

Earlier work this paper cites.

Koplon, R., Sontag, E.D.: Using fourier-neural recurrent networks to fit sequential input/output data. Neurocomputing 15

1997

Earlier work this paper cites.

Silvescu, A.: Fourier neural networks. In: IJCNN’99. International Joint Conference on Neural Networks. Proceedings (Cat. No. 99CH36339). vol. 1, pp. 488–491. IEEE (1999)

1999

Earlier work this paper cites.

Sopena, J.M., Romero, E., Alquezar, R.: Neural networks with periodic and monotonic activation functions: a comparative study in classification problems (1999)

1999

Earlier work this paper cites.

Liang, X.B., Wang, J.: Absolute exponential stability of neural networks with a general class of activation functions. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 47

2000

Earlier work this paper cites.

Liang, X.B., Wang, J.: An additive diagonal-stability condition for absolute exponential stability of a general class of neural networks. IEEE Transactions on circuits and systems I: Fundamental Theory and Applications 48

2001

Earlier work this paper cites.

Wong, K.w., Leung, C.s., Chang, S.j.: Handwritten digit recognition using multilayer feedforward neural networks with periodic and monotonic activation functions. In: Object recognition supported by user interaction for service robots. vol. 3, pp. 106–109. IEEE (2002)

2002

Earlier work this paper cites.

Cao, J., Wang, J.: Absolute exponential stability of recurrent neural networks with lipschitz-continuous activation functions and time delays. Neural networks 17

2004

Earlier work this paper cites.

Lu, W., Chen, T.: Dynamical behaviors of cohen–grossberg neural networks with discontinuous activation functions. Neural Networks 18

2005

Earlier work this paper cites.

Ma, L., Khorasani, K.: Constructive feedforward neural networks using hermite polynomial activation functions. IEEE Transactions on Neural Networks 16

2005

Earlier work this paper cites.

Biship, C.M.: Pattern recognition and machine learning (information science and statistics) (2007)

2007

Cited alongside, same era.

Rudelson, M., Vershynin, R.: Sampling from large matrices: An approach through geometric functional analysis. Journal of the ACM (JACM) 54

2007

Cited alongside, same era.

Karlik, B., Olgac, A.V.: Performance analysis of various activation functions in generalized mlp architectures of neural networks. International Journal of Artificial Intelligence and Expert Systems 1

2011

Cited alongside, same era.

Sibi, P., Jones, S.A., Siddarth, P.: Analysis of different activation functions using back propagation neural networks. Journal of theoretical and applied information technology 47

2013

Cited alongside, same era.

Liu, P., Zeng, Z., Wang, J.: Multistability of recurrent neural networks with nonmonotonic activation functions and mixed time delays. IEEE Transactions on Systems, Man, and Cybernetics: Systems 46

Henzler, P., Mitra, N.J., Ritschel, T.: Learning a neural 3d texture space from 2d exemplars. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 8356–8364 (2020)

2020

Later among the works it cites.

Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., Ng, R.: Nerf: Representing scenes as neural radiance fields for view synthesis. In: European Conference on Computer Vision. pp. 405–421. Springer (2020)

2020

Later among the works it cites.

Niemeyer, M., Mescheder, L., Oechsle, M., Geiger, A.: Differentiable volumetric rendering: Learning implicit 3d representations without 3d supervision. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 3504–3515 (2020)

2020

Later among the works it cites.

Sitzmann, V., Martel, J., Bergman, A., Lindell, D., Wetzstein, G.: Implicit neural representations with periodic activation functions. Advances in Neural Information Processing Systems 33

2020