Boosting Deep Neural Networks with Geometrical Prior Knowledge: A Survey

Feng D, Haase-Schuetz C, Rosenbaum L, et al (2019) Deep multi-modal object detection and semantic segmentation for autonomous driving: Datasets, methods, and challenges. CoRR abs/1902.07830. https://arxiv.org/abs/arXiv:1902.07830

Original

1902

Earlier work this paper cites.

Caesar H, Bankiti V, Lang AH, et al (2019) nuscenes: A multimodal dataset for autonomous driving. CoRR abs/1903.11027. https://arxiv.org/abs/arXiv:1903.11027

Original

1903

Earlier work this paper cites.

Ghosh R, Gupta AK (2019) Scale steerable filters for locally scale-invariant convolutional neural networks. CoRR abs/1906.03861. https://arxiv.org/abs/arXiv:1906.03861

Original

1906

Earlier work this paper cites.

Zhu W, Qiu Q, Calderbank AR, et al (2019) Scale-equivariant neural networks with decomposed convolutional filters. CoRR abs/1909.11193. https://arxiv.org/abs/arXiv:1909.11193

Original

1909

Earlier work this paper cites.

Diaconu N, Worrall DE (2019a) Affine self convolution. CoRR abs/1911.07704. https://arxiv.org/abs/arXiv:1911.07704

Original

1911

Earlier work this paper cites.

Fukushima K (1980) Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological Cybernetics 36:193–202

1980

Earlier work this paper cites.

LeCun Y, Boser BE, Denker JS, et al (1989) Handwritten digit recognition with a back-propagation network. In: Advances in Neural Information Processing Systems 2, [NIPS Conference, Denver, Colorado, USA, November 27-30, 1989], pp 396–404

1989

Earlier work this paper cites.

LeCun Y, Boser B, Denker JS, et al (1990) Handwritten digit recognition with a back-propagation network. In: Touretzky D (ed) Advances in Neural Information Processing Systems (NIPS 1989), vol 2. Morgan Kaufman, Denver, CO

1989

Earlier work this paper cites.

Freeman WT, Adelson EH (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13(9):891–906

1991

Earlier work this paper cites.

Schulz-Mirbach H (1992) On the existence of complete invariant feature spaces in pattern recognition. In: Pattern Recognition: Eleventh International Conference 1992, pp 178 – 182

1992

Earlier work this paper cites.

Schulz-Mirbach H (1994) Algorithms for the construction of invariant features. In: Tagungsband Mustererkennung 1994 (16. DAGM Symposium), Reihe Informatik Xpress, Nr.5, pp 324–332

1994

Earlier work this paper cites.

Schulz-Mirbach H (1995) Invariant features for gray scale images. In: Mustererkennung 1995, 17. DAGM-Symposium, Bielefeld, 13.-15. September 1995, Proceedings, pp 1–14

1995

Earlier work this paper cites.

Finzi M, Stanton S, Izmailov P, et al (2020) Generalizing convolutional neural networks for equivariance to lie groups on arbitrary continuous data. CoRR abs/2002.12880. https://arxiv.org/abs/arXiv:2002.12880

Original

2002

Earlier work this paper cites.

Esteves C (2020) Theoretical aspects of group equivariant neural networks. CoRR abs/2004.05154. https://arxiv.org/abs/arXiv:2004.05154

Original

2004

Earlier work this paper cites.

Romero DW, Bekkers EJ, Tomczak JM, et al (2020) Wavelet networks: Scale equivariant learning from raw waveforms. CoRR abs/2006.05259. URL https://arxiv.org/abs/2006.05259 , https://arxiv.org/abs/2006.05259

Original

2006

Earlier work this paper cites.

Larochelle H, Erhan D, Courville AC, et al (2007) An empirical evaluation of deep architectures on problems with many factors of variation. In: Machine Learning, Proceedings of the Twenty-Fourth International Conference (ICML 2007), Corvallis, Oregon, USA, June 20-24, 2007, pp 473–480

2007

Earlier work this paper cites.

Dosovitskiy A, Beyer L, Kolesnikov A, et al (2020) An image is worth 16x16 words: Transformers for image recognition at scale. CoRR abs/2010.11929. URL https://arxiv.org/abs/2010.11929 , https://arxiv.org/abs/arXiv:2010.11929

Original

2010

Earlier work this paper cites.

Coates A, Ng AY, Lee H (2011) An analysis of single-layer networks in unsupervised feature learning. In: Gordon GJ, Dunson DB, Dudík M (eds) Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, AISTATS 2011, Fort Lauderdale, USA, April 11-13, 2011, JMLR Proceedings, vol 15. JMLR.org, pp 215–223, URL http://proceedings.mlr.press/v15/coates11a/coates11a.pdf

2011

Earlier work this paper cites.

Hinton GE, Krizhevsky A, Wang SD (2011) Transforming auto-encoders. In: Honkela T, Duch W, Girolami MA, et al (eds) Artificial Neural Networks and Machine Learning - ICANN 2011 - 21st International Conference on Artificial Neural Networks, Espoo, Finland, June 14-17, 2011, Proceedings, Part I, Lecture Notes in Computer Science, vol 6791. Springer, pp 44–51

2011

Earlier work this paper cites.

Müller F, Mertins A (2011) Contextual invariant-integration features for improved speaker-independent speech recognition. Speech Communication 53(6):830–841

2011

Earlier work this paper cites.

Condurache AP, Mertins A (2012) Sparse representations and invariant sequence-feature extraction for event detection. VISAPP 2012 - Proceedings of the International Conference on Computer Vision Theory and Applications 1

2012

Earlier work this paper cites.

Geiger A, Lenz P, Urtasun R (2012) Are we ready for autonomous driving? the kitti vision benchmark suite. In: Conference on Computer Vision and Pattern Recognition (CVPR)

2012

Earlier work this paper cites.

Mallat S (2012) Group invariant scattering. Communications on Pure and Applied Mathematics 65

2012

Earlier work this paper cites.

Sohn K, Lee H (2012) Learning invariant representations with local transformations. In: Proceedings of the 29th International Conference on Machine Learning, ICML 2012, Edinburgh, Scotland, UK, June 26 - July 1, 2012. icml.cc / Omnipress

2012

Earlier work this paper cites.

Bruna J, Mallat S (2013) Invariant scattering convolution networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(8):1872–1886

2013

Earlier work this paper cites.

Sifre L, Mallat S (2013) Rotation, scaling and deformation invariant scattering for texture discrimination. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA, June 23-28, 2013, pp 1233–1240

2013

Earlier work this paper cites.

Tieleman T (2013) The affnist dataset URL http://www.cs.toronto.edu/~tijmen/affNIST

2013

Earlier work this paper cites.

Bruna J, Zaremba W, Szlam A, et al (2014) Spectral networks and locally connected networks on graphs. In: Bengio Y, LeCun Y (eds) 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14-16, 2014, Conference Track Proceedings, URL http://arxiv.org/abs/1312.6203

Original

2014

Earlier work this paper cites.

Gens R, Domingos PM (2014) Deep symmetry networks. In: Ghahramani Z, Welling M, Cortes C, et al (eds) Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada, pp 2537–2545

2014

Earlier work this paper cites.

Kanazawa A, Sharma A, Jacobs DW (2014) Locally scale-invariant convolutional neural networks. CoRR abs/1412.5104. https://arxiv.org/abs/arXiv:1412.5104

Original

2014

Earlier work this paper cites.

Oyallon E, Mallat S, Sifre L (2014) Generic deep networks with wavelet scattering. In: Bengio Y, LeCun Y (eds) 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14-16, 2014, Workshop Track Proceedings

2014

Earlier work this paper cites.

Xu Y, Xiao T, Zhang J, et al (2014) Scale-invariant convolutional neural networks. CoRR abs/1411.6369. https://arxiv.org/abs/arXiv:1411.6369

Original

2014

Earlier work this paper cites.

Hall BC (2015) Lie Groups, Lie Algebras, and Representations, 2nd edn. Springer International Publishing

2015

Earlier work this paper cites.

LeCun Y, Bengio Y, Hinton GE (2015) Deep learning. Nature 521(7553):436–444

2015

Earlier work this paper cites.

Oyallon E, Mallat S (2015) Deep roto-translation scattering for object classification. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp 2865–2873

2015

Earlier work this paper cites.

Cohen T, Welling M (2016) Group equivariant convolutional networks. In: Proceedings of the 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA, June 19-24, 2016, pp 2990–2999

2016

Earlier work this paper cites.

Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: Lee DD, Sugiyama M, von Luxburg U, et al (eds) Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, December 5-10, 2016, Barcelona, Spain, pp 3837–3845, URL https://proceedings.neurips.cc/paper/2016/hash/04df4d434d481c5bb723be1b6df1ee65-Abstract.html

2016

Earlier work this paper cites.

Laptev D, Savinov N, Buhmann JM, et al (2016) TI-POOLING: transformation-invariant pooling for feature learning in convolutional neural networks. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, pp 289–297

2016

Earlier work this paper cites.

Zagoruyko S, Komodakis N (2016) Wide residual networks. In: Wilson RC, Hancock ER, Smith WAP (eds) Proceedings of the British Machine Vision Conference 2016, BMVC 2016, York, UK, September 19-22, 2016. BMVA Press, URL http://www.bmva.org/bmvc/2016/papers/paper087/index.html

2016

Earlier work this paper cites.

Cohen TS, Welling M (2017) Steerable cnns. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net

2017

Earlier work this paper cites.

Cotter F, Kingsbury NG (2017) Visualizing and improving scattering networks. In: 27th IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2017, Tokyo, Japan, September 25-28, 2017, pp 1–6

2017

Earlier work this paper cites.

Henriques JF, Vedaldi A (2017) Warped convolutions: Efficient invariance to spatial transformations. In: Precup D, Teh YW (eds) Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017, Proceedings of Machine Learning Research, vol 70. PMLR, pp 1461–1469

2017

Earlier work this paper cites.

Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, URL https://openreview.net/forum?id=SJU4ayYgl

2017

Earlier work this paper cites.

Marcos D, Volpi M, Komodakis N, et al (2017) Rotation equivariant vector field networks. In: IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017. IEEE Computer Society, pp 5058–5067

2017

Earlier work this paper cites.

Oyallon E, Belilovsky E, Zagoruyko S (2017) Scaling the scattering transform: Deep hybrid networks. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp 5619–5628

2017

Earlier work this paper cites.

Ravanbakhsh S, Schneider JG, Póczos B (2017) Equivariance through parameter-sharing. In: Precup D, Teh YW (eds) Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017, Proceedings of Machine Learning Research, vol 70. PMLR, pp 2892–2901, URL http://proceedings.mlr.press/v70/ravanbakhsh17a.html

2017

Earlier work this paper cites.

Sabour S, Frosst N, Hinton GE (2017) Dynamic routing between capsules. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, CA, USA, pp 3856–3866

2017

Earlier work this paper cites.

Vaswani A, Shazeer N, Parmar N, et al (2017) Attention is all you need. In: Guyon I, von Luxburg U, Bengio S, et al (eds) Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, pp 5998–6008, URL https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html

2017

Earlier work this paper cites.

Worrall DE, Garbin SJ, Turmukhambetov D, et al (2017) Harmonic networks: Deep translation and rotation equivariance. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017, pp 7168–7177

2017

Earlier work this paper cites.

Bekkers EJ, Lafarge MW, Veta M, et al (2018) Roto-translation covariant convolutional networks for medical image analysis. In: Medical Image Computing and Computer Assisted Intervention - MICCAI 2018 - 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part I, pp 440–448

2018

Cited alongside, same era.

Cohen TS, Geiger M, Köhler J, et al (2018) Spherical cnns. In: 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings

2018

Cited alongside, same era.

Coors B, Condurache A, Mertins A, et al (2018) Learning transformation invariant representations with weak supervision. In: International Conference on Computer Vision Theory and Applications

2018

Cited alongside, same era.

Cotter F, Kingsbury NG (2018) Deep learning in the wavelet domain. CoRR abs/1811.06115. https://arxiv.org/abs/arXiv:1811.06115

Original

2018

Brandstetter J, Hesselink R, van der Pol E, et al (2021) Geometric and physical quantities improve E(3) equivariant message passing. CoRR abs/2110.02905. URL https://arxiv.org/abs/2110.02905 , https://arxiv.org/abs/2110.02905

Original

2021

Closest in time.

Dehmamy N, Walters R, Liu Y, et al (2021) Automatic symmetry discovery with lie algebra convolutional network. In: Ranzato M, Beygelzimer A, Dauphin YN, et al (eds) Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, pp 2503–2515, URL https://proceedings.neurips.cc/paper/2021/hash/148148d62be67e0916a833931bd32b26-Abstract.html

2021

Closest in time.

Dey N, Chen A, Ghafurian S (2021) Group equivariant generative adversarial networks. In: 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, URL https://openreview.net/forum?id=rgFNuJHHXv

2021

Closest in time.