Fetching the paper…
Reading the bibliography…
In learning with recurrent or very deep feed-forward networks, employing unitary matrices in each layer can be very effective at maintaining long-range stability.
Closest unitary, orthogonal and hermitian operators to a given operator
Joseph B Keller · 1975
Earlier work this paper cites.
A matrix approach to discrete wavelets
Jaroslav Kautsky and Radka Turcajová · 1994
Earlier work this paper cites.
Convolutional networks for images, speech, and time series
Yann LeCun, Yoshua Bengio, et al · 1995
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber · 1997
Earlier work this paper cites.
Fast face detection using mlp and fft
Souheil Ben-Yacoub, B Fasel, and Juergen Luettin · 1999
Earlier work this paper cites.
Latent semantic indexing: A probabilistic analysis
Christos H Papadimitriou, Prabhakar Raghavan, Hisao Tamaki, and Santosh Vempala · 2000
Earlier work this paper cites.
Fast monte-carlo algorithms for finding low-rank approximations
Alan Frieze, Ravi Kannan, and Santosh Vempala · 2004
Earlier work this paper cites.
Learning algorithms utilizing quasi-geodesic flows on the stiefel manifold
Yasunori Nishimori and Shotaro Akaho · 2005
Earlier work this paper cites.
Fast monte carlo algorithms for matrices ii: Computing a low-rank approximation to a matrix
Petros Drineas, Ravi Kannan, and Michael W Mahoney · 2006
Earlier work this paper cites.
An introduction to Lie groups and Lie algebras
Alexander Kirillov Jr · 2008
Earlier work this paper cites.
The scaling and squaring method for the matrix exponential revisited
Nicholas J Higham · 2009
Earlier work this paper cites.
Universal low-rank matrix recovery from pauli measurements
Yi-Kai Liu · 2011
Earlier work this paper cites.
Stochastic gradient descent on riemannian manifolds
Silvere Bonnabel · 2013
Earlier work this paper cites.
A closer look at quantum control landscapes and their implication for control optimization
Pierre De Fouquieres and Sophie G Schirmer · 2013
Earlier work this paper cites.
Fast training of convolutional networks through ffts
Michael Mathieu, Mikael Henaff, and Yann LeCun · 2013
Earlier work this paper cites.
Learning phrase representations using rnn encoder-decoder for statistical machine translation
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio · 2014
Earlier work this paper cites.
First-pass large vocabulary continuous speech recognition using bi-directional recurrent dnns
Awni Y Hannun, Andrew L Maas, Daniel Jurafsky, and Andrew Y Ng · 2014
Earlier work this paper cites.
Speeding up convolutional neural networks with low rank expansions
Max Jaderberg, Andrea Vedaldi, and Andrew Zisserman · 2014
Earlier work this paper cites.
A clockwork rnn
Jan Koutnik, Klaus Greff, Faustino Gomez, and Juergen Schmidhuber · 2014
Earlier work this paper cites.
The quest for a quantum neural network
Maria Schuld, Ilya Sinayskiy, and Francesco Petruccione · 2014
Earlier work this paper cites.
Read the fine print
Scott Aaronson · 2015
Earlier work this paper cites.
TensorFlow: Large-scale machine learning on heterogeneous systems, 2015
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dandelion Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng · 2015
Earlier work this paper cites.
Bidirectional recurrent neural networks as generative models
Mathias Berglund, Tapani Raiko, Mikko Honkala, Leo Kärkkäinen, Akos Vetek, and Juha T Karhunen · 2015
Earlier work this paper cites.
Lie groups, Lie algebras, and representations: an elementary introduction
Brian Hall · 2015
Earlier work this paper cites.
Training cnns with low-rank filters for efficient image classification
Yani Ioannou, Duncan Robertson, Jamie Shotton, Roberto Cipolla, and Antonio Criminisi · 2015
Earlier work this paper cites.
Convolutional neural networks with low-rank regularization
Cheng Tai, Tong Xiao, Yi Zhang, Xiaogang Wang, et al · 2015
Earlier work this paper cites.
Progress towards practical quantum variational algorithms
Dave Wecker, Matthew B Hastings, and Matthias Troyer · 2015
Earlier work this paper cites.
Unitary evolution recurrent neural networks
Martin Arjovsky, Amar Shah, and Yoshua Bengio · 2016
Earlier work this paper cites.
An overview of low-rank matrix recovery from incomplete observations
Mark A Davenport and Justin Romberg · 2016
Earlier work this paper cites.
Deep learning
Ian Goodfellow, Yoshua Bengio, and Aaron Courville · 2016
Cited alongside, same era.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Recurrent orthogonal networks and long-memory tasks
Mikael Henaff, Arthur Szlam, and Yann LeCun · 2016
Cited alongside, same era.
Full-capacity unitary recurrent neural networks
Scott Wisdom, Thomas Powers, John R Hershey, Jonathan Le Roux, and Les Atlas · 2016
Cited alongside, same era.
Quantum machine learning
Jacob Biamonte, Peter Wittek, Nicola Pancotti, Patrick Rebentrost, Nathan Wiebe, and Seth Lloyd · 2017
Cited alongside, same era.
Learning unitary operators with help from u (n)
Stephanie Hyland and Gunnar Rätsch · 2017
Cited alongside, same era.
Preventing gradient attenuation in lipschitz constrained convolutional networks
Qiyang Li, Saminul Haque, Cem Anil, James Lucas, Roger B Grosse, and Jörn-Henrik Jacobsen · 2019
Later among the works it cites.
Orthogonal deep neural networks
Shuai Li, Kui Jia, Yuxin Wen, Tongliang Liu, and Dacheng Tao · 2019
Later among the works it cites.
Pytorch: An imperative style, high-performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala · 2019
Later among the works it cites.
Legendre memory units: Continuous-time representation in recurrent neural networks
Aaron Voelker, Ivana Kajić, and Chris Eliasmith · 2019
Later among the works it cites.
Powersgd: Practical low-rank gradient compression for distributed optimization
Thijs Vogels, Sai Praneeth Karimireddy, and Martin Jaggi · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Tunable efficient unitary neural networks (eunn) and their application to rnns
Li Jing, Yichen Shen, Tena Dubcek, John Peurifoy, Scott Skirlo, Yann LeCun, Max Tegmark, and Marin Soljačić · 2017
Cited alongside, same era.
Efficient orthogonal parametrisation of recurrent neural networks using householder reflections
Zakaria Mhammedi, Andrew Hellicar, Ashfaqur Rahman, and James Bailey · 2017
Cited alongside, same era.
Automatic differentiation in pytorch
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer · 2017
Cited alongside, same era.
On compressing deep models by low rank and sparse decomposition
Xiyu Yu, Tongliang Liu, Xinchao Wang, and Dacheng Tao · 2017
Cited alongside, same era.
Stronger generalization bounds for deep nets via a compression approach
Sanjeev Arora, Rong Ge, Behnam Neyshabur, and Yi Zhang · 2018
Cited alongside, same era.
Can we gain more from orthogonality regularizations in training deep cnns?
Nitin Bansal, Xiaohan Chen, and Zhangyang Wang · 2018
Cited alongside, same era.
Accelerated variational quantum eigensolver
Daochen Wang, Oscar Higgott, and Stephen Brierley · 2019
Later among the works it cites.
Theory of variational quantum simulation
Xiao Yuan, Suguru Endo, Qi Zhao, Ying Li, and Simon C Benjamin · 2019
Later among the works it cites.
Quantum algorithms for feedforward neural networks
Jonathan Allcock, Chang-Yu Hsieh, Iordanis Kerenidis, and Shengyu Zhang · 2020
Later among the works it cites.
Training deep quantum neural networks
Kerstin Beer, Dmytro Bondarenko, Terry Farrelly, Tobias J Osborne, Robert Salzmann, Daniel Scheiermann, and Ramona Wolf · 2020
Later among the works it cites.
Variational quantum algorithms
Marco Cerezo, Andrew Arrasmith, Ryan Babbush, Simon C Benjamin, Suguru Endo, Keisuke Fujii, Jarrod R McClean, Kosuke Mitarai, Xiao Yuan, Lukasz Cincio, et al · 2020
Later among the works it cites.
Cost-function-dependent barren plateaus in shallow quantum neural networks
Marco Cerezo, Akira Sone, Tyler Volkoff, Lukasz Cincio, and Patrick J Coles · 2020
Later among the works it cites.
Lyapunov spectra of chaotic recurrent neural networks
Rainer Engelken, Fred Wolf, and Larry F Abbott · 2020
Later among the works it cites.
Lipschitz recurrent neural networks
N Benjamin Erichson, Omri Azencot, Alejandro Queiruga, Liam Hodgkinson, and Michael W Mahoney · 2020
Later among the works it cites.
Hippo: Recurrent memory with optimal polynomial projections
Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, and Christopher Ré · 2020
Later among the works it cites.
The convolution exponential and generalized sylvester flows
Emiel Hoogeboom, Victor Garcia Satorras, Jakub M Tomczak, and Max Welling · 2020
Later among the works it cites.
Controllable orthogonalization in training dnns
Lei Huang, Li Liu, Fan Zhu, Diwen Wan, Zehuan Yuan, Bo Li, and Ling Shao · 2020
Later among the works it cites.
Learning unitaries by gradient descent
Bobak Toussi Kiani, Seth Lloyd, and Reevu Maity · 2020
Later among the works it cites.
Efficient riemannian optimization on the stiefel manifold via the cayley transform
Jun Li, Li Fuxin, and Sinisa Todorovic · 2020
Later among the works it cites.
Sparse low rank factorization for deep neural network compression
Sridhar Swaminathan, Deepak Garg, Rajkumar Kannan, and Frederic Andres · 2020
Later among the works it cites.
Orthogonal convolutional neural networks
Jiayun Wang, Yubei Chen, Rudrasis Chakraborty, and Stella X Yu · 2020
Later among the works it cites.
Critical points in hamiltonian agnostic variational quantum algorithms
Eric R Anschuetz · 2021
Later among the works it cites.
Quantum algorithms for group convolution, cross-correlation, and equivariant transformations
Grecia Castelazo, Quynh T Nguyen, Giacomo De Palma, Dirk Englund, Seth Lloyd, and Bobak T Kiani · 2021
Later among the works it cites.
Efficiently modeling long sequences with structured state spaces
Albert Gu, Karan Goel, and Christopher Ré · 2021
Later among the works it cites.
Quantum earth mover’s distance: A new approach to learning quantum data
Bobak Toussi Kiani, Giacomo De Palma, Milad Marvian, Zi-Wen Liu, and Seth Lloyd · 2021
Later among the works it cites.
Implicit bias of linear equivariant networks
Hannah Lawrence, Kristian Georgiev, Andrew Dienes, and Bobak T Kiani · 2021
Later among the works it cites.
Orthogonal over-parameterized training
Weiyang Liu, Rongmei Lin, Zhen Liu, James M Rehg, Liam Paull, Li Xiong, Le Song, and Adrian Weller · 2021
Later among the works it cites.
Sahil Singla and Soheil Feizi · 2021
Later among the works it cites.
Orthogonalizing convolutional layers with the cayley transform
Asher Trockman and J Zico Kolter · 2021
Later among the works it cites.