Fetching the paper…
Reading the bibliography…
In this work, quantum transformers are designed and analysed in detail by extending the state-of-the-art classical transformer neural network architectures known to be very performant in natural language processing and image analysis.
“An algorithm for the machine calculation of complex fourier series”
James W Cooley and John W Tukey · 1965
Earlier work this paper cites.
“Learning to Control Fast-Weight Memories: An Alternative to Dynamic Recurrent Networks”
Jürgen Schmidhuber · 1992
Earlier work this paper cites.
“Reducing the Ratio Between Learning Complexity and Number of Time Varying Variables in Fully Recurrent Nets”
J. Schmidhuber · 1993
Earlier work this paper cites.
“Matrix analysis”
Roger A Horn and Charles R Johnson · 2012
Earlier work this paper cites.
“Adam: A method for stochastic optimization”
Diederik P. Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
“Neural Machine Translation by Jointly Learning to Align and Translate” (2016)
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio · 2016
Earlier work this paper cites.
“Tunable efficient unitary neural networks (eunn) and their application to rnns”
Li Jing, Yichen Shen, Tena Dubcek, John Peurifoy, Scott A. Skirlo, Yann LeCun, Max Tegmark, and Marin Soljacic · 2016
Earlier work this paper cites.
“Quantum machine learning”
Jacob Biamonte, Peter Wittek, Nicola Pancotti, Patrick Rebentrost, Nathan Wiebe, and Seth Lloyd · 2017
Earlier work this paper cites.
“Attention is all you need”
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
“Regularizing deep neural networks by noise: Its interpretation and optimization”
Hyeonwoo Noh, Tackgeun You, Jonghwan Mun, and Bohyung Han · 2017
Earlier work this paper cites.
“Bert: Pre-training of deep bidirectional transformers for language understanding” (2018)
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Earlier work this paper cites.
“Classification with quantum neural networks on near term processors” (2018)
Edward Farhi and Hartmut Neven · 2018
Earlier work this paper cites.
“Quantum circuit learning”
Kosuke Mitarai, Makoto Negoro, Masahiro Kitagawa, and Keisuke Fujii · 2018
Earlier work this paper cites.
“JAX: composable transformations of Python+NumPy programs”
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang · 2018
Earlier work this paper cites.
“Quantum convolutional neural networks”
Iris Cong, Soonwon Choi, and Mikhail D Lukin · 2019
Cited alongside, same era.
“Orthogonal deep neural networks”
Kui Jia, Shuai Li, Yuxin Wen, Tongliang Liu, and Dacheng Tao · 2019
Cited alongside, same era.
“An overview of overfitting and its solutions”
Xue Ying · 2019
Cited alongside, same era.
“Efficient transformers: A survey”
Yi Tay, Mostafa Dehghani, Dara Bahri, and Donald Metzler · 2020
Cited alongside, same era.
“Quanvolutional neural networks: powering image recognition with quantum circuits”
Maxwell Henderson, Samriddhi Shakya, Shashindra Pradhan, and Tristan Cook · 2020
Cited alongside, same era.
“Demonstrating a continuous set of two-qubit gates for near-term quantum algorithms”
Brooks Foxen, Charles Neill, Andrew Dunsworth, Pedram Roushan, Ben Chiaro, Anthony Megrant, Julian Kelly, Zijun Chen, Kevin Satzinger, Rami Barends, et al · 2020
“Noisy intermediate-scale quantum algorithms”
Kishor Bharti, Alba Cervera-Lierta, Thi Ha Kyaw, Tobias Haug, Sumner Alperin-Lea, Abhinav Anand, Matthias Degroote, Hermanni Heimonen, Jakob S Kottmann, Tim Menke, et al · 2022
Closest in time.
“Quantum methods for neural networks and application to medical image classification”
Jonas Landman, Natansh Mathur, Yun Yvonna Li, Martin Strahm, Skander Kazdaghli, Anupam Prakash, and Iordanis Kerenidis · 2022
Closest in time.
“projunn: Efficient method for training deep networks with unitary matrices”
Bobak Kiani, Randall Balestriero, Yann LeCun, and Seth Lloyd · 2022
Closest in time.
“The dawn of quantum natural language processing”
Riccardo Di Sipio, Jia-Hong Huang, Samuel Yen-Chi Chen, Stefano Mangini, and Marcel Worring · 2022
Closest in time.
“Quantum self-attention neural networks for text classification” (2022)
Guangxi Li, Xuanqiang Zhao, and Xin Wang · 2022
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
“Medmnist classification decathlon: A lightweight automl benchmark for medical image analysis” (2020)
Jiancheng Yang, Rui Shi, and Bingbing Ni · 2020
Cited alongside, same era.
“Transformers are rnns: Fast autoregressive transformers with linear attention”
Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, and François Fleuret · 2020
Cited alongside, same era.
“Variational quantum algorithms”
Marco Cerezo, Andrew Arrasmith, Ryan Babbush, Simon C Benjamin, Suguru Endo, Keisuke Fujii, Jarrod R McClean, Kosuke Mitarai, Xiao Yuan, Lukasz Cincio, et al · 2021
Cited alongside, same era.
“An image is worth 16x16 words: Transformers for image recognition at scale”
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby · 2021
Cited alongside, same era.
“Attention-based quantum tomography”
Peter Cha, Paul Ginsparg, Felix Wu, Juan Carrasquilla, Peter L McMahon, and Eun-Ah Kim · 2021
Cited alongside, same era.
“Nearest centroid classification on a trapped ion quantum computer”
Sonika Johri, Shantanu Debnath, Avinash Mocherla, Alexandros Singk, Anupam Prakash, Jungsang Kim, and Iordanis Kerenidis · 2021
Cited alongside, same era.
Fabio Sanches, Sean Weinberg, Takanori Ide, and Kazumitsu Kamiya · 2022
Closest in time.
“Semiconductor defect detection by hybrid classical-quantum deep learning”
YuanFu Yang and Min Sun · 2022
Closest in time.
“Quantum machine learning with subspace states” (2022)
Iordanis Kerenidis and Anupam Prakash · 2022
Closest in time.
“Quantum variational algorithms are swamped with traps”
Eric R. Anschuetz and Bobak Toussi Kiani · 2022
Closest in time.
Léo Monbroussou, Jonas Landman, Alex B. Grilo, Romain Kukla, and Elham Kashefi · 2023
Closest in time.
“The adjoint is all you need: Characterizing barren plateaus in quantum ansätze” (2023)
Enrico Fontana, Dylan Herman, Shouvanik Chakrabarti, Niraj Kumar, Romina Yalovetzky, Jamie Heredge, Shree Hari Sureshbabu, and Marco Pistoia · 2023
Closest in time.
“A unified theory of barren plateaus for deep parametrized quantum circuits” (2023)
Michael Ragone, Bojko N. Bakalov, Frédéric Sauvage, Alexander F. Kemper, Carlos Ortiz Marrero, Martin Larocca, and M. Cerezo · 2023
Closest in time.
“Medmnist v2-a large-scale lightweight benchmark for 2d and 3d biomedical image classification”
Jiancheng Yang, Rui Shi, Donglai Wei, Zequan Liu, Lin Zhao, Bilian Ke, Hanspeter Pfister, and Bingbing Ni · 2023
Closest in time.