Fetching the paper…
Reading the bibliography…
Transformer has been successfully used in practical applications, such as ChatGPT, due to its powerful advantages.
How to share a secret
Adi Shamir · 1979
Earlier work this paper cites.
Efficient multiparty protocols using circuit randomization
Donald Beaver · 1992
Earlier work this paper cites.
Fully homomorphic encryption without modulus switching from classical gapsvp
Zvika Brakerski · 2012
Earlier work this paper cites.
Somewhat practical fully homomorphic encryption
Junfeng Fan and Frederik Vercauteren · 2012
Earlier work this paper cites.
Secure multiparty computation
Ronald Cramer, Ivan Bjerre Damgård, et al · 2015
Earlier work this paper cites.
Aby-a framework for efficient mixed-protocol secure two-party computation
Daniel Demmler, Thomas Schneider, and Michael Zohner · 2015
Earlier work this paper cites.
Gaussian error linear units (gelus)
Dan Hendrycks and Kevin Gimpel · 2016
Earlier work this paper cites.
EMP-toolkit: Efficient MultiParty computation toolkit
Xiao Wang, Alex J. Malozemoff, and Jonathan Katz · 2016
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Secureml: A system for scalable privacy-preserving machine learning
Payman Mohassel and Yupeng Zhang · 2017
Earlier work this paper cites.
Oblivious neural network predictions via minionn transformations
Jian Liu, Mika Juuti, Yao Lu, and Nadarajah Asokan · 2017
Earlier work this paper cites.
Chameleon: A hybrid secure computation framework for machine learning applications
M Sadegh Riazi, Christian Weinert, Oleksandr Tkachenko, Ebrahim M Songhori, Thomas Schneider, and Farinaz Koushanfar · 2018
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Cited alongside, same era.
Glue: A multi-task benchmark and analysis platform for natural language understanding
Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R Bowman · 2018
Cited alongside, same era.
Efficient pseudorandom correlation generators: Silent ot extension and more
Elette Boyle, Geoffroy Couteau, Niv Gilboa, Yuval Ishai, Lisa Kohl, and Peter Scholl · 2019
Cited alongside, same era.
Efficient two-round ot extension and silent non-interactive secure computation
Elette Boyle, Geoffroy Couteau, Niv Gilboa, Yuval Ishai, Lisa Kohl, Peter Rindal, and Peter Scholl · 2019
The-x: Privacy-preserving transformer inference with homomorphic encryption
Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, and Jianxin Li · 2022
Later among the works it cites.
Mpcformer: fast, performant and private transformer inference with mpc
Dacheng Li, Rulin Shao, Hongyi Wang, Han Guo, Eric P Xing, and Hao Zhang · 2022
Later among the works it cites.
Mpcvit: Searching for mpc-friendly vision transformer with heterogeneous attention
Wenxuan Zeng, Meng Li, Wenjie Xiong, Wenjie Lu, Jin Tan, Runsheng Wang, and Ru Huang · 2022
Later among the works it cites.
Iron: Private inference on transformers
Meng Hao, Hongwei Li, Hanxiao Chen, Pengzhi Xing, Guowen Xu, and Tianwei Zhang · 2022
Later among the works it cites.
Nfgen: Automatic non-linear function evaluation code generator for general-purpose mpc platforms
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Delphi: a cryptographic inference system for neural networks
Pratyush Mishra, Ryan Lehmkuhl, Akshayaram Srinivasan, Wenting Zheng, and Raluca Ada Popa · 2020
Cited alongside, same era.
Cryptflow2: Practical 2-party secure inference
Deevashwer Rathee, Mayank Rathee, Nishant Kumar, Nishanth Chandran, Divya Gupta, Aseem Rastogi, and Rahul Sharma · 2020
Cited alongside, same era.
Ferret: Fast extension for correlated ot with small communication
Kang Yang, Chenkai Weng, Xiao Lan, Jiang Zhang, and Xiao Wang · 2020
Cited alongside, same era.
Sirnn: A math library for secure rnn inference
Deevashwer Rathee, Mayank Rathee, Rahul Kranti Kiran Goli, Divya Gupta, Rahul Sharma, Nishanth Chandran, and Aseem Rastogi · 2021
Cited alongside, same era.
https://github.com/Microsoft/SEAL , September 2021
Microsoft SEAL · 2021
Cited alongside, same era.
Cheetah: Lean and fast secure { \{ Two-Party } \} deep neural network inference
Zhicong Huang, Wen-jie Lu, Cheng Hong, and Jiansheng Ding · 2022
Cited alongside, same era.
https://openai.com/blog/openai-api
Openai api
Cited in the paper.
Xiaoyu Fan, Kun Chen, Guosai Wang, Mingchun Zhuang, Yi Li, and Wei Xu · 2022
Later among the works it cites.
Llms can understand encrypted prompt: Towards privacy-computing friendly transformers
Xuanqi Liu and Zhuotao Liu · 2023
Closest in time.
Privformer: Privacy-preserving transformer with mpc
Yoshimasa Akimoto, Kazuto Fukuchi, Youhei Akimoto, and Jun Sakuma · 2023
Closest in time.
Merge: Fast private text generation
Zi Liang, Pinghui Wang, Ruofei Zhang, Nuo Xu, and Shuo Zhang · 2023
Closest in time.
Primer: Fast private transformer inference on encrypted data
Mengxin Zheng, Qian Lou, and Lei Jiang · 2023
Closest in time.
Puma: Secure inference of llama-7b in five minutes
Ye Dong, Wen-jie Lu, Yancheng Zheng, Haoqi Wu, Derun Zhao, Jin Tan, Zhicong Huang, Cheng Hong, Tao Wei, and Wenguang Cheng · 2023
Closest in time.