Fetching the paper…
Reading the bibliography…
With ChatGPT as a representative, tons of companies have began to provide services based on large Transformers models.
How to share a secret
Adi Shamir · 1979
Earlier work this paper cites.
How to generate and exchange secrets
Andrew Chi-Chih Yao · 1986
Earlier work this paper cites.
How to play any mental game
O. Goldreich, S. Micali, and A. Wigderson · 1987
Earlier work this paper cites.
Protocol buffers: Google’s data interchange format
Kenton Varda · 2008
Earlier work this paper cites.
Flatbuffers: a memory efficient serialization library
Wouter van Oortmerssen · 2014
Earlier work this paper cites.
Deep learning with differential privacy
Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang · 2016
Earlier work this paper cites.
High-throughput semi-honest secure three-party computation with an honest majority
Toshinori Araki, Jun Furukawa, Yehuda Lindell, Ariel Nof, and Kazuma Ohara · 2016
Earlier work this paper cites.
Pointer sentinel mixture models, 2016
Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher · 2016
Earlier work this paper cites.
Oblivious neural network predictions via minionn transformations
Jian Liu, Mika Juuti, Yao Lu, and Nadarajah Asokan · 2017
Earlier work this paper cites.
Secureml: A system for scalable privacy-preserving machine learning
Payman Mohassel and Yupeng Zhang · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Aby3: A mixed protocol framework for machine learning
Payman Mohassel and Peter Rindal · 2018
Earlier work this paper cites.
Improving language understanding by generative pre-training
Alec Radford and Karthik Narasimhan · 2018
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Earlier work this paper cites.
Cryptflow: Secure tensorflow inference
Nishant Kumar, Mayank Rathee, Nishanth Chandran, Divya Gupta, Aseem Rastogi, and Rahul Sharma · 2019
Earlier work this paper cites.
Deep learning inference service at microsoft
Jonathan Soifer, Jason Li, Mingqin Li, Jeffrey Zhu, Yingnan Li, Yuxiong He, Elton Zheng, Adi Oltean, Maya Mosyak, Chris Barnes, et al · 2019
Earlier work this paper cites.
Securenn: 3-party secure computation for neural network training
Sameer Wagh, Divya Gupta, and Nishanth Chandran · 2019
Cited alongside, same era.
GLUE: A multi-task benchmark and analysis platform for natural language understanding
Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman · 2019
Cited alongside, same era.
Xlnet: Generalized autoregressive pretraining for language understanding
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov, and Quoc V. Le · 2019
Cited alongside, same era.
Language models are few-shot learners, 2020
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei · 2020
Cited alongside, same era.
Flash: Fast and robust framework for privacy-preserving machine learning
Megha Byali, Harsh Chaudhari, Arpita Patra, and Ajith Suresh · 2020
{ \{ ABY2. 0 } \} : Improved { \{ Mixed-Protocol } \} secure { \{ Two-Party } \} computation
Arpita Patra, Thomas Schneider, Ajith Suresh, and Hossein Yalame · 2021
Later among the works it cites.
Sirnn: A math library for secure rnn inference
Deevashwer Rathee, Mayank Rathee, Rahul Kranti Kiran Goli, Divya Gupta, Rahul Sharma, Nishanth Chandran, and Aseem Rastogi · 2021
Later among the works it cites.
Cryptgpu: Fast privacy-preserving machine learning on the gpu
Sijun Tan, Brian Knott, Yuan Tian, and David J Wu · 2021
Later among the works it cites.
Bootstrapped masked autoencoders for vision bert pretraining
Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, and Nenghai Yu · 2022
Later among the works it cites.
Iron: Private inference on transformers
Meng Hao, Hongwei Li, Hanxiao Chen, Pengzhi Xing, Guowen Xu, and Tianwei Zhang · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Mp-spdz: A versatile framework for multi-party computation
Marcel Keller · 2020
Cited alongside, same era.
Faster secure multiparty computation of adaptive gradient descent
Wen-jie Lu, Yixuan Fang, Zhicong Huang, Cheng Hong, Chaochao Chen, Hunter Qu, Yajin Zhou, and Kui Ren · 2020
Cited alongside, same era.
Delphi: A cryptographic inference service for neural networks
Pratyush Mishra, Ryan Lehmkuhl, Akshayaram Srinivasan, Wenting Zheng, and Raluca Ada Popa · 2020
Cited alongside, same era.
Blaze: blazing fast privacy-preserving machine learning
Arpita Patra and Ajith Suresh · 2020
Cited alongside, same era.
Cryptflow2: Practical 2-party secure inference
Deevashwer Rathee, Mayank Rathee, Nishant Kumar, Nishanth Chandran, Divya Gupta, Aseem Rastogi, and Rahul Sharma · 2020
Cited alongside, same era.
Falcon: Honest-majority maliciously secure framework for private deep learning
Sameer Wagh, Shruti Tople, Fabrice Benhamouda, Eyal Kushilevitz, Prateek Mittal, and Tal Rabin · 2020
Cited alongside, same era.
Transformers: State-of-the-art natural language processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush · 2020
Cited alongside, same era.
Cheetah: Lean and fast secure Two-Party deep neural network inference
Zhicong Huang, Wen jie Lu, Cheng Hong, and Jiansheng Ding · 2022
Later among the works it cites.
Fine-tuning can distort pretrained features and underperform out-of-distribution
Ananya Kumar, Aditi Raghunathan, Robbie Jones, Tengyu Ma, and Percy Liang · 2022
Later among the works it cites.
Characterization of mpc-based private inference for transformer-based models
Yongqin Wang, G. Edward Suh, Wenjie Xiong, Benjamin Lefaudeux, Brian Knott, Murali Annavaram, and Hsien-Hsin S. Lee · 2022
Later among the works it cites.
Privformer: Privacy-preserving transformer with mpc
Y. Akimoto, K. Fukuchi, Y. Akimoto, and J. Sakuma · 2023
Closest in time.
Meteor: Improved secure 3-party neural network inference with reducing online communication costs
Ye Dong, Chen Xiaojun, Weizhan Jing, Li Kaiyun, and Weiping Wang · 2023
Closest in time.
MPCFORMER: FAST, PERFORMANT AND PRIVATE TRANSFORMER INFERENCE WITH MPC
Dacheng Li, Hongyi Wang, Rulin Shao, Han Guo, Eric Xing, and Hao Zhang · 2023
Closest in time.
Merge: Fast private text generation, 2023
Zi Liang, Pinghui Wang, Ruofei Zhang, Lifeng Xing, Nuo Xu, and Shuo Zhang · 2023
Closest in time.
Llms can understand encrypted prompt: Towards privacy-computing friendly transformers, 2023
Xuanqi Liu and Zhuotao Liu · 2023
Closest in time.
SecretFlow-SPU: A performant and User-Friendly framework for Privacy-Preserving machine learning
Junming Ma, Yancheng Zheng, Jun Feng, Derun Zhao, Haoqi Wu, Wenjing Fang, Jin Tan, Chaofan Yu, Benyu Zhang, and Lei Wang · 2023
Closest in time.
Llama: Open and efficient foundation language models
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al · 2023
Closest in time.