Fetching the paper…
Reading the bibliography…
Fine-tuning is a prominent technique to adapt a pre-trained language model to downstream scenarios.
Term-weighting approaches in automatic text retrieval
Gerard Salton and Christopher Buckley · 1988
Earlier work this paper cites.
Broadening the scope of differential privacy using metrics
Konstantinos Chatzikokolakis, Miguel E Andrés, Nicolás Emilio Bordenabe, and Catuscia Palamidessi · 2013
Earlier work this paper cites.
Good debt or bad debt: Detecting semantic orientations in economic texts
Pekka Malo, Ankur Sinha, Pekka Korhonen, Jyrki Wallenius, and Pyry Takala · 2014
Earlier work this paper cites.
Inverting visual representations with convolutional networks
Alexey Dosovitskiy and Thomas Brox · 2016
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Split learning for health: Distributed deep learning without sharing raw patient data
Praneeth Vepakomma, Otkrist Gupta, Tristan Swedish, and Ramesh Raskar · 2018
Earlier work this paper cites.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al · 2018
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova · 2019
Earlier work this paper cites.
Finbert: Financial sentiment analysis with pre-trained language models
Dogu Araci · 2019
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 2019
Earlier work this paper cites.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 2020
Earlier work this paper cites.
Privacy risks of general-purpose language models
Xudong Pan, Mi Zhang, Shouling Ji, and Min Yang · 2020
Earlier work this paper cites.
Information leakage in embedding models
Congzheng Song and Ananth Raghunathan · 2020
Cited alongside, same era.
Splitnn-driven vertical partitioning
Iker Ceballos, Vivek Sharma, Eduardo Mugica, Abhishek Singh, Alberto Roman, Praneeth Vepakomma, and Ramesh Raskar · 2020
Cited alongside, same era.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu · 2020
Cited alongside, same era.
Attacking and protecting data privacy in edge–cloud collaborative inference systems
Zecheng He, Tianwei Zhang, and Ruby B Lee · 2020
Cited alongside, same era.
Differentially private representation for nlp: Formal guarantee and an empirical study on privacy and fairness
Lingjuan Lyu, Xuanli He, and Yitong Li · 2020
Cited alongside, same era.
Natural language understanding with privacy-preserving bert
Chen Qu, Weize Kong, Liu Yang, Mingyang Zhang, Michael Bendersky, and Marc Najork · 2021
Later among the works it cites.
Pyvertical: A vertical federated learning framework for multi-headed splitnn
Daniele Romanini, Adam James Hall, Pavlos Papadopoulos, Tom Titcombe, Abbas Ismail, Tudor Cebere, Robert Sandmann, Robin Roehm, and Michael A Hoeh · 2021
Later among the works it cites.
Extracting training data from large language models
Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al · 2021
Later among the works it cites.
Bitfit: Simple parameter-efficient fine-tuning for transformer-based masked language-models
Elad Ben Zaken, Yoav Goldberg, and Shauli Ravfogel · 2022
Later among the works it cites.
Legal syllogism prompting: Teaching large language models for legal judgment prediction
Cong Jiang and Xiaolei Yang · 2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Towards differentially private text representations
Lingjuan Lyu, Yitong Li, Xuanli He, and Tong Xiao · 2020
Cited alongside, same era.
Privacy-and utility-preserving textual analysis via calibrated multivariate perturbations
Oluwaseyi Feyisetan, Borja Balle, Thomas Drake, and Tom Diethe · 2020
Cited alongside, same era.
Lawformer: A pre-trained language model for chinese legal long documents
Chaojun Xiao, Xueyu Hu, Zhiyuan Liu, Cunchao Tu, and Maosong Sun · 2021
Cited alongside, same era.
A comparison of pre-trained language models for multi-class text classification in the financial domain
Yusuf Arslan, Kevin Allix, Lisa Veiber, Cedric Lothritz, Tegawendé F Bissyandé, Jacques Klein, and Anne Goujon · 2021
Cited alongside, same era.
Lora: Low-rank adaptation of large language models
Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al · 2021
Cited alongside, same era.
Prefix-tuning: Optimizing continuous prompts for generation
Xiang Lisa Li and Percy Liang · 2021
Cited alongside, same era.
The power of scale for parameter-efficient prompt tuning
Brian Lester, Rami Al-Rfou, and Noah Constant · 2021
Cited alongside, same era.
The promise of large language models in health care
Anmol Arora and Ananya Arora · 2023
Closest in time.
Parameter-efficient fine-tuning of large-scale pre-trained language models
Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, et al · 2023
Closest in time.
Privacy-preserving prompt tuning for large language model services
Yansong Li, Zhixing Tan, and Yang Liu · 2023
Closest in time.
Offsite-tuning: Transfer learning without full model
Guangxuan Xiao, Ji Lin, and Song Han · 2023
Closest in time.
Privacy in the time of language models
Charith Peris, Christophe Dupuy, Jimit Majmudar, Rahil Parikh, Sami Smaili, Richard Zemel, and Rahul Gupta · 2023
Closest in time.
Pac privacy: Automatic privacy measurement and control of data processing
Hanshen Xiao and Srinivas Devadas · 2023
Closest in time.