Fetching the paper…
Reading the bibliography…
Fine-tuning has emerged as a critical process in leveraging Large Language Models (LLMs) for specific downstream tasks, enabling these models to achieve state-of-the-art performance across various domains.
Sweeney, L.: Guaranteeing anonymity when sharing medical data, the datafly system. In: Proceedings of the AMIA Annual Fall Symposium. p. 51 (1997)
1997
Earlier work this paper cites.
Dwork, C.: Differential privacy. In: International colloquium on automata, languages, and programming. pp. 1–12 (2006)
2006
Earlier work this paper cites.
Mamede, N., Baptista, J., Dias, F.: Automated anonymization of text documents. In: 2016 IEEE Congress on Evolutionary Computation. pp. 1287–1294 (2016)
2016
Earlier work this paper cites.
2018
Earlier work this paper cites.
Feyisetan, O., Diethe, T., Drake, T.: Leveraging Hierarchical Representations for Preserving Privacy and Utility in Text . In: 2019 IEEE International Conference on Data Mining. pp. 210–219 (2019)
2019
Earlier work this paper cites.
Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., De Laroussilhe, Q., Gesmundo, A., Attariyan, M., Gelly, S.: Parameter-efficient transfer learning for nlp. In: International conference on machine learning. pp. 2790–2799 (2019)
2019
Earlier work this paper cites.
Zanella-Béguelin, S., Wutschitz, L., Tople, S., Rühle, V., Paverd, A., Ohrimenko, O., Köpf, B., Brockschmidt, M.: Analyzing information leakage of updates to natural language models. In: Proceedings of the 2020 ACM SIGSAC conference on computer and communications security. pp. 363–375 (2020)
2020
Earlier work this paper cites.
2021
Earlier work this paper cites.
Lester, B., Al-Rfou, R., Constant, N.: The power of scale for parameter-efficient prompt tuning. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. pp. 3045–3059 (2021)
2021
Earlier work this paper cites.
Li, X.L., Liang, P.: Prefix-tuning: Optimizing continuous prompts for generation. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. pp. 4582–4597 (2021)
2021
Earlier work this paper cites.
Yue, X., Du, M., Wang, T., Li, Y., Sun, H., Chow, S.S.M.: Differential privacy for text analytics via natural text sanitization. In: Findings, ACL-IJCNLP 2021 (2021)
2021
Earlier work this paper cites.
Behnia, R., Ebrahimi, M.R., Pacheco, J., Padmanabhan, B.: Ew-tune: A framework for privately fine-tuning large language models with differential privacy. In: 2022 IEEE International Conference on Data Mining Workshops. pp. 560–566 (2022)
2022
Earlier work this paper cites.
Ben Zaken, E., Goldberg, Y., Ravfogel, S.: BitFit: Simple parameter-efficient fine-tuning for transformer-based masked language-models. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. pp. 1–9 (2022)
2022
Earlier work this paper cites.
Gupta, S., Huang, Y., Zhong, Z., Gao, T., Li, K., Chen, D.: Recovering private text in federated learning of language models. Advances in neural information processing systems 35
2022
Earlier work this paper cites.
Hu, E.J., yelong shen, Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W.: LoRA: Low-rank adaptation of large language models. In: International Conference on Learning Representations (2022)
2022
Earlier work this paper cites.
Li, X., Tramer, F., Liang, P., Hashimoto, T.: Large language models can be strong differentially private learners. In: International Conference on Learning Representations (2022)
2022
Earlier work this paper cites.
Meng, K., Bau, D., Andonian, A., Belinkov, Y.: Locating and editing factual associations in gpt. Advances in Neural Information Processing Systems 35
2022
Earlier work this paper cites.
Mireshghallah, F., Uniyal, A., Wang, T., Evans, D.K., Berg-Kirkpatrick, T.: An empirical analysis of memorization in fine-tuned autoregressive language models. In: EMNLP. pp. 1816–1826 (2022)
2022
Cited alongside, same era.
Shi, W., Shea, R., Chen, S., Zhang, C., Jia, R., Yu, Z.: Just fine-tune twice: Selective differential privacy for large language models. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. pp. 6327–6340 (2022)
2022
Cited alongside, same era.
Wu, X., Gong, L., Xiong, D.: Adaptive differential privacy for language model training. In: Proceedings of the First Workshop on Federated Learning for Natural Language Processing. pp. 21–26 (2022)
2022
Cited alongside, same era.
Yu, D., Naik, S., Backurs, A., Gopi, S., Inan, H.A., Kamath, G., Kulkarni, J., Lee, Y.T., Manoel, A., Wutschitz, L., Yekhanin, S., Zhang, H.: Differentially private fine-tuning of language models. In: International Conference on Learning Representations (2022)
2022
2023
Later among the works it cites.
2023
Later among the works it cites.
Ding, Y., Wu, X., Meng, Y., Luo, Y., Wang, H., Pan, W.: Delving into differentially private transformer. In: Proceedings of the 41st International Conference on Machine Learning. vol. 235, p. TBD (2024)
2024
Closest in time.
2024
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Bu, Z., Wang, Y.X., Zha, S., Karypis, G.: Differentially private optimization on large model at small cost. In: Proceedings of the 40th International Conference on Machine Learning (2023)
2023
Cited alongside, same era.
Chen, J., Yang, D.: Unlearn what you want to forget: Efficient unlearning for llms. In: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. pp. 12041–12052 (2023)
2023
Cited alongside, same era.
2023
Cited alongside, same era.
2023
Cited alongside, same era.
2023
Cited alongside, same era.
Igamberdiev, T., Habernal, I.: Dp-bart for privatized text rewriting under local differential privacy. In: Findings of the Association for Computational Linguistics: ACL 2023. pp. 13914–13934 (2023)
2023
Cited alongside, same era.
Jang, J., Yoon, D., Yang, S., Cha, S., Lee, M., Logeswaran, L., Seo, M.: Knowledge unlearning for mitigating privacy risks in language models. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. pp. 14389–14408 (2023)
2023
Cited alongside, same era.
2023
Cited alongside, same era.
2024
Closest in time.
2024
Closest in time.
Liu, X.Y., Zhu, R., Zha, D., Gao, J., Zhong, S., White, M., Qiu, M.: Differentially private low-rank adaptation of large language model using federated learning (2024)
2024
Closest in time.
2024
Closest in time.
Sun, J., Xu, Z., Yin, H., Yang, D., Xu, D., Chen, Y., Roth, H.R.: FedBPT: Efficient federated black-box prompt tuning for large language models (2024)
2024
Closest in time.
Tong, M., Chen, K., Zhang, J., Qi, Y., Zhang, W., Yu, N., Zhang, T., Zhang, Z.: Inferdpt: Privacy-preserving inference for black-box large language model (2024)
2024
Closest in time.
Vats, A., Liu, Z., Su, P., Paul, D., Ma, Y., Pang, Y., Ahmed, Z., Kalinli, O.: Recovering from privacy-preserving masking with large language models. In: ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing. pp. 10771–10775 (2024)
2024
Closest in time.
2024
Closest in time.
Xu, M., Cai, D., Wu, Y., Li, X., Wang, S.: FwdLLM: Efficient federated finetuning of large language models with perturbed inferences. In: 2024 USENIX Annual Technical Conference. pp. 579–596 (2024)
2024
Closest in time.
2024
Closest in time.
Yan, J., Yadav, V., Li, S., Chen, L., Tang, Z., Wang, H., Srinivasan, V., Ren, X., Jin, H.: Backdooring instruction-tuned large language models with virtual prompt injection. In: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. pp. 6065–6086 (2024)
2024
Closest in time.
Zhang, J., Vahidian, S., Kuo, M., Li, C., Zhang, R., Yu, T., Wang, G., Chen, Y.: Towards building the federatedgpt: Federated instruction tuning. In: ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing. pp. 6915–6919 (2024)
2024
Closest in time.
2024
Closest in time.