The Fire Thief Is Also the Keeper: Balancing Usability and Privacy in Prompts

N. Carlini, S. Chien, M. Nasr, S. Song, A. Terzis, and F. Tramer, “Membership inference attacks from first principles,” in 2022 IEEE Symposium on Security and Privacy (SP) . IEEE, 2022, pp. 1897–1914

1914

Earlier work this paper cites.

G. A. Miller, “Wordnet: a lexical database for english,” Communications of the ACM , vol. 38, no. 11, pp. 39–41, 1995

1995

Earlier work this paper cites.

C. E. Shannon, “A mathematical theory of communication,” ACM SIGMOBILE mobile computing and communications review , vol. 5, no. 1, pp. 3–55, 2001

2001

Earlier work this paper cites.

H. Nissenbaum, “Privacy as contextual integrity,” Wash. L. Rev. , vol. 79, p. 119, 2004

2004

Earlier work this paper cites.

C. Dwork, “Differential privacy,” in International colloquium on automata, languages, and programming . Springer, 2006, pp. 1–12

2006

Earlier work this paper cites.

D. Nadeau and S. Sekine, “A survey of named entity recognition and classification,” Lingvisticae Investigationes , vol. 30, no. 1, pp. 3–26, 2007

2007

Earlier work this paper cites.

C. Cumby and R. Ghani, “A machine learning based system for semi-automatically redacting documents,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 25, no. 2, 2011, pp. 1628–1635

2011

Earlier work this paper cites.

T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” arXiv preprint arXiv:1301.3781 , 2013

Original

2013

Earlier work this paper cites.

J. Pennington, R. Socher, and C. D. Manning, “Glove: Global vectors for word representation,” in Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) , 2014, pp. 1532–1543

2014

Earlier work this paper cites.

M. Abadi, A. Chu, I. Goodfellow, H. B. McMahan, I. Mironov, K. Talwar, and L. Zhang, “Deep learning with differential privacy,” in Proceedings of the 2016 ACM SIGSAC conference on computer and communications security , 2016, pp. 308–318

2016

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017

2017

Earlier work this paper cites.

R. Shetty, B. Schiele, and M. Fritz, “ { \{ A4NT } \} : Author attribute anonymity by adversarial training of neural machine translation,” in 27th USENIX Security Symposium (USENIX Security 18) , 2018, pp. 1633–1650

2018

Earlier work this paper cites.

M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer, “Deep contextualized word representations,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) , 2018, pp. 2227–2237

2018

Earlier work this paper cites.

N. Papernot, S. Song, I. Mironov, A. Raghunathan, K. Talwar, and Ú. Erlingsson, “Scalable private learning with pate,” arXiv preprint arXiv:1802.08908 , 2018

Original

2018

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , 2019, pp. 4171–4186

2019

Earlier work this paper cites.

A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al. , “Language models are unsupervised multitask learners,” OpenAI blog , vol. 1, no. 8, p. 9, 2019

2019

Earlier work this paper cites.

Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. Zettlemoyer, and V. Stoyanov, “Roberta: A robustly optimized bert pretraining approach,” arXiv preprint arXiv:1907.11692 , 2019

Original

2019

Earlier work this paper cites.

J. Bevendorff, M. Potthast, M. Hagen, and B. Stein, “Heuristic authorship obfuscation,” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , 2019, pp. 1098–1108

2019

Earlier work this paper cites.

A. Mahmood, F. Ahmad, Z. Shafiq, P. Srinivasan, and F. Zaffar, “A girl has no name: Automated authorship obfuscation using mutant-x,” Proceedings on Privacy Enhancing Technologies , 2019

2019

Earlier work this paper cites.

O. Feyisetan, T. Diethe, and T. Drake, “Leveraging hierarchical representations for preserving privacy and utility in text,” in 2019 IEEE International Conference on Data Mining (ICDM) . IEEE, 2019, pp. 210–219

2019

Earlier work this paper cites.

B. Gliwa, I. Mochol, M. Biesek, and A. Wawer, “Samsum corpus: A human-annotated dialogue dataset for abstractive summarization,” arXiv preprint arXiv:1911.12237 , 2019

Original

2019

Earlier work this paper cites.

N. Reimers and I. Gurevych, “Sentence-bert: Sentence embeddings using siamese bert-networks,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , 2019, pp. 3982–3992

2019

Earlier work this paper cites.

Y. Huang, Z. Song, D. Chen, K. Li, and S. Arora, “Texthide: Tackling data privacy in language understanding tasks,” in Findings of the Association for Computational Linguistics: EMNLP 2020 , 2020, pp. 1368–1382

2020

Earlier work this paper cites.

X. Pan, M. Zhang, S. Ji, and M. Yang, “Privacy risks of general-purpose language models,” in 2020 IEEE Symposium on Security and Privacy (SP) . IEEE, 2020, pp. 1314–1331

2020

Earlier work this paper cites.

O. Feyisetan, B. Balle, T. Drake, and T. Diethe, “Privacy-and utility-preserving textual analysis via calibrated multivariate perturbations,” in Proceedings of the 13th international conference on web search and data mining , 2020, pp. 178–186

2020

Earlier work this paper cites.

T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020

2020

Earlier work this paper cites.

M. Lewis, Y. Liu, N. Goyal, M. Ghazvininejad, A. Mohamed, O. Levy, V. Stoyanov, and L. Zettlemoyer, “Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , 2020, pp. 7871–7880

2020

Cited alongside, same era.

D. Jin, E. Pan, N. Oufattole, W.-H. Weng, H. Fang, and P. Szolovits, “What disease does this patient have? a large-scale open domain question answering dataset from medical exams,” arXiv preprint arXiv:2009.13081 , 2020

Original

2020

Cited alongside, same era.

L. Lyu, Y. Li, X. He, and T. Xiao, “Towards differentially private text representations,” in Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval , 2020, pp. 1813–1816

2020

Cited alongside, same era.

B. Lester, R. Al-Rfou, and N. Constant, “The power of scale for parameter-efficient prompt tuning,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , 2021, pp. 3045–3059

C. Xu and J. McAuley, “A survey on model compression and acceleration for pretrained language models,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 37, no. 9, 2023, pp. 10 566–10 575

2023

Later among the works it cites.

X. Zhou, Y. Lu, R. Ma, T. Gui, Q. Zhang, and X.-J. Huang, “Textmixer: Mixing multiple inputs for privacy-preserving inference,” in Findings of the Association for Computational Linguistics: EMNLP 2023 , 2023, pp. 3749–3762

2023

Later among the works it cites.

M. Du, X. Yue, S. S. Chow, and H. Sun, “Sanitizing sentence embeddings (and labels) for local differential privacy,” in Proceedings of the ACM Web Conference 2023 , 2023, pp. 2349–2359

2023

Later among the works it cites.

Y. Chen, T. Li, H. Liu, and Y. Yu, “Hide and seek (has): A lightweight framework for prompt privacy protection,” arXiv preprint arXiv:2309.03057 , 2023

Original

2023

Later among the works it cites.