PII-Compass: Guiding LLM training data extraction prompts towards the target PII via grounding

Huggingface’s transformers: State-of-the-art natural language processing

Original

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. 2019 · 1910

Earlier work this paper cites.

The enron email dataset database schema and brief statistical report

Jitesh Shetty and Jafar Adibi. 2004 · 2004

Earlier work this paper cites.

Umap: Uniform manifold approximation and projection for dimension reduction

Original

Leland McInnes, John Healy, and James Melville. 2018 · 2018

Earlier work this paper cites.

Ethicist: Targeted training data extraction through loss smoothed soft prompting and calibrated confidence estimation

Original

Zhexin Zhang, Jiaxin Wen, and Minlie Huang. 2023b · 2019

Earlier work this paper cites.

The pile: An 800gb dataset of diverse text for language modeling

Original

Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, et al. 2020 · 2020

Earlier work this paper cites.

Extracting training data from large language models

Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al. 2021 · 2021

Earlier work this paper cites.

The power of scale for parameter-efficient prompt tuning

Original

Brian Lester, Rami Al-Rfou, and Noah Constant. 2021 · 2021

Earlier work this paper cites.

Quantifying memorization across neural language models

Original

Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramer, and Chiyuan Zhang. 2022 · 2022

Earlier work this paper cites.

Are large pre-trained language models leaking your personal information?

Original

Jie Huang, Hanyin Shao, and Kevin Chen-Chuan Chang. 2022 · 2022

Cited alongside, same era.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E Gonzalez, et al. 2023 · 2023

Cited alongside, same era.

Sok: Memorization in general-purpose large language models

Original

Valentin Hartmann, Anshuman Suri, Vincent Bindschaedler, David Evans, Shruti Tople, and Robert West. 2023 · 2023

Cited alongside, same era.

Training data extraction from pre-trained language models: A survey

Original

Shotaro Ishihara. 2023 · 2023

Cited alongside, same era.

Analyzing leakage of personally identifiable information in language models

Controlling the extraction of memorized data from large language models via prompt-tuning

Original

Mustafa Safa Ozdayi, Charith Peris, Jack FitzGerald, Christophe Dupuy, Jimit Majmudar, Haidar Khan, Rahil Parikh, and Rahul Gupta. 2023 · 2023

Later among the works it cites.

Quantifying association capabilities of large language models and its implications on privacy leakage

Original

Hanyin Shao, Jie Huang, Shen Zheng, and Kevin Chen-Chuan Chang. 2023 · 2023

Later among the works it cites.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023 · 2023

Later among the works it cites.

Bag of tricks for training data extraction from language models

Weichen Yu, Tianyu Pang, Qian Liu, Chao Du, Bingyi Kang, Yan Huang, Min Lin, and Shuicheng Yan. 2023 · 2023

Later among the works it cites.