Recognition, recall, and retention of few-shot memories in large language models

Language models are few-shot learners

Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · 1901

Earlier work this paper cites.

Recognition memory for words, sentences, and pictures

Shepard, R. N. (1967) · 1967

Earlier work this paper cites.

Fifty years of memory for names and faces: A cross-sectional approach

Bahrick, H. P., Bahrick, P. O., and Wittlinger, R. P. (1975) · 1975

Earlier work this paper cites.

Semantic memory content in permastore: Fifty years of memory for Spanish learned in school

Bahrick, H. P. (1984) · 1984

Earlier work this paper cites.

Retention of Spanish vocabulary over 8 years

Bahrick, H. P. and Phelphs, E. (1987) · 1987

Earlier work this paper cites.

On the very long-term retention of knowledge acquired through formal education: Twelve years of cognitive psychology

Conway, M. A., Cohen, G., and Stanhope, N. (1991) · 1991

Earlier work this paper cites.

On the form of forgetting

Wixted, J. T. and Ebbesen, E. B. (1991) · 1991

Earlier work this paper cites.

Very long-term retention of a novel

Stanhope, N., Cohen, G., and Conway, M. (1993) · 1993

Earlier work this paper cites.

One hundred years of forgetting: A quantitative description of retention

Rubin, D. C. and Wenzel, A. E. (1996) · 1996

Cited alongside, same era.

ROUGE: A package for automatic evaluation of summaries

Lin, C.-Y. (2004) · 2004

Cited alongside, same era.

Long-term retention of basic science knowledge: A review study

Custers, E. J. (2010) · 2010

Cited alongside, same era.

Note on the power law of forgetting

Kahana, M. J. and Adler, M. (2017) · 2017

Cited alongside, same era.

The secret sharer: Evaluating and testing unintended memorization in neural networks

Carlini, N., Liu, C., Erlingsson, Ú., Kos, J., and Song, D. (2019) · 2019

Cited alongside, same era.

Extracting training data from large language models

Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T. B., Song, D., Erlingsson, U., et al. (2021) · 2021

Counterfactual memorization in neural language models

Original

Zhang, C., Ippolito, D., Lee, K., Jagielski, M., Tramèr, F., and Carlini, N. (2021) · 2021

Later among the works it cites.

Quantifying memorization across neural language models

Original

Carlini, N., Ippolito, D., Jagielski, M., Lee, K., Tramer, F., and Zhang, C. (2022) · 2022

Later among the works it cites.

Understanding transformer memorization recall through idioms

Original

Haviv, A., Cohen, I., Gidron, J., Schuster, R., Goldberg, Y., and Geva, M. (2022) · 2022

Later among the works it cites.

Preventing verbatim memorization in language models gives a false sense of privacy

Original

Ippolito, D., Tramèr, F., Nasr, M., Zhang, C., Jagielski, M., Lee, K., Choquette-Choo, C. A., and Carlini, N. (2022) · 2022

Later among the works it cites.