Unlocking Context Constraints of LLMs: Enhancing Context Efficiency of LLMs with Self-Information-Based Content Filtering

A mathematical theory of communication

Shannon, C. E · 1948

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation

Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J · 2002

Earlier work this paper cites.

Rouge: A package for automatic evaluation of summaries

Lin, C.-Y · 2004

Earlier work this paper cites.

Meteor: An automatic metric for mt evaluation with improved correlation with human judgments

Banerjee, S. and Lavie, A · 2005

Earlier work this paper cites.

Attention is all you need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I · 2017

Cited alongside, same era.

Bertscore: Evaluating text generation with bert

Original

Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., and Artzi, Y · 2019

Cited alongside, same era.

Language models are few-shot learners

Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al · 2020

Cited alongside, same era.

Sparks of artificial general intelligence: Early experiments with gpt-4

Original

Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al · 2023

Closest in time.

A survey on long text modeling with transformers

Original

Dong, Z., Tang, T., Li, L., and Zhao, W. X · 2023

Closest in time.

Llama: Open and efficient foundation language models

Original

Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al · 2023

Closest in time.