CEBench: A Benchmarking Toolkit for the Cost-Effectiveness of LLM Pipelines

American Psychiatric Association, 2013

Diagnostic and statistical manual of mental disorders (dsm-5-tr) · 2013

Earlier work this paper cites.

The distress analysis interview corpus of human and computer interviews

J. Gratch, R. Artstein, G. M. Lucas, G. Stratou, S. Scherer, A. Nazarian, R. Wood, J. Boberg, D. DeVault, S. Marsella, et al · 2014

Earlier work this paper cites.

Boolq: Exploring the surprising difficulty of natural yes/no questions

C. Clark, K. Lee, M.-W. Chang, T. Kwiatkowski, M. Collins, and K. Toutanova · 2019

Earlier work this paper cites.

Language models as knowledge bases?

Original

F. Petroni, T. Rocktäschel, P. Lewis, A. Bakhtin, Y. Wu, A. H. Miller, and S. Riedel · 2019

Earlier work this paper cites.

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W.-t. Yih, T. Rocktäschel, S. Riedel, and D. Kiela · 2020

Earlier work this paper cites.

How Much Knowledge Can You Pack Into the Parameters of a Language Model?, Oct. 2020

A. Roberts, C. Raffel, and N. Shazeer · 2020

Earlier work this paper cites.

ContractNLI: A dataset for document-level natural language inference for contracts

Y. Koreeda and C. Manning · 2021

Earlier work this paper cites.

WHO, 2022

Who highlights urgent need to transform mental health and mental health care · 2022

Earlier work this paper cites.

A Survey on Retrieval-Augmented Text Generation, Feb. 2022

H. Li, Y. Su, D. Cai, Y. Wang, and L. Liu · 2022

Earlier work this paper cites.

Llmebench: A flexible framework for accelerating llms benchmarking

Original

F. Dalvi, M. Hasanain, S. Boughorbel, B. Mousi, S. Abdaljalil, N. Nazar, A. Abdelali, S. A. Chowdhury, H. Mubarak, A. Ali, et al · 2023

Earlier work this paper cites.

Prompt engineering in large language models

G. Marvin, N. Hellen, D. Jjingo, and J. Nakatumba-Nabende · 2023

Cited alongside, same era.

A study of generative large language model for medical research and healthcare

C. Peng, X. Yang, A. Chen, K. E. Smith, N. PourNejatian, A. B. Costa, C. Martin, M. G. Flores, Y. Zhang, T. Magoc, et al · 2023

Cited alongside, same era.

Welcome to the era of chatgpt et al. the prospects of large language models

T. Teubner, C. M. Flath, C. Weinhardt, W. van der Aalst, and O. Hinz · 2023

Cited alongside, same era.

Openicl: An open-source framework for in-context learning

Z. Wu, Y. Wang, J. Ye, Z. Wu, J. Feng, J. Xu, and Y. Qiao · 2023

Cited alongside, same era.

A survey on model compression and acceleration for pretrained language models

C. Xu and J. McAuley · 2023

Cited alongside, same era.

https://github.com/EleutherAI/lm-evaluation-harness , 2021

https://github.com/openai/evals , 2023

OpenAI Evals · 2024

Closest in time.

https://www.anthropic.com/claude , 2024

Claude 3 · 2024

Closest in time.

https://github.com/meta-llama/llama3 , 2024

Llama3 · 2024

Closest in time.

Retrieval-Augmented Generation for Large Language Models: A Survey, Jan. 2024

Y. Gao, Y. Xiong, X. Gao, K. Jia, J. Pan, Y. Bi, Y. Dai, J. Sun, Q. Guo, M. Wang, and H. Wang · 2024

Closest in time.

Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

N. Guha, J. Nyarko, D. Ho, C. Ré, A. Chilton, A. Chohlas-Wood, A. Peters, B. Waldon, D. Rockmore, D. Zambrano, et al · 2024

Closest in time.

Better call gpt, comparing large language models against lawyers

Original

L. Martin, N. Whitehouse, S. Yiu, L. Catterson, and R. Perera · 2024