Fetching the paper…

Reading the bibliography…

Better Call GPT, Comparing Large Language Models Against Lawyers · Around

2024

Better Call GPT, Comparing Large Language Models Against Lawyers

Martin, Lauren, Whitehouse, Nick, Yiu, Stephanie et al.

Original
PDF
Post on X

Understand

This paper presents a groundbreaking comparison between Large Language Models and traditional legal contract reviewers, Junior Lawyers and Legal Process Outsourcers.

We dissect whether LLMs can outperform humans in accuracy, speed, and cost efficiency during contract review.
Our empirical analysis benchmarks LLMs against a ground truth set by Senior Lawyers, uncovering that advanced models match or exceed human accuracy in determining legal issues.
In speed, LLMs complete reviews in mere seconds, eclipsing the hours required by their human counterparts.

Built on

Coefficient alpha and the internal structure of tests
L. J. Cronbach · 1951
Earlier work this paper cites.
Amazon titan: A large language model
Amazon · 2023
Earlier work this paper cites.
Palm 2 technical report
Original
R. Anil, A. M. Dai, O. Firat, M. Johnson, D. Lepikhin, A. Passos, S. Shakeri, E. Taropa, P. Bailey, Z. Chen, et al · 2023
Earlier work this paper cites.
Generative ai and finding the law
P. D. Callister · 2023
Earlier work this paper cites.

Similar

Chatgpt goes to law school
J. H. Choi, K. E. Hickman, A. Monahan, and D. Schwarcz · 2023
Cited alongside, same era.
Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models, 2023
N. Guha, J. Nyarko, D. E. Ho, C. Ré, A. Chilton, A. Narayana, A. Chohlas-Wood, A. Peters, B. Waldon, D. N. Rockmore, D. Zambrano, D. Talisman, E. Hoque, F. Surani, F. Fagan, G. Sarfaty, G. M. Dickinson, H. Porat, J. Hegland, J. Wu, J. Nudell, J. Niklaus, J. Nay, J. H. Choi, K. Tobia, M. Hagan, M. Ma, M. Livermore, N. Rasumov-Rahe, N. Holzenberger, N. Kolt, P. Henderson, S. Rehaag, S. Goel, S. Gao, S. Williams, S. Gandhi, T. Zur, V. Iyer, and Z. Li · 2023
Cited alongside, same era.
2023 law department compensation survey
A. of Corporate Counsel · 2023
Cited alongside, same era.
Gpt-4 technical report. arxiv 2303.08774
OpenAI · 2023
Cited alongside, same era.

Then

Chatgpt as an artificial lawyer?
J. Tan, H. Westermann, and K. Benyekhlef · 2023
Later among the works it cites.
Claude: A large language model
A. Team · 2023
Later among the works it cites.
Llama 2: Open foundation and fine-tuned chat models
Original
H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale, et al · 2023
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…