Fetching the paper…
Reading the bibliography…
Can foundation models be guided to execute tasks involving legal reasoning? We believe that building a benchmark to answer this question will require sustained collaborative efforts between the computer science and legal communities.
Legal reasoning
Phoebe C Ellsworth · 2005
Earlier work this paper cites.
Precedent and Analogy in Legal Reasoning
Grant Lamond · 2006
Earlier work this paper cites.
Creating New Pathways to Justice Using Simple Artificial Intelligence and Online Dispute Resolution
Darin Thompson · 2015
Earlier work this paper cites.
The Justice Gap: Measuring the Unmet Civil Legal Needs of Low-Income Americans, 2017
Legal Services Corporation · 2017
Earlier work this paper cites.
How ai can improve access to justice, 2017
Joel Tito · 2017
Earlier work this paper cites.
Opportunities and Obstacles for Deep Learning in Biology and Medicine
Travers Ching, Daniel S Himmelstein, Brett K Beaulieu-Jones, Alexandr A Kalinin, Brian T Do, Gregory P Way, Enrico Ferrero, Paul-Michael Agapow, Michael Zietz, Michael M Hoffman, et al · 2018
Earlier work this paper cites.
Harnessing Machine Learning for Due Diligence: Realizing the Possibilities
Darren Burrell · 2019
Earlier work this paper cites.
Language Models Are Unsupervised Multitask Learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019
Earlier work this paper cites.
AI Goes to Court: The growing Landscape of AI for Access to Justice, Aug 2019
Jonah Wu · 2019
Earlier work this paper cites.
Language models Are Few-Shot Learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 2020
Earlier work this paper cites.
Legal Tech, Civil Procedure, and the Future of Adversarialism
David Freeman Engstrom and Jonah B Gelbach · 2020
Cited alongside, same era.
Algorithmic Accountability in the Administrative State
David Freeman Engstrom and Daniel E Ho · 2020
Cited alongside, same era.
Government by Algorithm: Artificial Intelligence in Federal Administrative Agencies
David Freeman Engstrom, Daniel E Ho, Catherine M Sharkey, and Mariano-Florentino Cuéllar · 2020
Cited alongside, same era.
On the Sizes of OpenAI API Models
Eleuther AI · 2021
Cited alongside, same era.
On the opportunities and risks of foundation models
Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al · 2021
Cited alongside, same era.
CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review
Lucia Zheng, Neel Guha, Brandon R Anderson, Peter Henderson, and Daniel E Ho · 2021
Later among the works it cites.
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English
Ilias Chalkidis, Abhik Jana, Dirk Hartung, Michael Bommarito, Ion Androutsopoulos, Daniel Katz, and Nikolaos Aletras · 2022
Closest in time.
Natural language processing in legal tech
Jens Frankenreiter and Julian Nyarko · 2022
Closest in time.
Artificial Intelligence for Adjudication: The Social Security Administration and AI Governance
Kurt Glaze, Daniel E Ho, Gerald K Ray, and Christine Tsang · 2022
Closest in time.
PromptMaker: Prompt-Based Prototyping with Large Language Models
Ellen Jiang, Kristen Olson, Edwin Toh, Alejandra Molina, Aaron Donsbach, Michael Terry, and Carrie J Cai · 2022
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Dan Hendrycks, Collin Burns, Anya Chen, and Spencer Ball · 2021
Cited alongside, same era.
Epiq Launches Pre-Built NLP Model Strategy For eDiscovery, May 2021
Artificial Lawyer · 2021
Cited alongside, same era.
Jurassic-1: Technical Details and Evaluation
Opher Lieber, Or Sharir, Barak Lenz, and Yoav Shoham · 2021
Cited alongside, same era.
Our Journey Towards Data-Centric AI: A Retrospective, September 2021
Chris Ré and Karan Goel · 2021
Cited alongside, same era.
Legal Reasoning? It’s All About IRAC, Mar 2021
Norman Otto Stockmeyer · 2021
Cited alongside, same era.
PaLM: Scaling Language Modeling with Pathways
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, and Noah Fiedel
Cited in the paper.
Coauthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities
Mina Lee, Percy Liang, and Qian Yang · 2022
Closest in time.
Advances, challenges and opportunities in creating data for trustworthy ai
Weixin Liang, Girmaw Abebe Tadesse, Daniel Ho, Fei-Fei Li, Matei Zaharia, Ce Zhang, and James Zou · 2022
Closest in time.
Beyond the Imitation Game: Quantifying and Extrapolating the Capabilities of Language Models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, et al · 2022
Closest in time.
Chain of thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Ed H. Chi, Quoc Le, and Denny Zhou · 2022
Closest in time.
Promptchainer: Chaining Large Language Model Prompts Through Visual Programming
Tongshuang Wu, Ellen Jiang, Aaron Donsbach, Jeff Gray, Alejandra Molina, Michael Terry, and Carrie J Cai · 2022
Closest in time.