Large Action Models: From Inception to Implementation

Large language models in medicine

Arun James Thirunavukarasu, Darren Shu Jeng Ting, Kabilan Elangovan, Laura Gutierrez, Ting Fang Tan, and Daniel Shu Wei Ting. 2023 · 1940

Earlier work this paper cites.

Large language models can accurately predict searcher preferences. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval . 1930–1940

Paul Thomas, Seth Spielman, Nick Craswell, and Bhaskar Mitra. 2024 · 1940

Earlier work this paper cites.

Actions speak louder than words: Paralanguage, communication, and education

Alastair Pennycook. 1985 · 1985

Earlier work this paper cites.

Checkpointing and rollback-recovery for distributed systems

Richard Koo and Sam Toueg. 1987 · 1987

Earlier work this paper cites.

A neural system for error detection and compensation

William J Gehring, Brian Goss, Michael GH Coles, David E Meyer, and Emanuel Donchin. 1993 · 1993

Earlier work this paper cites.

Proximal policy optimization algorithms

Original

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017 · 2017

Earlier work this paper cites.

A method for automated user interface testing of windows-based applications. In Proceedings of the 9th International Symposium on Information and Communication Technology . 337–343

Duong Tran Dinh, Pham Ngoc Hung, and Tung Nguyen Duy. 2018 · 2018

Earlier work this paper cites.

Language models are few-shot learners

Original

Tom B Brown. 2020 · 2020

Earlier work this paper cites.

Calibrated language model fine-tuning for in-and out-of-distribution data

Original

Lingkai Kong, Haoming Jiang, Yuchen Zhuang, Jie Lyu, Tuo Zhao, and Chao Zhang. 2020 · 2020

Earlier work this paper cites.

Keep calm and explore: Language models for action generation in text-based games

Original

Shunyu Yao, Rohan Rao, Matthew Hausknecht, and Karthik Narasimhan. 2020 · 2020

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

How can we know when language models know? on the calibration of language models for question answering

Zhengbao Jiang, Jun Araki, Haibo Ding, and Graham Neubig. 2021 · 2021

Earlier work this paper cites.

Finetuned language models are zero-shot learners

Original

Jason Wei, Maarten Bosma, Vincent Y Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le. 2021 · 2021

Earlier work this paper cites.

Language models show human-like content effects on reasoning

Original

Ishita Dasgupta, Andrew K Lampinen, Stephanie CY Chan, Antonia Creswell, Dharshan Kumaran, James L McClelland, and Felix Hill. 2022 · 2022

Earlier work this paper cites.

Large language models still can’t plan (a benchmark for LLMs on planning and reasoning about change). In NeurIPS 2022 Foundation Models for Decision Making Workshop

Karthik Valmeekam, Alberto Olmo, Sarath Sreedharan, and Subbarao Kambhampati. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al · 2022

Earlier work this paper cites.

A systematic evaluation of large language models of code. In Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming . 1–10

Frank F Xu, Uri Alon, Graham Neubig, and Vincent Josua Hellendoorn. 2022 · 2022

Earlier work this paper cites.

React: Synergizing reasoning and acting in language models

Original

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022 · 2022

Earlier work this paper cites.

Guardrails for trust, safety, and ethical development and deployment of Large Language Models (LLM)

Anjanava Biswas and Wrick Talukdar. 2023 · 2023

Earlier work this paper cites.

Grounding large language models in interactive environments with online reinforcement learning. In International Conference on Machine Learning . PMLR, 3676–3713

Thomas Carta, Clément Romac, Thomas Wolf, Sylvain Lamprier, Olivier Sigaud, and Pierre-Yves Oudeyer. 2023 · 2023

Earlier work this paper cites.

Everything of thoughts: Defying the law of penrose triangle for thought generation

Original

Ruomeng Ding, Chaoyun Zhang, Lu Wang, Yong Xu, Minghua Ma, Wei Zhang, Si Qin, Saravan Rajmohan, Qingwei Lin, and Dongmei Zhang. 2023 · 2023

Earlier work this paper cites.

Studying large language model generalization with influence functions

Original

Roger Grosse, Juhan Bae, Cem Anil, Nelson Elhage, Alex Tamkin, Amirhossein Tajdini, Benoit Steiner, Dustin Li, Esin Durmus, Ethan Perez, et al · 2023

Earlier work this paper cites.

Leveraging pre-trained large language models to construct and utilize world models for model-based task planning

Lin Guan, Karthik Valmeekam, Sarath Sreedharan, and Subbarao Kambhampati. 2023 · 2023

Earlier work this paper cites.

Mistral 7B

Original

Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al · 2023

Earlier work this paper cites.

Action-gpt: Leveraging large-scale language models for improved and generalized action generation. In 2023 IEEE International Conference on Multimedia and Expo (ICME) . IEEE, 31–36

Sai Shashank Kalakonda, Shubh Maheshwari, and Ravi Kiran Sarvadevabhatla. 2023 · 2023

Earlier work this paper cites.

Embracing large language models for medical applications: opportunities and challenges

Mert Karabacak and Konstantinos Margetis. 2023 · 2023

Earlier work this paper cites.

ChatGPT for good? On opportunities and challenges of large language models for education

Enkelejda Kasneci, Kathrin Seßler, Stefan Küchemann, Maria Bannert, Daryna Dementieva, Frank Fischer, Urs Gasser, Georg Groh, Stephan Günnemann, Eyke Hüllermeier, et al · 2023

Earlier work this paper cites.

A survey on fairness in large language models

Original

Yingji Li, Mengnan Du, Rui Song, Xin Wang, and Ying Wang. 2023a · 2023

Earlier work this paper cites.

Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators. In Proceedings of the 5th international conference on conversational user interfaces . 1–6

Andreas Liesenfeld, Alianda Lopez, and Mark Dingemanse. 2023 · 2023

Earlier work this paper cites.

Domain specialization as the key to make large language models disruptive: A comprehensive survey

Original

Chen Ling, Xujiang Zhao, Jiaying Lu, Chengyuan Deng, Can Zheng, Junxiang Wang, Tanmoy Chowdhury, Yun Li, Hejie Cui, Xuchao Zhang, et al · 2023

Earlier work this paper cites.

Understanding the benefits and challenges of using large language model-based conversational agents for mental well-being support. In AMIA Annual Symposium Proceedings , Vol. 2023. American Medical Informatics Association, 1105

Zilin Ma, Yiyang Mei, and Zhaoyuan Su. 2023 · 2023

Cited alongside, same era.

The imperative for regulatory oversight of large language models (or generative AI) in healthcare

Bertalan Meskó and Eric J Topol. 2023 · 2023

Cited alongside, same era.

The challenges for regulating medical use of ChatGPT and other large language models

Timo Minssen, Effy Vayena, and I Glenn Cohen. 2023 · 2023

Cited alongside, same era.

Biases in large language models: origins, inventory, and discussion

Roberto Navigli, Simone Conia, and Björn Ross. 2023 · 2023

Cited alongside, same era.

Ethical challenges in the development of virtual assistants powered by large language models

Andrés Piñeiro-Martín, Carmen García-Mateo, Laura Docío-Fernández, and Maria Del Carmen Lopez-Perez. 2023 · 2023

AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation

Mengkang Hu, Pu Zhao, Can Xu, Qingfeng Sun, Jianguang Lou, Qingwei Lin, Ping Luo, Saravan Rajmohan, and Dongmei Zhang. 2024 · 2024

Closest in time.

Rag and rau: A survey on retrieval-augmented language model in natural language processing

Original

Yucheng Hu and Yuxing Lu. 2024 · 2024

Closest in time.

Xpert: Empowering incident management with query recommendations via large language models. In Proceedings of the IEEE/ACM 46th International Conference on Software Engineering . 1–13

Yuxuan Jiang, Chaoyun Zhang, Shilin He, Zhihao Yang, Minghua Ma, Si Qin, Yu Kang, Yingnong Dang, Saravan Rajmohan, Qingwei Lin, et al · 2024

Closest in time.

OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web

Original

Raghav Kapoor, Yash Parag Butala, Melisa Russak, Jing Yu Koh, Kiran Kamble, Waseem Alshikh, and Ruslan Salakhutdinov. 2024 · 2024

Closest in time.