Model Behavior Specification by Leveraging LLM Self-Playing and Self-Improving

Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research

Sandra G Hart and Lowell E Staveland. 1988 · 1988

Earlier work this paper cites.

" Yours is better!" participant response bias in HCI. In Proceedings of the sigchi conference on human factors in computing systems . 1321–1330

Nicola Dell, Vidya Vaidyanathan, Indrani Medhi, Edward Cutrell, and William Thies. 2012 · 2012

Earlier work this paper cites.

Local Standards for Sample Size at CHI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16) . Association for Computing Machinery, New York, NY, USA, 981–992

Kelly Caine. 2016 · 2016

Earlier work this paper cites.

On the opportunities and risks of foundation models

Original

Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al · 2021

Earlier work this paper cites.

Protochat: Supporting the conversation design process with crowd feedback

Yoonseo Choi, Toni-Jan Keith Palma Monserrat, Jeongeon Park, Hyungyu Shin, Nyoungwoo Lee, and Juho Kim. 2021 · 2021

Earlier work this paper cites.

Facilitating knowledge sharing from domain experts to data scientists for building nlp models. In 26th International Conference on Intelligent User Interfaces . 585–596

Soya Park, April Yi Wang, Ban Kawas, Q Vera Liao, David Piorkowski, and Marina Danilevsky. 2021 · 2021

Earlier work this paper cites.

How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study

David Piorkowski, Soya Park, April Yi Wang, Dakuo Wang, Michael Muller, and Felix Portnoy. 2021 · 2021

Earlier work this paper cites.

Constitutional ai: Harmlessness from ai feedback

Original

Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, et al · 2022

Earlier work this paper cites.

Promptagator: Few-shot dense retrieval from 8 examples

Original

Zhuyun Dai, Vincent Y Zhao, Ji Ma, Yi Luan, Jianmo Ni, Jing Lu, Anton Bakalov, Kelvin Guu, Keith B Hall, and Ming-Wei Chang. 2022 · 2022

Earlier work this paper cites.

Improving alignment of dialogue agents via targeted human judgements

Original

Amelia Glaese, Nat McAleese, Maja Trębacz, John Aslanides, Vlad Firoiu, Timo Ewalds, Maribeth Rauh, Laura Weidinger, Martin Chadwick, Phoebe Thacker, et al · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022

Earlier work this paper cites.

Self-instruct: Aligning language models with self-generated instructions

Original

Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu, Noah A Smith, Daniel Khashabi, and Hannaneh Hajishirzi. 2022 · 2022

Earlier work this paper cites.

Automatic chain of thought prompting in large language models

Original

Zhuosheng Zhang, Aston Zhang, Mu Li, and Alex Smola. 2022 · 2022

Earlier work this paper cites.

Prompting for Discovery: Flexible Sense-Making for AI Art-Making with Dreamsheets

Original

Shm Garanganao Almeda, JD Zamfirescu-Pereira, Kyu Won Kim, Pradeep Mani Rathnam, and Bjoern Hartmann. 2023 · 2023

Earlier work this paper cites.

ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing

Original

Ian Arawjo, Chelse Swoopes, Priyan Vaithilingam, Martin Wattenberg, and Elena Glassman. 2023 · 2023

Earlier work this paper cites.

Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23) . Association for Computing Machinery, New York, NY, USA, Article 96, 14 pages

Stephen Brade, Bryan Wang, Mauricio Sousa, Sageev Oore, and Tovi Grossman. 2023 · 2023

Earlier work this paper cites.

PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactions. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23) . Association for Computing Machinery, New York, NY, USA, Article 6, 17 pages

John Joon Young Chung and Eytan Adar. 2023 · 2023

Earlier work this paper cites.

Promptbreeder: Self-referential self-improvement via prompt evolution

Original

Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, and Tim Rocktäschel. 2023 · 2023

Cited alongside, same era.

Connecting large language models with evolutionary algorithms yields powerful prompt optimizers

Original

Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, and Yujiu Yang. 2023 · 2023

Cited alongside, same era.

Unlocking the Potential of User Feedback: Leveraging Large Language Model as User Simulators to Enhance Dialogue System. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management (CIKM ’23) . Association for Computing Machinery, New York, NY, USA, 3953–3957

Zhiyuan Hu, Yue Feng, Anh Tuan Luu, Bryan Hooi, and Aldo Lipani. 2023 · 2023

Cited alongside, same era.

Graphologue: Exploring Large Language Model Responses with Interactive Diagrams. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23) . Association for Computing Machinery, New York, NY, USA, Article 3, 20 pages

Star-gate: Teaching language models to ask clarifying questions

Original

Chinmaya Andukuri, Jan-Philipp Fränken, Tobias Gerstenberg, and Noah D Goodman. 2024 · 2024

Later among the works it cites.

Dices dataset: Diversity in conversational ai evaluation for safety

Lora Aroyo, Alex Taylor, Mark Diaz, Christopher Homan, Alicia Parrish, Gregory Serapio-García, Vinodkumar Prabhakaran, and Ding Wang. 2024 · 2024

Later among the works it cites.

Prompt Guide

Stable Diffusion Art. 2024 · 2024

Later among the works it cites.

Graph of thoughts: Solving elaborate problems with large language models. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 38. 17682–17690

Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Michal Podstawski, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Hubert Niewiadomski, Piotr Nyczyk, et al · 2024

Later among the works it cites.

PhaseEvo: Towards Unified In-Context Prompt Optimization for Large Language Models

Original