AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools

The theory of affordances

James J Gibson. 1977 · 1977

Earlier work this paper cites.

Lexical and pragmatic considerations of input structures

William Buxton. 1983 · 1983

Earlier work this paper cites.

Direct manipulation interfaces

Edwin L Hutchins, James D Hollan, and Donald A Norman. 1985 · 1985

Earlier work this paper cites.

Cognitive engineering

Donald A Norman. 1986 · 1986

Earlier work this paper cites.

Designing as reflective conversation with the materials of a design situation

D. A. Schön. 1992 · 1992

Earlier work this paper cites.

Toolglass and magic lenses: the see-through interface. In Conference Companion on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’94) . Association for Computing Machinery, New York, NY, USA, 445–446

Eric A. Bier, Maureen C. Stone, Ken Pier, Ken Fishkin, Thomas Baudel, Matt Conway, William Buxton, and Tony DeRose. 1994 · 1994

Earlier work this paper cites.

Chunking and phrasing and the design of human-computer dialogues

William Buxton. 1995 · 1995

Earlier work this paper cites.

The intelligent use of space

David Kirsh. 1995 · 1995

Earlier work this paper cites.

HCI, natural science and design: a framework for triangulation across disciplines. In Proceedings of the 2nd conference on Designing interactive systems: processes, practices, methods, and techniques . Association for Computing Machinery, New York, NY, USA, 223–234

Wendy E Mackay and Anne-Laure Fayard. 1997 · 1997

Earlier work this paper cites.

Design galleries: a general approach to setting parameters for computer graphics and animation. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’97) . ACM Press/Addison-Wesley Publishing Co., USA, 389–400

J. Marks, B. Andalman, P. A. Beardsley, W. Freeman, S. Gibson, J. Hodgins, T. Kang, B. Mirtich, H. Pfister, W. Ruml, K. Ryall, J. Seims, and S. Shieber. 1997 · 1997

Earlier work this paper cites.

Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems . Association for Computing Machinery, New York, NY, USA, 159–166

Eric Horvitz. 1999 · 1999

Earlier work this paper cites.

Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems . Association for Computing Machinery, New York, NY, USA, 446–453

Michel Beaudouin-Lafon. 2000 · 2000

Earlier work this paper cites.

Reification, polymorphism and reuse: three principles for designing visual interfaces. In Proceedings of the working conference on Advanced visual interfaces . Association for Computing Machinery, New York, NY, USA, 102–109

Michel Beaudouin-Lafon and Wendy E Mackay. 2000 · 2000

Earlier work this paper cites.

Activity Theory and Distributed Cognition: Or What Does CSCW Need to DO with Theories?

Christine A. Halverson. 2002 · 2002

Earlier work this paper cites.

Which interaction technique works when? Floating palettes, marking menus and toolglasses support different task strategies. In Proceedings of the Working Conference on Advanced Visual Interfaces . Association for Computing Machinery, New York, NY, USA, 203–208

Wendy E Mackay. 2002 · 2002

Earlier work this paper cites.

Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03) . Association for Computing Machinery, New York, NY, USA, 17–24

Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, and Björn Eiderbäck. 2003 · 2003

Earlier work this paper cites.

Context matters: Evaluating interaction techniques with the CIS model. In People and Computers XVIII—Design for Life: Proceedings of HCI 2004 . Springer, Springer, New York, NY, USA, 279–295

Caroline Appert, Michel Beaudouin-Lafon, and Wendy E Mackay. 2005 · 2004

Earlier work this paper cites.

Six learning barriers in end-user programming systems. In 2004 IEEE Symposium on Visual Languages-Human Centric Computing . IEEE, IEEE, New York, NY, USA, 199–206

Amy J Ko, Brad A Myers, and Htet Htet Aung. 2004 · 2004

Earlier work this paper cites.

New Theoretical Approaches for Human-Computer Interaction

Yvonne Rogers. 2004 · 2004

Earlier work this paper cites.

Supporting creativity in distributed scientific communities. In Proceedings of the 2005 ACM International Conference on Supporting Group Work . Association for Computing Machinery, New York, NY, USA, 217–226

Umer Farooq, John M Carroll, and Craig H Ganoe. 2005 · 2005

Earlier work this paper cites.

Reflective physical prototyping through integrated design, test, and analysis. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST ’06) . Association for Computing Machinery, New York, NY, USA, 299–308

Björn Hartmann, Scott R. Klemmer, Michael Bernstein, Leith Abdulla, Brandon Burr, Avi Robinson-Mosher, and Jennifer Gee. 2006 · 2006

Earlier work this paper cites.

Getting the right design and the design right. In Proceedings of the SIGCHI conference on Human Factors in computing systems . 1243–1252

Maryam Tohidi, William Buxton, Ronald Baecker, and Abigail Sellen. 2006 · 2006

Earlier work this paper cites.

Sketching User Experiences: Getting the Design Right and the Right Design

Bill Buxton. 2007 · 2007

Earlier work this paper cites.

TEAM STORM: demonstrating an interaction model for working with multiple ideas during creative group work. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (Washington, DC, USA) (C&C ’07) . Association for Computing Machinery, New York, NY, USA, 193–202

Joshua Hailpern, Erik Hinterbichler, Caryn Leppert, Damon Cook, and Brian P. Bailey. 2007 · 2007

Earlier work this paper cites.

A suggestive interface for 3D drawing. In ACM SIGGRAPH 2007 Courses (San Diego, California) (SIGGRAPH ’07) . Association for Computing Machinery, New York, NY, USA, 20–es

Takeo Igarashi and John F. Hughes. 2007 · 2007

Earlier work this paper cites.

Creativity support tools: accelerating discovery and innovation

Ben Shneiderman. 2007 · 2007

Earlier work this paper cites.

Mood boards: Current practice in learning and teaching strategies and students’ understanding of the process

Tracy Diane Cassidy. 2008 · 2008

Cited alongside, same era.

Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems . Association for Computing Machinery, New York, NY, USA, 201–210

Robert JK Jacob, Audrey Girouard, Leanne M Hirshfield, Michael S Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008 · 2008

Cited alongside, same era.

HCI Theory: Classical, Modern, and Contemporary (1 ed.)

Yvonne Rogers. 2012 · 2012

Cited alongside, same era.

An enactive model of creativity for computational collaboration and co-creation

Nicholas Davis, Chih-Pin Hsiao, Yanna Popova, and Brian Magerko. 2015 · 2015

Cited alongside, same era.

Storeoboard: Sketching Stereoscopic Storyboards. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16) . Association for Computing Machinery, New York, NY, USA, 4587–4598

Cells, generators, and lenses: Design framework for object-oriented interaction with large language models. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . Association for Computing Machinery, New York, NY, USA, 1–18

Tae Soo Kim, Yoonjoo Lee, Minsuk Chang, and Juho Kim. 2023 · 2023

Later among the works it cites.

Segment Anything

Original

Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollár, and Ross Girshick. 2023 · 2023

Later among the works it cites.

Beyond the Artifact: Power as a Lens for Creativity Support Tools. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . Association for Computing Machinery, New York, NY, USA, 1–15

Jingyi Li, Eric Rawn, Jacob Ritchie, Jasper Tran O’Leary, and Sean Follmer. 2023 · 2023

Later among the works it cites.

Beyond Text-to-Image: Multimodal Prompts to Explore Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23) . Association for Computing Machinery, New York, NY, USA, 1–6