How Do Analysts Understand and Verify AI-Assisted Data Analyses?

The cost structure of sensemaking

Daniel M. Russell, Mark Stefik, Peter Pirolli, and Stuart K. Card. 1993 · 1993

Earlier work this paper cites.

How HCI interprets the probes. In Proceedings of the SIGCHI conference on Human factors in computing systems . 1077–1086

Kirsten Boehner, Janet Vertesi, Phoebe Sengers, and Paul Dourish. 2007 · 2007

Earlier work this paper cites.

A Data–Frame Theory of Sensemaking

Gary Klein, Jennifer K. Phillips, Erica Rall, and Deborah A. Peluso. 2007 · 2007

Earlier work this paper cites.

The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis

Peter Pirolli. 2007 · 2007

Earlier work this paper cites.

How Information Visualization Novices Construct Visualizations

Lars Grammel, Melanie Tory, and Margaret-Anne D. Storey. 2010 · 2010

Earlier work this paper cites.

Complacency and Bias in Human Use of Automation: An Attentional Integration

Raja Parasuraman and Dietrich Manzey. 2010 · 2010

Earlier work this paper cites.

The state of the art in end-user software engineering

Amy J. Ko, Robin Abraham, Laura Beckwith, Alan F. Blackwell, Margaret M. Burnett, Martin Erwig, Christopher Scaffidi, Joseph Lawrance, Henry Lieberman, Brad A. Myers, Mary Beth Rosson, Gregg Rothermel, Mary Shaw, and Susan Wiedenbeck. 2011 · 2011

Earlier work this paper cites.

Visual analytic roadblocks for novice investigators

Bum Chul Kwon, Brian D. Fisher, and Ji Soo Yi. 2011 · 2011

Earlier work this paper cites.

Discovering statistics using R, 1st Edition

Andy P. Field, Jeremy Miles, and Zoë Field. 2012 · 2012

Earlier work this paper cites.

Enterprise Data Analysis and Visualization: An Interview Study

Sean Kandel, Andreas Paepcke, Joseph M. Hellerstein, and Jeffrey Heer. 2012 · 2012

Earlier work this paper cites.

Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives

Barbara Ubaldi. 2013 · 2013

Earlier work this paper cites.

A Cognitive Interpretation of Data Analysis

Garrett Grolemund and Hadley Wickham. 2014 · 2014

Earlier work this paper cites.

NLyze: interactive programming by natural language for spreadsheet data analysis and manipulation

Sumit Gulwani and Mark Marron. 2014 · 2014

Earlier work this paper cites.

From Data to Insight: Work Practices of Analysts in the Enterprise

Eser Kandogan, Aruna D. Balakrishnan, Eben M. Haber, and Jeffrey S. Pierce. 2014 · 2014

Earlier work this paper cites.

Estimating the reproducibility of psychological science

Alexander A. Aarts, Joanna E. Anderson, Christopher J. Anderson, Peter Raymond Attridge, Angela S. Attwood, Jordan R. Axt, Molly Babel, Štěpán Bahník, Erica Baranski, Michael Barnett-Cowan, Elizabeth Bartmess, Jennifer S. Beer, Raoul Bell, Heather Bentley, Leah Beyan, Grace Binion, Denny Borsboom, Annick Bosch, Frank Bosco, Sara D. Bowman, Mark John Brandt, Erin L Braswell, Hilmar Brohmer, Benjamin Thomas Brown, Kristina Brown, Jovita Brüning, Ann Calhoun-Sauls, Shannon P. Callahan, Elizabeth Chagnon, Jesse J. Chandler, Christopher R. Chartier, Felix Cheung, Cody Daniel Christopherson, Linda Cillessen, Russ Clay, Hayley M. D. Cleary, Mark D. Cloud, Michael Conn, Joanne McGrath Cohoon, Simon Columbus, Andreas Cordes, Giulio Costantini, Leslie D. Cramblet Alvarez, Edward J. Cremata, Jan Crusius, Jamie DeCoster, M. DeGaetano, Nicolás Delia Penna, Bobby Den Bezemer, Marie Katharina Deserno, Olivia Devitt, Laura Dewitte, David G. Dobolyi, Geneva T. Dodson, M. Brent Donnellan, Ryan Donohue, Rebecca A. Dore, Angela Rachael Dorrough, Anna Dreber, Michelle Dugas, Elizabeth W. Dunn, Kayleigh E. Easey, Sylvia Eboigbe, Casey Eggleston, Jo Embley, Sacha Epskamp, Timothy M. Errington, Vivien Estel, Frank J. Farach, Jenelle Feather, Anna Fedor, Belén Fernández-Castilla, Susann Fiedler, James G. Field, Stanka A. Fitneva, Taru Flagan, Amanda L. Forest, Eskil Forsell, Joshua D. Foster, Michael C. Frank, Rebecca S. Frazier, Heather M. Fuchs, Philip A Gable, Jeff Galak, Elisa Maria Galliani, Anup Gampa, Sara Garcia, Douglas Gazarian, Elizabeth Rees Gilbert, Roger Giner-Sorolla, Andreas Glöckner, Lars Goellner, Jin X. Goh, Rebecca M. Goldberg, Patrick T. Goodbourn, Shauna Gordon-McKeon, Bryan H. Gorges, Jessie Gorges, Justin Goss, Jesse Graham, James A. Grange, Jeremy R. Gray, C.H.J. Hartgerink, Joshua K. Hartshorne, Fred Hasselman, Timothy Hayes, Emma Heikensten, Felix Henninger, John Hodsoll, Taylor Holubar, G. C. Hoogendoorn, Denise J. Humphries, Cathy On-Ying Hung, Nathali Immelman, Vanessa C. Irsik, Georg Jahn, Frank Jäkel, Marc Jekel, Magnus Johannesson, Larissa Gabrielle Johnson, David J. Johnson, Kate M. Johnson, William Johnston, Kai J. Jonas, Jennifer A. Joy-Gaba, Heather Barry Kappes, Kim Kelso, Mallory C. Kidwell, Seung K. Kim, Matthew W. Kirkhart, Bennett Kleinberg, Goran Knežević, Franziska Maria Kolorz, Jolanda Jacqueline Kossakowski, Robert W. Krause, J.M.T. Krijnen, Tim Kuhlmann, Yoram K. Kunkels, Megan M. Kyc, Calvin K. Lai, Aamir Laique, Daniel Lakens, Kristin A. Lane, Bethany Lassetter, Ljiljana B. Lazarević, Etienne P. Le Bel, Key Jung Lee, Minha Lee, Kristi M. Lemm, Carmel A. Levitan, Melissa Lewis, Lin Lin, Stephanie C. Lin, Matthias Lippold, Darren Loureiro, Ilse Luteijn, Sean P. Mackinnon, Heather N. Mainard, Denise C. Marigold, Daniel P. Martin, Tylar Martinez, E. J. Masicampo, Joshua J. Matacotta, Maya B. Mathur, Michael May, Nicole C Mechin, Pranjal H. Mehta, Johannes M. Meixner, Alissa Melinger, Jeremy K. Miller, Mallorie Miller, Katherine Sledge Moore, Marcus Möschl, Matt Motyl, Stephanie L. Muller, Marcus Robert Munafo, Koen Ilja Neijenhuijs, Taylor Nervi, Gandalf Nicolas, Gustav Nilsonne, Brian A. Nosek, Michèle B. Nuijten, Catherine Olsson, Colleen Osborne, Lutz Ostkamp, Misha Pavel, Ian S. Penton-Voak, Olivia Kathleen Perna, Cyril R. Pernet, Marco Perugini, R. Nathan Pipitone, Michael C. Pitts, Franziska Plessow, Jason Prenoveau, Rima-Maria Rahal, Kate A. Ratliff, David A. Reinhard, Frank Renkewitz, Ashley A. Ricker, Anastasia E. Rigney, Andrew M Rivers, Mark A. Roebke, Abraham M. Rutchick, Robert S. Ryan, Onur Şahin, Anondah Saide, Gillian M. Sandstrom, David Santos, Rebecca Saxe, René Schlegelmilch, Kathleen Schmidt, Sabine Scholz, Larissa Seibel, Dylan Selterman, Samuel Shaki, William Brand Simpson, H. Colleen Sinclair, Jeanine L. M. Skorinko, Agnieszka Slowik, Joel S. Snyder, Courtney K. Soderberg, Carina M. Sonnleitner, Nicholas Brant Spencer, Jeffrey R. Spies, Sara Steegen, Stefan Stieger, Nina Strohminger, Gavin Brent Sullivan, Thomas Talhelm, Megan Tapia, Anniek te Dorsthorst, Manuela Thomae, Sarah L. Thomas, Pia Tio, Frits Traets, Steve Tsang, Francis Tuerlinckx, Paul Turchan, Milan Valášek, Anna van ’t Veer, Robbie C. M. Aert, Marcel A.L.M. van Assen, Riet Van Bork, Mathijs van de Ven, Don van den Bergh, Marije van der Hulst, Roel van Dooren, Johnny van Doorn, Daan R. van Renswoude, Hedderik van Rijn, Wolf Vanpaemel, Alejandro Echeverría, Melissa Vazquez, Natalia Vélez, Marieke Vermue, Mark Verschoor, Michelangelo Vianello, Martin Voracek, Gina Vuu, Eric-Jan Wagenmakers, Joanneke Weerdmeester, Ashlee Welsh, Erin C. Westgate, Joeri Wissink, Michael D. Wood, Andy Woods, Emily M. Wright, Sining Wu, Marcel Zeelenberg, and Kellylynn Zuni. 2015 · 2015

Complacency and Automation Bias in the Use of Imperfect Automation

Christopher D. Wickens, Benjamin A. Clegg, Alex Z. Vieane, and Angelia Sebok. 2015 · 2015

Earlier work this paper cites.

1,500 scientists lift the lid on reproducibility

Monya Baker. 2016 · 2016

Earlier work this paper cites.

The Emerging Role of Data Scientists on Software Development Teams

Miryung Kim, Thomas Zimmermann, Robert DeLine, and Andrew Begel. 2016 · 2016

Earlier work this paper cites.

How do People Make Sense of Unfamiliar Visualizations?: A Grounded Model of Novice’s Information Visualization Sensemaking

Sukwon Lee, Sung-Hee Kim, Ya-Hsin Hung, Heidi Lam, Youn ah Kang, and Ji Soo Yi. 2016 · 2016

Earlier work this paper cites.

"Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents

Ewa Luger and Abigail Sellen. 2016 · 2016

Earlier work this paper cites.

Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations

Kanit Wongsuphasawat, Dominik Moritz, Anushka Anand, Jock D. Mackinlay, Bill Howe, and Jeffrey Heer. 2016 · 2016

Earlier work this paper cites.

Opening up government data for Big Data analysis and public benefit

Keiran Hardy and Alana Maurushat. 2017 · 2017

Earlier work this paper cites.

Variolite: Supporting Exploratory Programming by Data Scientists

Mary Beth Kery, Amber Horvath, and Brad A. Myers. 2017 · 2017

Earlier work this paper cites.

Exploring exploratory programming

Mary Beth Kery and Brad A. Myers. 2017 · 2017

Earlier work this paper cites.

Trust, but Verify: Optimistic Visualizations of Approximate Queries for Exploring Big Data

Dominik Moritz, Danyel Fisher, Bolin Ding, and Chi Wang. 2017 · 2017

Earlier work this paper cites.

Voyager 2: Augmenting Visual Analysis with Partial View Specifications

Kanit Wongsuphasawat, Zening Qu, Dominik Moritz, Riley Chang, Felix Ouk, Anushka Anand, Jock D. Mackinlay, Bill Howe, and Jeffrey Heer. 2017 · 2017

Earlier work this paper cites.

The Interactive Visualization Gap in Initial Exploratory Data Analysis

Andrea Batch and Niklas Elmqvist. 2018 · 2018

Earlier work this paper cites.

Looks good to me: Visualizations as sanity checks

Michael Correll, Mingwei Li, Gordon Kindlmann, and Carlos Scheidegger. 2018 · 2018

Earlier work this paper cites.

How People Form Folk Theories of Social Media Feeds and What it Means for How We Study Self-Presentation

Michael Ann Devito, Jeremy P. Birnholtz, Jeffrey T. Hancock, Megan French, and Sunny Xun Liu. 2018 · 2018

Earlier work this paper cites.

Valletto: A Multimodal Interface for Ubiquitous Visual Analytics

Jan-Frederik Kassel and Michael Rohs. 2018 · 2018

Earlier work this paper cites.

Interactions for Untangling Messy History in a Computational Notebook

Mary Beth Kery and Brad A. Myers. 2018 · 2018

Earlier work this paper cites.

The Story in the Notebook: Exploratory Data Science using a Literate Programming Tool

Mary Beth Kery, Marissa Radensky, Mahima Arya, Bonnie E. John, and Brad A. Myers. 2018 · 2018

Earlier work this paper cites.

Data Scientists in Software Teams: State of the Art and Challenges

Miryung Kim, Thomas Zimmermann, Robert DeLine, and Andrew Begel. 2018 · 2018

Earlier work this paper cites.

Aiding Collaborative Reuse of Computational Notebooks with Annotated Cell Folding

Adam Rule, Ian Drosos, Aurélien Tabard, and James Hollan. 2018a · 2018

Earlier work this paper cites.

Exploration and Explanation in Computational Notebooks

Adam Rule, Aurélien Tabard, and James D. Hollan. 2018b · 2018

Earlier work this paper cites.

Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results

Raphael Silberzahn, Eric Luis Uhlmann, Daniel P. Martin, Pasquale Anselmi, Frederik Aust, Eli Awtrey, Štěpán Bahník, Fangxing Bai, Colin Bannard, Evelina Bonnier, Rickard Carlsson, Felix Cheung, G. Christensen, Russ Clay, Maureen A. Craig, Anna Dalla Rosa, Lammertjan Dam, Mathew H. Evans, Ismael Flores Cervantes, N. Fong, Monica Gamez-Djokic, Andreas Glenz, Shauna Gordon-McKeon, Timothy J. Heaton, Karin Hederos, Moritz Heene, Alicia Hofelich Mohr, Fabia Högden, K. Hui, Magnus Johannesson, Jonathan Kalodimos, Erikson Kaszubowski, Deanna M. Kennedy, R. Lei, Thomas Lindsay, Silvia Liverani, Christopher R. Madan, Daniel C. Molden, Eric Molleman, Richard Donald Morey, Laetitia B. Mulder, B. R. Nijstad, Nolan G. Pope, B. Pope, Jason Prenoveau, Floor Rink, Egidio Robusto, H. Roderique, Anna Sandberg, Elmar Schlüter, Felix D. Schönbrodt, Martin F. Sherman, S. Amy Sommer, Kristin Lee Sotak, S Spain, Christoph Spörlein, Tom Stafford, Luca Stefanutti, Susanne Täuber, Johannes Ullrich, Michelangelo Vianello, Eric-Jan Wagenmakers, Maciej Witkowiak, Sangsuk Yoon, and Brian A. Nosek. 2018 · 2018

Earlier work this paper cites.

Futzing and Moseying: Interviews with Professional Data Analysts on Exploration Practices

Sara Alspaugh, Nava Zokaei, Andrea Liu, Cindy Jin, and Marti A. Hearst. 2019 · 2019

Earlier work this paper cites.

Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns

Zahra Ashktorab, Mohit Jain, Qingzi Vera Liao, and Justin D. Weisz. 2019 · 2019

Earlier work this paper cites.

Managing Messes in Computational Notebooks

Andrew Head, Fred Hohman, Titus Barik, Steven Mark Drucker, and Robert DeLine. 2019 · 2019

Earlier work this paper cites.

Interfacing Chatbot with Data Retrieval and Analytics Queries for Decision Making

Gan Keng Hoon, Loo Ji Yong, and Goh Kau Yang. 2019 · 2019

Earlier work this paper cites.

Towards Effective Foraging by Data Scientists to Find Past Analysis Choices

Mary Beth Kery, Bonnie E. John, Patrick O’Flaherty, Amber Horvath, and Brad A. Myers. 2019 · 2019

Earlier work this paper cites.

Talking datasets: Understanding data sensemaking behaviours

Laura M. Koesten, Kathleen Gregory, Paul T. Groth, and Elena Paslaru Bontas Simperl. 2019a · 2019

Earlier work this paper cites.

Collaborative Practices with Structured Data: Do Tools Support What Users Need?

Laura M. Koesten, Emilia Kacprzak, Jeni Tennison, and Elena Paslaru Bontas Simperl. 2019b · 2019

Earlier work this paper cites.

Paths Explored, Paths Omitted, Paths Obscured: Decision Points & Selective Reporting in End-to-End Data Analysis

Yang Liu, Tim Althoff, and Jeffrey Heer. 2019 · 2019

Earlier work this paper cites.

How Data Scientists Use Computational Notebooks for Real-Time Collaboration

April Yi Wang, Anant Mittal, Christopher A. Brooks, and Steve Oney. 2019 · 2019

Earlier work this paper cites.

Language Models are Few-Shot Learners

Original

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, T. J. Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeff Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2020

Earlier work this paper cites.

What’s Wrong with Computational Notebooks? Pain Points, Needs, and Design Opportunities

Souti Chattopadhyay, I. V. R. K. V. Prasad, Austin Z. Henley, Anita Sarma, and Titus Barik. 2020 · 2020

Earlier work this paper cites.

Passing the Data Baton : A Retrospective Analysis on Data Science Work and Workers

Anamaria Crisan, Brittany Fiore-Gartland, and Melanie K. Tory. 2020 · 2020

Earlier work this paper cites.

Mito: Edit a Spreadsheet. Generate Production Ready Python.. In LIVE: Workshop on Live Programming

Jacob Diamond-Reivich. 2020 · 2020

Cited alongside, same era.

Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists

Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLine, and Sumit Gulwani. 2020 · 2020

Cited alongside, same era.

Table Scraps: An Actionable Framework for Multi-Table Data Wrangling From An Artifact Study of Computational Journalism

Stephen Kasica, Charles Berret, and Tamara Munzner. 2020 · 2020

Cited alongside, same era.

mage: Fluid Moves Between Code and Graphical Work in Computational Notebooks

Mary Beth Kery, Donghao Ren, Fred Hohman, Dominik Moritz, Kanit Wongsuphasawat, and Kayur Patel. 2020 · 2020

Cited alongside, same era.

Conceptual Metaphors Impact Perceptions of Human-AI Collaboration

Pranav Khadpe, Ranjay Krishna, Fei-Fei Li, Jeffrey T. Hancock, and Michael S. Bernstein. 2020 · 2020

Cited alongside, same era.

Travel+Leisure World’s Best Hotels 2022

Chadner Navarro. 2022 · 2022

Later among the works it cites.

How Do Data Science Workers Communicate Intermediate Results?

Rock Yuren Pang, Ruotong Wang, Joely Nelson, and Leilani Battle. 2022 · 2022

Later among the works it cites.

GridBook: Natural Language Formulas for the Spreadsheet Grid

Sruti Srinivasa Srinivasa Ragavan, Zhitao Hou, Yun Wang, Andrew D. Gordon, Haidong Zhang, and Dongmei Zhang. 2022 · 2022

Later among the works it cites.

Bollywood Movies Box-Office Collection 2022

Shivani Rana. 2022 · 2022

Later among the works it cites.

What is it like to program with artificial intelligence?. In Annual Workshop of the Psychology of Programming Interest Group

Advait Sarkar, Andrew D. Gordon, Carina Negreanu, Christian Poelitz, Sruti Srinivasa Srinivasa Ragavan, and Benjamin G. Zorn. 2022 · 2022

Later among the works it cites.