Fetching the paper…
Reading the bibliography…
An important challenge in interactive machine learning, particularly in subjective or ambiguous domains, is fostering bi-directional alignment between humans and models.
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Milton Friedman. 1937 · 1937
Earlier work this paper cites.
Use of ranks in one-criterion variance analysis
William H Kruskal and W Allen Wallis. 1952 · 1952
Earlier work this paper cites.
Large sample standard errors of kappa and weighted kappa
Joseph L Fleiss, Jacob Cohen, and Brian S Everitt. 1969 · 1969
Earlier work this paper cites.
A sequential algorithm for training text classifiers: Corrigendum and additional data. In Acm Sigir Forum , Vol. 29. ACM New York, NY, USA, 13–19
David D Lewis. 1995 · 1995
Earlier work this paper cites.
Structure mapping in analogy and similarity
Dedre Gentner and Arthur B Markman. 1997 · 1997
Earlier work this paper cites.
What makes a man similar to a tie? Stimulus compatibility with comparison and integration
Edward J Wisniewski and Miriam Bassok. 1999 · 1999
Earlier work this paper cites.
Structural alignment facilitates the noticing of differences
Dedre Gentner and Virginia Gunn. 2001 · 2001
Earlier work this paper cites.
Interactive machine learning. In Proceedings of the 8th international conference on Intelligent user interfaces . 39–45
Jerry Alan Fails and Dan R Olsen Jr. 2003 · 2003
Earlier work this paper cites.
The importance of being nonalignable: a critical test of the structural alignment theory of similarity
Zachary Estes and Uri Hasson. 2004 · 2004
Earlier work this paper cites.
Reducing labeling effort for structured prediction tasks. In AAAI , Vol. 5. 746–751
Aron Culotta and Andrew McCallum. 2005 · 2005
Earlier work this paper cites.
Kendall’s coefficient of concordance
Andy P Field. 2005 · 2005
Earlier work this paper cites.
NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting , Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908
Sandra G Hart. 2006 · 2006
Earlier work this paper cites.
Active learning for natural language processing
Shilpa Arora and Sachin Agarwal. 2007 · 2007
Earlier work this paper cites.
Affect in* text and speech
Ebba Cecilia Ovesdotter Alm. 2008 · 2008
Earlier work this paper cites.
Structural alignment methods with applications to geospatial ontologies
Isabel F Cruz and William Sunna. 2008 · 2008
Earlier work this paper cites.
Active learning: An introduction
Richard M Felder and Rebecca Brent. 2009 · 2009
Earlier work this paper cites.
Active learning literature survey
Burr Settles. 2009 · 2009
Earlier work this paper cites.
Bootstrapping the mind: Analogical processes and symbol systems
Dedre Gentner. 2010 · 2010
Earlier work this paper cites.
Wilcoxon-Mann-Whitney Test
Markus Neuhäuser. 2011 · 2011
Earlier work this paper cites.
Based on Isolated Saliency or Causal Integration? Toward a Better Understanding of Human Annotation Process using Multiple Instance Learning and Sequential Probability Ratio Test.. In INTERSPEECH . 619–622
Chi-Chun Lee, Athanasios Katsamanis, Panayiotis G Georgiou, and Shrikanth S Narayanan. 2012 · 2012
Earlier work this paper cites.
Interrater reliability: the kappa statistic
Mary L McHugh. 2012 · 2012
Earlier work this paper cites.
Structured labeling for facilitating concept evolution in machine learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . 3075–3084
Todd Kulesza, Saleema Amershi, Rich Caruana, Danyel Fisher, and Denis Charles. 2014 · 2014
Earlier work this paper cites.
Necessary conditions of learning
Ference Marton. 2014 · 2014
Earlier work this paper cites.
FeatureInsight: Visual support for error-driven feature ideation in text classification. In 2015 IEEE Conference on Visual Analytics Science and Technology (VAST) . IEEE, 105–112
Michael Brooks, Saleema Amershi, Bongshin Lee, Steven M Drucker, Ashish Kapoor, and Patrice Simard. 2015 · 2015
Cited alongside, same era.
Yelp dataset challenge: Review rating prediction
Nabiha Asghar. 2016 · 2016
Cited alongside, same era.
Alloy: Clustering with crowds and computation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems . 3180–3191
Joseph Chee Chang, Aniket Kittur, and Nathan Hahn. 2016 · 2016
Cited alongside, same era.
Human-centred machine learning. In Proceedings of the 2016 CHI conference extended abstracts on human factors in computing systems . 3558–3565
Marco Gillies, Rebecca Fiebrink, Atau Tanaka, Jérémie Garcia, Frédéric Bevilacqua, Alexis Heloir, Fabrizio Nunnari, Wendy Mackay, Saleema Amershi, Bongshin Lee, et al · 2016
Cited alongside, same era.
Revisiting human-robot teaching and learning through the lens of human concept learning. In 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI) . IEEE, 147–156
Serena Booth, Sanjana Sharma, Sarah Chung, Julie Shah, and Elena L Glassman. 2022 · 2022
Later among the works it cites.
DISCO: Distilling counterfactuals with large language models
Zeming Chen, Qiyue Gao, Antoine Bosselut, Ashish Sabharwal, and Kyle Richardson. 2022 · 2022
Later among the works it cites.
CORE: A retrieve-then-edit framework for counterfactual data generation
Tanay Dixit, Bhargavi Paranjape, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2022 · 2022
Later among the works it cites.
Exploratory training: when trainers learn. In Proceedings of the Workshop on Human-In-the-Loop Data Analytics . 1–5
Omeed Habibelahian, Rajesh Shrestha, Arash Termehchy, and Paolo Papotti. 2022 · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Active learning using uncertainty information. In 2016 23rd International Conference on Pattern Recognition (ICPR) . IEEE, 2646–2651
Yazhou Yang and Marco Loog. 2016 · 2016
Cited alongside, same era.
Process patterns and conceptual changes in knowledge representations during information seeking and sensemaking: A qualitative user study
Pengyi Zhang and Dagobert Soergel. 2016 · 2016
Cited alongside, same era.
Research on string similarity algorithm based on Levenshtein Distance. In 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) . IEEE, 2247–2251
Shengnan Zhang, Yan Hu, and Guangrong Bian. 2017 · 2017
Cited alongside, same era.
A review of user interface design for interactive machine learning
John J Dudley and Per Ola Kristensson. 2018 · 2018
Cited alongside, same era.
Advancing Organizational Alignment Decisions: Insights from the Structural Alignment Theory to the Business-IT Alignment Problem
Hannu Kivijärvi. 2018 · 2018
Cited alongside, same era.
Active learning via membership query synthesis for semi-supervised sentence classification. In Proceedings of the 23rd conference on computational natural language learning (CoNLL) . 472–481
Raphael Schumann and Ines Rehbein. 2019 · 2019
Cited alongside, same era.
Anchorviz: Facilitating semantic data exploration and concept discovery for interactive machine learning
Jina Suh, Soroush Ghorashi, Gonzalo Ramos, Nan-Chen Chen, Steven Drucker, Johan Verwey, and Patrice Simard. 2019 · 2019
Cited alongside, same era.
The art of coding and thematic exploration in qualitative research
Michael Williams and Tami Moser. 2019 · 2019
Cited alongside, same era.
Alva Noë. 2022 · 2022
Later among the works it cites.
Human-AI Interaction Design in Machine Teaching
Karan Taneja, Harshvardhan Sikka, and Ashok Goel. 2022 · 2022
Later among the works it cites.
Concept-annotated examples for library comparison. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology . 1–16
Litao Yan, Miryung Kim, Bjoern Hartmann, Tianyi Zhang, and Elena L Glassman. 2022 · 2022
Later among the works it cites.
A survey of active learning for natural language processing
Zhisong Zhang, Emma Strubell, and Eduard Hovy. 2022 · 2022
Later among the works it cites.
What did my AI learn? How data scientists make sense of model behavior
Ángel Alexander Cabrera, Marco Tulio Ribeiro, Bongshin Lee, Robert Deline, Adam Perer, and Steven M Drucker. 2023 · 2023
Later among the works it cites.
Patat: Human-ai collaborative qualitative coding with explainable interactive rule synthesis. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1–19
Simret Araya Gebreegziabher, Zheng Zhang, Xiaohang Tang, Yihao Meng, Elena L Glassman, and Toby Jia-Jun Li. 2023 · 2023
Later among the works it cites.
D-CALM: A dynamic clustering-based active learning approach for mitigating bias
Sabit Hassan and Malihe Alikhani. 2023 · 2023
Later among the works it cites.
Exploratory Training: When Annonators Learn About Data
Rajesh Shrestha, Omeed Habibelahian, Arash Termehchy, and Paolo Papotti. 2023 · 2023
Later among the works it cites.
Human Expectations and Perceptions of Learning in Machine Teaching
Jeffrey M Rzeszotarski Swati Mishra. 2023 · 2023
Later among the works it cites.
PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . 1–18
Zheng Zhang, Zheng Ning, Chenliang Xu, Yapeng Tian, and Toby Jia-Jun Li. 2023 · 2023
Later among the works it cites.
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing. In Proceedings of the CHI Conference on Human Factors in Computing Systems . 1–18
Ian Arawjo, Chelse Swoopes, Priyan Vaithilingam, Martin Wattenberg, and Elena L Glassman. 2024 · 2024
Closest in time.
Identifying and Generating Edge Cases. In Proceedings of the 2nd ACM Workshop on Secure and Trustworthy Deep Learning Systems . 16–23
Niklas Bunzel, Nicolas Göller, and Raphael Antonius Frick. 2024 · 2024
Closest in time.
Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning
Simret Araya Gebreegziabher, Kuangshi Ai, Zheng Zhang, Elena L. Glassman, and Toby Jia-Jun Li. 2024 · 2024
Closest in time.
Supporting Sensemaking of Large Language Model Outputs at Scale. In Proceedings of the CHI Conference on Human Factors in Computing Systems . 1–21
Katy Ilonka Gero, Chelse Swoopes, Ziwei Gu, Jonathan K Kummerfeld, and Elena L Glassman. 2024 · 2024
Closest in time.
Finding Patterns in Ambiguity: Interpretable Stress Testing in the Decision Boundary. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 8316–8321
Inês Gomes, Luís F Teixeira, Jan N Van Rijn, Carlos Soares, André Restivo, Luís Cunha, and Moisés Santos. 2024 · 2024
Closest in time.
An AI-Resilient Text Rendering Technique for Reading and Skimming Documents. In Proceedings of the CHI Conference on Human Factors in Computing Systems . 1–22
Ziwei Gu, Ian Arawjo, Kenneth Li, Jonathan K Kummerfeld, and Elena L Glassman. 2024 · 2024
Closest in time.
Knearem shen. 2024 · 2024
Closest in time.
Annalisa Szymanski, Simret Araya Gebreegziabher, Oghenemaro Anuyah, Ronald A Metoyer, and Toby Jia-Jun Li. 2024a · 2024
Closest in time.
Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks
Annalisa Szymanski, Noah Ziems, Heather A Eicher-Miller, Toby Jia-Jun Li, Meng Jiang, and Ronald A Metoyer. 2024b · 2024
Closest in time.