Fetching the paper…
Reading the bibliography…
Traditional approaches for ensuring high quality crowdwork have failed to achieve high-accuracy on difficult problems.
Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. In Technical report, DTIC Document
R. L. Rogers J. P. Kincaid, R. P. Fishburne Jr and B. S. Chissom. 1975 · 1975
Earlier work this paper cites.
Maximum Likelihood Estimation of Observer Error-rates using the EM Algorithm
A.P. Dawid and A. M. Skene. 1979 · 1979
Earlier work this paper cites.
Information extraction: Techniques and challenges
Ralph Grishman. 1997 · 1997
Earlier work this paper cites.
Development and use of a gold-standard data set for subjectivity classifications. In Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
J. Wiebe, R. Bruce, and T. O’Hara. 1999 · 1999
Earlier work this paper cites.
An algorithm that finds truth even if most people are wrong
Drazen Prelec and H. Sebastian Seung. 2007 · 2007
Earlier work this paper cites.
Using “annotator rationales" to improve machine learning for text categorization. In Proceedings of NAACL and HLT 2007
Omar F Zaidan, Jason Eisner, and Christine D Piatko. 2007 · 2007
Earlier work this paper cites.
Deliberative discourse idealized and realized: Accountable talk in the classroom and in civic life
Sarah Michaels, Catherine O’Connor, and Lauren B Resnick. 2008 · 2008
Earlier work this paper cites.
Cheap and Fast — But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks. In EMNLP’08
Rion Snow, Brendan O’Connor, Daniel Jurafsky, and A. Ng. 2008 · 2008
Earlier work this paper cites.
TurKit: Tools for Iterative Tasks on Mechanical Turk. In Human Computation Workshop (HComp2009)
Greg Little, Lydia B. Chilton, Max Goldman, and Robert C. Miller. 2009 · 2009
Earlier work this paper cites.
Soylent: a word processor with a crowd inside. In UIST ’10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Michael S Bernstein, Greg Little, Robert C Miller, Björn Hartmann, Mark S Ackerman, David R Karger, David Crowell, and Katrina Panovich. 2010 · 2010
Earlier work this paper cites.
VizWiz: Nearly Real-Time Answers to Visual Questions. In UIST
J. Bigham, C. Jayant, H. Ji, G. Little, , A. Miller, R. Miller, A. Tatarowicz, B. White, S. White, and T. Yeh. 2010 · 2010
Earlier work this paper cites.
The Multidimensional Wisdom of Crowds. In NIPS
Peter Welinder, Steve Branson, Serge Belongie, and Pietro Perona. 2010 · 2010
Earlier work this paper cites.
Annotator rationales for visual recognition. In ICCV 2011
Jeff Donahue and Kristen Grauman. 2011 · 2011
Earlier work this paper cites.
Budget-optimal Crowdsourcing using Low-rank Matrix Approximations. In Conference on Communication, Control, and Computing
David R. Karger, Sewoong Oh, and Devavrat Shah. 2011 · 2011
Earlier work this paper cites.
ConsiderIt: improving structured public deliberation. In CHI Extended Abstracts
Travis Kriplean, Jonathan T. Morgan, Deen Freelon, Alan Borning, and Lance Bennett. 2011 · 2011
Cited alongside, same era.
Platemate: crowdsourcing nutritional analysis from food photographs. In Proceedings of the 24th annual ACM symposium on User interface software and technology
Jon Noronha, Eric Hysen, Haoqi Zhang, and Krzysztof Z Gajos. 2011 · 2011
Cited alongside, same era.
Programmatic Gold: Targeted and Scalable Quality Assurance in Crowdsourcing.. In Human Computation Workshop
David Oleson, Alexander Sorokin, Greg P Laughlin, Vaughn Hester, John Le, and Lukas Biewald. 2011 · 2011
Cited alongside, same era.
How to assure the quality of human computation tasks when majority voting fails. In Workshop on Computational Social Science and the Wisdom of Crowds, NIPS
Yu-An Sun, Christopher R Dance, Shourya Roy, and Greg Little. 2011 · 2011
Cited alongside, same era.
ZenCrowd: Leveraging Probabilistic Reasoning and Crowdsourcing Techniques for Large-scale Entity Linking. In Proceedings of the 21st International Conference on World Wide Web
To Re(label), or Not To Re(label). In HCOMP
Christopher H. Lin, Mausam, and Daniel S. Weld. 2014 · 2014
Later among the works it cites.
Infusion of labeled data into distant supervision for relation extraction. In Proceedings of ACL
Maria Pershina, Bonan Min, Wei Xu, and Ralph Grishman. 2014 · 2014
Later among the works it cites.
Expert crowdsourcing with flash teams. In Proceedings of the 27th annual ACM symposium on User interface software and technology
Daniela Retelny, Sébastien Robaszkiewicz, Alexandra To, Walter S Lasecki, Jay Patel, Negar Rahmati, Tulsee Doshi, Melissa Valentine, and Michael S Bernstein. 2014 · 2014
Later among the works it cites.
Haiyi Zhu, Steven P. Dow, Robert E. Kraut, and Aniket Kittur. 2014 · 2014
Later among the works it cites.
Peer and self assessment in massive online classes
Chinmay Kulkarni, Koh Pang Wei, Huy Le, Daniel Chia, Kathryn Papadopoulos, Justin Cheng, Daphne Koller, and Scott R Klemmer. 2015 · 2015
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Gianluca Demartini, Djellel Eddine Difallah, and Philippe Cudré-Mauroux. 2012 · 2012
Cited alongside, same era.
Shepherding the crowd yields better work. In CSCW
Steven Dow, Anand Pramod Kulkarni, Scott R. Klemmer, and Björn Hartmann. 2012 · 2012
Cited alongside, same era.
Combining human and machine intelligence in large-scale crowdsourcing. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems-Volume 1
Ece Kamar, Severin Hacker, and Eric Horvitz. 2012 · 2012
Cited alongside, same era.
Collaboratively crowdsourcing workflows with Turkomatic. In CSCW
Anand Kulkarni, Matthew Can, and Björn Hartmann. 2012 · 2012
Cited alongside, same era.
TurkServer: Enabling Synchronous and Longitudinal Online Experiments. In The Fourth Workshop on Human Computation (HCOMP 2012)
Andrew Mao, Yiling Chen, Krzysztof Z. Gajos, David C. Parkes, Ariel D. Procaccia, and Haoqi Zhang. 2012 · 2012
Cited alongside, same era.
Big data versus the crowd: Looking for relationships in all the right places. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1
Ce Zhang, Feng Niu, Christopher Ré, and Jude Shavlik. 2012 · 2012
Cited alongside, same era.
Cascade: Crowdsourcing Taxonomy Creation. In CHI ’13
L. Chilton, G. Little, D. Edge, D. Weld, and J. Landay. 2013 · 2013
Cited alongside, same era.
POMDP-based control of workflows for crowdsourcing
Peng Dai, Christopher H. Lin, Mausam, and Daniel S. Weld. 2013 · 2013
Cited alongside, same era.
Later among the works it cites.
MicroTalk: Using Argumentation to Improve Crowdsourcing Accuracy
Ryan Drapeau, Lydia B. Chilton, Jonathan Bragg, and Daniel S. Weld. 2016 · 2016
Later among the works it cites.
" Is There Anything Else I Can Help You With?" Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent. In Fourth AAAI Conference on Human Computation and Crowdsourcing
Ting-Hao Kenneth Huang, Walter S Lasecki, Amos Azaria, and Jeffrey P Bigham. 2016 · 2016
Later among the works it cites.
Effective Crowd Annotation for Relation Extraction. In Proceedings of NAACL and HLT 2016
Angli Liu, Stephen Soderland, Jonathan Bragg, Christopher H. Lin, Xiao Ling, and Daniel S. Weld. 2016a · 2016
Later among the works it cites.
Effective Crowd Annotation for Relation Extraction. In Proceedings of NAACL and HLT 2016
Angli Liu, Stephen Soderland, Jonathan Bragg, Christopher H. Lin, Xiao Ling, and Daniel S. Weld. 2016b · 2016
Later among the works it cites.
Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments. In Proceedings of the 4th AAAI Conference on Human Computation and Crowdsourcing (HCOMP)
Tyler McDonnell, Matthew Lease, Tamer Elsayad, and Mucahid Kutlu. 2016 · 2016
Later among the works it cites.
A 10-Month-Long Deployment Study of On-Demand Recruiting for Low-Latency Crowdsourcing. In Proceedings of The fifth AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2017)
Ting-Hao Kenneth Huang and Jeffrey P Bigham. 2017 · 2017
Later among the works it cites.
An Empirical Study on Short- and Long-Term Effects of Self-Correction in Crowdsourced Microtasks. In HCOMP
Masaki Kobayashi, Hiromi Morita, Masaki Matsubara, Nobuyuki Shimizu, and Atsuyuki Morishima. 2018 · 2018
Closest in time.
In Search of the Dream Team: Temporally Constrained Multi-Armed Bandits for Identifying Effective Team Structures
Sharon Zhou, Melissa Valentine, and Michael S. Bernstein. 2018 · 2018
Closest in time.
Whose Vote Should Count More: Optimal Integration of Labels from Laberlers of Unknown Expertise. In In Proc. of NIPS
Jacob Whitehill, Paul Ruvolo, Tingfan Wu, Jacob Bergsma, and Javier Movellan. 2009 · 2043
Closest in time.