Fetching the paper…

Reading the bibliography…

2016

Peer Prediction with Heterogeneous Tasks

Mandal, Debmalya, Leifer, Matthew, Parkes, David C. et al.

Original
PDF
Post on X

Understand

Peer prediction is a method to promote contributions of information by users in settings in which there is no way to verify the quality of responses.

In multi-task peer prediction, the reports from users across multiple tasks are used to score contributions.
This paper extends the correlated agreement (CA) multi-task peer prediction mechanism to allow the reports from users to be on heterogeneous tasks, each associated with different distributions on responses.
The motivation comes from wanting to elicit user-generated content about places in a city, where tasks vary because places, and questions about places, vary.

Peer Prediction with Heterogeneous Tasks · Around

Built on

Maximum Likelihood Estimation of Observer Error-Rates Using the EM Algorithm
Alexander P. Dawid and Allan M. Skene · 1979
Earlier work this paper cites.
Eliciting Informative Feedback: The Peer-Prediction method
Nolan Miller, Paul Resnick, and Richard Zeckhauser · 2005
Earlier work this paper cites.
Truthful Opinions from the Crowds
Radu Jurca and Boi Faltings · 2008
Earlier work this paper cites.
Mechanisms for Making Crowds Truthful
Radu Jurca and Boi Faltings · 2009
Earlier work this paper cites.
Combinatorial Methods in Density Estimation
Luc Devroye and Gábor Lugosi · 2012
Earlier work this paper cites.

Similar

A Robust Bayesian Truth Serum for Small Populations
Jens Witkowski and David C Parkes · 2012
Cited alongside, same era.
Crowdsourced Judgement Elicitation with Endogenous Proficiency
Anirban Dasgupta and Arpita Ghosh · 2013
Cited alongside, same era.
Truth Serums for Massively Crowdsourced Evaluation Tasks
Vijay Kamble, David Marn, Nihar Shah, Abhay Parekh, and Kannan Ramachandran · 2015
Cited alongside, same era.
Putting Peer Prediction Under the Micro (economic) scope and Making Truth-telling Focal
Yuqing Kong, Katrina Ligett, and Grant Schoenebeck · 2016
Cited alongside, same era.

Then

Incentives for Effort in Crowdsourcing Using the Peer Truth Serum
Goran Radanovic, Boi Faltings, and Radu Jurca · 2016
Closest in time.
Informed Truthfulness in Multi-Task Peer Prediction
Victor Shnayder, Arpit Agarwal, Rafael Frongillo, and David C Parkes · 2016
Closest in time.
Measuring performance of peer prediction mechanisms using replicator dynamics
Victor Shnayder, Rafael Frongillo, and David C. Parkes · 2016
Closest in time.
Peer Prediction with Heterogeneous Users
Arpit Agarwal, Debmalya Mandal, David C. Parkes, and Nisarg Shah · 2017
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…