Estimating the Accuracies of Multiple Classifiers Without Labeled Data

Maximum likelihood estimation of observer error-rates using the em algorith

A. P Dawid and A. M Skene · 1979

Earlier work this paper cites.

Uniform convergence in probability and stochastic equicontinuity

W. K. Newey · 1991

Earlier work this paper cites.

Estimating a mixture of two product distributions

Y. Freund and Y. Mansour · 1999

Earlier work this paper cites.

Ensemble methods in machine learning

T.G. Dietterich · 2000

Earlier work this paper cites.

Learning mixtures of product distributions over discrete domains

J. Feldman, R. O’Donnell, and R.A. Servedio · 2008

Earlier work this paper cites.

Get another label? improving data quality and data mining using multiple, noisy labelers

V.S. Sheng, F. Provost, and P.G. Ipeirotis · 2008

Earlier work this paper cites.

Cheap and fast — but is it good?

R. Snow, B. O’Connor, D. Jurafsky, and A.Y. Ng · 2008

Earlier work this paper cites.

The weka data mining software: An update

M. Hall, E. Frank, G. Holmes, G. Pfahringer, P. Reutemann, and I.H Witten · 2009

Cited alongside, same era.

Collective-agreement-based pruning of ensembles

L. Rokach · 2009

Cited alongside, same era.

Whose vote should count more: Optimal integration of labels from labelers of unknown expertise

J. Whitehill, P. Ruvolo, T. Wu, J Bergsma, and J.R. Movellan · 2009

Cited alongside, same era.

Unsupervised supervised learning I: Estimating classification and regression errors without labels

P. Donmez, G. Lebanon, and K. Balasubramanian · 2010

Cited alongside, same era.

Learning from crowds

V.C. Raykar, Y. Shipeng, L.H. Zhao, G.H. Valdez, C. Florin, L. Bogoni, and Moy L · 2010

Cited alongside, same era.

The multidimensional wisdom of crowds

P. Welinder, S. Branson, S. Belongie, and P. Perona · 2010

Cited alongside, same era.

UCI machine learning repository, 2013

K. Bache and M. Lichman · 2013

Later among the works it cites.

Learning mixtures of discrete product distributions using spectral decompositions

Original

P. Jain and S. Oh · 2013

Later among the works it cites.

Square: A benchmark for research on computing crowd concensus

A. Sheshadri and M. Lease · 2013

Later among the works it cites.

Ranking and combining multiple predictors without labeled data

F. Parisi, F. Strino, B. Nadler, and Y. Kluger · 2014

Closest in time.

Estimating accuracy from unlabeled data

E.A. Platanios, A. Blum, and T. Mitchell · 2014

Closest in time.

Spectral methods meet em: A provably optimal algorithm for crowdsourcin

Original