Fetching the paper…

Reading the bibliography…

2018

Pytrec_eval: An Extremely Fast Python Interface to trec_eval

Van Gysel, Christophe, de Rijke, Maarten

Original
PDF
Post on X

Understand

We introduce pytrec_eval, a Python interface to the tree_eval information retrieval evaluation toolkit.

pytrec_eval exposes the reference implementations of trec_eval within Python as a native extension.
We show that pytrec_eval is around one order of magnitude faster than invoking trec_eval as a sub process from within Python.
Compared to a native Python implementation of NDCG, pytrec_eval is twice as fast for practically-sized rankings.

Pytrec_eval: An Extremely Fast Python Interface to trec_eval · Around

Built on

Problems in the simulation of bibliographic retrieval systems
J. Tague, M. Nelson, and H. Wu · 1980
Earlier work this paper cites.
An empirical comparison of seven programming languages
L. Prechelt · 2000
Earlier work this paper cites.
Test collection based evaluation of information retrieval systems
M. Sanderson · 2010
Earlier work this paper cites.

Similar

Information retrieval evaluation
D. Harman · 2011
Cited alongside, same era.
OpenAI gym, 2016
G. Brockman, V. Cheung, L. Pettersson, J. Schneider, J. Schulman, J. Tang, and W. Zaremba · 2016
Cited alongside, same era.
Text retrieval conference, 1992–2017
NIST · 2017
Cited alongside, same era.

Then

Pyndri: a python interface to the indri search engine
Original
C. Van Gysel, E. Kanoulas, and M. de Rijke · 2017
Later among the works it cites.
Why python rocks for research
H. Koepke · 2018
Closest in time.
Bayesian optimization for optimizing retrieval systems
D. Li and E. Kanoulas · 2018
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…