WIKIR: A Python toolkit for building a large-scale Wikipedia-based English Information Retrieval Dataset

Understand

Over the past years, deep learning methods allowed for new state-of-the-art results in ad-hoc information retrieval.

• However such methods usually require large amounts of annotated data to be effective.
• Since most standard ad-hoc information retrieval datasets publicly available for academic research (e.g.
• Robust04, ClueWeb09) have at most 250 annotated queries, the recent deep learning models for information retrieval perform poorly on these datasets.