Relevance behaviour in TREC

Ruthven, Ian (2014) Relevance behaviour in TREC. Journal of Documentation, 70 (6). pp. 1098-1117. ISSN 0022-0418 (https://doi.org/10.1108/JD-02-2014-0031)

[thumbnail of Ruthven-JOD-2014-Relevance-behaviour-in-TREC]
Preview
Text. Filename: Ruthven_JOD_2014_Relevance_behaviour_in_TREC.pdf
Accepted Author Manuscript

Download (828kB)| Preview

Abstract

The purpose of this paper is to examine how various types of TREC data can be used to better understand relevance and serve as test-bed for exploring relevance. The author proposes that there are many interesting studies that can be performed on the TREC data collections that are not directly related to evaluating systems but to learning more about human judgements of information and relevance and that these studies can provide useful research questions for other types of investigation.