Examining assessor attributes at HARD 2005

Baillie, Mark and Ruthven, Ian; (2006) Examining assessor attributes at HARD 2005. In: Proceedings of the 29th Annual ACM Conference on Research and Development in Information Retrieval (SIGIR '06). ACM Press, New York, NY., pp. 609-610. ISBN 1595933697 (https://doi.org/10.1145/1148170.1148279)

[thumbnail of strathprints002778.pdf]
Preview
PDF. Filename: strathprints002778.pdf
Accepted Author Manuscript

Download (102kB)| Preview

Abstract

The TREC HARD (High accuracy Retrieval from Documents) track was motivated to investigate techniques for personalised retrieval of documents. Through the use of a limited dialogue with the TREC assessors, the track facilitated the gathering and exploitation of information about the assessors' personal search context (e.g. knowledge of search topic) which could be used to improve document retrieval. In this paper we describe experiments, run within the context of the 2005 HARD track, which indicate that assessor attributes such as familiarity, interest and confidence when searching a topic can help determine when the utilisation of automatic query expansion improves retrieval over the original document ranking.