Picture map of Europe with pins indicating European capital cities

Open Access research with a European policy impact...

The Strathprints institutional repository is a digital archive of University of Strathclyde's Open Access research outputs. Strathprints provides access to thousands of Open Access research papers by Strathclyde researchers, including by researchers from the European Policies Research Centre (EPRC).

EPRC is a leading institute in Europe for comparative research on public policy, with a particular focus on regional development policies. Spanning 30 European countries, EPRC research programmes have a strong emphasis on applied research and knowledge exchange, including the provision of policy advice to EU institutions and national and sub-national government authorities throughout Europe.

Explore research outputs by the European Policies Research Centre...

Strathprints

A retrieval evaluation methodology for incomplete relevance assessments

Baillie, M. and Azzopardi, L. and Ruthven, I. (2007) A retrieval evaluation methodology for incomplete relevance assessments. In: Advances in Information Retrieval: 29th European Conference on IR Research (ECIR 2007). Lecture Notes in Computer Science, 4425 . Springer. ISBN 978-3-540-71494-1

[img]
Preview
 PDF (strathprints003158.pdf)
strathprints003158.pdf
Download (323kB) | Preview

Abstract

In this paper we a propose an extended methodology for laboratory based Information Retrieval evaluation under in complete relevance assessments. This new protocol aims to identify potential uncertainty during system comparison that may result from incompleteness. We demonstrate how this methodology can lead towards a finer grained analysis of systems. This is advantageous, because the detection of uncertainty during the evaluation process can guide and direct researchers when evaluating new systems over existing and future test collections.

Item type: Book Section
ID code: 3158
Keywords: information retrieval, document retrieval, relevance ranking, searching, Electronic information resources, Electronic computers. Computer science
Subjects: Bibliography. Library Science. Information Resources > Information resources > Electronic information resources
Science > Mathematics > Electronic computers. Computer science
Department: Faculty of Science > Computer and Information Sciences
Depositing user: Strathprints Administrator
Date deposited: 30 Apr 2007
Last modified: 21 Sep 2017 14:27
URI: https://strathprints.strath.ac.uk/id/eprint/3158
Export data:
CORE (COnnecting REpositories)