Picture of a sphere with binary code

Making Strathclyde research discoverable to the world...

The Strathprints institutional repository is a digital archive of University of Strathclyde research outputs. It exposes Strathclyde's world leading Open Access research to many of the world's leading resource discovery tools, and from there onto the screens of researchers around the world.

Explore Strathclyde Open Access research content

Methods for ranking information retrieval systems without relevance judgements

Wu, S. and Crestani, F. (2003) Methods for ranking information retrieval systems without relevance judgements. In: Proceedings of the 2003 ACM Symposium on Applied Computing, 2003-03-09 - 2003-03-12.

Full text not available in this repository. (Request a copy from the Strathclyde author)

Abstract

In this paper we present some new methods of ranking information retrieval systems without relevance judgement. The common ground of these methods is using a measure we called reference count . An extensive experimentation was conducted to evaluate the effectiveness of the proposed methods using various different standards Information Retrieval evaluation measures for the ranking, like average precision, R-precision, and precision and different document levels. We also compared the effectiveness of the proposed methods with the method proposed by Soboroff et al. The experimental results showed that the proposed methods are effective, and in many cases are more effective than Soboroff at al.'s method.