Introduction to the special issue on evaluating interactive information retrieval systems

Borlund, P. and Ruthven, I. (2008) Introduction to the special issue on evaluating interactive information retrieval systems. Information Processing and Management, 44 (1). pp. 1-3. ISSN 0306-4573

[img]
Preview
 PDF (strathprints003178.pdf)
strathprints003178.pdf
Download (64kB)| Preview

    Abstract

    Evaluation has always been a strong element of Information Retrieval (IR) research, much of our focus being on how we evaluate IR algorithms. As a research field we have benefited greatly from initiatives such as Cranfield, TREC, CLEF and INEX that have added to our knowledge of how to create test collections, the reliability of system-based evaluation criteria and our understanding of how to interpret the results of an algorithmic evaluation. In contrast, evaluations whose main focus is the user experience of searching using IR systems have not yet reached the same level of maturity. Such evaluations are complex to create and assess due to the increased number of variables to incorporate within the study, the lack of standard tools available (for example, test collections) and the difficulty of selecting appropriate evaluation criteria for study.

    Creators(s): Borlund, P. and Ruthven, I. ORCID logoORCID: https://orcid.org/0000-0001-6669-5376;
    Item type:Article
    ID code:3178
    Keywords:information retrieval, algorithms, evaluation, computer systems, Electronic information resources, Electronic computers. Computer science, Media Technology, Management Science and Operations Research, Library and Information Sciences, Information Systems, Computer Science Applications
    Subjects:Bibliography. Library Science. Information Resources > Information resources > Electronic information resources
    Science > Mathematics > Electronic computers. Computer science
    Department:Faculty of Science > Computer and Information Sciences
    Depositing user: Strathprints Administrator
    Date deposited:16 May 2007
    Last modified:15 Jan 2021 01:29
    Related URLs:
    URI:https://strathprints.strath.ac.uk/id/eprint/3178
    Export data:
    CORE (COnnecting REpositories)