Strathprints Home | Open Access | Browse | Search | User area | Copyright | Help | Library Home | SUPrimo

Reflections on Mira: interactive evaluation in information retrieval

Dunlop, M.D. (2000) Reflections on Mira: interactive evaluation in information retrieval. Journal of the American Society for Information Science and Technology, 51 (14). pp. 1269-1274. ISSN 1532-2882

[img]
Preview
PDF (strathprints002577.pdf)
Download (92Kb) | Preview

    Abstract

    Evaluation in information retrieval (IR) has focussed largely on noninteractive evaluation of text retrieval systems. This is increasingly at odds with how people use modern IR systems: in highly interactive settings to access linked, multimedia information. Furthermore, this approach ignores potential improvements through better interface design. In 1996 the Commission of the European Union Information Technologies Programme, funded a three year working group, Mira, to discuss and advance research in the area of evaluation frameworks for interactive and multimedia IR applications. Led by Keith van Rijsbergen, Steve Draper and myself from Glasgow University, this working group brought together many of the leading researchers in the evaluation domain from both the IR and human computer interaction (HCI) communities. This paper presents my personal view of the main lines of discussion that took place throughout Mira: importing and adapting evaluation techniques from HCI, evaluating at different levels as appropriate, evaluating against different types of relevance and the new challenges that drive the need for rethinking the old evaluation approaches. The paper concludes that we need to consider more varied forms of evaluation to complement engine evaluation.

    Item type: Article
    ID code: 2577
    Keywords: information retrieval, human computer interaction, relevance feedback, searching, programming, Electronic computers. Computer science, Artificial Intelligence, Software, Computer Networks and Communications, Information Systems, Human-Computer Interaction
    Subjects: Science > Mathematics > Electronic computers. Computer science
    Department: Faculty of Science > Computer and Information Sciences
    Related URLs:
      Depositing user: Strathprints Administrator
      Date Deposited: 20 Feb 2007
      Last modified: 04 Sep 2014 18:39
      URI: http://strathprints.strath.ac.uk/id/eprint/2577

      Actions (login required)

      View Item

      Fulltext Downloads: