Picture of a sphere with binary code

Making Strathclyde research discoverable to the world...

The Strathprints institutional repository is a digital archive of University of Strathclyde research outputs. It exposes Strathclyde's world leading Open Access research to many of the world's leading resource discovery tools, and from there onto the screens of researchers around the world.

Explore Strathclyde Open Access research content

Contextual information and assessor characteristics in complex question answering

Azzopardi, C. and Azzopardi, L. and Baillie, M. and Bierig, R. and Nicol, E. and Ruthven, I. and Sweeney, S. (2006) Contextual information and assessor characteristics in complex question answering. In: The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings. NIST.

[img]
Preview
PDF (strathprints003157.pdf)
strathprints003157.pdf

Download (137kB) | Preview

Abstract

The ciqa track investigates the role of interaction in answering complex questions: questions that relate two or more entities by some specified relationship. In our submission to the first ciqa track we were interested in the interplay between groups of variables: variables describing the question creators, the questions asked and the presentation of answers to the questions. We used two interaction forms - html questionnaires completed before answer assessment - to gain contextual information from the answer assessors to better understand what factors influence assessors when judging retrieved answers to complex questions. Our results indicate the importance of understanding the assessor's personal relationship to the question - their existing topical knowledge for example - and also the presentation of the answers - contextual information about the answer to aid in the assessment of the answer.