Contextual information and assessor characteristics in complex question answering

Azzopardi, C. and Azzopardi, L. and Baillie, M. and Bierig, R. and Nicol, E. and Ruthven, I. and Sweeney, S.; Voorhees, E.M. and Buckland, L.P., eds. (2006) Contextual information and assessor characteristics in complex question answering. In: The Fifteenth Text REtrieval Conference (TREC 2006) Proceedings. NIST.

[thumbnail of strathprints003157.pdf]
Preview
 PDF. Filename: strathprints003157.pdf
Download (137kB)| Preview

Abstract

The ciqa track investigates the role of interaction in answering complex questions: questions that relate two or more entities by some specified relationship. In our submission to the first ciqa track we were interested in the interplay between groups of variables: variables describing the question creators, the questions asked and the presentation of answers to the questions. We used two interaction forms - html questionnaires completed before answer assessment - to gain contextual information from the answer assessors to better understand what factors influence assessors when judging retrieved answers to complex questions. Our results indicate the importance of understanding the assessor's personal relationship to the question - their existing topical knowledge for example - and also the presentation of the answers - contextual information about the answer to aid in the assessment of the answer.

ORCID iDs

Azzopardi, C., Azzopardi, L., Baillie, M., Bierig, R., Nicol, E. ORCID logoORCID: https://orcid.org/0000-0003-1729-1345, Ruthven, I. ORCID logoORCID: https://orcid.org/0000-0001-6669-5376 and Sweeney, S.; Voorhees, E.M. and Buckland, L.P.
CORE (COnnecting REpositories)