An analysis of the cost and benefit of search interactions

Azzopardi, Leif and Zuccon, Guido; (2016) An analysis of the cost and benefit of search interactions. In: ICTIR '16 Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval. ACM, New York,, pp. 59-68. ISBN 9781450344975 (https://doi.org/10.1145/2970398.2970412)

[thumbnail of Azzopardi-Zuccon-ICTIR2016-An-analysis-of-the-cost-and-benefit-of-search-interactions]
Preview
Text. Filename: Azzopardi_Zuccon_ICTIR2016_An_analysis_of_the_cost_and_benefit_of_search_interactions.pdf
Accepted Author Manuscript

Download (606kB)| Preview

Abstract

Interactive Information Retrieval (IR) systems often provide various features and functions, such as query suggestions and relevance feedback, that a user may or may not decide to use. The decision to take such an option has associated costs and may lead to some benefit. Thus, a savvy user would take decisions that maximises their net benefit. In this paper, we formally model the costs and benefits of various decisions that users, implicitly or explicitly, make when searching. We consider and analyse the following scenarios: (i) how long a user's query should be? (ii) should the user pose a specific or vague query? (iii) should the user take a suggestion or re-formulate? (iv) when should a user employ relevance feedback? and (v) when would the "find similar" functionality be worthwhile to the user? To this end, we build a series of cost-benefit models exploring a variety of parameters that affect the decisions at play. Through the analyses, we are able to draw a number of insights into different decisions, provide explanations for observed behaviours and generate numerous testable hypotheses. This work not only serves as a basis for future empirical work, but also as a template for developing other cost-benefit models involving human-computer interaction.