Cognitive biases in search : a review and reflection of cognitive biases in Information Retrieval

Azzopardi, Leif; (2021) Cognitive biases in search : a review and reflection of cognitive biases in Information Retrieval. In: CHIIR 2021 - Proceedings of the 2021 Conference on Human Information Interaction and Retrieval. CHIIR 2021 - Proceedings of the 2021 Conference on Human Information Interaction and Retrieval . ACM, New York, NY., 27–37. ISBN 9781450380553 (https://doi.org/10.1145/3406522.3446023)

[thumbnail of Azzopardi-CHIIR-2021-Cognitive-biases-in-search-a-review-and-reflection-of-cognitive-biases-in-information-retrieval]
Preview
Text. Filename: Azzopardi_CHIIR_2021_Cognitive_biases_in_search_a_review_and_reflection_of_cognitive_biases_in_information_retrieval.pdf
Accepted Author Manuscript

Download (503kB)| Preview

Abstract

People are susceptible to an array of cognitive biases, which can result in systematic errors and deviations from rational decision making. Over the past decade, an increasing amount of attention has been paid towards investigating how cognitive biases influence information seeking and retrieval behaviours and outcomes. In particular, how such biases may negatively affect decisions because, for example, searchers may seek confirmatory but incorrect infor- mation or anchor on an initial search result even if its incorrect. In this perspectives paper, we aim to: (1) bring together and catalogue the emerging work on cognitive biases in the field of Information Retrieval; and (2) provide a critical review and reflection on these studies and subsequent findings. During our analysis we report on over thirty studies, that empirically examined cognitive biases in search, providing over forty key findings related to different domains (e.g. health, web, socio-political) and different parts of the search process (e.g. querying, assessing, judging, etc.). Our reflection highlights the importance of this research area, and critically discusses the limitations, difficulties and challenges when investigating this phenomena along with presenting open questions and future directions in researching the impact — both positive and negative — of cognitive biases in Information Retrieval.