Effects of task structure and confirmation bias in alternative hypotheses evaluation

Dhami, Mandeep K. and Belton, Ian K. and De Werd, Peter and Hadzhieva, Velichka and Wicke, Lars (2024) Effects of task structure and confirmation bias in alternative hypotheses evaluation. Cognitive Research: Principles and Implications, 9 (1). 37. ISSN 2365-7464 (https://doi.org/10.1186/s41235-024-00560-y)

[thumbnail of Dhami-etal-CRPI-2024-Effects-of-task-structure-and-confirmation-bias-in-alternative-hypotheses-evaluation]
Preview
 Text. Filename: Dhami-etal-CRPI-2024-Effects-of-task-structure-and-confirmation-bias-in-alternative-hypotheses-evaluation.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

We empirically examined the effectiveness of how the Analysis of Competing Hypotheses (ACH) technique structures task information to help reduce confirmation bias (Study 1) and the portrayal of intelligence analysts as suffering from such bias (Study 2). Study 1 (N = 161) showed that individuals presented with hypotheses in rows and evidence items in columns were significantly less likely to demonstrate confirmation bias, whereas those presented with the ACH-style matrix (with hypotheses in columns and evidence items in rows) or a paragraph of text (listing the evidence for each hypothesis) were not less likely to demonstrate bias. The ACH-style matrix also did not confer any benefits regarding increasing sensitivity to evidence credibility. Study 2 showed that the majority of 62 Dutch military analysts did not suffer from confirmation bias and were sensitive to evidence credibility. Finally, neither judgmental coherence nor cognitive reflection differentiated between better or worse performers in the hypotheses evaluation tasks.

ORCID iDs

Dhami, Mandeep K., Belton, Ian K. ORCID logoORCID: https://orcid.org/0000-0002-2479-6563, De Werd, Peter, Hadzhieva, Velichka and Wicke, Lars;
CORE (COnnecting REpositories)