Interaction effects on common measures of sensitivity : choice of measure, type I error, and power
Rhodes, Stephen and Cowan, Nelson and Parra, Mario A. and Logie, Robert H. (2018) Interaction effects on common measures of sensitivity : choice of measure, type I error, and power. Behavior Research Methods. ISSN 1554-3528 (https://doi.org/10.3758/s13428-018-1081-0)
Preview |
Text.
Filename: Rhodes_et_al_BRM_2018_Interaction_effects_on_common_measures_of_sensitivity.pdf
Accepted Author Manuscript Download (1MB)| Preview |
Abstract
Here we use simulation to assess previously unaddressed problems in the assessment of statistical interactions in detection and recognition tasks. The proportion of hits and false-alarms made by an observer on such tasks is affected by both their sensitivity and bias, and numerous measures have been developed to separate out these two factors. Each of these measures makes different assumptions regarding the underlying process and different predictions as to how false-alarm and hit rates should covary. Previous simulations have shown that choice of an inappropriate measure can lead to inflated type I error rates, or reduced power, for main effects, provided there are differences in response bias between the conditions being compared. Interaction effects pose a particular problem in this context. We show that spurious interaction effects in analysis of variance can be produced, or true interactions missed, even in the absence of variation in bias. Additional simulations show that variation in bias complicates patterns of type I error and power further. This under-appreciated fact has the potential to greatly distort the assessment of interactions in detection and recognition experiments. We discuss steps researchers can take to mitigate their chances of making an error.
ORCID iDs
Rhodes, Stephen, Cowan, Nelson, Parra, Mario A. ORCID: https://orcid.org/0000-0002-2412-648X and Logie, Robert H.;-
-
Item type: Article ID code: 65652 Dates: DateEvent18 July 2018Published18 July 2018Published Online26 June 2018AcceptedSubjects: Philosophy. Psychology. Religion > Psychology Department: Faculty of Humanities and Social Sciences (HaSS) > Psychological Sciences and Health > Psychology Depositing user: Pure Administrator Date deposited: 03 Oct 2018 14:35 Last modified: 19 Sep 2024 00:41 URI: https://strathprints.strath.ac.uk/id/eprint/65652