The overlap area as a novel measure of effect size in neuroscience research

Tools

Wu, Ying and Woods, Hanan and Yuan, Kunhao and Dominic, Digin and Qiu, Zhen and Grant, Seth G.N. (2025) The overlap area as a novel measure of effect size in neuroscience research. Other. bioRxiv. (https://doi.org/10.64898/2025.12.13.694093)

[thumbnail of Wu-etal-bioRxiv-2025-The-overlap-area-as-a-novel-measure-of-effect-size-in-neuroscience-research]
Preview
 Text. Filename: Wu-etal-bioRxiv-2025-The-overlap-area-as-a-novel-measure-of-effect-size-in-neuroscience-research.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (2MB)| Preview

Abstract

In experimental biomedical research, a common concern is whether a manipulation produces a biologically meaningful effect. Another concern is whether effect sizes are reliable, statistically significant, and generalizable. Traditional effect size measures, such as Cohen’s d, quantify mean differences but ignore variance heterogeneity between groups. This can result in biased effect size estimates and a lack of thresholds for statistical significance testing. Motivated by this, we introduce a novel effect size measure, termed overlap area (OA), which quantifies the difference between the population distributions of the experimental and control groups. A robust Bayesian method estimated OA, and random resampling determined OA thresholds for statistical significance in single and replicated experiments. Simulations confirmed the approach’s sensitivity and robustness. Applied to a real-world dataset, OA revealed that environmental enrichment affects the mouse brain synaptome. Moreover, we developed an open-source toolbox supporting OA as a powerful new measurement for conducting robust, reliable, and reproducible analyses of manipulation effects in neuroscience and related fields.

ORCID iDs

Wu, Ying, Woods, Hanan, Yuan, Kunhao, Dominic, Digin, Qiu, Zhen ORCID logoORCID: https://orcid.org/0000-0002-0226-7855 and Grant, Seth G.N.;
CORE (COnnecting REpositories)