Quantifying uncertainty about future antimicrobial resistance : comparing structured expert judgment and statistical forecasting methods

Colson, Abigail R. and Megiddo, Itamar and Alvarez-Uria, Gerardo and Gandra, Sumanth and Bedford, Tim and Morton, Alec and Cooke, Roger M. and Laxminarayan, Ramanan (2019) Quantifying uncertainty about future antimicrobial resistance : comparing structured expert judgment and statistical forecasting methods. PLOS One, 14 (7). e0219190. e0219190. ISSN 1932-6203 (https://doi.org/10.1371/journal.pone.0219190)

[thumbnail of Colson-etal-PLOS-One-2019-Quantifying-uncertainty-about-future-antimicrobial-resistance]
Preview
 Text. Filename: Colson_etal_PLOS_One_2019_Quantifying_uncertainty_about_future_antimicrobial_resistance.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

The increase of multidrug resistance and resistance to last-line antibiotics is a major global public health threat. Although surveillance programs provide useful current and historical information on the scale of the problem, the future emergence and spread of antibiotic resistance is uncertain, and quantifying this uncertainty is crucial for guiding decisions about investment in antibiotics and resistance control strategies. Mathematical and statistical models capable of projecting future rates are challenged by the paucity of data and the complexity of the emergence and spread of resistance, but experts have relevant knowledge. We use the Classical Model of structured expert judgment to elicit projections with uncertainty bounds of resistance rates through 2026 for nine pathogen-antibiotic pairs in four European countries and empirically validate the assessments against data on a set of calibration questions. The performance-weighted combination of experts in France, Spain, and the United Kingdom projected that resistance for five pairs on the World Health Organization’s priority pathogens list (E. coli and K. pneumoniae resistant to third-generation cephalosporins and carbapenems and MRSA) would remain below 50% in 2026. In Italy, although upper bounds of 90% credible ranges exceed 50% resistance for some pairs, the medians suggest Italy will sustain or improve its current rates. We compare these expert projections to statistical forecasts based on historical data from the European Antimicrobial Resistance Surveillance Network (EARS-Net). Results from the statistical models differ from each other and from the judgmental forecasts in many cases. The judgmental forecasts include information from the experts about the impact of current and future shifts in infection control, antibiotic usage, and other factors that cannot be easily captured in statistical forecasts, demonstrating the potential of structured expert judgment as a tool for better understanding the uncertainty about future antibiotic resistance.

CORE (COnnecting REpositories)