Practice-relevant model validation : distributional parameter risk analysis in financial model risk management

Cummins, Mark and Gogolin, Fabian and Kearney, Fearghal and Kiely, Greg and Murphy, Bernard (2022) Practice-relevant model validation : distributional parameter risk analysis in financial model risk management. Annals of Operations Research. ISSN 0254-5330 (https://doi.org/10.1007/s10479-022-04574-x)

[thumbnail of Cummins-etal-AOR-2022-Practice-relevant-model-validation-distributional-parameter-risk-analysis]
Preview
Text. Filename: Cummins_etal_AOR_2022_Practice_relevant_model_validation_distributional_parameter_risk_analysis.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo

Download (1MB)| Preview

Abstract

An objective of model validation within organisations is to provide guidance on model selection decisions that balance the operational effectiveness and structural complexity of competing models. We consider a practice-relevant model validation scenario where a financial quantitative analysis team seeks to decide between incumbent and alternative models on the basis of parameter risk. We devise a model risk management methodology that gives a meaningful distributional assessment of parameter risk in a setting where market calibration and historical estimation procedures must be jointly applied. Such a scenario is typically driven by data constraints that preclude market calibration only. We demonstrate our proposed methodology in a natural gas storage modelling context, where model usage is necessary to support profit and loss reporting, and to inform trading and hedging strategy. We leverage our distributional parameter risk approach to devise an accessible technique to support model selection decisions.