Picture of person typing on laptop with programming code visible on the laptop screen

World class computing and information science research at Strathclyde...

The Strathprints institutional repository is a digital archive of University of Strathclyde's Open Access research outputs. Strathprints provides access to thousands of Open Access research papers by University of Strathclyde researchers, including by researchers from the Department of Computer & Information Sciences involved in mathematically structured programming, similarity and metric search, computer security, software systems, combinatronics and digital health.

The Department also includes the iSchool Research Group, which performs leading research into socio-technical phenomena and topics such as information retrieval and information seeking behaviour.


Merging expert and empirical data for rare event frequency estimation : pool homogenisation for empirical Bayes models

Quigley, John and Hardman, Gavin and Bedford, Tim and Walls, Lesley (2011) Merging expert and empirical data for rare event frequency estimation : pool homogenisation for empirical Bayes models. Reliability Engineering and System Safety, 96 (6). pp. 687-695. ISSN 0951-8320

PDF (Quigley-etalRESS2011-merging-expert-and-empirical-data-for-rare)
Merging_Expert_and_Empirical_Data_for_Rare_Event_Frequency_Estimation.pdf - Accepted Author Manuscript

Download (749kB) | Preview


Empirical Bayes provides one approach to estimating the frequency of rare events as a weighted average of the frequencies of an event and a pool of events. The pool will draw upon, for example, events with similar precursors. The higher the degree of homogeneity of the pool, then the Empirical Bayes estimator will be more accurate. We propose and evaluate a new method using homogenisation factors under the assumption that events are generated from a Homogeneous Poisson Process. The homogenisation factors are scaling constants, which can be elicited through structured expert judgement and used to align the frequencies of different events, hence homogenising the pool. The estimation error relative to the homogeneity of the pool is examined theoretically indicating that reduced error is associated with larger pool homogeneity. The effects of misspecified expert assessments of the homogenisation factors are examined theoretically and through simulation experiments. Our results show that the proposed Empirical Bayes method using homogenisation factors is robust under different degrees of misspecification.