Replication's role in software engineering

Wood, Murray and Roper, Marc and Miller, J. and Daly, J. and Brooks, Andrew; Schull, Forrest and Singer, Janice and Sjoberg, Daj, eds. (2008) Replication's role in software engineering. In: Guide to Advanced Empirical Software Engineering. Springer, pp. 365-379. ISBN 9781848000438 (https://doi.org/10.1007/978-1-84800-044-5_14)

Full text not available in this repository.Request a copy

Abstract

We provide motivation for researchers to replicate experiments in software engineering. The ideology of replication is discussed. We address the question: Is an experiment worth repeating? The current lack of replication studies is highlighted. We make clear that exact replication is unattainable and we draw on our first experience of performing an external replication. To categorise various kinds of replication, we propose a simple extension to Basili et al's framework for experimentation in software engineering. We present guidance as to the level of reported detail required to enable others perform a replication. Our conclusion is that there is only one route for empirical software engineering to follow: to make available laboratory packages of experimental materials to facilitate internal and external replications, especially the latter, which have greater confirming power.

ORCID iDs

Wood, Murray ORCID logoORCID: https://orcid.org/0000-0002-9449-1036, Roper, Marc ORCID logoORCID: https://orcid.org/0000-0001-6794-4637, Miller, J., Daly, J. and Brooks, Andrew; Schull, Forrest, Singer, Janice and Sjoberg, Daj
CORE (COnnecting REpositories)