Measurement issues in the evaluation of projects in a project portfolio

Morton, Alec (2015) Measurement issues in the evaluation of projects in a project portfolio. European Journal of Operational Research, 245 (3). pp. 789-796. ISSN 0377-2217 (https://doi.org/10.1016/j.ejor.2015.03.037)

[thumbnail of Morton-EJOR-2015-Measurement-issues-in-the-evaluation-of-projects]
Preview
 Text. Filename: Morton_EJOR_2015_Measurement_issues_in_the_evaluation_of_projects.pdf
Accepted Author Manuscript
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 logo
Download (301kB)| Preview

Abstract

A common problem in multicriteria decision analysis is how to value projects in a project portfolio. Recently, there has been some attention given to a practice whereby analysts define a value function on some criterion by setting 0 as the value of the worst project. In particular, Clemen and Smith have argued this practice is not sound as it gives different results from the case where projects are "priced out", and makes a strong implicit assumption about the value of not doing a project. Moreover, it can be shown easily that the optimal choice set is not invariant with respect to rescalings such as those induced by the addition of a new item to the choice set, hence rank reversal can occur when this procedure is used. We provide a measurement theoretic account of the phenomenon and show that whether the admissible transformations of the underlying scale are similarity or affine (or other) transformations depends on the precise details of the value model used. We also provide an axiomatic impossibility result which illustrates an incompatibility between an idea that inaction has a value of zero and the admissibility of constant scale translations. We use our analysis to comment on the view of Clemen and Smith that the baseline problem is best dealt with by assigning project-specific scores for not doing particular projects.

ORCID iDs

Morton, Alec ORCID logoORCID: https://orcid.org/0000-0003-3803-8517;
CORE (COnnecting REpositories)