Enslaving the algorithm : from a 'right to an explanation' to a 'right to better decisions'?

Edwards, Lilian and Veale, Michael (2018) Enslaving the algorithm : from a 'right to an explanation' to a 'right to better decisions'? IEEE Security and Privacy Magazine, 16 (3). pp. 46-54. ISSN 1540-7993 (https://doi.org/10.1109/MSP.2018.2701152)

[thumbnail of Edwards-Veale-SPM-2018-Enslaving-the-algorithm-from-a-right-to-an-explanation-to-a-right-to-better-decisions]
Preview
Text. Filename: Edwards_Veale_SPM_2018_Enslaving_the_algorithm_from_a_right_to_an_explanation_to_a_right_to_better_decisions.pdf
Accepted Author Manuscript

Download (181kB)| Preview

Abstract

As concerns about unfairness and discrimination in “black box” machine learning systems rise, a legal “right to an explanation” has emerged as a compellingly attractive approach for challenge and redress. We outline recent debates on the limited provisions in European data protection law, and introduce and analyse newer explanation rights in French administrative law and the draft modernised Council of Europe Convention 108. While individual rights can be useful, in privacy law they have historically unreasonably burdened the average data subject. “Meaningful information” about algorithmic logics is more technically possible than commonly thought, but this exacerbates a new “transparency fallacy”—an illusion of remedy rather than anything substantively helpful. While rights-based approaches deserve a firm place in the toolbox, other forms of governance, such as impact assessments, “soft law”, judicial review and model repositories deserve more attention, alongside catalysing agencies acting for users to control algorithmic system design.