Efficient training of interval neural networks for imprecise training data
Sadeghi, Jonathan and de Angelis, M. and Patelli, Edoardo (2019) Efficient training of interval neural networks for imprecise training data. Neural Networks, 118. pp. 338-351. ISSN 0893-6080
|
Text (Sadeghi-etal-NN-2019-Efficient-training-of-interval-neural-networks-for-imprecise)
Sadeghi_etal_NN_2019_Efficient_training_of_interval_neural_networks_for_imprecise.pdf Accepted Author Manuscript License: ![]() Download (721kB)| Preview |
Abstract
This paper describes a robust and computationally feasible method to train and quantify the uncertainty of Neural Networks. Specifically, we propose a back propagation algorithm for Neural Networks with interval predictions. In order to maintain numerical stability we propose minimising the maximum of the batch of errors at each step. Our approach can accommodate incertitude in the training data, and therefore adversarial examples from a commonly used attack model can be trivially accounted for. We present results on a test function example, and a more realistic engineering test case. The reliability of the predictions of these networks is guaranteed by the non-convex Scenario approach to chance constrained optimisation, which takes place following training, and is hence robust to the performance of the optimiser. A key result is that, by using minibatches of size M, the complexity of the proposed approach scales as O(M⋅Niter), and does not depend upon the number of training data points as with other Interval Predictor Model methods. In addition, troublesome penalty function methods are avoided. To the authors’ knowledge this contribution presents the first computationally feasible approach for dealing with convex set based epistemic uncertainty in huge datasets.
Creators(s): |
Sadeghi, Jonathan, de Angelis, M. and Patelli, Edoardo ![]() | Item type: | Article |
---|---|
ID code: | 71230 |
Keywords: | imprecise probability, interval predictor models, machine learning, neural networks, uncertainty quantification, Risk Management, Cognitive Neuroscience, Artificial Intelligence |
Subjects: | Social Sciences > Industries. Land use. Labor > Risk Management |
Department: | Faculty of Engineering > Civil and Environmental Engineering |
Depositing user: | Pure Administrator |
Date deposited: | 28 Jan 2020 12:03 |
Last modified: | 26 Feb 2021 05:29 |
Related URLs: | |
URI: | https://strathprints.strath.ac.uk/id/eprint/71230 |
Export data: |