An Optimized Uncertainty-Aware Training Framework for Neural Networks

• Tipo: Artigo em Revista Científica Internacional
• Data: 2024

Autores

Tabarisaadi, P (Autor) Outra; Khosravi, A (Autor) Outra; Nahavandi, S (Autor) Outra; Shafie-Khah, M (Autor) Outra; Catalao, JPS (Autor) FEUP

Revista

Título: IEEE Transactions on Neural Networks and Learning Systems

Vol. 35

Páginas: 6928-6935

ISSN: 2162-237X

Editora: IEEE

Indexação

ISI Web of Knowledge - 1 Citação

Scopus - 1 Citação

Outras Informações

ID Authenticus: P-00X-ESF

DOI: 10.1109/tnnls.2022.3213315

Abstract (EN): Uncertainty quantification (UQ) for predictions generated by neural networks (NNs) is of vital importance in safety-critical applications. An ideal model is supposed to generate low uncertainty for correct predictions and high uncertainty for incorrect predictions. The main focus of state-of-the-art training algorithms is to optimize the NN parameters to improve the accuracy-related metrics. Training based on uncertainty metrics has been fully ignored or overlooked in the literature. This article introduces a novel uncertainty-aware training algorithm for classification tasks. A novel predictive uncertainty estimate-based objective function is defined and optimized using the stochastic gradient descent method. This new multiobjective loss function covers both accuracy and uncertainty accuracy (UA) simultaneously during training. The performance of the proposed training framework is compared from different aspects with other UQ techniques for different benchmarks. The obtained results demonstrate the effectiveness of the proposed framework for developing the NN models capable of generating reliable uncertainty estimates.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 8