Physiological Inspired Deep Neural Networks for Emotion Recognition

• Type: Article in International Scientific Journal
• Date: 2018

Authors

Pedro M. Ferreira (Author) Other; Filipe Marques (Author) Other; Jaime S. Cardoso (Author) FEUP; Ana Rebelo (Author) Other

Journal

Title: IEEE Access

Vol. 6

Pages: 53930-53943

ISSN: 2169-3536

Publisher: IEEE

Indexing

ISI Web of Knowledge - 15 Citations

Scopus - 21 Citations

INSPEC

Other information

Authenticus ID: P-00P-T6W

DOI: 10.1109/access.2018.2870063

Abstract (EN): Facial expression recognition (FER) is currently one of the most active research topics due to its wide range of applications in the human-computer interaction field. An important part of the recent success of automatic FER was achieved thanks to the emergence of deep learning approaches. However, training deep networks for FER is still a very challenging task, since most of the available FER data sets are relatively small. Although transfer learning can partially alleviate the issue, the performance of deep models is still below of its full potential as deep features may contain redundant information from the pre-trained domain. Instead, we propose a novel end-to-end neural network architecture along with a well-designed loss function based on the strong prior knowledge that facial expressions are the result of the motions of some facial muscles and components. The loss function is defined to regularize the entire learning process so that the proposed neural network is able to explicitly learn expression-specific features. Experimental results demonstrate the effectiveness of the proposed model in both lab-controlled and wild environments. In particular, the proposed neural network provides quite promising results, outperforming in most cases the current state-of-the-art methods.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 14