Real-time facial expression recognition using smoothed deep neural network ensemble

Journal ar
Integrated Computer-Aided Engineering
  • Volumen: 28
  • Número: 1
  • Fecha: 01 enero 2021
  • Páginas: 97-111
  • ISSN: 18758835 10692509
  • Tipo de fuente: Revista
  • DOI: 10.3233/ICA-200643
  • Tipo de documento: Artículo
  • Editorial: IOS Press BV
© 2021 - IOS Press. All rights reserved.Facial emotion recognition (FER) has been extensively researched over the past two decades due to its direct impact in the computer vision and affective robotics fields. However, the available datasets to train these models include often miss-labelled data due to the labellers bias that drives the model to learn incorrect features. In this paper, a facial emotion recognition system is proposed, addressing automatic face detection and facial expression recognition separately, the latter is performed by a set of only four deep convolutional neural network respect to an ensembling approach, while a label smoothing technique is applied to deal with the miss-labelled training data. The proposed system takes only 13.48 ms using a dedicated graphics processing unit (GPU) and 141.97 ms using a CPU to recognize facial emotions and reaches the current state-of-the-art performances regarding the challenging databases, FER2013, SFEW 2.0, and ExpW, giving recognition accuracies of 72.72%, 51.97%, and 71.82% respectively.

Palabras clave del autor

    Palabras clave indexadas

      Detalles de financiación