Dominant and Complementary Emotion Recognition from Still Images of Faces

Emotion recognition has a key role in affective computing. Recently, fine-grained emotion analysis, such as compound facial expression of emotions, has attracted high interest of researchers working on affective computing. A compound facial emotion includes dominant and complementary emotions (e.g.,...

Descripción completa

Detalles Bibliográficos
Autores: Guo, Jianzhu, Lei, Zhen, Wan, Jun, Avots, Egils, Hajarolasvadi, Noushin, Knyazev, Boris, Kuharenko, Artem, Jacques Junior, Julio C. S., Baró i Solé, Xavier, Demirel, Hasan, Escalera Guerrero, Sergio, Allik, Jüri, Anbarjafari, Gholamreza
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2018
País:España
Institución:Universidad de Barcelona
Repositorio:Dipòsit Digital de la UB
OAI Identifier:oai:diposit.ub.edu:2445/141659
Acceso en línea:https://hdl.handle.net/2445/141659
Access Level:acceso abierto
Palabra clave:Reconeixement facial (Informàtica)
Expressió facial
Emocions
Human face recognition (Computer science)
Facial expression
Emotions
Descripción
Sumario:Emotion recognition has a key role in affective computing. Recently, fine-grained emotion analysis, such as compound facial expression of emotions, has attracted high interest of researchers working on affective computing. A compound facial emotion includes dominant and complementary emotions (e.g., happily-disgusted and sadly-fearful), which is more detailed than the seven classical facial emotions (e.g., happy, disgust, and so on). Current studies on compound emotions are limited to use data sets with limited number of categories and unbalanced data distributions, with labels obtained automatically by machine learning-based algorithms which could lead to inaccuracies. To address these problems, we released the iCV-MEFED data set, which includes 50 classes of compound emotions and labels assessed by psychologists. The task is challenging due to high similarities of compound facial emotions from different categories. In addition, we have organized a challenge based on the proposed iCV-MEFED data set, held at FG workshop 2017. In this paper, we analyze the top three winner methods and perform further detailed experiments on the proposed data set. Experiments indicate that pairs of compound emotion (e.g., surprisingly-happy vs happily-surprised) are more difficult to be recognized if compared with the seven basic emotions. However, we hope the proposed data set can help to pave the way for further research on compound facial emotion recognition.