Facial expression recogntion in unconstrained environment

Andres Hernandez-Matamoros, Takayuki Nagai, Muhammad Attamimi, Mariko Nakano, Hector Perez-Meana*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)


The facial expression recognition has been a topic of active researches given a result the proposal of several efficient algorithms; however, in most cases they remain limited to controlled conditions situations. In this study, we tackle the challenge of recognizing emotions through the facial expression into activities inthe- wild adding the accuracy rate for each expression. To this end we an algorithm that allows accurate face expression recognition in an uncontrolled environment, that means different kind of illumination, backgrounds, occlusions, face's profiles, etc. Proposed system firstly detects different profile of face (left, frontal and right), Then it uses only the frames in which the face profile is frontal, in the next step the face regions of interest (ROI) are segmented automatically to carry out the feature extraction. We use a classifier based on clustering, it has the advantage that if a new class (emotion) is added, it is not necessary to train this completely. Proposed system was evaluated using short video clips of several pictures together with description sentences describing the main activity in the video. The evaluation results show that the proposed scheme is able to recognize the face's profiles with the recognition rate to approximately 93% and principal emotions in unconstrained video sequences.

Original languageEnglish
Title of host publicationNew Trends in Intelligent Software Methodologies, Tools and Techniques - Proceedings of the 16th International Conference, SoMeT 2017
EditorsHamido Fujita, Ali Selamat, Sigeru Omatu
PublisherIOS Press BV
Number of pages14
ISBN (Electronic)9781614997993
Publication statusPublished - 2017
Externally publishedYes
Event16th International Conference on New Trends in Intelligent Software Methodology Tools, and Techniques, SoMeT 2017 - Kitakyushu, Japan
Duration: 26 Sept 201728 Sept 2017

Publication series

NameFrontiers in Artificial Intelligence and Applications
ISSN (Print)0922-6389
ISSN (Electronic)1879-8314


Conference16th International Conference on New Trends in Intelligent Software Methodology Tools, and Techniques, SoMeT 2017


  • Face dimension estimation
  • Face expression recognition
  • Modal analysis
  • Profile estimation
  • Projective integral


Dive into the research topics of 'Facial expression recogntion in unconstrained environment'. Together they form a unique fingerprint.

Cite this