Feature Extraction Trends for Intelligent Facial Expression Recognition: A Survey
DOI:
https://doi.org/10.31449/inf.v42i4.2037Abstract
Human facial expression is important means of non-verbal communication and conveys a lot more information visually than vocally. In Human-machine interaction facial expression recognition plays a vital role. Still facial expression recognition through machines like computer is a difficult task. Face detection, feature extraction and expression classification are the three main stages in the process of Facial Expression Recognition (FER). This survey mainly covers the recent work on FER techniques. It especially focuses on the performance including efficiency and accuracy in face detection, feature extraction and classification methods.References
References
Liu, Shuai-Shi, Yan-Tao Tian, and Dong Li. "New research advances of facial expression recognition." Machine Learning and Cybernetics, 2009 International Conference on. Vol. 2. IEEE, 2009.
Alazrai, Rami, and CS George Lee. "Real-time emotion identification for socially intelligent robots." Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 2012.
Lau, Bee Theng. "Portable real time emotion detection system for the disabled." Expert Systems with Applications 37.9 (2010): 6561-6566.
Lu, X. "Image Analysis for Face Recognition, personal notes, May 2003." URL https://www. msu. edu/~ lvxiaogu/publications/publications. htm (2003).
Zhao-Yi, Peng, Zhu Yan-Hui, and Zhou Yu. "Real-time facial expression recognition based on adaptive canny operator edge detection." Multimedia and Information Technology (MMIT), 2010 Second International Conference on. Vol. 2. IEEE, 2010.
Mayer, Christoph, et al. "A real time system for model-based interpretation of the dynamics of facial expressions." Automatic Face & Gesture Recognition, 2008. FG'08. 8th IEEE International Conference on. IEEE, 2008.
Peng, Zhao-yi, Zhi-qiang Wen, and Yu Zhou. "Application of mean shift algorithm in real-time facial expression recognition." Computer Network and Multimedia Technology, 2009. CNMT 2009. International Symposium on. IEEE, 2009.
Happy, S. L., Anjith George, and Aurobinda Routray. "A real time facial expression classification system using Local Binary Patterns." Intelligent Human Computer Interaction (IHCI), 2012 4th International Conference on. IEEE, 2012.
Bailenson, Jeremy N., et al. "Real-time classification of evoked emotions using facial feature tracking and physiological responses." International journal of human-computer studies 66.5 (2008): 303-317.
Ghimire, Deepak, and Joonwhoan Lee. "Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines." Sensors 13.6 (2013): 7714-7734.
Sung, Jaewon, Sangjae Lee, and Daijin Kim. "A real-time facial expression recognition using the STAAM." Pattern Recognition, 2006. ICPR 2006. 18th International Conference on. Vol. 1. IEEE, 2006.
Lu, H-C., Y-J. Huang, and Y-W. Chen. "Real-time facial expression recognition based on pixel-pattern-based texture feature." Electronics letters 43.17 (2007): 916-918.
Khan, Rizwan Ahmed, et al. "Framework for reliable, real-time facial expression recognition for low resolution images." Pattern Recognition Letters 34.10 (2013): 1159-1168.
Ghandi, Bashir Mohammed, R. Nagarajan, and Hazry Desa. "Particle swarm optimization algorithm for facial emotion detection." Industrial Electronics & Applications, 2009. ISIEA 2009. IEEE Symposium on. Vol. 2. IEEE, 2009.
Punitha, A., and M. Kalaiselvi Geetha. "HMM Based Real Time Facial Expression Recognition." IJETAE 3.1 (2013).
Adeshina, A.M., Lau, S.-H., Loo, C.-K.:‘Real-time FERs: a review’. Innovative Technologies in Intelligent Systems and Industrial Applications, CITISIA 2009, Monash, 25–26 July 2009, pp. 375–378
Geetha, A., et al. "Facial expression recognition–A real time approach." Expert Systems with Applications 36.1 (2009): 303-308.
Owusu, Ebenezer, Yongzhao Zhan, and Qi Rong Mao. "A neural-AdaBoost based facial expression recognition system." Expert Systems with Applications 41.7 (2014): 3383-3390.
Fan, Xijian, and Tardi Tjahjadi. "A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences." Pattern Recognition 48.11 (2015): 3407-3416.
Zhang, Ligang, Dian Tjondronegoro, and Vinod Chandran. "Facial expression recognition experiments with data from television broadcasts and the World Wide Web." Image and Vision Computing 32.2 (2014): 107-119.
Fang, Hui, et al. "Facial expression recognition in dynamic sequences: An integrated approach." Pattern Recognition 47.3 (2014): 1271-1281.
Wang, Zhan, Qiuqi Ruan, and Gaoyun An. "Facial expression recognition using sparse local Fisher discriminant analysis." Neurocomputing 174 (2016): 756-766.
Happy, S. L., and Aurobinda Routray. "Automatic facial expression recognition using features of salient facial patches." IEEE transactions on Affective Computing 6.1 (2015): 1-12.
Tong, Ying, Rui Chen, and Yong Cheng. "Facial expression recognition algorithm using LGC based on horizontal and diagonal prior principle." Optik-International Journal for Light and Electron Optics 125.16 (2014): 4186-4189.
Ali, Ghulam, Muhammad Amjad Iqbal, and Tae-Sun Choi. "Boosted NNE collections for multicultural facial expression recognition." Pattern Recognition 55 (2016): 14-27.
Andrews, Timothy J., et al. "Contributions of feature shapes and surface cues to the recognition and neural representation of facial identity." Cortex 83 (2016): 280-291.
Hernandez-Matamoros, Andres, et al. "A facial expression recognition with automatic segmentation of face regions." International Conference on Intelligent Software Methodologies, Tools, and Techniques. Springer International Publishing, 2015.
Downloads
Published
How to Cite
Issue
Section
License
I assign to Informatica, An International Journal of Computing and Informatics ("Journal") the copyright in the manuscript identified above and any additional material (figures, tables, illustrations, software or other information intended for publication) submitted as part of or as a supplement to the manuscript ("Paper") in all forms and media throughout the world, in all languages, for the full term of copyright, effective when and if the article is accepted for publication. This transfer includes the right to reproduce and/or to distribute the Paper to other journals or digital libraries in electronic and online forms and systems.
I understand that I retain the rights to use the pre-prints, off-prints, accepted manuscript and published journal Paper for personal use, scholarly purposes and internal institutional use.
In certain cases, I can ask for retaining the publishing rights of the Paper. The Journal can permit or deny the request for publishing rights, to which I fully agree.
I declare that the submitted Paper is original, has been written by the stated authors and has not been published elsewhere nor is currently being considered for publication by any other journal and will not be submitted for such review while under review by this Journal. The Paper contains no material that violates proprietary rights of any other person or entity. I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in my article. I have informed the co-author(s) of the terms of this publishing agreement.
Copyright © Slovenian Society Informatika