Open Access Open Access  Restricted Access Subscription or Fee Access

Emotion Recognition Through Image Processing for Improving Human Computer Interaction

Harshala Chaudhari, Abhijit Banubakode, Amrapali Waghmare, Reshma Ganjewar


Detection and extracting various emotions and then validating those emotions from facial expression have become very important for improving the overall human-computer interaction. Emotion detection has several applications in areas such as artificial intelligence, image processing, intelligent Human-Computer interfaces. This paper reviews the literature on different aspects like different theories of emotions, methods of detecting emotions like face detection, eye detection, lip detection. This paper reviews comparative techniques for recognizing emotions through static images. This paper also shows the comparison of facial expression recognition techniques with different approaches on JAFFE database and Cohn Kanade database. The basic four emotions to be recognized are: Happy, Sad, Normal, and Surprised. These emotions are detected based on the facial expressions obtained after processing image.


Cite this Article:
Chaudhari H, Banubakode A, Waghmare A, Ganjewar R. Emotion Recognition through Image Processing for improving human Computer Interaction. Journal of Image Processing & Pattern Recognition Progress. 2015; 2(1): 31–35p.


Emotion, emotion detection, facial expression, face detection, lip detection, eye detection

Full Text:



Koutlas A, Fotiadis DI. An automatic region based methodology for facial expression recognition. IEEE International Conference on Systems, Man and Cybernetics. 2008; 662–666p.

Shinde S, Pande S. A Survey on: Emotion Recognition with respect to Database and Various Recognition Techniques. International Journal of Computer Applications. 2012; 58 (3): 0975–8887p.

Shan C, Gong S, McOwan P. Robust facial expression recognition using local binary patterns. IEEE International Conference on Image Processing. 2005; 370–373p.

Luoh L, Huang CC, Liu HY. Image processing based emotion recognition. System Science and Engineering (ICSSE), International Conference. 2010; 491– 494p.

Aiping C, Lian P, Yaobin T, Ning N. Face Detection Technology Based on Skin Color Segmentation and Template Matching. Second International Workshop on Education Technology and Computer Science, 2010.

Moallem P, Mousavi BS, Monadjemi SA. A novel fuzzy rule base system for pose independent faces detection. Applied Soft Computing. 2011; 11 (2).

Yang M, Kriegman DJ, Ahuja N. Detecting Face in Image: A Survey. IEEE Transaction on Pattern Analysis and Machine Intelligence. 2002; 24(1).

Chellappa R, Wilson CL, Sirohey S. Human and Machine Recognition of faces: A survey. 1995, IEEE members, In IEEE Conference, 1995.

Wei S, Zhang W, Zhang X, Chen G, C. Ly Multi-feature Driver Face Detection Based on Area Coincidence Degree and Prior Knowledge.

Feraud R, Bernier O, Viallet JE, et al. Fast and Accurate Face Detector for Indexation of Face Images. Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference 11. Lang L, Gu W. Study of Face Detection Algorithm for Real-time Face Detection System. Publication Year: 2009, IEEE Conference Publications.

Moallem P, Mousavi BS. Optimized Fuzzy System Using Genetic Algorithm to Detect Faces in Color Images. Proceedings of ICEE, May 11-13, 2010.

Zhang Q, Kamata S, Zhang J. Face Detection and Tracking in Color images Using Color Centroids Segmentation.

Huang Ying Li, Robust Symbolic Dual-View Facial Expression Recognition With Skin Wrinkles: Local Versus Global Approach, Yizhen Senior Member, IEEE. 2010; 12 (6):536–543p.

Luoh L, Huang CC, Liu HY. Image processing based emotion recognition. System Science and Engineering (ICSSE), International Conference. 2010; 491– 494p.

Hjelm°as E, Low BK. Face Detection: A Survey. Computer Vision and Image Understanding. IEEE Conference Publications. 2001; 83: 236–274p.

Zhang Z, Lyons MJ, Schuster M, Akamatsu S. Comparison between geometry-based and Gabor- wavelets-based facial expression recognition using multi- layer perceptron. IEEE international conference on automatic face and gesture recognition. 1998; 454–459p.

Bashan S, Venayagamoorthy GK. Recognition of facial expressions using Gabor wavelets and learning vector quantization. Engineering Applications of Artificial Intelligence. 2008; 28: 1056–1064p.

Zhang L, Tjondronegoro D. Facial Expression Recognition Using Facial Movement Features. IEEE Transactions on Affective Computing., 2011; 2 (4).

Shih FY, Chuang CF, Wang PSP. Performance comparisons of facial expression recognition in JAFFE database. International Journal of Pattern Recognition and Artificial Intelligence. 2008; 22(3): 445–459p.

Liao S, Fan W, Chung CS, Yeung DY. Facial expression recognition using advanced local binary patterns. International conference on image processing. ICIP-IEEE. 2006; 665–668p.

Cheng F, Yu J, Xiong H. Facial expression recognition in jaffe dataset based on Gaussian process classification. IEEE Transactions on Neural Networks. 2010; 572 21(10): 1685–1690p.

Battocchi A, Pianesi F, Goren- Bar D. A first evaluation study of a database of kinetic facial expressions (dafex). ICMI ’05: Proceedings of the 7th international conference on Multimodal interfaces, New York, NY, USA, ACM. 2005.

Shan C, Gong S, McOwan P. Robust facial expression recognition using local binary patterns. IEEE International Conference on Image Processing. 2005; 370–373p

Shan C, Gong S, McOwan PW. Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study. Image and Vision Computing. 2009; 27: 803–816p.

Wong JJ, Cho SY. A Face Emotion Tree Structure Representation with Probabilistic Recursive Neural Network Modeling. Neural Computing and Applications. 2010, 19: 33–54p.


  • There are currently no refbacks.

This site has been shifted to