Emotion Recognition Through Image Processing for Improving Human Computer Interaction

Authors

  • Harshala Chaudhari Department of Information Technology, JSPM’S RSCOE, Pune, Maharashtra, India
  • Abhijit Banubakode Department of Information Technology, JSPM’S RSCOE, Pune, Maharashtra, India
  • Amrapali Waghmare Department of Information Technology, JSPM’S RSCOE, Pune, Maharashtra, India
  • Reshma Ganjewar Department of Information Technology, JSPM’S RSCOE, Pune, Maharashtra, India

DOI:

https://doi.org/10.37591/joipprp.v2i1.281

Keywords:

Emotion, emotion detection, facial expression, face detection, lip detection, eye detection

Abstract

Detection and extracting various emotions and then validating those emotions from facial expression have become very important for improving the overall human-computer interaction. Emotion detection has several applications in areas such as artificial intelligence, image processing, intelligent Human-Computer interfaces. This paper reviews the literature on different aspects like different theories of emotions, methods of detecting emotions like face detection, eye detection, lip detection. This paper reviews comparative techniques for recognizing emotions through static images. This paper also shows the comparison of facial expression recognition techniques with different approaches on JAFFE database and Cohn Kanade database. The basic four emotions to be recognized are: Happy, Sad, Normal, and Surprised. These emotions are detected based on the facial expressions obtained after processing image.

 

Cite this Article:
Chaudhari H, Banubakode A, Waghmare A, Ganjewar R. Emotion Recognition through Image Processing for improving human Computer Interaction. Journal of Image Processing & Pattern Recognition Progress. 2015; 2(1): 31–35p.

References

Koutlas A, Fotiadis DI. An automatic region based methodology for facial expression recognition. IEEE International Conference on Systems, Man and Cybernetics. 2008; 662–666p.

Shinde S, Pande S. A Survey on: Emotion Recognition with respect to Database and Various Recognition Techniques. International Journal of Computer Applications. 2012; 58 (3): 0975–8887p.

Shan C, Gong S, McOwan P. Robust facial expression recognition using local binary patterns. IEEE International Conference on Image Processing. 2005; 370–373p.

Luoh L, Huang CC, Liu HY. Image processing based emotion recognition. System Science and Engineering (ICSSE), International Conference. 2010; 491– 494p.

Aiping C, Lian P, Yaobin T, Ning N. Face Detection Technology Based on Skin Color Segmentation and Template Matching. Second International Workshop on Education Technology and Computer Science, 2010.

Moallem P, Mousavi BS, Monadjemi SA. A novel fuzzy rule base system for pose independent faces detection. Applied Soft Computing. 2011; 11 (2).

Yang M, Kriegman DJ, Ahuja N. Detecting Face in Image: A Survey. IEEE Transaction on Pattern Analysis and Machine Intelligence. 2002; 24(1).

Chellappa R, Wilson CL, Sirohey S. Human and Machine Recognition of faces: A survey. 1995, IEEE members, In IEEE Conference, 1995.

Wei S, Zhang W, Zhang X, Chen G, C. Ly Multi-feature Driver Face Detection Based on Area Coincidence Degree and Prior Knowledge.

Feraud R, Bernier O, Viallet JE, et al. Fast and Accurate Face Detector for Indexation of Face Images. Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference 11. Lang L, Gu W. Study of Face Detection Algorithm for Real-time Face Detection System. Publication Year: 2009, IEEE Conference Publications.

Moallem P, Mousavi BS. Optimized Fuzzy System Using Genetic Algorithm to Detect Faces in Color Images. Proceedings of ICEE, May 11-13, 2010.

Zhang Q, Kamata S, Zhang J. Face Detection and Tracking in Color images Using Color Centroids Segmentation.

Huang Ying Li, Robust Symbolic Dual-View Facial Expression Recognition With Skin Wrinkles: Local Versus Global Approach, Yizhen Senior Member, IEEE. 2010; 12 (6):536–543p.

Luoh L, Huang CC, Liu HY. Image processing based emotion recognition. System Science and Engineering (ICSSE), International Conference. 2010; 491– 494p.

Hjelm°as E, Low BK. Face Detection: A Survey. Computer Vision and Image Understanding. IEEE Conference Publications. 2001; 83: 236–274p.

Zhang Z, Lyons MJ, Schuster M, Akamatsu S. Comparison between geometry-based and Gabor- wavelets-based facial expression recognition using multi- layer perceptron. IEEE international conference on automatic face and gesture recognition. 1998; 454–459p.

Bashan S, Venayagamoorthy GK. Recognition of facial expressions using Gabor wavelets and learning vector quantization. Engineering Applications of Artificial Intelligence. 2008; 28: 1056–1064p.

Zhang L, Tjondronegoro D. Facial Expression Recognition Using Facial Movement Features. IEEE Transactions on Affective Computing., 2011; 2 (4).

Shih FY, Chuang CF, Wang PSP. Performance comparisons of facial expression recognition in JAFFE database. International Journal of Pattern Recognition and Artificial Intelligence. 2008; 22(3): 445–459p.

Liao S, Fan W, Chung CS, Yeung DY. Facial expression recognition using advanced local binary patterns. International conference on image processing. ICIP-IEEE. 2006; 665–668p.

Cheng F, Yu J, Xiong H. Facial expression recognition in jaffe dataset based on Gaussian process classification. IEEE Transactions on Neural Networks. 2010; 572 21(10): 1685–1690p.

Battocchi A, Pianesi F, Goren- Bar D. A first evaluation study of a database of kinetic facial expressions (dafex). ICMI ’05: Proceedings of the 7th international conference on Multimodal interfaces, New York, NY, USA, ACM. 2005.

Shan C, Gong S, McOwan P. Robust facial expression recognition using local binary patterns. IEEE International Conference on Image Processing. 2005; 370–373p

Shan C, Gong S, McOwan PW. Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study. Image and Vision Computing. 2009; 27: 803–816p.

Wong JJ, Cho SY. A Face Emotion Tree Structure Representation with Probabilistic Recursive Neural Network Modeling. Neural Computing and Applications. 2010, 19: 33–54p.

Downloads

Published

2015-02-12

Issue

Vol. 2 No. 1 (2015)

Section

Review Articles

License

Declaration and Copyright Transfer Form

(to be completed by authors)

I/ We, the undersigned author(s) of the submitted manuscript, hereby declare, that the above manuscript which is submitted for publication in the STM Journals(s), is not published already in part or whole (except in the form of abstract) in any journal or magazine for private or public circulation, and, is not under consideration of publication elsewhere.

  • I/We will not withdraw the manuscript after 1 week of submission as I have read the Author Guidelines and will adhere to the guidelines.
  • I/We Author(s ) have niether given nor will give this manuscript elsewhere for publishing after submitting in STM Journal(s).
  • I/ We have read the original version of the manuscript and am/ are responsible for the thought contents embodied in it. The work dealt in the manuscript is my/ our own, and my/ our individual contribution to this work is significant enough to qualify for authorship.
  •  I/We also agree to the authorship of the article in the following order:

Author’s name                                    

 

1. ________________

2. ________________

3. ________________

4. ________________

 

We  Author(s) tick this box and would request you to consider it as our signature as we agree to the terms of this Copyright Notice, which will apply to this submission if and when it is published by this journal.