Gesture to Speech Recognition for Deaf and Dumb People

Abstract

The main aim of this project is to extend the human right of communication to a larger audience. There are 70 million people who are deaf in the world, but many do not know how to communicate with this community. To overcome this real time issues, our smart gloves are very useful to translate sign language into text and audio.The smart glove is normal cloth driving glove that recognizes hand gestures that corresponds to text. The gloves make use of sign language which translated in text and audio. It uses hand gestures and orientation of the fingers which has flex sensors embedded to it to measure the movement and convey the message. This data is then sent to the PIC (16F877A) microcontroller. The input signal needs to stay constant for the defined period and if the gesture remains unchanged then it is valid and the translated text and audio is observed on the smart phone application. The transmission of signals is done with the help of Bluetooth HC-05 module.

Keywords: Gloves, binary file, sign language, PIC microcontroller, Bluetooth model.

Cite this Article: Mansi Rajaram Jadhav, Vaishnavi Manohar Rohekar, Pranali Vijay Vhadage, Praveen Sambhaji Shinde. Gesture to Speech Recognition for Deaf and Dumb People. Journal of Mobile Computing, Communications & Mobile Networks. 2020; 7(2): 17–20p.