Sign Language gestures to Speech Gloves

This glove can convert sign language gestures to actual speech. It uses 9 axis motion data (accelerometer, gyroscope and magnetometer) to estimate the orientation of the hand, along with one flex sensor on each finger to detect the bendings. The microprocessor used on the gloves then translates the data to the English language and sends it to a custom application on a mobile phone. The app then dictates the received text.

This project was done as a part of a hardware hackathon held on Thapathali Campus (Institute of Engineering) and was completed in the time frame of 1 week. The signs used were arbitrary, but can be updated to use standard ones.

Glimpse of Android app that connects with the glove using bluetooth