Gesture vocalizer
- 1. Vikash ranjan vipul vikram Rajat kapoor sultan amed
- 2. ABSTRACT Gesture Vocalizer is a large scale multi-microcontroller based system. Designed to facilitate the communication among the dumb, deaf and blind communities and their communication with the normal people. This system can be dynamically reconfigured to work as a “smart device”.
- 3. METHODOLOGY Speech Gesture Detection Synthesis Tilt LCD Detection
- 4. MODULES Data Glove Tilt detection Gesture detection Speech Synthesis LCD Display
- 5. DATA GLOVE BEND SENSOR data glove is equipped with five bend sensors each of the bend sensor is fixed on each finger of the hand glove Used for the monitoring and sensing of static movements of the fingers of the hand. The bend sensor is made by using 555 timer IC in astable mode along with a photo transistor. The output of the bend sensor is a square wave.
- 6. BEND SENSOR
- 7. TILT SENSOR Accelerometer in the Gesture Vocalizer system is used as a tilt sensor. Two ADXL103 accelerometer checks the tilting of the hand. The accelerometer has an analog output which varies from 1.5 volts to 3.5 volts. The output of the accelerometer is provided to third module TECHNICAL ISSUE
- 8. REMEDY Amplification and Attenuation Circuitry This additional circuitry increases the range of the accelerometer from 2 volts range to 5volts range
- 9. TILT DETECTION The basic function of this module is to detect the tilting of the hand and sending some binary data against meaningful gestures, to the bend detection module. A dual channel ADC can be used to convert the outputs of two accelerometers in to digital form. Gesture Vocalizer system is a dual axis system, which can detect the tilt of the hand in two axes. Microcontroller receives the data of the two ADC’s one by one, and saves them, for the further use.
- 10. Contd……. The microcontroller checks whether the data received from the ADC’s is some meaningful data, or useless one. The microcontroller compares the values received from the ADC’s with the predefined values The next step of the microcontroller is to send eight bit binary data to the main “bend detection” module. The microcontroller checks the output of the first bend sensor, calculates its pulse width, saves its output, and then moves towards the next bend sensor one by one.
- 11. GESTURE DETECTION Followed by BEND DETECTION In this module one microcontroller is used and three ports of this microcontroller are in use. The microcontroller checks the output of the first bend sensor, calculates its pulse width, saves its output, and then moves towards the next bend sensor one by one.
- 12. Contd…… Even a little bend of the finger is detected at this stage of the system. Now the bending of each finger is quantized into ten levels. At any stage, the finger must be at one of these levels, and it can easily be determined how much the finger is bended. next step is to combine the movement of each finger and name it a particular gesture of the hand. In the next step the system checks the data, which was sent by tilt detection module at port one of the microcontroller. The gesture detection module assigns a different 8bit code to each gesture. If the gesture is meaningful the system sends an eight bit data to the speech synthesis module.
- 13. SPEECH SYNTHESIS This module of the system is consisted of a microcontroller (AT89C51), a SP0256 (speech synthesizer) IC, amplifier circuitry and a speaker. The function of this module is to produce voice against the respective gesture. The microcontroller receives the eight bit data from the “bend detection” module. Comparing this data with the predefined values the microcontroller comes to know that which gesture does the hand make. The last step of the system is to give voice to the each defined gesture. For this purpose a speech synthesizer IC, SPO256 is used.
- 14. LCD DISPLAY to translate the gestures, which are made by the hand, into some text form. The text is display on LCD. Gesture Detection module sends signal to the speech synthesis module, the same signal is sent to the LCD display module. The LCD display module is consisted of a microcontroller and an LCD. The LCD display module checks each signal, and compares it with the already stored values. On the basis of this comparison the microcontroller takes the decision what should be displayed, having taken the decision the microcontroller send an eight bit address to the LCD, this eight bit address, tells the LCD, what should be displayed
- 15. OVERVIEW
- 16. CONCLUSION This system is useful for dumb, deaf and blind people to communicate with one another and with the normal people. The dumb people use their standard sign language which is not easily understandable by common people and blind people cannot see their gestures. This system converts the sign language into voice which is easily understandable by blind and normal people. The sign language is translated into some text form, to facilitate the deaf people as well. This text is display on LCD.
- 17. FUTURE ENHANCEMENTS Designing of wireless transceiver system for “Microcontroller and Sensors Based Gesture Vocalizer”. Perfection in monitoring and sensing of the dynamic movements involved in “Microcontroller and Sensors Based Gesture Vocalizer”. Designing of a whole jacket, which would be capable of vocalizing the gestures and movements of animals. Virtual reality application e.g., replacing the conventional input devices like joy sticks in videogames with the data glove. The Robot control system to regulate machine activity at remote sensitive sites.
- 18. REFERENCES Sushmita Mitra and Tinku Acharya,”Gesture Recognition: A Survey”, IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS. Juan P. Wachs, Helman Stern and Yael Edan, “Cluster Labeling and Parameter Estimation for the Automated Setup of a Hand-Gesture Recognition System”, IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS—SYSTEMS AND HUMANS
- 19. QUERY
- 20. THANK YOU