Gesture Recogntion Technology
- 1. Seminar on Gesture Recognition System Presentation by- Mohit (15MI414)
- 2. Content What is Gesture Recognition Basic Working and types of Gestures Facial and Hand Gesture Recognition Gesture Sensing Technology and Algorithms Technology behind…. Features Applications Leap Motion Challenges
- 3. What is Gesture Recognition Gesture Recognition Technology allows a user to interact with their digital devices using simple hand and body gestures. It is used for interpreting human gestures via mathematical algorithms.
- 4. A Basic working of gesture recognition system
- 5. Types of Gestures 1. Gesticulation Spontaneous movement of hands and arms that accompany gestures. 2. Language like Gestures • Gesticulation that is integrated into a spoken utterance, replacing a particular spoken word or phrase. 3. Pantomimes Gestures that depict objects or actions, with or without accompanying speech. 4. Emblems • Familiar gestures such as V for victory, thumbs up, and assorted rude gestures. 5. Sign Language • Linguistic systems, such as American Sign Language, which are well defined.
- 6. Facial Gesture Recognition • Facial gesture recognition creates an effective non-contact interface between user and machines. • The goal of facial gesture recognition is to make machines effectively understand human emotions, regardless of the countless physical differences between individuals .
- 7. Hand Gesture Recognition This technology allows operations of complex machines using only a series of finger and hand movements, eliminating the need for physical contact between user and machines and acts as a highly interactive interface between machine and users
- 8. Gesture Sensing Technology • Contact Type • 1. Touch Based Gestures • Non Contact Type • 1. Device Gesture Technologies • 2. Vision-based Technologies • 3. Electrical Field Sensing
- 9. Algorithms • 3D model based algorithm • Skeletal based algorithms • Appearance based algorithms
- 10. 3D model based algorithm A real hand is interpreted as a collection of vertices and lines in the 3D mesh version and the software uses their relative position. Skeletal based algorithm The skeletal version is effectively modelling the hand. This has fewer parameters than the volumetric version and it's easier to compute, making it suitable for real-time gesture analysis systems Appearance based models These binary silhouette or contour images represent typical input for appearance- based algorithms.
- 11. Technology Behind Wired Gloves • These can provide input to the computer about the position and rotation of the hands using magnetic or inertial tracking devices. • The first commercially available hand- tracking glove-type device was the Data Glove , a glove-type device which could detect hand position, movement and finger bending. • This uses fiber optic cables running down the back of the hand. Light pulses are created and when the fingers are bent, light leaks through small cracks and the loss is registered, giving an approximation of the hand pose.
- 12. Technologies behind Thermal Camera • An infrared camera is a device that detects infrared radiation(temperature) from the target object and converts it into an electronic signal to generate a thermal picture on a monitor or to make temperature calculations on it. • The temperature which is captured by an infrared camera can be measured or quantified exactly, so that not only the thermal behavior can be observed but also the relative magnitude of temperature related problems can be recognized and noted
- 13. Technology Behind Depth Camera • Using specialized cameras such as structured light or time-of-flight cameras, one can generate a depth map of what is being seen through the camera at a short range, and use this data to approximate a 3d representation of what is being seen. • These can be effective for detection of hand gestures due to their short range capabilities.
- 14. Features More accurate High stability Time saving • Gesture recognition technology has been considered to be the highly successful technology as it saves time to unlock any device. • Gesture recognition can be conducted with techniques from computer vision and image processing. • The literature includes ongoing work in the computer vision field on capturing gestures or more general human pose and movements by cameras connected to a computer
- 16. Leap Motion Leap Motion, Inc. is an American company that manufactures and markets a computer hardware sensor device that supports hand and finger motions as input, analogous to a mouse, but requires no hand contact or touching. In 2016, the company released new software designed for hand tracking in virtual reality.
- 17. Latency • Image processing can be significantly slow creating unacceptable latency for video • games and other similar applications Lack of Gesture Language • Different users make gestures differently, causing difficulty in identifying motions Robustness • Many gesture recognition systems do not read motions accurately or optimally due to factors like insufficient background light, high background noise etc. Performance • Image processing involved in gesture recognition is quite resource intensive and the applications may found difficult to run on resource constrained devices. CHALLENGES
- 18. THANK YOU