Gesture recognition technology
- 1. GESTURE RECOGNITION TECHNOLOGY DEPARTMENT OF COMPUTER SCIENCE AND INFORMATION TECHNOLOGY Guided by- Presented by- Dr. Ritu soni (H.O.D) Kompal Msc1(s/w) 1739006
- 2. CONTENT Introduction Gesture recognition Gesture operate on… Input devices Various technology in GRT Current GRT Benefits Drawbacks Conclusion
- 3. Introduction What are gestures? Movement of the hands or other part of the body. What is gesture recognition? Interpreting human gesture via mathematical algorithms. Gestures as input to control devices.
- 4. EXAMPLE A smart TV recognizing the hand movement to control the channels or to select a option from the menu…..
- 5. Gesture recognition 2 types of gestures are- Offline gestures processed after the user’s intraction. ex- gesture to activate a menu. Online gestures direct manipulations
- 6. GRT operates on…2D or 3D 2D-software based…. Three steps to process- Segmentation-separation of pixels Feature detection-detect based on outline of the user body. Gesture recognition-focus on direction.
- 7. GRT Operates on 3D… Uses cameras or sensors. Sensors depend on light wave. Type of light Structure light
- 8. Input devices Tools to track a person movement Tracking technology. wired gloves,depth aware camera,stereo cameras, controller based gesture,single camera. Natural gesture only recognition. Symbolic gesture recognition.
- 9. Wired gloves Provide input to computer about position and notation of hands. Use fiber optic cable.
- 10. Depth aware cameras Specialized camera generate depth map of what is being seen Effective detection due to short range
- 11. Stereo camera Camera has two lenses about the same distance A 3D representation can be approximated.
- 12. Controller based gesture act as an extension of the body so that when gestures are performed ,some of their motion can be conveniently captured by software.
- 13. Working System is capable of detecting movements in 3-D without putting fingers on the screen. Sensors are mounted around the screen, by interacting in the line-of-sight of these sensors the motion is detected and interpreted into on-screen movements.
- 14. Cont…current gesture recognition technology. There are technology companies that are dedicated to providing touch free gestures recognition products such as: TV, tab , mobile phones.
- 15. GRT system (body parameters) (feature space) recognised gesture Sensor processing Feature extraction Gesture claasification
- 17. Algorithms 3D :-A real hand is interpreted as a collection of vertices, software uses their relative position and interaction in order to infer the gesture. Skeletal:-has fewer parameters and it's easier to compute. Appearance :-compared with different hand templates ,if match, the correspondent gesture is inferred.
- 18. 3D :-A real hand is interpreted as a collection of vertices, software uses their relative position and interaction in order to infer the gesture. Skeletal:-has fewer parameters and it's easier to compute. Appearance :-compared with different hand templates ,if match, the correspondent gesture is inferred.
- 20. Gesture or Letters Code for 9 letters or gestures. Letters were-A,I,J,L,M,O,S,V,Z. Based on the values gives output the yaw,Pitch,Role.
- 21. Methodology When the y,p,r value exceeds a certain range,it sets a flag. Each y,p,r has certain flag. Each gesture will set different flag depending on the shape.
- 22. An example….Eye Sight Eye Sight is a gesture technology which allows you to navigate through your devices by just pointing at it.
- 23. Advantages Pointing gestures Camera based gesture needs a lighted environment. Camera need to be pointed at you always. Different from motion robotic arm. Navigate in a virtual environment. Pick up and manipulate virtual objects. Intract with the 3D world. No physical contact with the computer. Communicate at a distance.
- 25. Disadvantages Performance recognition algorith decreases when the distance is greater than 1.5 metres b/w user & camera. System limitation restrict the applications such as-arm must be vertical etc.
- 27. Conclusion Recently this has become a emerging technology. Allow user to intract with digital environment.