Blink detection and tracking of eyes for eye localisat
Download as PPT, PDF1 like1,360 views
This document presents a method for blink detection, eye tracking, and eye localization. It proposes using frame differencing, thresholding, and optical flow analysis to detect eye blinks. Key steps include obtaining motion regions through frame differencing, thresholding to find eye blobs, and computing optical flow fields to determine if dominant blob motion is upward or downward, indicating eye opening or closing. Eye tracking is then performed on localized eye regions using KLT tracking with 20 feature points. The method aims to accurately and quickly locate and track eyes for applications like human-computer interaction and security identification.
Blink detection and tracking of eyes for eye localisat
- 1. 1 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALISATION BY LOPAMUDRA MOHAPATRA (200199200)
- 2. 2 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 INTRODUCTION What is blink detection? What is eye tracking? What is localization of eye?
- 3. 3 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 WHY WE GO FOR EYE LOCALIZATION • Face normalization • Eye gaze based human computer interface. • For reading detection. • Security systems using the human iris for identification.
- 4. 4 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 PROPOSED PROTOCOL WHOLE METHOD EYETRACKING THRESHHOLDING FRAMEDIFFERENCING EYE LOCALIZATION
- 5. 5 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 THRESH HOLDING
- 6. 6 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 FRAME DIFFERENCING
- 7. 7 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 FRAME DIFFERENCING
- 8. 8 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 ALGORITHMS Steps in the blink detection (1) Obtain location of possible motion using Frame differencing. (2) Suitably thresh hold the motion regions and obtain blobs using morphological operation and connected components.
- 9. 9 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 ALGORITHM CONTD…... (3) Remove unsuitable blobs that is either too big or too small or have incorrect width to height ratios to be considered as eyes. (4) Repeat (1) to (3) until a suitable pair of blobs are found and mark their positions. (5) Compute optical flow field in the blob regions (6)Mark dominant direction of motion of blobs.
- 10. 10 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 Algorithm contd….. If the dominant motion is downward in a pair of blobs their positions are noted.These would represent eye closure during a blink. If the motion is not downward then steps (1) to (6) are repeated. (7) Repeat steps (1) to (6). (8)Discard blobs that are not suited near the location of the blobs found with downward motion.
- 11. 11 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 Algorithm contd (8) Compute optical flow to ascertain if the dominant motion is upward with two ball remaining or repeat from step (7). (9) If the dominant motion is upward, then classify the frame beginning from the frame where downward motion was detected to the frame where upward motion was detected as blink frames. If after downward motion no upward motion is detected upto 3 frames it is considered as no blinks. Process of blink detection is started from newframe.
- 12. 12 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 (10) The bounding boxes of the blobs where blink is deemed to have occurred is taken as eye detection. OPTICAL FLOW METHOD: It allows for the differentiation between vertical eyelid movements during blinks and movement of eyeball and horizotal head movements. EYE TRACKING : After the location of eyes tracking is done by using KLT tracker.
- 13. 13 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 EYETRACKING In eye tracking mainly there are 20 feature points are taken,which gives the more accuracy. * These feature pts are taken from the eye area and they are tracked in different places,and reinitialization is done.
- 14. 14 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 Results of eye tracking (a) eye region initialized (b) tracked eye regions to a movement just before blink.
- 15. 15 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 COMPUTATION SPEEDUP To speed up localization we need to speed up in - Optical Flow - Eye tracking. EXPERIMENTAL RESULT : (1) Optical flow: 10 sec (2) Tracking of eyes : 10 sec (3) reading image from disk: 13 sec
- 16. 16 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 CONCLUSION In this paper we have proposed an accurate and fast method for locating and tracking the eyes of a computer user situated in front of the monitor. By computing optical flow and using both the magnitude and direction of the flow vectors, we can differentiate blinking from the other motions. In this way our study completed.
- 17. 17 Nationalinstituteofscience&technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS200199200 THANK YOU!!!