Eigenface For Face Recognition
Download as PPT, PDF8 likes22,363 views
The document discusses the eigenface approach for face recognition. It provides an overview of eigenfaces, how they are calculated from a training set of faces, and how they can be used to identify faces by projecting faces onto the eigenface space. Major steps include calculating the eigenfaces from a training set, projecting new images into eigenface space to get weight coefficients, and comparing the weights to known individuals' weights or thresholds to classify faces as known or unknown. Advantages are ease of implementation and little preprocessing required, while limitations include sensitivity to head scale and only applicable to frontal views under controlled conditions.
![Overview Face Representation Template-based approaches Feature-based approaches Appearance-based approaches Face Detection Utilization of elliptical shape of human head ( applicable only to front views ) [5] Manipulation of images in “face space” [1] Face Identification Performance affected by scale, pose, illumination, facial expression, and disguise, etc.](https://image.slidesharecdn.com/eigenface-for-face-recognition-1226889441984942-9/85/Eigenface-For-Face-Recognition-3-320.jpg)
Eigenface For Face Recognition
- 1. Eigenface for Face Recognition Presenter: Trần Đức Minh
- 2. Outline Overview Eigenfaces for Recognition Conclusion
- 3. Overview Face Representation Template-based approaches Feature-based approaches Appearance-based approaches Face Detection Utilization of elliptical shape of human head ( applicable only to front views ) [5] Manipulation of images in “face space” [1] Face Identification Performance affected by scale, pose, illumination, facial expression, and disguise, etc.
- 4. Face space An image is a point in a high dimensional space An N x M image is a point in R NM We can define vectors in this space as we did in the 2D case + =
- 5. Outline Overview Eigenfaces for Recognition Conclusion
- 6. Eigenfaces Approach In the language of information theory…… Efficient encoding followed by comparing one face encoding with a database of models encoded similarly
- 7. Eigenfaces Approach (Contd.) In mathematical terms……. Find the principal components of the face distribution, or the eigenvectors of the covariance matrix of the set of face images, called eigenfaces Eigenfaces are a set of features that characterize the variation between face images Each training face image can be represented in terms of a linear combination of the eigenfaces, so can the new input image Compare the feature weights of the new input image with those of the known individuals
- 8. Example for eigenface Eigenfaces look somewhat like generic faces.
- 9. Major Steps Initialization: acquire the training set of face images and calculate the eigenfaces, which define the face space Given an image to be recognized, calculate a set of weights of the M eigenfaces by projecting it onto each of the eigenfaces Determine if the image is a face at all by checking if the image is sufficiently close to the face space If it is a face, classify the weight pattern as either a known person of as unknown (Optional) If the same unknown face is seen several times, update the eigenfaces / weight patterns, calculate its characteristic weight pattern and incorporate into the known faces
- 10. Calculating Eigenfaces Set of training images ( is a column vector of size ) Average face of the training set: Each training image differs from the average face by: A total number of pairs of eigenvectors and eigenvalues of the covariance matrix ( C : matrix) Eq. (1) where ( A : matrix) Computationally Intractable !
- 11. Calculating Eigenfaces For Computational Feasibility Only M - 1 eigenvectors are meaningful ( ) Eigenvectors and associated eigenvalues of : Eq. (2) Therefore, are the eigenvalues of , are the associated eigenvalues Eq. (3) The associated eigenvalues allow us to rank the eigenvectors according to their usefulness in characterizing the variation among the images
- 12. Using Eigenfaces for Identification Construction of Known Individuals’ Face Classes -- Images of known individuals are projected onto “face space” by a simple operation , where i=1, 2, ……, M represents the i th individual, and k =1, 2, ……, M’ represents the weight coefficient of eigenvector . The pattern vector of the i th individual -- If an individual has more than one image, take the average of the pattern vectors of this person
- 13. Using Eigenfaces for Identification (Contd.) Given a new image -- Project onto face space, and get its pattern vector -- Determine whether is a face image: Eq. (4) If < a predefined threshold , it is a face image; otherwise, not -- Classify either as a known individual or as unknown: Eq. (5) If < a predefined threshold , is identified as the k’ th face class; otherwise, it is identified as unknown
- 14. Outline Overview Eigenfaces for Recognition Conclusion
- 15. Advantages Ease of implementation No knowledge of geometry or specific feature of the face required Little preprocessing work
- 16. Limitations Sensitive to head scale Applicable only to front view Good performance only under controlled background (not including natural scenes)
- 17. Reference “ Eigenfaces for recognition”, M. Turk and A. Pentland, Journal of Cognitive Neuroscience, vol.3, No.1, 1991 “ Face recognition using eigenfaces”, M. Turk and A. Pentland, Proc. IEEE Conf. on Computer Vision and Pattern Recognition , pages 586-591, 1991 Lindsay. I. Smith. A tutorial on principal components analysis, February 2002 Ilker Atalay M.Sc Thesis: Face Recognition Using Eigenfaces Istanbul Technical University – January 1996 Dimitri Pissarenko, Eigenface-based facial recognition, Feb 06, 2003
- 18. Demo
- 19. Thank you