MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
1
Pattern Recognition
Name: Muhammad Gulraj
Muhammad.gulraj@yahoo.com
MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
2
Introduction
In real world human beings identify certain things using pattern recognition. It is a built in ability
in human beings, e.g. humans recognize different melodies, faces, words and images using
their innate abilities of pattern recognition.
In computer science Pattern Recognition ‘is taking a decision or inference on the basis of
some input data using the patterns of data’, e.g. an Email system decides on the basis of certain
patterns, whether a specific email is spam or non-spam. Similarly using the patterns of DNA it
can be inferred whether a patient have chances of breast cancer or not.
Input Data Results
Pattern recognition assigns label to input values using classification or regression, which are the
main forms of Pattern recognition. Classification is usually used for discrete class labels in
which certain decisions are made by assigning a label to each input value from the given
classes. Supervised learning is a type of classification because the training set has been
provided. Deciding whether an email is spam or non-spam is an example of
Classification/Supervised learning.
Pattern recognition
system
MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
3
The above figure shows an example of Classification. The figure shows that a patient having
small tumor size and young age have less chances of breast cancer (blue color), than the one
having large tumor size and older age (red color). Regression is used for labeling continuous
values.
In Unsupervised learning there is no training set/data provided on which the system can be
trained. Search engines usually implements unsupervised learning algorithms for
indexing/clustering of information. Pattern recognition tries to find the best answer using
statistical and probabilistic variations.
Applications
Pattern recognition has been used in security systems, medical diagnosis, search engines, data
mining and speech recognition systems, optical and hand written character recognition systems,
identification systems, robotics and analysis of astronomical data.
Pattern recognition has been vastly used in Security systems. These systems are normally
used in banks, offices, military and government installations. Some security systems which use
pattern recognition are as follows.
 Iris recognition system uses the patterns of iris in human eyes to recognize
individuals. Every human being have unique iris pattern inside his eye on the basis of
which a human being can be recognized.
 Face recognition system is another system that uses the patterns of skin and other
features to identify humans in images and videos.
MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
4
 Another system that is used for security purposes is Finger print recognition system
which uses three different patterns namely whorl, arch and loop of thumb to identify a
person.
Pattern recognition is also used in medical systems to diagnose patients. Systems such as
MRI scanning and computer aided diagnosis systems CAD are using pattern recognition
techniques to identify different diseases.
Search engines e.g. yahoo, Google, Ask and Bing also use pattern recognition techniques to
identify and index information for users.
Data mining is another field in which pattern recognition has been used. Data mining is
basically used for extracting useful information from huge data sets.
Pattern recognition is also used in speech recognition and speech tagging. Speech
recognition system is used for security purposes as well as research in natural language
processing.
Robotics is using pattern recognition to inculcate supervised as well as unsupervised learning
in robots. Scientists are working on super intelligent robots, which can understand the
environment and act accordingly. NASA has developed pattern recognition robots which can be
used for navigating and studying environment of other planets such as Mars. Autonomous and
Semi-autonomous cars have also been introduced using pattern recognition techniques.
Industrial automation uses pattern recognition techniques to identify items that have some
fault from the rest. These techniques have reduced work hours and enhanced efficiency.
Astronomers and scientists use pattern recognition techniques to identify and study different
galaxies. Usually techniques such as decision tree are used for star – galaxy classification.
MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
5
Apart from the above mentioned systems, pattern recognition techniques and algorithms are
used in image processing, computer vision, machine learning, artificial intelligence, cognitive
science and psychology.
Basic steps of pattern recognition task
The basic steps that involves in pattern recognition task are
 Data acquisition using sensors.
 Pre- processing such as segmentation and contrast adjustment.
 Feature extraction from the Pre-processed data.
 Classification on the basis of features extracted.
 Post processing which includes cost to improve system’s performance.
 Decision on the basis of the above steps
Data
Acquisition
Pre -
Processing
Feature
Extraction
Classification
Post
Processing
SENSOR
DecisionInput Data
MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
6
Techniques
The system usually acquires data using different sensors such as camera, microphone or
scanner. These sensors normally convert analog or continuous data into discrete form so that it
can be used in computer. The data acquired using sensors can be used as input data as well as
a training set for the system.
The second step is Pre-processing. Pre-processing is a process in which the system perform
some operations on the input data to make it useful for the next step. There are several
techniques to make this data useful, e.g. if the input data that is acquired is an image or video
then this image can be divided into different segments or pixels (Segmentation). This image can
also be made useful by adjusting the contrast of the image.
After pre-processing the data is passed to the next step which is called Feature Extraction.
Feature extraction is a domain specific problem and different methods can be applied to extract
features, e.g. in a system that is used for Human recognition, we can extract features such as
shape, hair, legs, skin color, nose, eyes and hands using edge detection, motion detection and
color intensities. Contrast equalization and Gabor filter can be used to extract features from an
image in face recognition system.
The Classification uses the features extracted by the system to assign classes to each point.
The system will have to establish some threshold on the basis of which a certain class can be
assign to every data point. A system can use one or more classifiers depending upon the
problem. There are different classifiers available which can be used such as Bayes classifier,
linear classifiers, nearest neighbor classifier and support vector machines. Bayes classifier is
the most common classifier which is used in classification.
Post processing is usually used for improvement in performance using different techniques
such as minimizing the cost of classification. Post processing can enhance the quality of
decision. Using the above steps the system decides to perform a particular action.
MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
7
Areas and application for research
Pattern recognition is a vast and interesting field of study which is interrelated with Artificial
intelligence and machine learning. There are enormous opportunities of research in this field.
Research area includes feature extraction, classification, and discriminant analysis, analysis of
astronomical data using clusters, human identification, image/video analysis, data mining and
business intelligence, speech recognition, optical character recognition OCR, medical diagnosis
systems, industrial automation, autonomous vehicles, robotics and error/cost estimation.
Robotics is another field which uses pattern recognition extensively. Rover 1 which has been
recently sent to Mars by NASA to identify and navigate the environment uses Pattern
recognition. Robots can also be used for fire-fighting. Advance research is going on in robotics
as well.
Medical and cognitive science is another field in which application development and research
has been done using pattern recognition. In cognitive science patterns of human behavior and
their actions according to these patterns are studied. Psychologists use these patterns to
identify human behavioral disorders. Medical diagnosis decision support system is another field
of medical/pattern recognition in which research is carried out.
Pattern recognition is an important subject of research in security systems. There are many
security systems which uses pattern recognition techniques. But these systems have also some
hacks, so scientists are constantly trying to develop new algorithms and techniques to find new
and enhanced solutions.
Unlimited recognition such as cursive script and continuous speech/image recognition is still a
distant dream for scientists and a lot of work needs to be done to achieve that dream.
MuhammadGulraj
BS Computersystemengineering, GIKI,Pakistan
MS Computersystemengineering, UETPeshawar,Pakistan
8
References
1. Andrew Ng (2013), an online course for Machine learning, Stanford University,
Stanford, https://class.coursera.org/ml-004/class.
2. Duda and Hart, Pattern Classification (2001-2002), Wiley, New York.
3. Ying Cui and Zhong Jin, Facial feature points (2012),
http://www.jprr.org/index.php/jprr
4. Ioannis Dimou and Michalis Zervakis, On the analogy of classifier ensembles,
http://www.jprr.org/index.php/jprr
5. Nair, H., A system for pattern recognition and pattern summarization in multiband
satellite images, http://www.springer.com/computer/image+processing/journal/11493

More Related Content

DOCX
Multiple object detection report
PDF
A review on fake biometric detection system for various applications
PDF
IMAGE QUALITY ASSESSMENT FOR FAKE BIOMETRIC DETECTION: APPLICATION TO IRIS, F...
PDF
A REVIEW ON BLIND STILL IMAGE STEGANALYSIS TECHNIQUES USING FEATURES EXTRACTI...
PDF
Improving the accuracy of fingerprinting system using multibiometric approach
PDF
A Survey of Security of Multimodal Biometric Systems
PDF
ENHANCED SYSTEM FOR COMPUTER-AIDED DETECTION OF MRI BRAIN TUMORS
PPTX
Thesis presentation ist
Multiple object detection report
A review on fake biometric detection system for various applications
IMAGE QUALITY ASSESSMENT FOR FAKE BIOMETRIC DETECTION: APPLICATION TO IRIS, F...
A REVIEW ON BLIND STILL IMAGE STEGANALYSIS TECHNIQUES USING FEATURES EXTRACTI...
Improving the accuracy of fingerprinting system using multibiometric approach
A Survey of Security of Multimodal Biometric Systems
ENHANCED SYSTEM FOR COMPUTER-AIDED DETECTION OF MRI BRAIN TUMORS
Thesis presentation ist

What's hot (19)

PDF
Facial image classification and searching –a survey
PDF
IRJET - Biometric Traits and Applications of Fingerprint
PDF
IRJET- Result on the Application for Multiple Disease Prediction from Symptom...
PDF
Performance Enhancement Of Multimodal Biometrics Using Cryptosystem
PDF
(2007) Performance Analysis for Multi Sensor Fingerprint Recognition System
PDF
IRJET- Pattern Recognition Process, Methods and Applications in Artificial In...
PDF
ADAPTABLE FINGERPRINT MINUTIAE EXTRACTION ALGORITHM BASED-ON CROSSING NUMBER ...
PDF
Image annotation - Segmentation & Annotation
PDF
AHP validated literature review of forgery type dependent passive image forge...
PDF
System for Fingerprint Image Analysis
PDF
AN IMPROVED TECHNIQUE FOR HUMAN FACE RECOGNITION USING IMAGE PROCESSING
PDF
Use of artificial neural network in pattern recognition
PDF
A NOVEL BINNING AND INDEXING APPROACH USING HAND GEOMETRY AND PALM PRINT TO E...
PDF
1879 1885
PDF
Fault Detection in Mobile Communication Networks Using Data Mining Techniques...
PDF
(2008) Statistical Analysis Framework for Biometric System Interoperability T...
PDF
Sum Rule Based Matching Score Level Fusion of Fingerprint and Iris Images for...
PDF
IRJET - Real Time Facial Analysis using Tensorflowand OpenCV
Facial image classification and searching –a survey
IRJET - Biometric Traits and Applications of Fingerprint
IRJET- Result on the Application for Multiple Disease Prediction from Symptom...
Performance Enhancement Of Multimodal Biometrics Using Cryptosystem
(2007) Performance Analysis for Multi Sensor Fingerprint Recognition System
IRJET- Pattern Recognition Process, Methods and Applications in Artificial In...
ADAPTABLE FINGERPRINT MINUTIAE EXTRACTION ALGORITHM BASED-ON CROSSING NUMBER ...
Image annotation - Segmentation & Annotation
AHP validated literature review of forgery type dependent passive image forge...
System for Fingerprint Image Analysis
AN IMPROVED TECHNIQUE FOR HUMAN FACE RECOGNITION USING IMAGE PROCESSING
Use of artificial neural network in pattern recognition
A NOVEL BINNING AND INDEXING APPROACH USING HAND GEOMETRY AND PALM PRINT TO E...
1879 1885
Fault Detection in Mobile Communication Networks Using Data Mining Techniques...
(2008) Statistical Analysis Framework for Biometric System Interoperability T...
Sum Rule Based Matching Score Level Fusion of Fingerprint and Iris Images for...
IRJET - Real Time Facial Analysis using Tensorflowand OpenCV
Ad

Viewers also liked (20)

PPTX
Feature Selection in Machine Learning
PDF
Iris data analysis example in R
DOCX
Machine Learning 1
DOCX
An Introduction to HMM and it’s Uses
DOCX
Paper - Muhammad Gulraj
DOCX
Performance analysis of KNN & K-Means using internet advertisements data
PPT
www1.cs.columbia.edu
PDF
Machine learning algorithm for classification of activity of daily life’s
PPT
MSShin-Machine_Learning_Algorithm_in_Period_Estimation.ppt
PPTX
Design & implementation of machine learning algorithm in (2)
PDF
An Introduction to Hidden Markov Model
PPTX
Introduction to hmm
PPTX
Support Vector Machine(SVM) with Iris and Mushroom Dataset
PPTX
PPT
Introduction to HMMs in Bioinformatics
PPT
Hidden Markov Models with applications to speech recognition
PPT
Online Character Recognition
PDF
Markov Models
PPTX
Analysis of Feature Selection Algorithms (Branch & Bound and Beam search)
PPT
HIDDEN MARKOV MODEL AND ITS APPLICATION
Feature Selection in Machine Learning
Iris data analysis example in R
Machine Learning 1
An Introduction to HMM and it’s Uses
Paper - Muhammad Gulraj
Performance analysis of KNN & K-Means using internet advertisements data
www1.cs.columbia.edu
Machine learning algorithm for classification of activity of daily life’s
MSShin-Machine_Learning_Algorithm_in_Period_Estimation.ppt
Design & implementation of machine learning algorithm in (2)
An Introduction to Hidden Markov Model
Introduction to hmm
Support Vector Machine(SVM) with Iris and Mushroom Dataset
Introduction to HMMs in Bioinformatics
Hidden Markov Models with applications to speech recognition
Online Character Recognition
Markov Models
Analysis of Feature Selection Algorithms (Branch & Bound and Beam search)
HIDDEN MARKOV MODEL AND ITS APPLICATION
Ad

Similar to Pattern Recognition #1 - Gulraj (20)

PPTX
Pattern recognition and Machine Learning.
PDF
Lect#1_Pattern_Recognition_PGIT204D_By_Dr_TSSinha.pdf
PPTX
Machine learning and pattern recognition
PDF
Pattern Matching AI.pdf
PDF
Understanding The Pattern Of Recognition
PPT
pattern recognition.ppt
PDF
Pattern Recognition 21BR551 MODULE 01 NOTES.pdf
PPTX
Introduction-to-Pattern-Recognition.pptx
PDF
A Review on Pattern Recognition with Offline Signature Classification and Tec...
PPTX
Pattern recognition
PPTX
Lecture 1.pptx
PPTX
Pattern recognition
PDF
Pattern recognition in ML.pdf
PDF
Applications of Pattern Recognition Algorithms in Agriculture: A Review
PDF
Design principle of pattern recognition system and STATISTICAL PATTERN RECOGN...
PPTX
Presentation flora
PPT
Pattern recognition
PPTX
Avin jalal ai & pattern recognition1
PDF
Recognition of Handwritten Mathematical Equations
PPT
Introduction to pattern recognization
Pattern recognition and Machine Learning.
Lect#1_Pattern_Recognition_PGIT204D_By_Dr_TSSinha.pdf
Machine learning and pattern recognition
Pattern Matching AI.pdf
Understanding The Pattern Of Recognition
pattern recognition.ppt
Pattern Recognition 21BR551 MODULE 01 NOTES.pdf
Introduction-to-Pattern-Recognition.pptx
A Review on Pattern Recognition with Offline Signature Classification and Tec...
Pattern recognition
Lecture 1.pptx
Pattern recognition
Pattern recognition in ML.pdf
Applications of Pattern Recognition Algorithms in Agriculture: A Review
Design principle of pattern recognition system and STATISTICAL PATTERN RECOGN...
Presentation flora
Pattern recognition
Avin jalal ai & pattern recognition1
Recognition of Handwritten Mathematical Equations
Introduction to pattern recognization

Pattern Recognition #1 - Gulraj

  • 1. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 1 Pattern Recognition Name: Muhammad Gulraj Muhammad.gulraj@yahoo.com
  • 2. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 2 Introduction In real world human beings identify certain things using pattern recognition. It is a built in ability in human beings, e.g. humans recognize different melodies, faces, words and images using their innate abilities of pattern recognition. In computer science Pattern Recognition ‘is taking a decision or inference on the basis of some input data using the patterns of data’, e.g. an Email system decides on the basis of certain patterns, whether a specific email is spam or non-spam. Similarly using the patterns of DNA it can be inferred whether a patient have chances of breast cancer or not. Input Data Results Pattern recognition assigns label to input values using classification or regression, which are the main forms of Pattern recognition. Classification is usually used for discrete class labels in which certain decisions are made by assigning a label to each input value from the given classes. Supervised learning is a type of classification because the training set has been provided. Deciding whether an email is spam or non-spam is an example of Classification/Supervised learning. Pattern recognition system
  • 3. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 3 The above figure shows an example of Classification. The figure shows that a patient having small tumor size and young age have less chances of breast cancer (blue color), than the one having large tumor size and older age (red color). Regression is used for labeling continuous values. In Unsupervised learning there is no training set/data provided on which the system can be trained. Search engines usually implements unsupervised learning algorithms for indexing/clustering of information. Pattern recognition tries to find the best answer using statistical and probabilistic variations. Applications Pattern recognition has been used in security systems, medical diagnosis, search engines, data mining and speech recognition systems, optical and hand written character recognition systems, identification systems, robotics and analysis of astronomical data. Pattern recognition has been vastly used in Security systems. These systems are normally used in banks, offices, military and government installations. Some security systems which use pattern recognition are as follows.  Iris recognition system uses the patterns of iris in human eyes to recognize individuals. Every human being have unique iris pattern inside his eye on the basis of which a human being can be recognized.  Face recognition system is another system that uses the patterns of skin and other features to identify humans in images and videos.
  • 4. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 4  Another system that is used for security purposes is Finger print recognition system which uses three different patterns namely whorl, arch and loop of thumb to identify a person. Pattern recognition is also used in medical systems to diagnose patients. Systems such as MRI scanning and computer aided diagnosis systems CAD are using pattern recognition techniques to identify different diseases. Search engines e.g. yahoo, Google, Ask and Bing also use pattern recognition techniques to identify and index information for users. Data mining is another field in which pattern recognition has been used. Data mining is basically used for extracting useful information from huge data sets. Pattern recognition is also used in speech recognition and speech tagging. Speech recognition system is used for security purposes as well as research in natural language processing. Robotics is using pattern recognition to inculcate supervised as well as unsupervised learning in robots. Scientists are working on super intelligent robots, which can understand the environment and act accordingly. NASA has developed pattern recognition robots which can be used for navigating and studying environment of other planets such as Mars. Autonomous and Semi-autonomous cars have also been introduced using pattern recognition techniques. Industrial automation uses pattern recognition techniques to identify items that have some fault from the rest. These techniques have reduced work hours and enhanced efficiency. Astronomers and scientists use pattern recognition techniques to identify and study different galaxies. Usually techniques such as decision tree are used for star – galaxy classification.
  • 5. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 5 Apart from the above mentioned systems, pattern recognition techniques and algorithms are used in image processing, computer vision, machine learning, artificial intelligence, cognitive science and psychology. Basic steps of pattern recognition task The basic steps that involves in pattern recognition task are  Data acquisition using sensors.  Pre- processing such as segmentation and contrast adjustment.  Feature extraction from the Pre-processed data.  Classification on the basis of features extracted.  Post processing which includes cost to improve system’s performance.  Decision on the basis of the above steps Data Acquisition Pre - Processing Feature Extraction Classification Post Processing SENSOR DecisionInput Data
  • 6. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 6 Techniques The system usually acquires data using different sensors such as camera, microphone or scanner. These sensors normally convert analog or continuous data into discrete form so that it can be used in computer. The data acquired using sensors can be used as input data as well as a training set for the system. The second step is Pre-processing. Pre-processing is a process in which the system perform some operations on the input data to make it useful for the next step. There are several techniques to make this data useful, e.g. if the input data that is acquired is an image or video then this image can be divided into different segments or pixels (Segmentation). This image can also be made useful by adjusting the contrast of the image. After pre-processing the data is passed to the next step which is called Feature Extraction. Feature extraction is a domain specific problem and different methods can be applied to extract features, e.g. in a system that is used for Human recognition, we can extract features such as shape, hair, legs, skin color, nose, eyes and hands using edge detection, motion detection and color intensities. Contrast equalization and Gabor filter can be used to extract features from an image in face recognition system. The Classification uses the features extracted by the system to assign classes to each point. The system will have to establish some threshold on the basis of which a certain class can be assign to every data point. A system can use one or more classifiers depending upon the problem. There are different classifiers available which can be used such as Bayes classifier, linear classifiers, nearest neighbor classifier and support vector machines. Bayes classifier is the most common classifier which is used in classification. Post processing is usually used for improvement in performance using different techniques such as minimizing the cost of classification. Post processing can enhance the quality of decision. Using the above steps the system decides to perform a particular action.
  • 7. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 7 Areas and application for research Pattern recognition is a vast and interesting field of study which is interrelated with Artificial intelligence and machine learning. There are enormous opportunities of research in this field. Research area includes feature extraction, classification, and discriminant analysis, analysis of astronomical data using clusters, human identification, image/video analysis, data mining and business intelligence, speech recognition, optical character recognition OCR, medical diagnosis systems, industrial automation, autonomous vehicles, robotics and error/cost estimation. Robotics is another field which uses pattern recognition extensively. Rover 1 which has been recently sent to Mars by NASA to identify and navigate the environment uses Pattern recognition. Robots can also be used for fire-fighting. Advance research is going on in robotics as well. Medical and cognitive science is another field in which application development and research has been done using pattern recognition. In cognitive science patterns of human behavior and their actions according to these patterns are studied. Psychologists use these patterns to identify human behavioral disorders. Medical diagnosis decision support system is another field of medical/pattern recognition in which research is carried out. Pattern recognition is an important subject of research in security systems. There are many security systems which uses pattern recognition techniques. But these systems have also some hacks, so scientists are constantly trying to develop new algorithms and techniques to find new and enhanced solutions. Unlimited recognition such as cursive script and continuous speech/image recognition is still a distant dream for scientists and a lot of work needs to be done to achieve that dream.
  • 8. MuhammadGulraj BS Computersystemengineering, GIKI,Pakistan MS Computersystemengineering, UETPeshawar,Pakistan 8 References 1. Andrew Ng (2013), an online course for Machine learning, Stanford University, Stanford, https://class.coursera.org/ml-004/class. 2. Duda and Hart, Pattern Classification (2001-2002), Wiley, New York. 3. Ying Cui and Zhong Jin, Facial feature points (2012), http://www.jprr.org/index.php/jprr 4. Ioannis Dimou and Michalis Zervakis, On the analogy of classifier ensembles, http://www.jprr.org/index.php/jprr 5. Nair, H., A system for pattern recognition and pattern summarization in multiband satellite images, http://www.springer.com/computer/image+processing/journal/11493