SlideShare a Scribd company logo
Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2;
Nov, 2014)
© 2014, IJARIIT All Rights Reserved Page | 1
Classifications & Misclassifications of EEG
Signals using Linear and AdaBoost Support
Vector Machines
Neelam Rout
Research Scholar, Computer Science Department, S’O’A University
neelamrout732@gmail.com
Abstract: Epilepsy is one of the frequent brain disorder due to transient and unexpected electrical interruptions of
brain. Electroencephalography (EEG) is one of the most clinically and scientifically exploited signals recorded
from humans and very complex signal. EEG signals are non-stationary as it changes over time. So, discrete
wavelet transform (DWT) technique is used for feature extraction. Classifications and misclassifications of EEG
signals of linearly separable support vector machines are shown using training and testing datasets. Then
AdaBoost support vector machine is used to get strong classifier.
Keyword: Electroencephalography (EEG) signals, Feature extraction and selection, Linearly separable support
vector machines (SVM), AdaBoost support vector machines.
I. INTRODUCTION
Human brain is very complex system. Electroencephalography (EEG) signals which is the recording of
spontaneous electrical activity of the brain gives information about the function of the brain and it is a direct
measurement of cortical activity with millisecond temporal resolution. EEG signals are recorded in a short time by
placing electrodes at various positions on the scalp. Its temporal resolution of the EEG signal is high and it is also a
non-invasive procedure. The uses of EEG signals can be clinical and research uses [1].
II. MATERIALS AND METHODS
A. Description of EEG signals
The raw EEG signal is taken [2] which consists of total 5 sets (classes) of data (SET A, SET B, SET C, SET D,
and SET E) but three data sets are selected from 5 data sets in this work i.e. SET A contains recordings from healthy
volunteers with open eyes, SET D contains recording of epilepsy patients in the epileptogenic zone during the
seizure free interval, and SET E contains the recordings of epilepsy patients during epileptic seizures by using
Standard Electrode placement scheme also called as International 10-20 system [1]. Most of EEG waves range from
0.5-500 Hz, these bands are clinically relevant: (i) delta, (ii) theta, (iii) alpha, (iv) beta and (v) gamma.
Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2;
Nov, 2014)
© 2014, IJARIIT All Rights Reserved Page | 2
B. Feature Extraction and Selection
Feature extraction is the collection of relevant information from the signal. A discrete wavelet transform (DWT)
is any wavelet transform for which the wavelets are discretely sampled. For classification of EEG signals there are
four different successive stages followed i.e. normalization, segment detection, feature extraction, and classification.
In this each of the EEG signals is decomposed into four detail wavelet coefficients (D1, D2, D3, and D4) and one
approximation wavelet coefficients (A4). There are 20 dimension feature vectors for single EEG segment of Class
A, Class D, and Class E are used. Different statistics methods are used to reduce the number of features are,
maximum, minimum of wavelet, mean and standard Deviation of wavelet coefficients in each sub band [3].
Raw EEG signals
Feature extraction
Feature selection
20- Dimensional input vector 20- Dimensional input vector
[Fig 1: Generalized Structure of SVM Classifier]
III. CLASSIFIER
A. Linearly Separable support Vector Machines
Support vector machines (SVMs, also support vector networks) are supervised learning models. A Support vector
machine constructs a hyper plane or set of hyper planes in a high or infinite dimensional space, that optimally
separates the data into two categories. It is based on the concept of decision planes that define decision boundaries.
The Linearly separable figures are shown in the result section [6] [9].
B. AdaBoost Support Vector Machines
Ensemble method is used for unstable classifier to achieve improve performance. AdaBoost (Adaptive Boosting),
is a machine learning meta-algorithm was proposed by Y. Freund R. Schapire who won the prestigious “Godel
prize” in 2003. It is used in conjunction with other learning algorithms („weak learns‟) is combined into a weighted
sum that represents the final output of the boosted classifier for a given set of training sample. It maintains weight
for each sample. For each iteration , it is adaptively adjust weights. AdaBoost uses higher weights, which seems
Discrete wavelet transforms (level 4)
Wavelet coefficients
Statistics over wavelet coefficients
Linear Support Vector Machine AdaBoost SVM
Classifications & Misclassifications Classification
Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2;
Nov, 2014)
© 2014, IJARIIT All Rights Reserved Page | 3
difficult for component classifier. It combines all the component classifiers to make decision. It is sensitive to noisy
data. It is less susceptible to the over-fitting.
It is very fast, simple and easy to program, versatile, and no parameters to tune (except t). Its disadvantages are
weak classifiers too complex leads to over-fitting, weak classifiers too weak can lead to low margins, and can also
lead to over-fitting, and from empirical evidence, AdaBoost is particularly vulnerable to uniform noise [13][14].
C. Connection and Comparison between Linear & AdaBoost SVM
The Boosting and Support Vector Machines methods are “essentially the same” except the measuring techniques
for the margin. Boosting relies only the most salient dimensions and SVMs uses kernel tricks (l2 norm) to compute
scalar products in feature space and boosting uses l1-norm [17].
Using any desired linear or non-linear hyper-plane, SVMs globally and explicitly maximize the margin while
minimizing the number of wrongly classified examples while in a greedy fashion with lowest error, AdaBoost
combines a set of weak learners in order to form a strong classifier.
IV.DISCUSSION OF PRACTICAL IMPLEMENTATION & RESULTS OF SVM
A. Linearly separable SVM
[Fig 2: Linearly separable SVM 1] [Fig 3: Result of linearly separable SVM 1]
TABLE 1
LINEARLY SEPARABLE SVM 1
Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2;
Nov, 2014)
© 2014, IJARIIT All Rights Reserved Page | 4
[Fig 4: Linearly separable SVM 2] [Fig 5: Result of linearly separable SVM 2]
TABLE 2
LINEARLY SEPARABLE SVM 2
Theta Values -9.209138 & 10.543934
Support Vectors 70
Misclassifications 3
Classifications 67
B. AdaBoost SVM
[Fig 6: Training data for AdaBoost SVM model] [Fig 7: Training data classified with SVM model]
[Fig 8: Classification error versus weak signal classifier] [Fig 9: Test data classified with model]
Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2;
Nov, 2014)
© 2014, IJARIIT All Rights Reserved Page | 5
V. DISCUSSION OF RESULTS
In linear SVM 1, different theta values are taken but support vectors are fixed i.e. 400 and the results of
classifications and misclassifications are shown. In linear SVM 2, by using training and test data sets, the results of
classifications and misclassifications are shown where theta values and support vectors are fixed.
In the experiment of AdaBoost SVM, AdaBoost tries to generate a strong classifier. It is done by using a linear
combination of a set of weak classifiers which tries to find the best threshold to separate the data into two classes. In
each classification step, the boosting part changes the weights of miss-classified data. So that, “weak classifiers”
behaves as a “strong classifiers”.
VI. CONCLUSIONS & FUTURE WORKS
Electroencephalography (EEG) signals give important information about neurobiological disorders and for feature
extraction, DWT method is used. Different wavelet coefficients like maximum, minimum, mean and standard
deviation are used. Then the result of classifications and misclassifications of Support Vector Machines (Linear and
AdaBoost) for EEG signals are shown. AdaBooost SVM is used to convert a weak signal to a strong signal. EEG
signal processing is a vast area of research. Different types of feature extraction techniques can be tried to reduce the
computational complexity. Other new methodologies can be implemented in this area and further different types of
classifiers like hybridize pattern classifiers, kernel SVM can be tested.
ACKNOWLEDGMENT
I would like to express my special appreciation and thanks to my advisors, Parents and God.
REFERENCES
[1]. Mohammad Zavid Parvez, Manoranjan Paul, Epileptic seizure detection by analyzing EEG signals using
different transformation techniques, Volume 145, 5 December 2014, Pages 190–200.
[2]. http://www.meb.unibonn.de/epileptologie/science/physik/eegdata.html.
[3]. S.Soltani, On the use of the wavelet decomposition for time series prediction, Neurocomputing, vol. 48, pp. 267 -
277, 2002.
[4]. Qi Xu*, Hui Zhou, YongjiWang, Jian Huang, Fuzzy support vector machine for classification of EEG signals
using wavelet-based features, Medical Engineering & Physics 31 (2009) 858–865.
[5]. Deng Wang*, Duoqian Miao, Chen Xie, Best basis-based wavelet packet entropy feature extraction and
hierarchical EEG classification for epileptic detection, Expert Systems with Applications 38 (2011) 14314–14320.
[6]. Abdulhamit Subasi*, M. Ismail Gursoy, EEG signal classification using PCA, ICA, LDA and support vector
machines, Expert Systems with Applications 37 (2010) 8659–8666.
[7]. Elif Derya U¨ beyli*, Decision support systems for time-varying biomedical signals: EEG signals classification,
Expert Systems with Applications 36 (2009) 2275–2284.
[8]. Suryannarayana Chandaka, Amitava Chatterjee*, Sugata Munshi, Cross-correlation aided support vector
machine classifier for classification of EEG signals, Expert Systems with Applications 36 (2009) 1329–1336.
[9]. Elif Derya U¨beyli*, Support vector machines for detection of electrocardiographic changes in partial epileptic
patients, Engineering Applications of Artificial Intelligence 21 (2008) 1196–1203.
[10]. Babak Mohammadzadeh Asl*, Seyed Kamaledin Setarehdan, Maryam Mohebbi, Support vector machine-based
arrhythmia classification using reduced features of heart rate variability signal, Artificial Intelligence in Medicine
(2008) 44, 51—64.
Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2;
Nov, 2014)
© 2014, IJARIIT All Rights Reserved Page | 6
[11]. Sebastián Maldonado , Richard Weber , Fazel Famili, Feature selection for high-dimensional class-imbalanced
data sets using Support Vector Machines, Information Sciences 286 (2014) 228–246.
[12]. Elif Derya Übeyli*, Analysis of EEG signals by combining eigenvector methods and multiclass support vector
machines, Computers in Biology and Medicine 38 (2008) 14 – 22.
[13]. Xue-Fang Chen, Hong-Jie Xing*, Xi-Zhao Wang, A modified AdaBoost method for one-class SVM and its
application to novelty detection, Systems, Man, and Cybernetics (SMC), 2011 IEEE International Conference on ,
Page(s): 3506 – 3511, ISBN: 978-1-4577-0652-3.
[14]. Chengming Liu, Manchun Li*, Yongxue Liu*, Jieli Chen, Chenglei Shen, Application of Adaboost Based
Ensemble SVM on IKONOS Image Classification, Geoinformatics, 2010 18th International Conference on ,
Page(s):1 – 5, ISBN: 978-1-4244-7301-4.
[15]. Enrique Romero*, Llu12s M3arquez, Xavier Carreras, Margin maximization with feed-forward neural
networks: a comparative study with SVM and AdaBoost, Neurocomputing 57 (2004) 313 – 344.
[16]. Xuchun Li*, Lei Wang, Eric Sung, AdaBoost with SVM-based component classifiers, Engineering
Applications of Artificial Intelligence 21 (2008) 785–795.
[17]. Hanif Mohaddes Deylami, Yashwant Prasad Singh, Adaboost and SVM based cybercrime detection and
prevention model, Artificial Intelligence Research, December 2012, Vol. 1, No. 2.
[18]. E. D.U beyli, Combined neural network model employing wavelet coefficients for EEG signals classification,
Digital Signal Processing, vol. 19, pp. 297-308, 2009.

More Related Content

PDF
Classifications & Misclassifications of EEG Signals using Linear and AdaBoost...
PDF
IRJET - Effective Workflow for High-Performance Recognition of Fruits using M...
PDF
IRJET- Fault Detection and Maintenance Prediction for Gear of an Industri...
PDF
Iaetsd multi-view and multi band face recognition
PDF
IRJET - Implementation of Neural Network on FPGA
PDF
IRJET- Detection of Cataract by Statistical Features and Classification
PDF
Multi-way Array Decomposition on Acoustic Source Separation for Fault Diagnos...
PDF
IRJET- Diabetic Haemorrhage Detection using DWT and Elliptical LBP
Classifications & Misclassifications of EEG Signals using Linear and AdaBoost...
IRJET - Effective Workflow for High-Performance Recognition of Fruits using M...
IRJET- Fault Detection and Maintenance Prediction for Gear of an Industri...
Iaetsd multi-view and multi band face recognition
IRJET - Implementation of Neural Network on FPGA
IRJET- Detection of Cataract by Statistical Features and Classification
Multi-way Array Decomposition on Acoustic Source Separation for Fault Diagnos...
IRJET- Diabetic Haemorrhage Detection using DWT and Elliptical LBP

What's hot (19)

PDF
Ijetcas14 329
PDF
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
PDF
Genetic Algorithm Processor for Image Noise Filtering Using Evolvable Hardware
PPTX
Deep learning summary
PPTX
Final Thesis Presentation
PDF
The effect of gamma value on support vector machine performance with differen...
PDF
IRJET- Efficient Face Detection from Video Sequences using KNN and PCA
PDF
ENERGY COMPUTATION FOR BCI USING DCT AND MOVING AVERAGE WINDOW FOR NOISE SMOO...
PDF
IRJET- Image Classification – Cat and Dog Images
PDF
Efficiency of Neural Networks Study in the Design of Trusses
PDF
PDF
Comparison of hybrid pso sa algorithm and genetic algorithm for classification
PDF
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...
PPTX
Face Recognition: From Scratch To Hatch / Эдуард Тянтов (Mail.ru Group)
PDF
11.comparison of hybrid pso sa algorithm and genetic algorithm for classifica...
PDF
E1803053238
PDF
40120140507007
PDF
“Introducing Machine Learning and How to Teach Machines to See,” a Presentati...
PPT
15857 cse422 unsupervised-learning
Ijetcas14 329
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
Genetic Algorithm Processor for Image Noise Filtering Using Evolvable Hardware
Deep learning summary
Final Thesis Presentation
The effect of gamma value on support vector machine performance with differen...
IRJET- Efficient Face Detection from Video Sequences using KNN and PCA
ENERGY COMPUTATION FOR BCI USING DCT AND MOVING AVERAGE WINDOW FOR NOISE SMOO...
IRJET- Image Classification – Cat and Dog Images
Efficiency of Neural Networks Study in the Design of Trusses
Comparison of hybrid pso sa algorithm and genetic algorithm for classification
IRJET- Disentangling Brain Activity from EEG Data using Logistic Regression, ...
Face Recognition: From Scratch To Hatch / Эдуард Тянтов (Mail.ru Group)
11.comparison of hybrid pso sa algorithm and genetic algorithm for classifica...
E1803053238
40120140507007
“Introducing Machine Learning and How to Teach Machines to See,” a Presentati...
15857 cse422 unsupervised-learning
Ad

Viewers also liked (16)

PDF
ARFI on Testes @MEDIC CENTER, Nguyen Thien Hung et al
PPTX
Rodeo Hockey Club Campeon
ODP
7 24-Iisaku
PDF
Guitarra 14
PPTX
Struktur data & computer trends 2015 2016
PPTX
Storyboard
PPTX
Measuring a Nation’s Income
DOC
13.sürrealism
DOC
1.abstraktne ekspressionism usa konspekt
PPTX
CAP ARFI trong GAN THẤM MỠ tại MEDIC, Dr NGUYỄN THIỆN HÙNG
PPTX
Sieu am dan hoi trong chan doan ung thu tien liet tuyen
PDF
Jeff Moyer at Quivira Coalition Conference
PDF
DwesaBot - a Telegram bot for Africa
PPTX
ARFI on Testes @MEDIC CENTER, Nguyen Thien Hung et al
Rodeo Hockey Club Campeon
7 24-Iisaku
Guitarra 14
Struktur data & computer trends 2015 2016
Storyboard
Measuring a Nation’s Income
13.sürrealism
1.abstraktne ekspressionism usa konspekt
CAP ARFI trong GAN THẤM MỠ tại MEDIC, Dr NGUYỄN THIỆN HÙNG
Sieu am dan hoi trong chan doan ung thu tien liet tuyen
Jeff Moyer at Quivira Coalition Conference
DwesaBot - a Telegram bot for Africa
Ad

Similar to Classifications & Misclassifications of EEG Signals using Linear and AdaBoost Support Vector Machines (20)

PDF
A hybrid classification model for eeg signals
PDF
IRJET- Facial Gesture Recognition using Surface EMG and Multiclass Support Ve...
PDF
Neural network based numerical digits recognization using nnt in matlab
PDF
IRJET - Machine Learning Algorithms for the Detection of Diabetes
PDF
A Review of Lie Detection Techniques.pdf
PDF
A Review of Lie Detection Techniques
PDF
Ijetcas14 323
PDF
Bj4103381384
PDF
IRJET - Heart Health Classification and Prediction using Machine Learning
PDF
RECOGNITION SYSTEM USING MYO ARMBAND FOR HAND GESTURES - SURVEY
PDF
Microarray Data Classification Using Support Vector Machine
PDF
FPGA Implementation of Accelerated Finite Impulse Response Filter for EEG Ana...
PPTX
Biomedical Signals Classification With Transformer Based Model.pptx
PPTX
Recognition of Epilepsy from Non Seizure Electroencephalogram using combinati...
PDF
40220140507004
PDF
40220140507004
PDF
Comparative Study of Pre-Trained Neural Network Models in Detection of Glaucoma
PDF
Wavelet-Based Approach for Automatic Seizure Detection Using EEG Signals
PDF
Image Steganography Using Wavelet Transform And Genetic Algorithm
PDF
IRJET- Intrusion Detection using IP Binding in Real Network
A hybrid classification model for eeg signals
IRJET- Facial Gesture Recognition using Surface EMG and Multiclass Support Ve...
Neural network based numerical digits recognization using nnt in matlab
IRJET - Machine Learning Algorithms for the Detection of Diabetes
A Review of Lie Detection Techniques.pdf
A Review of Lie Detection Techniques
Ijetcas14 323
Bj4103381384
IRJET - Heart Health Classification and Prediction using Machine Learning
RECOGNITION SYSTEM USING MYO ARMBAND FOR HAND GESTURES - SURVEY
Microarray Data Classification Using Support Vector Machine
FPGA Implementation of Accelerated Finite Impulse Response Filter for EEG Ana...
Biomedical Signals Classification With Transformer Based Model.pptx
Recognition of Epilepsy from Non Seizure Electroencephalogram using combinati...
40220140507004
40220140507004
Comparative Study of Pre-Trained Neural Network Models in Detection of Glaucoma
Wavelet-Based Approach for Automatic Seizure Detection Using EEG Signals
Image Steganography Using Wavelet Transform And Genetic Algorithm
IRJET- Intrusion Detection using IP Binding in Real Network

Recently uploaded (20)

PDF
composite construction of structures.pdf
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
Lecture Notes Electrical Wiring System Components
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PPT
Mechanical Engineering MATERIALS Selection
PPTX
Construction Project Organization Group 2.pptx
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PDF
R24 SURVEYING LAB MANUAL for civil enggi
PPTX
Internet of Things (IOT) - A guide to understanding
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PPTX
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
PPTX
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
PPTX
UNIT 4 Total Quality Management .pptx
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
composite construction of structures.pdf
UNIT-1 - COAL BASED THERMAL POWER PLANTS
Lecture Notes Electrical Wiring System Components
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
Mechanical Engineering MATERIALS Selection
Construction Project Organization Group 2.pptx
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
R24 SURVEYING LAB MANUAL for civil enggi
Internet of Things (IOT) - A guide to understanding
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
UNIT 4 Total Quality Management .pptx
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Mitigating Risks through Effective Management for Enhancing Organizational Pe...

Classifications & Misclassifications of EEG Signals using Linear and AdaBoost Support Vector Machines

  • 1. Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2; Nov, 2014) © 2014, IJARIIT All Rights Reserved Page | 1 Classifications & Misclassifications of EEG Signals using Linear and AdaBoost Support Vector Machines Neelam Rout Research Scholar, Computer Science Department, S’O’A University neelamrout732@gmail.com Abstract: Epilepsy is one of the frequent brain disorder due to transient and unexpected electrical interruptions of brain. Electroencephalography (EEG) is one of the most clinically and scientifically exploited signals recorded from humans and very complex signal. EEG signals are non-stationary as it changes over time. So, discrete wavelet transform (DWT) technique is used for feature extraction. Classifications and misclassifications of EEG signals of linearly separable support vector machines are shown using training and testing datasets. Then AdaBoost support vector machine is used to get strong classifier. Keyword: Electroencephalography (EEG) signals, Feature extraction and selection, Linearly separable support vector machines (SVM), AdaBoost support vector machines. I. INTRODUCTION Human brain is very complex system. Electroencephalography (EEG) signals which is the recording of spontaneous electrical activity of the brain gives information about the function of the brain and it is a direct measurement of cortical activity with millisecond temporal resolution. EEG signals are recorded in a short time by placing electrodes at various positions on the scalp. Its temporal resolution of the EEG signal is high and it is also a non-invasive procedure. The uses of EEG signals can be clinical and research uses [1]. II. MATERIALS AND METHODS A. Description of EEG signals The raw EEG signal is taken [2] which consists of total 5 sets (classes) of data (SET A, SET B, SET C, SET D, and SET E) but three data sets are selected from 5 data sets in this work i.e. SET A contains recordings from healthy volunteers with open eyes, SET D contains recording of epilepsy patients in the epileptogenic zone during the seizure free interval, and SET E contains the recordings of epilepsy patients during epileptic seizures by using Standard Electrode placement scheme also called as International 10-20 system [1]. Most of EEG waves range from 0.5-500 Hz, these bands are clinically relevant: (i) delta, (ii) theta, (iii) alpha, (iv) beta and (v) gamma.
  • 2. Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2; Nov, 2014) © 2014, IJARIIT All Rights Reserved Page | 2 B. Feature Extraction and Selection Feature extraction is the collection of relevant information from the signal. A discrete wavelet transform (DWT) is any wavelet transform for which the wavelets are discretely sampled. For classification of EEG signals there are four different successive stages followed i.e. normalization, segment detection, feature extraction, and classification. In this each of the EEG signals is decomposed into four detail wavelet coefficients (D1, D2, D3, and D4) and one approximation wavelet coefficients (A4). There are 20 dimension feature vectors for single EEG segment of Class A, Class D, and Class E are used. Different statistics methods are used to reduce the number of features are, maximum, minimum of wavelet, mean and standard Deviation of wavelet coefficients in each sub band [3]. Raw EEG signals Feature extraction Feature selection 20- Dimensional input vector 20- Dimensional input vector [Fig 1: Generalized Structure of SVM Classifier] III. CLASSIFIER A. Linearly Separable support Vector Machines Support vector machines (SVMs, also support vector networks) are supervised learning models. A Support vector machine constructs a hyper plane or set of hyper planes in a high or infinite dimensional space, that optimally separates the data into two categories. It is based on the concept of decision planes that define decision boundaries. The Linearly separable figures are shown in the result section [6] [9]. B. AdaBoost Support Vector Machines Ensemble method is used for unstable classifier to achieve improve performance. AdaBoost (Adaptive Boosting), is a machine learning meta-algorithm was proposed by Y. Freund R. Schapire who won the prestigious “Godel prize” in 2003. It is used in conjunction with other learning algorithms („weak learns‟) is combined into a weighted sum that represents the final output of the boosted classifier for a given set of training sample. It maintains weight for each sample. For each iteration , it is adaptively adjust weights. AdaBoost uses higher weights, which seems Discrete wavelet transforms (level 4) Wavelet coefficients Statistics over wavelet coefficients Linear Support Vector Machine AdaBoost SVM Classifications & Misclassifications Classification
  • 3. Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2; Nov, 2014) © 2014, IJARIIT All Rights Reserved Page | 3 difficult for component classifier. It combines all the component classifiers to make decision. It is sensitive to noisy data. It is less susceptible to the over-fitting. It is very fast, simple and easy to program, versatile, and no parameters to tune (except t). Its disadvantages are weak classifiers too complex leads to over-fitting, weak classifiers too weak can lead to low margins, and can also lead to over-fitting, and from empirical evidence, AdaBoost is particularly vulnerable to uniform noise [13][14]. C. Connection and Comparison between Linear & AdaBoost SVM The Boosting and Support Vector Machines methods are “essentially the same” except the measuring techniques for the margin. Boosting relies only the most salient dimensions and SVMs uses kernel tricks (l2 norm) to compute scalar products in feature space and boosting uses l1-norm [17]. Using any desired linear or non-linear hyper-plane, SVMs globally and explicitly maximize the margin while minimizing the number of wrongly classified examples while in a greedy fashion with lowest error, AdaBoost combines a set of weak learners in order to form a strong classifier. IV.DISCUSSION OF PRACTICAL IMPLEMENTATION & RESULTS OF SVM A. Linearly separable SVM [Fig 2: Linearly separable SVM 1] [Fig 3: Result of linearly separable SVM 1] TABLE 1 LINEARLY SEPARABLE SVM 1
  • 4. Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2; Nov, 2014) © 2014, IJARIIT All Rights Reserved Page | 4 [Fig 4: Linearly separable SVM 2] [Fig 5: Result of linearly separable SVM 2] TABLE 2 LINEARLY SEPARABLE SVM 2 Theta Values -9.209138 & 10.543934 Support Vectors 70 Misclassifications 3 Classifications 67 B. AdaBoost SVM [Fig 6: Training data for AdaBoost SVM model] [Fig 7: Training data classified with SVM model] [Fig 8: Classification error versus weak signal classifier] [Fig 9: Test data classified with model]
  • 5. Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2; Nov, 2014) © 2014, IJARIIT All Rights Reserved Page | 5 V. DISCUSSION OF RESULTS In linear SVM 1, different theta values are taken but support vectors are fixed i.e. 400 and the results of classifications and misclassifications are shown. In linear SVM 2, by using training and test data sets, the results of classifications and misclassifications are shown where theta values and support vectors are fixed. In the experiment of AdaBoost SVM, AdaBoost tries to generate a strong classifier. It is done by using a linear combination of a set of weak classifiers which tries to find the best threshold to separate the data into two classes. In each classification step, the boosting part changes the weights of miss-classified data. So that, “weak classifiers” behaves as a “strong classifiers”. VI. CONCLUSIONS & FUTURE WORKS Electroencephalography (EEG) signals give important information about neurobiological disorders and for feature extraction, DWT method is used. Different wavelet coefficients like maximum, minimum, mean and standard deviation are used. Then the result of classifications and misclassifications of Support Vector Machines (Linear and AdaBoost) for EEG signals are shown. AdaBooost SVM is used to convert a weak signal to a strong signal. EEG signal processing is a vast area of research. Different types of feature extraction techniques can be tried to reduce the computational complexity. Other new methodologies can be implemented in this area and further different types of classifiers like hybridize pattern classifiers, kernel SVM can be tested. ACKNOWLEDGMENT I would like to express my special appreciation and thanks to my advisors, Parents and God. REFERENCES [1]. Mohammad Zavid Parvez, Manoranjan Paul, Epileptic seizure detection by analyzing EEG signals using different transformation techniques, Volume 145, 5 December 2014, Pages 190–200. [2]. http://www.meb.unibonn.de/epileptologie/science/physik/eegdata.html. [3]. S.Soltani, On the use of the wavelet decomposition for time series prediction, Neurocomputing, vol. 48, pp. 267 - 277, 2002. [4]. Qi Xu*, Hui Zhou, YongjiWang, Jian Huang, Fuzzy support vector machine for classification of EEG signals using wavelet-based features, Medical Engineering & Physics 31 (2009) 858–865. [5]. Deng Wang*, Duoqian Miao, Chen Xie, Best basis-based wavelet packet entropy feature extraction and hierarchical EEG classification for epileptic detection, Expert Systems with Applications 38 (2011) 14314–14320. [6]. Abdulhamit Subasi*, M. Ismail Gursoy, EEG signal classification using PCA, ICA, LDA and support vector machines, Expert Systems with Applications 37 (2010) 8659–8666. [7]. Elif Derya U¨ beyli*, Decision support systems for time-varying biomedical signals: EEG signals classification, Expert Systems with Applications 36 (2009) 2275–2284. [8]. Suryannarayana Chandaka, Amitava Chatterjee*, Sugata Munshi, Cross-correlation aided support vector machine classifier for classification of EEG signals, Expert Systems with Applications 36 (2009) 1329–1336. [9]. Elif Derya U¨beyli*, Support vector machines for detection of electrocardiographic changes in partial epileptic patients, Engineering Applications of Artificial Intelligence 21 (2008) 1196–1203. [10]. Babak Mohammadzadeh Asl*, Seyed Kamaledin Setarehdan, Maryam Mohebbi, Support vector machine-based arrhythmia classification using reduced features of heart rate variability signal, Artificial Intelligence in Medicine (2008) 44, 51—64.
  • 6. Rout et al, International Journal of Advance research, Ideas and Innovations in Technology. (Volume1, Issue 2; Nov, 2014) © 2014, IJARIIT All Rights Reserved Page | 6 [11]. Sebastián Maldonado , Richard Weber , Fazel Famili, Feature selection for high-dimensional class-imbalanced data sets using Support Vector Machines, Information Sciences 286 (2014) 228–246. [12]. Elif Derya Übeyli*, Analysis of EEG signals by combining eigenvector methods and multiclass support vector machines, Computers in Biology and Medicine 38 (2008) 14 – 22. [13]. Xue-Fang Chen, Hong-Jie Xing*, Xi-Zhao Wang, A modified AdaBoost method for one-class SVM and its application to novelty detection, Systems, Man, and Cybernetics (SMC), 2011 IEEE International Conference on , Page(s): 3506 – 3511, ISBN: 978-1-4577-0652-3. [14]. Chengming Liu, Manchun Li*, Yongxue Liu*, Jieli Chen, Chenglei Shen, Application of Adaboost Based Ensemble SVM on IKONOS Image Classification, Geoinformatics, 2010 18th International Conference on , Page(s):1 – 5, ISBN: 978-1-4244-7301-4. [15]. Enrique Romero*, Llu12s M3arquez, Xavier Carreras, Margin maximization with feed-forward neural networks: a comparative study with SVM and AdaBoost, Neurocomputing 57 (2004) 313 – 344. [16]. Xuchun Li*, Lei Wang, Eric Sung, AdaBoost with SVM-based component classifiers, Engineering Applications of Artificial Intelligence 21 (2008) 785–795. [17]. Hanif Mohaddes Deylami, Yashwant Prasad Singh, Adaboost and SVM based cybercrime detection and prevention model, Artificial Intelligence Research, December 2012, Vol. 1, No. 2. [18]. E. D.U beyli, Combined neural network model employing wavelet coefficients for EEG signals classification, Digital Signal Processing, vol. 19, pp. 297-308, 2009.