SlideShare a Scribd company logo
AN EEG-BASED BRAIN COMPUTER
INTERFACE FOR
EMOTION RECOGNITION AND ITS
APPLICATION IN
PATIENTS WITH DISORDER OF
CONSCIOUSNESS
HAIYUN HUANG, QIUYOU XIE, JIAHUI PAN, YANBIN HE, ZHENFU WEN,
RONGHAO YU AND YUANQING LI,
2019
PRESENTED BY
NAFIZ ISHTIAQUE AHMED
23-JANUARY-2020
UOU- UNIVERSITY OF ULSAN
Computational
Neural
Engineering Lab.
DISORDER OF CONSCIOUSNESS (DOC)
 Brain Injuries :
 Coma,
 Vegetative state (VS),
 Minimal conscious state
(MCS),
 Emergence from MCS (EMCS)
INTRODUCTION
 Emotion has strong connection with Consciousness.
 If DOC patients emotion is recognized then it can help to
assess their residual consciousness as well as their impaired
brain functions.
 As DOC patients suffers from severe motor impairments and
unable to provide proper emotion expressions; So far doctors
cannot detect their emotional states.
EMOTION RECOGNITION
Evoked Mechanisms Accuracy
Viewing Picture EEG 80.77%
listening to music EEG 82.29% ± 3.06%
Watching videos EEG, pupillary responses,
and gaze distances
76.4%
Watching videos EEG 79.28%
listening to music
(Real-time)
EEG 53.96%
 Emotion Recognition of Healthy people.
INTRODUCTION
 EEG is significant and widely used for identifying
human emotion state.
 This paper shows EEG Based BCI system to
recognize
the emotions of DOC patients at real-time.
 Emotion evoked by 2 class video clips
 Positive
 Negative
SUBJECTS
 Control group
(validate the BCI system)
 10 student (8-male, 2-female)
 Mean age 26
 Normal vision and hearing
 DOC Patient
(applied the BCI system)
 8 patient (6-male, 2-female)
 Mean age 35
 Stable condition with normal vision
and hearing
 No psychiatric medications (2-days)
 Clinical diagnosis
 2 patient-VS,
 5 patient-MSC,
 1 patient-EMCS
STIMULUS
 Initially, 140 Chinese movie clips (30s) that contained positive
or negative scenes was collected.
 10 volunteers evaluate their emotions with a level (i.e., not at
all, slightly, or extremely) and a keywords (i.e., positive or
negative) while watching the clips.
 Finally, 40 Chinese video clips(20 positive ,20 negative ) that all
volunteers scored as extremely positive or negative were
selected.
 Only 2 emotional state is chosen because complex and many
emotional states may increase the burden on the patients.
EXPERIMRNT
 SVM model (20 trials-train, 10-positive, 10-negative, 20
trails-test)
DATA ANALYSIS
 Baseline corrected by subtracting the mean value of the 1s
signal before the stimulus start.
 Notch filter was applied to remove the 50 Hz power-line noise.
 Tenth order minimum-phase FIR bandpass filter between 0.1 to
70 Hz.
 Online - Spectral power – STFT - a non-overlapped Hanning
window of 1 second- band power values are calculated by
averaging the power values in each frequency bands -
logarithmic scale – SVM model – Prediction.
 Offline - preprocessing, feature extraction -classification
procedures are the same as online method - 10 times 5-fold
cross-validation.
RESULTS (HEALTHY SUBJECT)
RESULTS (HEALTHY SUBJECT)
Topographical maps of the classification weight of each electrode :
average of the weights of all five subbands
1. The left frontal areas correlated to
positive emotion.
2. The right hemisphere mainly processed
negative emotion .
3. The reported frontal midline areas were
associated with the process of positive
emotion.
Topographies of different frequency bands
1. Depicts the average power changes for negative
and positive emotions in the five bands (delta,
theta, alpha, beta, and gamma).
2. In the delta band, the right anterior areas were
activated more for positive emotion than for
negative emotion.
3. In the theta band, the prefrontal regions and
occipital lobe show higher power during positive
emotional state than during negative emotional
state.
4. In the alpha band, the power decreased in the right
frontal areas during negative emotion, the power of
the frontal areas increased during positive emotion.
5. In the beta and gamma bands, the power in the
lateral temporal areas for positive emotion was
significantly higher than that for negative emotion.
Results for Patients with
DOC:
Results for Patients with
DOC:
CONCLUSION
1. An EEG-based BCI system to distinguish video-induced positive
and negative emotions.
2. Positive & Negative emotions were well evoked and recognized
by this BCI system.
3. This system provides an potential approach to detect the
emotions in patients with DOC.
4. The emotion BCI system may be a potential tool for evaluating
the consciousness levels of patients with DOC.
Nafiz prasented an eeg-based brain computer interface for

More Related Content

PDF
Elinore McCance Katz-b
PPT
Electro practical
PDF
Brain inf2012(present)
PDF
IRJET- Machine Learning Approach for Emotion Recognition using EEG Signals
PDF
Recognition of emotional states using EEG signals based on time-frequency ana...
PDF
IRJET- Deap Base Detection of Epilepsy and Sleep Paralysis through Comput...
PPTX
Emotion Detection Using Noninvasive Low-cost Sensors
PDF
Analysis of emotion disorders based on EEG signals ofHuman Brain
Elinore McCance Katz-b
Electro practical
Brain inf2012(present)
IRJET- Machine Learning Approach for Emotion Recognition using EEG Signals
Recognition of emotional states using EEG signals based on time-frequency ana...
IRJET- Deap Base Detection of Epilepsy and Sleep Paralysis through Comput...
Emotion Detection Using Noninvasive Low-cost Sensors
Analysis of emotion disorders based on EEG signals ofHuman Brain

Similar to Nafiz prasented an eeg-based brain computer interface for (20)

PDF
Comparing emotion classification: machine learning algorithms and hybrid mode...
PPTX
COMA_Progress_PPTpresentaionof itsuses.pptx
PPTX
Automated Parkinson’s Disease Detection and Affective Analysis from Emotional...
PDF
HUMAN EMOTION ESTIMATION FROM EEG AND FACE USING STATISTICAL FEATURES AND SVM
PDF
Classification of emotions induced by horror and relaxing movies using single-...
PPTX
exploring human values through eeg and deep learning methods
PPTX
exploring human values through eeg and deep learning methods
PDF
Convolutional neural network with binary moth flame optimization for emotion ...
PPTX
Conference_presentation.pptx for atsip conference 2024
PPTX
Conference_presentation by khouloud mouss
PDF
Robot Motion Control Using the Emotiv EPOC EEG System
PDF
An approach of re-organizing input dataset to enhance the quality of emotion ...
PDF
Prediction Model for Emotion Recognition Using EEG
PDF
IRJET- Deep Learning Technique for Feature Classification of Eeg to Acces...
PPTX
EMOTION BASED COMPUTING
PPTX
Emotiv epoc final
DOCX
The Preface Layer for Auditing Sensual Interacts of Primary Distress Conceali...
PDF
PERFORMANCE EVALUATION OF VARIOUS EMOTION CLASSIFICATION APPROACHES FROM PHYS...
PPTX
moussaoui-atsip-2024_presentation_mf.pptx
PDF
Quantification and Comparison of Different Non-Linear Techniques of EEG Signals
Comparing emotion classification: machine learning algorithms and hybrid mode...
COMA_Progress_PPTpresentaionof itsuses.pptx
Automated Parkinson’s Disease Detection and Affective Analysis from Emotional...
HUMAN EMOTION ESTIMATION FROM EEG AND FACE USING STATISTICAL FEATURES AND SVM
Classification of emotions induced by horror and relaxing movies using single-...
exploring human values through eeg and deep learning methods
exploring human values through eeg and deep learning methods
Convolutional neural network with binary moth flame optimization for emotion ...
Conference_presentation.pptx for atsip conference 2024
Conference_presentation by khouloud mouss
Robot Motion Control Using the Emotiv EPOC EEG System
An approach of re-organizing input dataset to enhance the quality of emotion ...
Prediction Model for Emotion Recognition Using EEG
IRJET- Deep Learning Technique for Feature Classification of Eeg to Acces...
EMOTION BASED COMPUTING
Emotiv epoc final
The Preface Layer for Auditing Sensual Interacts of Primary Distress Conceali...
PERFORMANCE EVALUATION OF VARIOUS EMOTION CLASSIFICATION APPROACHES FROM PHYS...
moussaoui-atsip-2024_presentation_mf.pptx
Quantification and Comparison of Different Non-Linear Techniques of EEG Signals
Ad

More from Nafiz Ishtiaque Ahmed (20)

PPTX
Stress effects in the brain during transcranial magnetic (1)
PPTX
Mobile ip presented by nafiz
PPTX
Bci communication _old
PPTX
Hh model(me)
PPTX
Brain signal seminar
PDF
Team 5 imputing_medical_missing_data_ga approach_preseatation
PPTX
Proposal (20185748, ahmed nafiz ishtiaque)
DOCX
Proposal (20185748, ahmed nafiz ishtiaque)
PPTX
Brain signal seminar
PPTX
Brain signal seminar
PPTX
Brain signal seminar
PPTX
Brain signal seminar
PPTX
Brain signal seminar
PPTX
Brain signal seminar
PPTX
Brain signal seminar
PPTX
Brain signal seminar
PDF
Hw nafiz ishtiaque
PPTX
Hodgkin huxleymodeling
PPTX
Library in Modern age
PPT
Responsive Distributed Routing Algorithm
Stress effects in the brain during transcranial magnetic (1)
Mobile ip presented by nafiz
Bci communication _old
Hh model(me)
Brain signal seminar
Team 5 imputing_medical_missing_data_ga approach_preseatation
Proposal (20185748, ahmed nafiz ishtiaque)
Proposal (20185748, ahmed nafiz ishtiaque)
Brain signal seminar
Brain signal seminar
Brain signal seminar
Brain signal seminar
Brain signal seminar
Brain signal seminar
Brain signal seminar
Brain signal seminar
Hw nafiz ishtiaque
Hodgkin huxleymodeling
Library in Modern age
Responsive Distributed Routing Algorithm
Ad

Recently uploaded (20)

PPTX
Lesson notes of climatology university.
PPTX
master seminar digital applications in india
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
PDF
Classroom Observation Tools for Teachers
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
RMMM.pdf make it easy to upload and study
PDF
Yogi Goddess Pres Conference Studio Updates
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PPTX
Orientation - ARALprogram of Deped to the Parents.pptx
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
Pharma ospi slides which help in ospi learning
PDF
Computing-Curriculum for Schools in Ghana
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PPTX
Cell Structure & Organelles in detailed.
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Lesson notes of climatology university.
master seminar digital applications in india
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
STATICS OF THE RIGID BODIES Hibbelers.pdf
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
Classroom Observation Tools for Teachers
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
O7-L3 Supply Chain Operations - ICLT Program
FourierSeries-QuestionsWithAnswers(Part-A).pdf
RMMM.pdf make it easy to upload and study
Yogi Goddess Pres Conference Studio Updates
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Orientation - ARALprogram of Deped to the Parents.pptx
VCE English Exam - Section C Student Revision Booklet
Pharma ospi slides which help in ospi learning
Computing-Curriculum for Schools in Ghana
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
O5-L3 Freight Transport Ops (International) V1.pdf
Cell Structure & Organelles in detailed.
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape

Nafiz prasented an eeg-based brain computer interface for

  • 1. AN EEG-BASED BRAIN COMPUTER INTERFACE FOR EMOTION RECOGNITION AND ITS APPLICATION IN PATIENTS WITH DISORDER OF CONSCIOUSNESS HAIYUN HUANG, QIUYOU XIE, JIAHUI PAN, YANBIN HE, ZHENFU WEN, RONGHAO YU AND YUANQING LI, 2019 PRESENTED BY NAFIZ ISHTIAQUE AHMED 23-JANUARY-2020 UOU- UNIVERSITY OF ULSAN Computational Neural Engineering Lab.
  • 2. DISORDER OF CONSCIOUSNESS (DOC)  Brain Injuries :  Coma,  Vegetative state (VS),  Minimal conscious state (MCS),  Emergence from MCS (EMCS)
  • 3. INTRODUCTION  Emotion has strong connection with Consciousness.  If DOC patients emotion is recognized then it can help to assess their residual consciousness as well as their impaired brain functions.  As DOC patients suffers from severe motor impairments and unable to provide proper emotion expressions; So far doctors cannot detect their emotional states.
  • 4. EMOTION RECOGNITION Evoked Mechanisms Accuracy Viewing Picture EEG 80.77% listening to music EEG 82.29% ± 3.06% Watching videos EEG, pupillary responses, and gaze distances 76.4% Watching videos EEG 79.28% listening to music (Real-time) EEG 53.96%  Emotion Recognition of Healthy people.
  • 5. INTRODUCTION  EEG is significant and widely used for identifying human emotion state.  This paper shows EEG Based BCI system to recognize the emotions of DOC patients at real-time.  Emotion evoked by 2 class video clips  Positive  Negative
  • 6. SUBJECTS  Control group (validate the BCI system)  10 student (8-male, 2-female)  Mean age 26  Normal vision and hearing  DOC Patient (applied the BCI system)  8 patient (6-male, 2-female)  Mean age 35  Stable condition with normal vision and hearing  No psychiatric medications (2-days)  Clinical diagnosis  2 patient-VS,  5 patient-MSC,  1 patient-EMCS
  • 7. STIMULUS  Initially, 140 Chinese movie clips (30s) that contained positive or negative scenes was collected.  10 volunteers evaluate their emotions with a level (i.e., not at all, slightly, or extremely) and a keywords (i.e., positive or negative) while watching the clips.  Finally, 40 Chinese video clips(20 positive ,20 negative ) that all volunteers scored as extremely positive or negative were selected.  Only 2 emotional state is chosen because complex and many emotional states may increase the burden on the patients.
  • 8. EXPERIMRNT  SVM model (20 trials-train, 10-positive, 10-negative, 20 trails-test)
  • 9. DATA ANALYSIS  Baseline corrected by subtracting the mean value of the 1s signal before the stimulus start.  Notch filter was applied to remove the 50 Hz power-line noise.  Tenth order minimum-phase FIR bandpass filter between 0.1 to 70 Hz.  Online - Spectral power – STFT - a non-overlapped Hanning window of 1 second- band power values are calculated by averaging the power values in each frequency bands - logarithmic scale – SVM model – Prediction.  Offline - preprocessing, feature extraction -classification procedures are the same as online method - 10 times 5-fold cross-validation.
  • 12. Topographical maps of the classification weight of each electrode : average of the weights of all five subbands 1. The left frontal areas correlated to positive emotion. 2. The right hemisphere mainly processed negative emotion . 3. The reported frontal midline areas were associated with the process of positive emotion.
  • 13. Topographies of different frequency bands 1. Depicts the average power changes for negative and positive emotions in the five bands (delta, theta, alpha, beta, and gamma). 2. In the delta band, the right anterior areas were activated more for positive emotion than for negative emotion. 3. In the theta band, the prefrontal regions and occipital lobe show higher power during positive emotional state than during negative emotional state. 4. In the alpha band, the power decreased in the right frontal areas during negative emotion, the power of the frontal areas increased during positive emotion. 5. In the beta and gamma bands, the power in the lateral temporal areas for positive emotion was significantly higher than that for negative emotion.
  • 14. Results for Patients with DOC:
  • 15. Results for Patients with DOC:
  • 16. CONCLUSION 1. An EEG-based BCI system to distinguish video-induced positive and negative emotions. 2. Positive & Negative emotions were well evoked and recognized by this BCI system. 3. This system provides an potential approach to detect the emotions in patients with DOC. 4. The emotion BCI system may be a potential tool for evaluating the consciousness levels of patients with DOC.

Editor's Notes

  • #3: Coma A coma is when a person shows no signs of being awake and no signs of being aware. A person in a coma lies with their eyes closed and doesn't respond to their environment, voices or pain. Vegetative state awake but is showing no signs of awareness. open their eyes wake up and fall asleep at regular intervals have basic reflexes (such as blinking when they're startled by a loud noise or withdrawing their hand when it's squeezed hard). Minimally conscious state A person who shows inconsistent awareness. They may have periods where they can communicate or respond to commands, such as moving a finger when asked.
  • #4: the research of emotion recognition in patients with DOC may help us assess their residual consciousness and the impaired brain functions.
  • #5: However, none of the existing studies has developed an EEG-based emotion recognition system for patients with DOC.
  • #9: Then, the video clip that represents a positive/negative emotion, respectively, is played and the EEG data are collected and processed simultaneously. Then, the online recognition result is displayed on the screen as feedback. In this study, a smiling/crying cartoon face is presented as feedback, which represents the detection of a positive/negative emotion, respectively. 5 session total 10 trails and 10 test several differences between the experimental procedures for DOC patients compared with healthy subject like braek time depending upon patients condition
  • #10: the research of emotion recognition in patients with DOC may help us assess their residual consciousness and the impaired brain functions.
  • #12: the importance of the theta band in emotion recognition
  • #16: P4 is EMCS patient thus his emotion reorganization rate is higher Patient P4 achieved the highest online accuracy among all patients, The electrodes that correlated with the top-20 features were mainly located in the temporal lobe, central area and occipital lobe. For positive emotion, the frontal midline had a significant higher theta response. Meanwhile, as shown in Fig. 3(b), the parietal and frontal areas were activated more in the alpha band in response to positive emotion. In the beta and gamma frequency bands, the occipital lobe presented greater activation for positive emotional state than negative emotional state