BUILDING
  AN EMOTION RECOGNITION
        FRAMEWORK


Javier Gonzalez-Sanchez, Maria-Elena Chavez-Echeagaray




               CUbiC Seminar Series presentation | April 2011
FRONT-END | | BACK-END




                         Software
  Affective
                        Architecture
 Computing
                          proof-of-concept
  emotion recognition            VS
                          reusable platform
EMOTION RECOGNITION



                    Affective
Perception         Computing              Sensing
                                          Devices

                    emotion recognition
Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
BUILDING | FRAMEWORK

                                      It is NOT about
  Tools                               programming


                 Software
                Architecture
Framework                               Building

                  proof-of-concept
                         VS
                  reusable platform



   API
FRAMEWORK
Sensing Devices




                                                   Sensed Values
                                                                                      Data Logger
                                                        Beliefs
                                                                                     Data Visualizer
                                                   Emotional State
                                                                                    Tutoring Systems
                                                    Confidence

                                                                     Third-party
                               Agent      Agent                       Systems



                       Agent


    Multimodal                         President

                                                                      Third-party
                                                                       Systems




   Agent-Based
Component-oriented
                                                    Third-party
   Architecture                                      Systems

Emotion Recognition
   Framework          Agent Federation
Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
EXAMPLE 1
EXAMPLE 1
 Third-party
  Systems

 VISUALIZER




gaze-x, gaze-y, time


                               frustration
                               threshold = 0.75
EXAMPLE 1
EXAMPLE 2
EXAMPLE 2




t1/4   t2/4   t3/4   t4/4
Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
ONGOING WORK

• Affective   Meta Tutor
 Kurt VanLehn, Winslow Burleson, et al.


• Seductive   Details (Instructional Design)
 Robert Atkinson, et al.


• Emotions    and Working Memory Capacity
 Robert Atkinson, et al.


• 3D    scenarios for training (US Navy)
 Robert Atkinson, Brian Nelson, et al.


• BCI
 Robert Atkinson, David Gibson, et al.
201104 cubic

More Related Content

PPTX
Building beyond billions
PPTX
Urban elements in interior spaces
PDF
Illusionism in Architecture
PPTX
Tabagisme et thrombose habbal
PDF
007 014 belcaro corrige
PDF
200310 - Apache Web Server
PPTX
Huizenprijzen in amsterdam
PDF
Amazon resource for bioinformatics
Building beyond billions
Urban elements in interior spaces
Illusionism in Architecture
Tabagisme et thrombose habbal
007 014 belcaro corrige
200310 - Apache Web Server
Huizenprijzen in amsterdam
Amazon resource for bioinformatics

Viewers also liked (14)

PDF
201506 CSE340 Lecture 09
PDF
201505 CSE340 Lecture 03
PDF
201506 CSE340 Lecture 17
PDF
201505 CSE340 Lecture 04
PPT
2013 cch basic principles ch04
XLS
Temlate Of Module
PDF
201506 CSE340 Lecture 13
PDF
201506 CSE340 Lecture 07
PDF
Deutsche Telekom BarCamp 03, 25 June 2009
PDF
Eurochap2010
PDF
Week5-Group-J
PPT
Domain driven design
PDF
Object Flow Analysis
PPT
Vol 02 chapter 8 2012
201506 CSE340 Lecture 09
201505 CSE340 Lecture 03
201506 CSE340 Lecture 17
201505 CSE340 Lecture 04
2013 cch basic principles ch04
Temlate Of Module
201506 CSE340 Lecture 13
201506 CSE340 Lecture 07
Deutsche Telekom BarCamp 03, 25 June 2009
Eurochap2010
Week5-Group-J
Domain driven design
Object Flow Analysis
Vol 02 chapter 8 2012
Ad

Similar to 201104 cubic (20)

PDF
201209 An Introduction to Building Affective-Driven Self-Adaptive Software
PDF
Workshopvin1 2018 Technology In Labour For Rebirth Of Hal 9000 Series
PDF
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...
PPTX
201204 AME High Five
PDF
Pushing the awareness envelope
PDF
Emotion-oriented computing: Possible uses and applications
PDF
PDF
Agent testing
PPT
My Robot
KEY
Thesis defense
PDF
Epics introduction-dec-2010
PDF
Maya
PDF
201500 Cognitive Informatics
PDF
Multiple representations talk, Middlesex University. February 23, 2018
PDF
Robert Gordon talk, 21 March 2018
PDF
Multiple representations and visual mental imagery in artificial cognitive sy...
PDF
Pratim sengupta world ia day 2013
PDF
Towards a Smart Control Room for Crisis Response Using Visual Perception of U...
PPTX
Reality As A Knowledge Medium
201209 An Introduction to Building Affective-Driven Self-Adaptive Software
Workshopvin1 2018 Technology In Labour For Rebirth Of Hal 9000 Series
201404 Multimodal Detection of Affective States: A Roadmap Through Diverse Te...
201204 AME High Five
Pushing the awareness envelope
Emotion-oriented computing: Possible uses and applications
Agent testing
My Robot
Thesis defense
Epics introduction-dec-2010
Maya
201500 Cognitive Informatics
Multiple representations talk, Middlesex University. February 23, 2018
Robert Gordon talk, 21 March 2018
Multiple representations and visual mental imagery in artificial cognitive sy...
Pratim sengupta world ia day 2013
Towards a Smart Control Room for Crisis Response Using Visual Perception of U...
Reality As A Knowledge Medium
Ad

More from Javier Gonzalez-Sanchez (20)

PDF
201804 SER332 Lecture 01
PDF
201801 SER332 Lecture 03
PDF
201801 SER332 Lecture 04
PDF
201801 SER332 Lecture 02
PDF
201801 CSE240 Lecture 26
PDF
201801 CSE240 Lecture 25
PDF
201801 CSE240 Lecture 24
PDF
201801 CSE240 Lecture 23
PDF
201801 CSE240 Lecture 22
PDF
201801 CSE240 Lecture 21
PDF
201801 CSE240 Lecture 20
PDF
201801 CSE240 Lecture 19
PDF
201801 CSE240 Lecture 18
PDF
201801 CSE240 Lecture 17
PDF
201801 CSE240 Lecture 16
PDF
201801 CSE240 Lecture 15
PDF
201801 CSE240 Lecture 14
PDF
201801 CSE240 Lecture 13
PDF
201801 CSE240 Lecture 12
PDF
201801 CSE240 Lecture 11
201804 SER332 Lecture 01
201801 SER332 Lecture 03
201801 SER332 Lecture 04
201801 SER332 Lecture 02
201801 CSE240 Lecture 26
201801 CSE240 Lecture 25
201801 CSE240 Lecture 24
201801 CSE240 Lecture 23
201801 CSE240 Lecture 22
201801 CSE240 Lecture 21
201801 CSE240 Lecture 20
201801 CSE240 Lecture 19
201801 CSE240 Lecture 18
201801 CSE240 Lecture 17
201801 CSE240 Lecture 16
201801 CSE240 Lecture 15
201801 CSE240 Lecture 14
201801 CSE240 Lecture 13
201801 CSE240 Lecture 12
201801 CSE240 Lecture 11

Recently uploaded (20)

PDF
A novel scalable deep ensemble learning framework for big data classification...
DOCX
search engine optimization ppt fir known well about this
PPTX
O2C Customer Invoices to Receipt V15A.pptx
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PPT
What is a Computer? Input Devices /output devices
PPTX
observCloud-Native Containerability and monitoring.pptx
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
STKI Israel Market Study 2025 version august
PDF
Five Habits of High-Impact Board Members
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PPTX
Benefits of Physical activity for teenagers.pptx
PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
PDF
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
Unlock new opportunities with location data.pdf
PPTX
Web Crawler for Trend Tracking Gen Z Insights.pptx
A novel scalable deep ensemble learning framework for big data classification...
search engine optimization ppt fir known well about this
O2C Customer Invoices to Receipt V15A.pptx
NewMind AI Weekly Chronicles – August ’25 Week III
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
What is a Computer? Input Devices /output devices
observCloud-Native Containerability and monitoring.pptx
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
STKI Israel Market Study 2025 version august
Five Habits of High-Impact Board Members
A comparative study of natural language inference in Swahili using monolingua...
Taming the Chaos: How to Turn Unstructured Data into Decisions
Benefits of Physical activity for teenagers.pptx
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
TrustArc Webinar - Click, Consent, Trust: Winning the Privacy Game
Zenith AI: Advanced Artificial Intelligence
Enhancing emotion recognition model for a student engagement use case through...
Unlock new opportunities with location data.pdf
Web Crawler for Trend Tracking Gen Z Insights.pptx

201104 cubic

  • 1. BUILDING AN EMOTION RECOGNITION FRAMEWORK Javier Gonzalez-Sanchez, Maria-Elena Chavez-Echeagaray CUbiC Seminar Series presentation | April 2011
  • 2. FRONT-END | | BACK-END Software Affective Architecture Computing proof-of-concept emotion recognition VS reusable platform
  • 3. EMOTION RECOGNITION Affective Perception Computing Sensing Devices emotion recognition
  • 4. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
  • 5. BUILDING | FRAMEWORK It is NOT about Tools programming Software Architecture Framework Building proof-of-concept VS reusable platform API
  • 7. Sensing Devices Sensed Values Data Logger Beliefs Data Visualizer Emotional State Tutoring Systems Confidence Third-party Agent Agent Systems Agent Multimodal President Third-party Systems Agent-Based Component-oriented Third-party Architecture Systems Emotion Recognition Framework Agent Federation
  • 8. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
  • 9. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
  • 10. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
  • 12. EXAMPLE 1 Third-party Systems VISUALIZER gaze-x, gaze-y, time frustration threshold = 0.75
  • 15. EXAMPLE 2 t1/4 t2/4 t3/4 t4/4
  • 16. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.
  • 17. ONGOING WORK • Affective Meta Tutor Kurt VanLehn, Winslow Burleson, et al. • Seductive Details (Instructional Design) Robert Atkinson, et al. • Emotions and Working Memory Capacity Robert Atkinson, et al. • 3D scenarios for training (US Navy) Robert Atkinson, Brian Nelson, et al. • BCI Robert Atkinson, David Gibson, et al.

Editor's Notes