SlideShare a Scribd company logo
Data Visualization Summit
                                          San Francisco, CA
                                             Apr 11, 2013




     Visualizations for
Event Sequences Exploration
     Krist Wongsuphasawat


       Data Visualization Scientist
               Twitter, Inc.


               @kristw
event%
         event%
              event%            event% event%
     event%
event%
          event%
                   Life         event%
                                      event%
                                                event%
                   event%
    event%                             event%
                       event%
              event%
Time   Event type%

 ( 7:00 am, Wake up )


                                     event%
         event%
              event%             event% event%
     event%
event%
           event%
                    Life         event%
                                       event%
                                                 event%
                    event%
    event%                              event%
                        event%
              event%
event%
         event%
              event%            event% event%
     event%
event%
          event%
                   Life         event%
                                      event%
                                                event%
                   event%
    event%                             event%
                       event%
              event%

                                  “Event Sequence”
Daily Activity




7:30 a.m.       7:45 a.m.    8:30 a.m.
Wake Up         Exercise     Go to work
Traffic Incidents




9:30 a.m.           9:55 a.m.       10:30 a.m.
Notification        Units arrived   Road cleared
http://timeline.national911memorial.org/
Event Sequences
Medical    Transportation


Sports     Education


Web logs   Logistics



                 and more…
Outline
                                   ?
                            u ences
                  e nt seq
       hat are ev         them?
     W
               is ualize
     Ho w to v            a
                b  ig dat
      Ap ply to
Visualization
 Techniques
Event
           glyphs   timeline
sequence
simple event sequence
timeline.js




     Horizontal axis = time
                                                    Glyphs = events

                       http://timeline.verite.co/
Event
               glyphs   timeline
    sequence



+   Interval
interval
 •  Car crash (point)    time


   10 a.m.
 •  Meeting (interval)
   10 – 11 a.m.
interval >> width
traffic incident




          CATT Lab, University of Maryland -- http://teachamerica.com/VIZ11/VIZ1102Pack/index.htm
interval >> width
chronoline.js




                http://stoicloofah.github.io/chronoline.js/
Event
               glyphs   timeline
    sequence



+   Interval   width



+    Event
     types
types

                      time




    Nurses’ actions          Doctors’ actions


            They all look similar.
types

                      time




    Nurses’ actions          Doctors’ actions


                  Better?
The path of protest
                                                                                                 types >> color




http://www.guardian.co.uk/world/interactive/2011/mar/22/middle-east-protest-interactive-timeline
types >> colors + shapes




                           http://timeglider.com/widget/
timeglider.js
Event
               glyphs   timeline
    sequence



+   Interval   width



+    Event
               colors   shapes
     types


     High
+
    density
high density

                   time




     Too many overlaps and occlusions
high density >> facet
Google Chrome




                        loading
                      scripting
           rendering & painting




                      Facet




                   Google Chrome > Developer Tools > Timeline
high density >> facet
Lifelines




            http://www.cs.umd.edu/lifelines
high density >> binning
British History Timeline




                           bin by year
high density >> aggregation
CloudLines

        Raw event data




        Kernel Density Estimation + Importance Func. + Truncation




        Encode cloud size
high density >> aggregation
CloudLines (2)




                          Krstajic, M., Bertini, E., & Keim, D. A. (2011).
            CloudLines: Compact Display of Event Episodes in Multiple Time-Series.
            IEEE Transactions on Visualization and Computer Graphics, 17(12), 2432.
linear
      Event
               glyphs    timeline
    sequence
                                      non-linear

+   Interval   width



+    Event
               colors     shapes
     types


     High
+              facet    aggregation binning
    density
circular timeline
    2008     2009       2010            2011         2012


    linear
                                  Dec          Jan   Feb


                            Nov                             Mar



                circular    Oct                             Apr
       repeating patterns
                            Sep                             May


                                  Aug                Jun
                                               Jul
circular timeline (2)
Traffic Incidents




         VanDaniker, M. (2010). Leverage of Spiral Graph for Transportation System Data Visualization.
         Transportation Research Record: Journal of the Transportation Research Board, 2165, 79–88.
stacked timeline
   2008                  2009           2010    2011     2012

                                       linear


                                                  2008
                                                  2009
    2008
           2009


                         2011
                  2010


                                2012



                                                  2010
                                                  2011
                                                  2012
stacked timeline (2)
Tweet Volume




    Rios, M., & Lin, J. (2012). Distilling Massive Amounts of Data into Simple Visualizations : Twitter Case Studies.
       Proceedings of the Workshop on Social Media Visualization (SocMedVis) at ICWSM 2012 (pp. 22–25).
linear
      Event
               glyphs    timeline
    sequence
                                      non-linear

+   Interval   width



+    Event
               colors     shapes
     types


     High
+              facet    aggregation binning
    density
collection
   1          2                         n

  Event      Event             ...     Event
sequence   sequence                  sequence
collection
multiple timelines


  Event sequence #1


  Event sequence #2


  Event sequence #3


  Event sequence #4
collection
   1          2                         n

  Event      Event             ...     Event
sequence   sequence                  sequence




                  Millions!
collection
   1          2                         n

  Event      Event             ...     Event
sequence   sequence                  sequence




       Interactions
Interaction #1
align
Interaction #1
align
Interaction #1
align
Interaction #2
rank
Interaction #2
rank




                 Rank by number of   events
                 or any criteria
Interaction #3
filter
Interaction #3
filter




     Select only event sequences with   events
     Set your own filters
Interaction #4
group
Interaction #4
group

 1



 2


 3

                 Group by sequence length
                 or any clustering algorithm / properties
Interaction #5
search
  •  Simple search             ABC
     –  Sequence matching      AABCDEFGH
     –  Subsequence matching   AXAYBZCED


  •  Regular Expression        A B* (C|D)
Interaction #5
search (2)
  •  Dynamic     X 50%        C 75%
                         AB
                 Y 50%        D 25%
Interaction #5
search (2)
  •  Dynamic             X 70%         D 50%
                                 ABC
                         Y 30%         E 50%


  •  Similarity search      Similar to ABCD

                                       ABCD
                                       ABD
                                       ACE
                                       …
collection
        1           2                          n

     Event        Event              ...     Event
   sequence     sequence                   sequence




            Interactions         Aggregation

align
                                                 by
                                               time
    rank                    search

            filter   group
aggregation by time
temporal summary
         Day 1   Day 2   Day 3   Day 4   Day 5




                                                 bin & count
aggregation by time
                                                                                             temporal summary




Wang, T. D., Plaisant, C., Shneiderman, B., Spring, N., Roseman, D., Marchand, G., Mukherjee, V., et al. (2009).
         Temporal Summaries: Supporting Temporal Categorical Searching, Aggregation and Comparison.
                                IEEE Transactions on Visualization and Computer Graphics, 15(6), 1049–1056.
collection
        1           2                                 n

     Event        Event              ...           Event
   sequence     sequence                         sequence




            Interactions         Aggregation

align
                                                        by
                                                      time
    rank                    search            by
                                           sequence
            filter   group
aggregation by sequence
LifeFlow
  e.g.   1) What happened to the patients after they arrived?


                               Arrival!
                                              ?
                                          ?
         2) What happened to the patients before & after ICU?

                                ICU!

                   ?                          ?
                         ?                ?
aggregation by sequence
LifeFlow
                overview / summary




                 Millions of records!
Demo
                                         LifeFlow




Wongsuphasawat, K., Guerra Gómez, J. A., Plaisant, C., Wang, T. D., Taieb-Maimon, M., & Shneiderman, B. (2011).
      LifeFlow: Visualizing an Overview of Event Sequences. Proceedings of CHI'2011 (pp. 1747–1756).
Demo
                                         LifeFlow




Wongsuphasawat, K., Guerra Gómez, J. A., Plaisant, C., Wang, T. D., Taieb-Maimon, M., & Shneiderman, B. (2011).
      LifeFlow: Visualizing an Overview of Event Sequences. Proceedings of CHI'2011 (pp. 1747–1756).
Demo
                                         LifeFlow




Wongsuphasawat, K., Guerra Gómez, J. A., Plaisant, C., Wang, T. D., Taieb-Maimon, M., & Shneiderman, B. (2011).
      LifeFlow: Visualizing an Overview of Event Sequences. Proceedings of CHI'2011 (pp. 1747–1756).
aggregation by sequence
LifeFlow

                          profile!    home!




        start!   home!    photos!    home!




                          contact!   home!
aggregation by sequence
Google Analytics

                                   profile!




        start!   home!            photos!             home!




                                  contact!




                    http://www.google.com/analytics
aggregation by sequence
Google Analytics

                                   profile!

                                                      home!


        start!   home!            photos!

                                                      videos!

                                  contact!




                    http://www.google.com/analytics
aggregation by sequence
Google Analytics




                                                     top pages only

                          height = number of visits


                   http://www.google.com/analytics
Event
         + Outcome
sequence
Time%

Game #1                                  Win (1)


 10th minute     25th minute        90th minute
     Goal         Concede              Goal




               or any sports
Time%


Game #1                                              Win (1)
              Goal% Concede%       Goal%

Game #2                                              Win (1)
          Goal%   Goal%      Concede%

Game #3                                              Lose (0)
              Goal%              Concede% Concede%



Game #n                                              Win (1)
            Concede% Goal%     Goal%       Goal%
aggregation by sequence with outcome
Outflow (Careflow)
                overview / summary




                  Event Sequences!
                   with Outcome!
Assumption
            Events are persistent.


Record #1
                  e1%   e2%     e3%



Record #1
Assumption
            Events are persistent.


Record #1
                  e1%   e2%     e3%



Record #1
                  e1%   e1%     e1%
Assumption
            Events are persistent.


Record #1
                  e1%   e2%     e3%



Record #1
                  e1%   e1%     e1%
                        e2%     e2%
Assumption
            Events are persistent.


Record #1
                  e1%   e2%     e3%



Record #1
                  e1%   e1%     e1%
                        e2%     e2%
                                e3%
Assumption
            Events are persistent.


Record #1
                  e1%      e2%          e3%



Record #1
                  e1%     e1%           e1%
                 [e1]     e2%           e2%
                                        e3%
States                  [e1, e2]
                                   [e1, e2, e3]
Select alignment point
                        Pick a state




What are the paths                     What are the paths
that led to ?                          after ?



        Example
        Soccer: Goal, Concede, Goal
Outflow Graph
       Alignment Point




         [e1, e2, e3]!
1%record%
           Outflow Graph
                           Alignment Point


       [e1]!   [e1, e2]!




[ ]!

                             [e1, e2, e3]!
                                             [e1, e2, e3, e5]!
2%records%
           Outflow Graph
                           Alignment Point


       [e1]!   [e1, e2]!




[ ]!           [e1, e3]!

                             [e1, e2, e3]!
                                             [e1, e2, e3, e5]!
3%records%
           Outflow Graph
                           Alignment Point


       [e1]!   [e1, e2]!
                                             [e1, e2, e3, e4]!


[ ]!           [e1, e3]!

                             [e1, e2, e3]!
                                             [e1, e2, e3, e5]!
       [e3]!
n%records%
           Outflow Graph
                           Alignment Point


       [e1]!   [e1, e2]!
                                             [e1, e2, e3, e4]!


[ ]!   [e2]!   [e1, e3]!

                             [e1, e2, e3]!
                                             [e1, e2, e3, e5]!
       [e3]!   [e2, e3]!
n%records%
           Outflow Graph
                           Alignment Point


       [e1]!   [e1, e2]!
                                              [e1, e2, e3, e4]!


[ ]!   [e2]!   [e1, e3]!

                             [e1, e2, e3]!
                                              [e1, e2, e3, e5]!
       [e3]!   [e2, e3]!
                            Average outcome     = 0.4
                            Average time        = 10 days
                            No. of records      = 10
Soccer Results
                     Alignment Point


       1-0!   2-0!
                                       2-2!


0-0!          1-1!

                          2-1!
                                       3-1!
       0-1!   0-2!
Past&                                      Future&
                         Alignment%

                                                               Node’s horizontal position
                                                               shows sequence of states.%
                                                         e1!
                                                         e2!
                                                         e3!
                                                                      End of path%
e1!


                            e1!
                            e2!
                               7me%          link%       e1!
                                                                Node’s height is
                               edge%        edge%        e2!
                                                                number of records.%
                                                         e4!
e2!




      Color is outcome            Time edge’s width is
      measure.%                   duration of transition.%
Visualization for Event Sequences Exploration
Wongsuphasawat, K., & Gotz, D. (2012).
Exploring Flow, Factors, and Outcomes of Temporal Event Sequences with the Outflow Visualization.
                     IEEE Transactions on Visualization and Computer Graphics, 18(12), 2659–2668.
collection
        1           2                                 n

     Event        Event              ...           Event
   sequence     sequence                         sequence




            Interactions         Aggregation

align
                                                        by
                                                      time
    rank                    search            by
                                           sequence
            filter   group
                                                  + Outcome
Application to
Big Data Analysis
Something sounds simple
           X
 magnitude of big data
           =
   Big mess
 & Big reward
Event Sequence Analysis at
eBay
                    CheckoutProcStep1
                    PaymentReview
                    CheckoutProcStep2
                    CheckoutProcStep3
                    PaymentConfirm
                    CheckoutProcStep4
                    CheckoutProcStep5
                    CheckoutProcStep6
                    CheckoutSuccess
eBay
                                                                    Event Sequence Analysis at

                                                        alignment




                    Shen, Z., Wei, J., Sundaresan, N., & Ma, K.-L. (2012).
                          Visual analysis of massive web session data.
IEEE Symposium on Large Data Analysis and Visualization (LDAV), 65–72.
Event Sequence Analysis at
Twitter
   •  Data
     –  TBs of session logs everyday
   •  Complexity
     –  millions of sessions per day
     –  1000+ types of events
     –  long sessions
   •  Goal
     –  Overview of how users are using Twitter
   •  Technique
     –  LifeFlow
                                       Simplify!
Event Sequence Analysis at
Twitter (2)
   •  So far
     –  millions of sessions per day
     –  millions of sessions on the same screen
     –  1000+ types of events
     –  simplified sets of events
        •  e.g., pages only, selected pages only
     –  long sessions
     –  limited session length to 10-20 events
Event Sequence Analysis at
Twitter (3)
                                Session%Start%
                  Page%A%                        Page%B%        Page%C%
            Page%B%                      Page%A%              Page%D%
   Page%C%            Page%D%           Page%B%            Page%C%
  Page%D%         Page%C%




                                                            *fake data
Event Sequence Analysis at
Twitter (4)
   •  Implementation
     –  Hadoop 
     –  Web-based (js)
   •  More
     –  Stored preprocessed data in smaller db
        (MySQL/Vertica)

                                        Interactive

                         MySQL /
         HDFS             Vertica         Visualization


                    Batch pig scripts
Takeaway Messages
•  Life is full of event sequences.


•  How to visualize an event sequence




                                  Krist Wongsuphasawat
                                      krist.wongz@gmail.com

                                               @kristw
linear
      Event
               glyphs    timeline
    sequence
                                      non-linear

+   Interval   width



+    Event
               colors     shapes
     types


     High
+              facet    aggregation binning
    density
Takeaway Messages
•  Life is full of event sequences.


•  How to visualize an event sequence
•  How to visualize collection of event seq.




                                  Krist Wongsuphasawat
                                      krist.wongz@gmail.com

                                               @kristw
collection
        1           2                                 n

     Event        Event              ...           Event
   sequence     sequence                         sequence




            Interactions         Aggregation

align
                                                        by
                                                      time
    rank                    search            by
                                           sequence
            filter   group
                                                  + Outcome
Takeaway Messages
•  Life is full of event sequences.


•  How to visualize an event sequence
•  How to visualize collection of event seq.
•  Applicable to big data
•  New techniques happen everyday.
                                  Krist Wongsuphasawat
                                      krist.wongz@gmail.com

                                               @kristw
Smurf Communism - Wikipedia
delete   keep
                                        …




                http://notabilia.net/
http://www.evolutionoftheweb.com
Takeaway Messages
•  Life is full of event sequences.


•  How to visualize an event sequence
•  How to visualize collection of event seq.
•  Applicable to big data
•  New techniques happen everyday.
                                  Krist Wongsuphasawat
                                      krist.wongz@gmail.com

                                               @kristw

More Related Content

PPTX
Monitoring with Dynatrace Presentation.pptx
PDF
Paths to more personal and collaborative knowledge graphs
PDF
Marlabs Capabilities Overview: Application Maintenance Support Services
PPTX
Analysis In Agile: It's More than Just User Stories
PDF
ServiceNow ITSM Overview
PDF
Building a Data Strategy – Practical Steps for Aligning with Business Goals
PDF
ITIL SIAM - Service Integration and Management Model
PPT
Gartner: Master Data Management Functionality
Monitoring with Dynatrace Presentation.pptx
Paths to more personal and collaborative knowledge graphs
Marlabs Capabilities Overview: Application Maintenance Support Services
Analysis In Agile: It's More than Just User Stories
ServiceNow ITSM Overview
Building a Data Strategy – Practical Steps for Aligning with Business Goals
ITIL SIAM - Service Integration and Management Model
Gartner: Master Data Management Functionality

What's hot (7)

PPTX
PMO y SMO, diferencias, similitudes y colaboracion
PDF
[WSO2Con EU 2018] The Hybrid Integration Platform: Can You Be in Business Wit...
PPTX
Azure information protection and SharePoint
PDF
Transformación Digital
PDF
Metrics-Based Process Mapping
PDF
Archive First: An Intelligent Data Archival Strategy, Part 1 of 3
PDF
Agile Kaizen: Continuous Improvement Far Beyond Retrospectives
PMO y SMO, diferencias, similitudes y colaboracion
[WSO2Con EU 2018] The Hybrid Integration Platform: Can You Be in Business Wit...
Azure information protection and SharePoint
Transformación Digital
Metrics-Based Process Mapping
Archive First: An Intelligent Data Archival Strategy, Part 1 of 3
Agile Kaizen: Continuous Improvement Far Beyond Retrospectives
Ad

Viewers also liked (11)

PPTX
EventFlow Presentation
PDF
LifeFlow: Understanding Millions of Event Sequences in a Million Pixels
PDF
6 things to expect when you are visualizing
PDF
Lifeflow: Visualizing an Overview of Event Sequences
PPT
Linera sequence
PDF
Krist Wongsuphasawat's Dissertation Defense: Interactive Exploration of Tempo...
DOC
Topic 1 whole numbers
PPT
Math unit8 number sequences
PDF
Visualization of big time series data
PDF
GDC 2017: Evaluating Monetization Early
PPTX
Real time data viz with Spark Streaming, Kafka and D3.js
EventFlow Presentation
LifeFlow: Understanding Millions of Event Sequences in a Million Pixels
6 things to expect when you are visualizing
Lifeflow: Visualizing an Overview of Event Sequences
Linera sequence
Krist Wongsuphasawat's Dissertation Defense: Interactive Exploration of Tempo...
Topic 1 whole numbers
Math unit8 number sequences
Visualization of big time series data
GDC 2017: Evaluating Monetization Early
Real time data viz with Spark Streaming, Kafka and D3.js
Ad

Similar to Visualization for Event Sequences Exploration (20)

PDF
Visualising Space and Time
PDF
Oklahoma University (OU) Presentation
PPTX
Importance
PDF
MeetMarket
PPT
Events Diagram for PowerPoint by PoweredTemplate.com
PPTX
Using topological analysis to support event guided exploration in urban data
PPT
Temporal
PDF
Interactions in time; Evaluation and redesign of three abstract temporal data...
PDF
Eventshop 120721
PDF
Information Visualization for Knowledge Discovery
PDF
16 critique
PDF
7 Principles for Engaging Users with Visualization
PPTX
PDF
Network Mapping & Data Storytelling for Beginners
PDF
Surfacing Real-World Event Content on Twitter
PPTX
EventGraphs Talk at HCIL2011
PPTX
Event Detection via LDA for the MediaEval2012 SED Task
PDF
Data Vis for Transylvania DH
PDF
Event detection in twitter using text and image fusion
PPTX
TMRE 2011 _Alcaraz _Data Visualization
Visualising Space and Time
Oklahoma University (OU) Presentation
Importance
MeetMarket
Events Diagram for PowerPoint by PoweredTemplate.com
Using topological analysis to support event guided exploration in urban data
Temporal
Interactions in time; Evaluation and redesign of three abstract temporal data...
Eventshop 120721
Information Visualization for Knowledge Discovery
16 critique
7 Principles for Engaging Users with Visualization
Network Mapping & Data Storytelling for Beginners
Surfacing Real-World Event Content on Twitter
EventGraphs Talk at HCIL2011
Event Detection via LDA for the MediaEval2012 SED Task
Data Vis for Transylvania DH
Event detection in twitter using text and image fusion
TMRE 2011 _Alcaraz _Data Visualization

More from Krist Wongsuphasawat (20)

PDF
What I tell myself before visualizing
PDF
Navigating the Wide World of Data Visualization Libraries
PDF
Encodable: Configurable Grammar for Visualization Components
PDF
6 things to expect when you are visualizing (2020 Edition)
PDF
Increasing the Impact of Visualization Research
PDF
What to expect when you are visualizing (v.2)
PDF
ร้อยเรื่องราวจากข้อมูล / Storytelling with Data
PDF
Reveal the talking points of every episode of Game of Thrones from fans' conv...
PDF
What to expect when you are visualizing
PDF
Adventure in Data: A tour of visualization projects at Twitter
PDF
Logs & Visualizations at Twitter
PDF
Data Visualization: A Quick Tour for Data Science Enthusiasts
PDF
Using Visualizations to Monitor Changes and Harvest Insights from a Global-sc...
PDF
Data Visualization at Twitter
PDF
Making Sense of Millions of Thoughts: Finding Patterns in the Tweets
PDF
From Data to Visualization, what happens in between?
PDF
A Narrative Display for Sports Tournament Recap
PDF
Krist Wongsuphasawat's Dissertation Proposal Slides: Interactive Exploration ...
PDF
Usability of Google Docs
What I tell myself before visualizing
Navigating the Wide World of Data Visualization Libraries
Encodable: Configurable Grammar for Visualization Components
6 things to expect when you are visualizing (2020 Edition)
Increasing the Impact of Visualization Research
What to expect when you are visualizing (v.2)
ร้อยเรื่องราวจากข้อมูล / Storytelling with Data
Reveal the talking points of every episode of Game of Thrones from fans' conv...
What to expect when you are visualizing
Adventure in Data: A tour of visualization projects at Twitter
Logs & Visualizations at Twitter
Data Visualization: A Quick Tour for Data Science Enthusiasts
Using Visualizations to Monitor Changes and Harvest Insights from a Global-sc...
Data Visualization at Twitter
Making Sense of Millions of Thoughts: Finding Patterns in the Tweets
From Data to Visualization, what happens in between?
A Narrative Display for Sports Tournament Recap
Krist Wongsuphasawat's Dissertation Proposal Slides: Interactive Exploration ...
Usability of Google Docs

Recently uploaded (20)

PDF
Approach and Philosophy of On baking technology
PPTX
1. Introduction to Computer Programming.pptx
PPTX
A Presentation on Touch Screen Technology
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
Getting Started with Data Integration: FME Form 101
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
Enhancing emotion recognition model for a student engagement use case through...
PPTX
OMC Textile Division Presentation 2021.pptx
PPTX
Tartificialntelligence_presentation.pptx
PDF
WOOl fibre morphology and structure.pdf for textiles
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Approach and Philosophy of On baking technology
1. Introduction to Computer Programming.pptx
A Presentation on Touch Screen Technology
cloud_computing_Infrastucture_as_cloud_p
Building Integrated photovoltaic BIPV_UPV.pdf
Programs and apps: productivity, graphics, security and other tools
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Getting Started with Data Integration: FME Form 101
Univ-Connecticut-ChatGPT-Presentaion.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Zenith AI: Advanced Artificial Intelligence
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Enhancing emotion recognition model for a student engagement use case through...
OMC Textile Division Presentation 2021.pptx
Tartificialntelligence_presentation.pptx
WOOl fibre morphology and structure.pdf for textiles
Group 1 Presentation -Planning and Decision Making .pptx
gpt5_lecture_notes_comprehensive_20250812015547.pdf

Visualization for Event Sequences Exploration

  • 1. Data Visualization Summit San Francisco, CA Apr 11, 2013 Visualizations for Event Sequences Exploration Krist Wongsuphasawat Data Visualization Scientist Twitter, Inc. @kristw
  • 2. event% event% event% event% event% event% event% event% Life event% event% event% event% event% event% event% event%
  • 3. Time Event type% ( 7:00 am, Wake up ) event% event% event% event% event% event% event% event% Life event% event% event% event% event% event% event% event%
  • 4. event% event% event% event% event% event% event% event% Life event% event% event% event% event% event% event% event% “Event Sequence”
  • 5. Daily Activity 7:30 a.m. 7:45 a.m. 8:30 a.m. Wake Up Exercise Go to work
  • 6. Traffic Incidents 9:30 a.m. 9:55 a.m. 10:30 a.m. Notification Units arrived Road cleared
  • 8. Event Sequences Medical Transportation Sports Education Web logs Logistics and more…
  • 9. Outline ? u ences e nt seq hat are ev them? W is ualize Ho w to v a b ig dat Ap ply to
  • 11. Event glyphs timeline sequence
  • 12. simple event sequence timeline.js Horizontal axis = time Glyphs = events http://timeline.verite.co/
  • 13. Event glyphs timeline sequence + Interval
  • 14. interval •  Car crash (point) time 10 a.m. •  Meeting (interval) 10 – 11 a.m.
  • 15. interval >> width traffic incident CATT Lab, University of Maryland -- http://teachamerica.com/VIZ11/VIZ1102Pack/index.htm
  • 16. interval >> width chronoline.js http://stoicloofah.github.io/chronoline.js/
  • 17. Event glyphs timeline sequence + Interval width + Event types
  • 18. types time Nurses’ actions Doctors’ actions They all look similar.
  • 19. types time Nurses’ actions Doctors’ actions Better?
  • 20. The path of protest types >> color http://www.guardian.co.uk/world/interactive/2011/mar/22/middle-east-protest-interactive-timeline
  • 21. types >> colors + shapes http://timeglider.com/widget/ timeglider.js
  • 22. Event glyphs timeline sequence + Interval width + Event colors shapes types High + density
  • 23. high density time Too many overlaps and occlusions
  • 24. high density >> facet Google Chrome loading scripting rendering & painting Facet Google Chrome > Developer Tools > Timeline
  • 25. high density >> facet Lifelines http://www.cs.umd.edu/lifelines
  • 26. high density >> binning British History Timeline bin by year
  • 27. high density >> aggregation CloudLines Raw event data Kernel Density Estimation + Importance Func. + Truncation Encode cloud size
  • 28. high density >> aggregation CloudLines (2) Krstajic, M., Bertini, E., & Keim, D. A. (2011). CloudLines: Compact Display of Event Episodes in Multiple Time-Series. IEEE Transactions on Visualization and Computer Graphics, 17(12), 2432.
  • 29. linear Event glyphs timeline sequence non-linear + Interval width + Event colors shapes types High + facet aggregation binning density
  • 30. circular timeline 2008 2009 2010 2011 2012 linear Dec Jan Feb Nov Mar circular Oct Apr repeating patterns Sep May Aug Jun Jul
  • 31. circular timeline (2) Traffic Incidents VanDaniker, M. (2010). Leverage of Spiral Graph for Transportation System Data Visualization. Transportation Research Record: Journal of the Transportation Research Board, 2165, 79–88.
  • 32. stacked timeline 2008 2009 2010 2011 2012 linear 2008 2009 2008 2009 2011 2010 2012 2010 2011 2012
  • 33. stacked timeline (2) Tweet Volume Rios, M., & Lin, J. (2012). Distilling Massive Amounts of Data into Simple Visualizations : Twitter Case Studies. Proceedings of the Workshop on Social Media Visualization (SocMedVis) at ICWSM 2012 (pp. 22–25).
  • 34. linear Event glyphs timeline sequence non-linear + Interval width + Event colors shapes types High + facet aggregation binning density
  • 35. collection 1 2 n Event Event ... Event sequence sequence sequence
  • 36. collection multiple timelines Event sequence #1 Event sequence #2 Event sequence #3 Event sequence #4
  • 37. collection 1 2 n Event Event ... Event sequence sequence sequence Millions!
  • 38. collection 1 2 n Event Event ... Event sequence sequence sequence Interactions
  • 43. Interaction #2 rank Rank by number of events or any criteria
  • 45. Interaction #3 filter Select only event sequences with events Set your own filters
  • 47. Interaction #4 group 1 2 3 Group by sequence length or any clustering algorithm / properties
  • 48. Interaction #5 search •  Simple search ABC –  Sequence matching AABCDEFGH –  Subsequence matching AXAYBZCED •  Regular Expression A B* (C|D)
  • 49. Interaction #5 search (2) •  Dynamic X 50% C 75% AB Y 50% D 25%
  • 50. Interaction #5 search (2) •  Dynamic X 70% D 50% ABC Y 30% E 50% •  Similarity search Similar to ABCD ABCD ABD ACE …
  • 51. collection 1 2 n Event Event ... Event sequence sequence sequence Interactions Aggregation align by time rank search filter group
  • 52. aggregation by time temporal summary Day 1 Day 2 Day 3 Day 4 Day 5 bin & count
  • 53. aggregation by time temporal summary Wang, T. D., Plaisant, C., Shneiderman, B., Spring, N., Roseman, D., Marchand, G., Mukherjee, V., et al. (2009). Temporal Summaries: Supporting Temporal Categorical Searching, Aggregation and Comparison. IEEE Transactions on Visualization and Computer Graphics, 15(6), 1049–1056.
  • 54. collection 1 2 n Event Event ... Event sequence sequence sequence Interactions Aggregation align by time rank search by sequence filter group
  • 55. aggregation by sequence LifeFlow e.g. 1) What happened to the patients after they arrived? Arrival! ? ? 2) What happened to the patients before & after ICU? ICU! ? ? ? ?
  • 56. aggregation by sequence LifeFlow overview / summary Millions of records!
  • 57. Demo LifeFlow Wongsuphasawat, K., Guerra Gómez, J. A., Plaisant, C., Wang, T. D., Taieb-Maimon, M., & Shneiderman, B. (2011). LifeFlow: Visualizing an Overview of Event Sequences. Proceedings of CHI'2011 (pp. 1747–1756).
  • 58. Demo LifeFlow Wongsuphasawat, K., Guerra Gómez, J. A., Plaisant, C., Wang, T. D., Taieb-Maimon, M., & Shneiderman, B. (2011). LifeFlow: Visualizing an Overview of Event Sequences. Proceedings of CHI'2011 (pp. 1747–1756).
  • 59. Demo LifeFlow Wongsuphasawat, K., Guerra Gómez, J. A., Plaisant, C., Wang, T. D., Taieb-Maimon, M., & Shneiderman, B. (2011). LifeFlow: Visualizing an Overview of Event Sequences. Proceedings of CHI'2011 (pp. 1747–1756).
  • 60. aggregation by sequence LifeFlow profile! home! start! home! photos! home! contact! home!
  • 61. aggregation by sequence Google Analytics profile! start! home! photos! home! contact! http://www.google.com/analytics
  • 62. aggregation by sequence Google Analytics profile! home! start! home! photos! videos! contact! http://www.google.com/analytics
  • 63. aggregation by sequence Google Analytics top pages only height = number of visits http://www.google.com/analytics
  • 64. Event + Outcome sequence
  • 65. Time% Game #1 Win (1) 10th minute 25th minute 90th minute Goal Concede Goal or any sports
  • 66. Time% Game #1 Win (1) Goal% Concede% Goal% Game #2 Win (1) Goal% Goal% Concede% Game #3 Lose (0) Goal% Concede% Concede% Game #n Win (1) Concede% Goal% Goal% Goal%
  • 67. aggregation by sequence with outcome Outflow (Careflow) overview / summary Event Sequences! with Outcome!
  • 68. Assumption Events are persistent. Record #1 e1% e2% e3% Record #1
  • 69. Assumption Events are persistent. Record #1 e1% e2% e3% Record #1 e1% e1% e1%
  • 70. Assumption Events are persistent. Record #1 e1% e2% e3% Record #1 e1% e1% e1% e2% e2%
  • 71. Assumption Events are persistent. Record #1 e1% e2% e3% Record #1 e1% e1% e1% e2% e2% e3%
  • 72. Assumption Events are persistent. Record #1 e1% e2% e3% Record #1 e1% e1% e1% [e1] e2% e2% e3% States [e1, e2] [e1, e2, e3]
  • 73. Select alignment point Pick a state What are the paths What are the paths that led to ? after ? Example Soccer: Goal, Concede, Goal
  • 74. Outflow Graph Alignment Point [e1, e2, e3]!
  • 75. 1%record% Outflow Graph Alignment Point [e1]! [e1, e2]! [ ]! [e1, e2, e3]! [e1, e2, e3, e5]!
  • 76. 2%records% Outflow Graph Alignment Point [e1]! [e1, e2]! [ ]! [e1, e3]! [e1, e2, e3]! [e1, e2, e3, e5]!
  • 77. 3%records% Outflow Graph Alignment Point [e1]! [e1, e2]! [e1, e2, e3, e4]! [ ]! [e1, e3]! [e1, e2, e3]! [e1, e2, e3, e5]! [e3]!
  • 78. n%records% Outflow Graph Alignment Point [e1]! [e1, e2]! [e1, e2, e3, e4]! [ ]! [e2]! [e1, e3]! [e1, e2, e3]! [e1, e2, e3, e5]! [e3]! [e2, e3]!
  • 79. n%records% Outflow Graph Alignment Point [e1]! [e1, e2]! [e1, e2, e3, e4]! [ ]! [e2]! [e1, e3]! [e1, e2, e3]! [e1, e2, e3, e5]! [e3]! [e2, e3]! Average outcome = 0.4 Average time = 10 days No. of records = 10
  • 80. Soccer Results Alignment Point 1-0! 2-0! 2-2! 0-0! 1-1! 2-1! 3-1! 0-1! 0-2!
  • 81. Past& Future& Alignment% Node’s horizontal position shows sequence of states.% e1! e2! e3! End of path% e1! e1! e2! 7me% link% e1! Node’s height is edge% edge% e2! number of records.% e4! e2! Color is outcome Time edge’s width is measure.% duration of transition.%
  • 83. Wongsuphasawat, K., & Gotz, D. (2012). Exploring Flow, Factors, and Outcomes of Temporal Event Sequences with the Outflow Visualization. IEEE Transactions on Visualization and Computer Graphics, 18(12), 2659–2668.
  • 84. collection 1 2 n Event Event ... Event sequence sequence sequence Interactions Aggregation align by time rank search by sequence filter group + Outcome
  • 86. Something sounds simple X magnitude of big data = Big mess & Big reward
  • 87. Event Sequence Analysis at eBay CheckoutProcStep1 PaymentReview CheckoutProcStep2 CheckoutProcStep3 PaymentConfirm CheckoutProcStep4 CheckoutProcStep5 CheckoutProcStep6 CheckoutSuccess
  • 88. eBay Event Sequence Analysis at alignment Shen, Z., Wei, J., Sundaresan, N., & Ma, K.-L. (2012). Visual analysis of massive web session data. IEEE Symposium on Large Data Analysis and Visualization (LDAV), 65–72.
  • 89. Event Sequence Analysis at Twitter •  Data –  TBs of session logs everyday •  Complexity –  millions of sessions per day –  1000+ types of events –  long sessions •  Goal –  Overview of how users are using Twitter •  Technique –  LifeFlow Simplify!
  • 90. Event Sequence Analysis at Twitter (2) •  So far –  millions of sessions per day –  millions of sessions on the same screen –  1000+ types of events –  simplified sets of events •  e.g., pages only, selected pages only –  long sessions –  limited session length to 10-20 events
  • 91. Event Sequence Analysis at Twitter (3) Session%Start% Page%A% Page%B% Page%C% Page%B% Page%A% Page%D% Page%C% Page%D% Page%B% Page%C% Page%D% Page%C% *fake data
  • 92. Event Sequence Analysis at Twitter (4) •  Implementation –  Hadoop  –  Web-based (js) •  More –  Stored preprocessed data in smaller db (MySQL/Vertica) Interactive MySQL / HDFS Vertica Visualization Batch pig scripts
  • 93. Takeaway Messages •  Life is full of event sequences. •  How to visualize an event sequence Krist Wongsuphasawat krist.wongz@gmail.com @kristw
  • 94. linear Event glyphs timeline sequence non-linear + Interval width + Event colors shapes types High + facet aggregation binning density
  • 95. Takeaway Messages •  Life is full of event sequences. •  How to visualize an event sequence •  How to visualize collection of event seq. Krist Wongsuphasawat krist.wongz@gmail.com @kristw
  • 96. collection 1 2 n Event Event ... Event sequence sequence sequence Interactions Aggregation align by time rank search by sequence filter group + Outcome
  • 97. Takeaway Messages •  Life is full of event sequences. •  How to visualize an event sequence •  How to visualize collection of event seq. •  Applicable to big data •  New techniques happen everyday. Krist Wongsuphasawat krist.wongz@gmail.com @kristw
  • 98. Smurf Communism - Wikipedia delete keep … http://notabilia.net/
  • 100. Takeaway Messages •  Life is full of event sequences. •  How to visualize an event sequence •  How to visualize collection of event seq. •  Applicable to big data •  New techniques happen everyday. Krist Wongsuphasawat krist.wongz@gmail.com @kristw