SlideShare a Scribd company logo
 
inside
Not only,  whether  one gets to Rome, but also  how . Not only,  whether  a user solves a task, but also  how .
What other processes lie in the dark? problem solving
Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies Eva Mayr, Michael Smuc, Hanna Risku Research Center KnowComm Danube University Krems
Problem Solving Eyeryday work   problems are often ill-defined! Ill-defined Well-defined Problem Type More than one correct solutions Ill-defined One correct solution Well-defined Solution Problem Type Multiple ways to get there More than one correct solutions Ill-defined Multiple ways to get there One correct solution Well-defined Problem Solving Strategies Solution Problem Type Reading beyond data (e.g. new hypotheses) Reading in the data  (e.g. concrete value) Example Multiple ways to get there More than one correct solutions Ill-defined Multiple ways to get there One correct solution Well-defined Problem Solving Strategies Solution Problem Type
User Study Aim : Comparison of two prototyps of Visual Analytics tools Sample : 12 data explorers 5 real-world data sets  6-7 problems (from well- to ill-defined) Measures : think-aloud, eye-gaze, interaction
Multiscale  vs.  GROOVE
Problem 1: Reading the Data What is the exact value on Christmas day 2007?
Problem 1: Reading the Data What is the exact value on Christmas day 2007?
Problem 2: Reading Beyond the Data From which gastronomic business do the data stem? .
Conclusions Problem solving strategies can be identified with little effort. Problem solving strategies are highly situated. For ill-defined problems different information sources are used, both types of problems allow for multiple strategies. Problem solving strategies are related to the solution quality. Analyzing problem solving strategies provides suggestions how to improve a tool.
 
Postulations for Discussion The black box of the „exploratory mind“ is still in the dark for a great extent. Analysing problem solving strategies can shed light on it. Problem solving strategies are related to insights, time and errors. A „good“ visual analytics tool allows for multiple ways to Rome. Insights, time or errors alone cannot unveal this fact.
Thanks … …  to our expert users for participating …  to the Austrian research foundation (FFG) for funding …  to the reviewers for re-directing the focus of our paper …  to you for your interest

More Related Content

PPTX
Learn Statistics by Interaction
PDF
Quizz: Targeted Crowdsourcing with a Billion (Potential) Users
PDF
3. Workshop Responsible Data Science - Discussion on Accuracy in data science...
PDF
5. Workshop Responsible Data Science - Discussion on Transparency in data sci...
PPTX
D18-EWRT 2-S18
PPTX
HOW TO BECOME AN EFFECTIVE DATA SCIENTIST (WORKSHOP) - MIKE BUGEMBE
PPS
Math early release
PPT
Learn Statistics by Interaction
Quizz: Targeted Crowdsourcing with a Billion (Potential) Users
3. Workshop Responsible Data Science - Discussion on Accuracy in data science...
5. Workshop Responsible Data Science - Discussion on Transparency in data sci...
D18-EWRT 2-S18
HOW TO BECOME AN EFFECTIVE DATA SCIENTIST (WORKSHOP) - MIKE BUGEMBE
Math early release

Similar to Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies. (20)

PDF
Camden Council (Design Group Project) Dropbox
PPTX
Creative Thinking.pptx
PPS
Mental Models2
PPT
Decision making & problem solving
PDF
Introduction to Design thinking 2015 by Vedran Antoljak
PDF
The Collaboratory: Problem-Solving in the Learning Environment
PDF
Yo. big data. understanding data science in the era of big data.
PPT
Dissemination Of Information
PPTX
Decision Science POV 6-26-13
PPTX
IFI7159 M4
PPT
PROBLEM SOLVING POWERPOINT
PPT
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...
PPTX
The Social Side of Behavioural Economics
PDF
Design and Data Processes  Unified -  3rd Corner View
PPTX
Campus Session 2
PPTX
problem-solving
PPTX
Machine Learning and Languge
PPTX
Using the web 20 for alternative assessment
PDF
Deliberate Assessment of the Creative Process
PPT
Best Practice Information Architecture
Camden Council (Design Group Project) Dropbox
Creative Thinking.pptx
Mental Models2
Decision making & problem solving
Introduction to Design thinking 2015 by Vedran Antoljak
The Collaboratory: Problem-Solving in the Learning Environment
Yo. big data. understanding data science in the era of big data.
Dissemination Of Information
Decision Science POV 6-26-13
IFI7159 M4
PROBLEM SOLVING POWERPOINT
Seeing the Forest for the Trees: Visual Problem Solving as a Design and Usabi...
The Social Side of Behavioural Economics
Design and Data Processes  Unified -  3rd Corner View
Campus Session 2
problem-solving
Machine Learning and Languge
Using the web 20 for alternative assessment
Deliberate Assessment of the Creative Process
Best Practice Information Architecture
Ad

More from BELIV Workshop (17)

PDF
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
PPTX
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
PDF
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
PPTX
Implications of Individual Differences on Evaluating Information Visualizatio...
PDF
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
PPT
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
KEY
A Descriptive Model of Visual Scanning.
PPT
Generating a synthetic video dataset
PPTX
Beyond system logging: human logging for evaluating information visualization.
PPT
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
PPTX
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
PPT
Learning-Based Evaluation of Visual Analytic Systems.
PDF
Visualization Evaluation of the Masses, by the Masses, and for the Masses.
PPT
Evaluating Information Visualization in Large Companies: Challenges, Experien...
PPT
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
PPTX
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
PPTX
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
Look Before You Link: Eye Tracking in Multiple Coordinated View Visualization.
Proposed Working Memory Measures for Evaluating Information Visualization Tools.
How is a graphic like pumpkin pie? A framework for analysis and critique of v...
Implications of Individual Differences on Evaluating Information Visualizatio...
Towards Information-Theoretic Visualization Evaluation Measure: A Practical e...
Is Your User Hunting or Gathering Insights? Identifying Insight Drivers Acros...
A Descriptive Model of Visual Scanning.
Generating a synthetic video dataset
Beyond system logging: human logging for evaluating information visualization.
Scanning Between Graph Visualizations: An Eye Tracking Evaluation.
Focus Groups for Functional InfoVis Prototype Evaluation: A Case Study.
Learning-Based Evaluation of Visual Analytic Systems.
Visualization Evaluation of the Masses, by the Masses, and for the Masses.
Evaluating Information Visualization in Large Companies: Challenges, Experien...
Pragmatic Challenges in the Evaluation of Interactive Visualization Systems.
Comparative Evaluation of Two Interface Tools in Performing Visual Analytics ...
BELIV'10 Keynote: Conceptual and Practical Challenges in InfoViz Evaluations
Ad

Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies.

  • 1.  
  • 3. Not only, whether one gets to Rome, but also how . Not only, whether a user solves a task, but also how .
  • 4. What other processes lie in the dark? problem solving
  • 5. Many Roads Lead to Rome. Mapping Users’ Problem Solving Strategies Eva Mayr, Michael Smuc, Hanna Risku Research Center KnowComm Danube University Krems
  • 6. Problem Solving Eyeryday work problems are often ill-defined! Ill-defined Well-defined Problem Type More than one correct solutions Ill-defined One correct solution Well-defined Solution Problem Type Multiple ways to get there More than one correct solutions Ill-defined Multiple ways to get there One correct solution Well-defined Problem Solving Strategies Solution Problem Type Reading beyond data (e.g. new hypotheses) Reading in the data (e.g. concrete value) Example Multiple ways to get there More than one correct solutions Ill-defined Multiple ways to get there One correct solution Well-defined Problem Solving Strategies Solution Problem Type
  • 7. User Study Aim : Comparison of two prototyps of Visual Analytics tools Sample : 12 data explorers 5 real-world data sets 6-7 problems (from well- to ill-defined) Measures : think-aloud, eye-gaze, interaction
  • 8. Multiscale vs. GROOVE
  • 9. Problem 1: Reading the Data What is the exact value on Christmas day 2007?
  • 10. Problem 1: Reading the Data What is the exact value on Christmas day 2007?
  • 11. Problem 2: Reading Beyond the Data From which gastronomic business do the data stem? .
  • 12. Conclusions Problem solving strategies can be identified with little effort. Problem solving strategies are highly situated. For ill-defined problems different information sources are used, both types of problems allow for multiple strategies. Problem solving strategies are related to the solution quality. Analyzing problem solving strategies provides suggestions how to improve a tool.
  • 13.  
  • 14. Postulations for Discussion The black box of the „exploratory mind“ is still in the dark for a great extent. Analysing problem solving strategies can shed light on it. Problem solving strategies are related to insights, time and errors. A „good“ visual analytics tool allows for multiple ways to Rome. Insights, time or errors alone cannot unveal this fact.
  • 15. Thanks … … to our expert users for participating … to the Austrian research foundation (FFG) for funding … to the reviewers for re-directing the focus of our paper … to you for your interest

Editor's Notes

  • #13: – depending on the task, the data, the visualisation, & the user