Visual Sensemaking for Contested Collective Intelligence
2 likes1,016 views
The document discusses the Visual Analytics Summer School held at Middlesex University in 2010, focusing on visual sensemaking for contested collective intelligence. It highlights the importance of discourse in understanding and interpreting information, the challenges of mapping arguments, and the development of tools for enhancing collective sensemaking. It also emphasizes the necessity of human-centered computing and the integration of argumentation theory in designing effective sensemaking tools.
Visual Sensemaking for Contested Collective Intelligence
- 1. VASS 2010: Visual Analytics Summer School Middlesex University, Sep. 16-24, 2010 Visual Sensemaking for Contested Collective Intelligence Simon Buckingham Shum Knowledge Media Institute Open University UK http://people.kmi.open.ac.uk/sbs http://creativecommons.org/licenses/by-nc/2.0/uk 1
- 2. Acknowledgements Open Learning Network project (2009-12): olnet.org funded by the William & Flora Hewlett Foundation OLnet Collective Intelligence workstream: http://olnet.org/collective-intelligence Developing conceptual foundations and infrastructure (people+proceses+tools) for Contested Collective Intelligence on the open social web 2
- 3. The Hypermedia Discourse Group Knowledge Media Institute, Open University: http://projects.kmi.open.ac.uk/hyperdiscourse Funders span disciplines, from basic research to applications: 3
- 4. overview the key idea a framework CSCA with a simple scheme probing argumentation social-semantic web future directions 4
- 5. the key idea… it all revolves around conversations (“discourse”) we don’t always agree contested collective intelligence 5
- 6. Where our tools fit… Given a wealth of documents… 6
- 7. Where our tools fit… Given a wealth of documents, and tools to detect and render potentially significant patterns… 7
- 8. Where our tools fit… Given a wealth of documents, and tools to detect and render potentially significant patterns… 8
- 9. Where our tools fit: making meaningful connections between information elements… 9
- 10. Where our tools fit: making meaningful connections between interpretations interpretation interpretation interpretation interpretation 10
- 11. Where our tools fit: making meaningful connections between interpretations interpretation interpretation interpretation (a hunch – no grounding evidence yet) interpretation interpretation interpretation 11
- 12. Where our tools fit: making meaningful connections between information elements interpretation Is pre-requisite for interpretation interpretation (a hunch – no grounding evidence yet) causes predicts interpretation interpretation interpretation 12
- 13. Where our tools fit: making meaningful connections between information elements interpretation Is pre-requisite for prevents interpretation interpretation (a hunch – no grounding Is inconsistent with evidence yet) causes predicts challenges interpretation interpretation interpretation 13
- 14. Where our tools fit: building the story that makes sense of the evidence… i.e. plausible arguments Question responds to motivates Answer Assumption supports challenges Supporting Challenging Argument… Argument… 14
- 15. Where our tools fit: building the story that makes sense of the evidence… i.e. plausible arguments Question responds to motivates Answer Hunch supports challenges Supporting Challenging Argument… Argument… 15
- 16. Where our tools fit: building the story that makes sense of the evidence… i.e. plausible arguments Question responds to motivates Answer Data supports challenges Supporting Challenging Argument… Argument… 16
- 17. Where our tools fit: building the story that makes sense of the evidence… i.e. plausible arguments What kinds of arguments underpin these claimed relationships? (Argumentation Schemes) motivates supports challenges 17
- 18. The building blocks of this approach
- 19. how to deliver the vision? 19
- 20. Human-Centred Computing for Sensemaking (including Design Rationale, and arguably, many RE tools?) Domain Discourse
- 21. Human-Centred Computing for Sensemaking (including Design Rationale, and arguably, many RE tools?) Services Interaction Interoperability Design Domain Discourse
- 22. Human-Centred Computing for Sensemaking (including Design Rationale, and arguably, many RE tools?) Services Interaction Interoperability Design Learning Domain Curve Discourse Mastery
- 23. Human-Centred Computing for Sensemaking Services Interaction Interoperability Design Learning Domain Curve Discourse Mastery
- 24. Analyst-defined visual connection language 24
- 25. Horst Rittel’s IBIS (1972): Issue-Based Information System 25
- 26. Compendium Java application visual hypermedia for managing the connections between ideas flexibly Buckingham Shum, S., Selvin, A., Sierhuis, M., Conklin, J., Haley, C. and Nuseibeh, B. (2006). Hypermedia Support for Argumentation-Based Rationale: 15 Years on26 from gIBIS and QOC. In: Rationale Management in Software Engineering (Eds.) A.H. Dutoit, R. McCall, I. Mistrik, and B. Paech. Springer-Verlag: Berlin. http://oro.open.ac.uk/3032
- 27. example from yesterday’s Enron exercise 27
- 28. Using Compendium as a workspace to build the emerging “plausible narrative” Enron dataset, as used in Simon Attwell’s Visual Threads workshop (left-right layout) 28
- 29. Using Compendium as a workspace to build the emerging “plausible narrative” Enron dataset, as used in Simon Attwell’s Visual Threads workshop (vertical layout) 29
- 30. Human-Centred Computing for Sensemaking Services Interaction Interoperability Design Learning Domain Curve Discourse Mastery
- 31. Wall-size displays: Robert Horn 31
- 32. Wall-size displays: Robert Horn 32
- 33. What if we could get search results like this?… (Robert Horn) One of seven maps in the Mapping Great Debates: Can Computers Think? Series. MacroVU Press. www.macrovu.com (Horn, 2003; Yoshimi, 2006) 33
- 34. Horn (zoomed in) 34 MacroVU Press. www.macrovu.com
- 35. There are now a number of tools for mapping issues, dialogue and argumentation Online Deliberation: Emerging Tools Workshop Online Deliberation 2010, Leeds UK (30 June – 2 July) www.olnet.org/odet2010 ESSENCE: E-Science, Sensemaking & Climate Change ESSENCE workshop, KMI, Open University http://events.kmi.open.ac.uk/essence 35
- 36. David Price, Debategraph.org 36
- 37. Tim van Gelder, AusThinkConsulting.com bCsive Online
- 38. Tim van Gelder, AusThinkConsulting.com ShowCase Word document with macros Turns Word into an argument mapping application
- 39. Tim van Gelder, AusThinkConsulting.com ShowCase
- 40. SEAS: Structured Evidential Argumentation System (John Lowrance, SRI) Extensive work with the intelligence analysis community Experimented with automated argument evaluation Analysts tend to reject AI that can’t be easily understood Lowrance, J. et al. (2008). Template-based Structured Argumentation . In: Knowledge Cartography: Software Tools and Mapping Techniques. (Eds.) Okada, A., Buckingham Shum, S. and Sherborne, T. Springer 40
- 41. SEAS: Structured Evidential Argumentation System (John Lowrance, SRI) Lowrance, J. et al. (2008). Template-based Structured Argumentation . In: Knowledge Cartography: Software Tools and Mapping Techniques. (Eds.) Okada, A., Buckingham Shum, S. and Sherborne, T. Springer 41
- 42. SEAS: Structured Evidential Argumentation System (John Lowrance, SRI) Lowrance, J. et al. (2008). Template-based Structured Argumentation . In: Knowledge Cartography: Software Tools and Mapping Techniques. (Eds.) Okada, A., Buckingham Shum, S. and Sherborne, T. Springer 42
- 43. Compendium “it’s like Excel, but for knowledge” http://compendium.open.ac.uk/institute 43
- 44. NASA e-science field trials Simulated distributed Mars-Earth planning and data analysis tools for Mars Habitat field trial in Utah desert, supported from US+UK www.kmi.open.ac.uk/projects/coakting/nasa 44
- 45. Issue/concept mapping Mapping the ideas, themes and arguments in a complex debate (Iraq) An overview map of pro- invasion authors www.kmi.open.ac.uk/projects/compendium/iraq 45
- 46. Issue/concept mapping Detailed argument map of an author’s article www.kmi.open.ac.uk/projects/compendium/iraq 46
- 47. Using Compendium for personnel recovery planning Example of Conversational Modelling: real time dialogue mapping combined with model driven templates (AI+IA) Co-OPR Project (with Austin Tate): http://www.aiai.ed.ac.uk/project/co-opr
- 48. Personnel Recovery: Planning Cell 48
- 49. Doctrine for Situation Analysis extracted as an Issue Template Link to the source doctrine document Issues that require attention (as specified in the doctrine document) Relevant extract from doctrine publication inside the node for reference
- 50. Mission Briefing: Intent template Options may be constrained by predefined ‘doctrine’ 50
- 51. Capturing political deliberation/rationale Visual background structures the display for planning The collective intelligence available in the room and online: Dialogue Map capturing the team’s deliberations 51
- 52. Option Comparison matrix Summary of how options trade off against each other, derived from each option analysis Constraints Restraints
- 53. I-X Planning Engine input to Compendium Issues on which the I-X planning engine provided candidate Options 53
- 54. Compendium has played a number of roles in supporting collective sensemaking Decision/Design Rationale Knowledge Management Storyboarding Meeting Capture & Replay Domain Modelling Presentations Requirements Data Construction Analysis Specification Documentation Project Reviews 54
- 55. Argument Mapping Using argumentation theory to probe reasoning in more detail 55
- 56. Argument Mapping 101 Neil Thomason & Yanna Rider (2008). Cognitive and Pedagogical Benefits of Argument Mapping: L.A.M.P. Guides the Way to Better Thinking. In: Knowledge Cartography: Software Tools and Mapping Techniques. (Eds.) Okada, A., Buckingham Shum, S. and Sherborne, T. Springer 56
- 57. Argument Mapping 101 Neil Thomason & Yanna Rider (2008). Cognitive and Pedagogical Benefits of Argument Mapping: L.A.M.P. Guides the Way to Better Thinking. In: Knowledge Cartography: Software Tools and Mapping Techniques. (Eds.) Okada, A., Buckingham Shum, S. and Sherborne, T. Springer 57
- 58. Argument Mapping 101 Neil Thomason & Yanna Rider (2008). Cognitive and Pedagogical Benefits of Argument Mapping: L.A.M.P. Guides the Way to Better Thinking. In: Knowledge Cartography: Software Tools and Mapping Techniques. (Eds.) Okada, A., Buckingham Shum, S. and Sherborne, T. Springer 58
- 59. Argument Mapping 101 Neil Thomason & Yanna Rider (2008). Cognitive and Pedagogical Benefits of Argument Mapping: L.A.M.P. Guides the Way to Better Thinking. In: Knowledge Cartography: Software Tools and Mapping Techniques. (Eds.) Okada, A., Buckingham Shum, S. and Sherborne, T. Springer 59
- 60. Argument Mapping 101 Why Tanks? Why Abrams? The Application of Argument Mapping to a Contentious Public Policy Debate. A report prepared for the Australian Army, reviewing the arguments bearing upon the controversial decision to purchase the Abrams battle tank. An “industrial strength” application of argument mapping. http://austhinkconsulting.com/resources/ 60
- 61. Argument Mapping 101 xx 61
- 62. Argument Mapping 101 xx 62
- 63. Large Scale Argument Mapping Why Tanks? Why Abrams? The Application of Argument Mapping to a Contentious Public Policy Debate. A report prepared for the Australian Army, reviewing the arguments bearing upon the controversial decision to purchase the Abrams battle tank. An “industrial strength” application of argument mapping. http://austhinkconsulting.com/resources/ 63
- 64. Large Scale Argument Mapping Why Tanks? Why Abrams? The Application of Argument Mapping to a Contentious Public Policy Debate. A report prepared for the Australian Army, reviewing the arguments bearing upon the controversial decision to purchase the Abrams battle tank. An “industrial strength” application of argument mapping. http://austhinkconsulting.com/resources/ 64
- 65. Hypothesis Mapping (Tim van Gelder, Austhink Consulting) A megacryometeor is a giant hailstone; A blue-sky megacryometeor is one that falls out of a clear blue sky. Map based on: Douglas, E. (2007). Mystery of the monster hailstones. New Scientist, 23 Dec. 2007. 65
- 66. Argumentation Schemes Using argumentation theory to probe reasoning in more detail 66
- 67. Recall this… What’s the reasoning behind this asserted challenges link? Answer challenges Challenging Argument… 67
- 68. Compendium Libraries of IBIS templates with critical questions to probe different kinds of argument scheme Argument Interchange: These XML files were transformed from another format, generated 68 from Chris Reed & Doug Walton’s work on modelling Walton’s argumentation schemes
- 69. Compendium Libraries of IBIS templates with critical questions to probe different kinds of argument scheme 69
- 70. 70
- 71. 71
- 73. web annotation for sensemaking (A winner in the Mozilla/MacArthur Foundation Jetpack for Learning Design Challenge) http://cohere.open.ac.uk 73
- 74. — Web 2.0 IBIS++ structured deliberation 74
- 75. — annotating documents with Firefox plugin De Liddo, A. and Buckingham Shum, S. (2010). Cohere: A prototype for contested collective intelligence. In: ACM Computer Supported Cooperative Work 75 (CSCW 2010) - Workshop: Collective Intelligence In Organizations, February 6-10, 2010, Savannah, Georgia, USA. http://oro.open.ac.uk/19554
- 76. — geospatial mashup of ideas Nodes in the semantic network containing geolocation data can be visualized in Google Maps
- 77. — timeline viz. mashup of ideas Nodes in the semantic network containing temporal data can be visualized in MIT Simile’s timeline
- 78. seeing the connections people make as they annotate the web using Cohere Visualizing all the connections that a set of analysts have made between web resources — but this may also be confusing De Liddo, A. and Buckingham Shum, S. (2010). Cohere: A prototype for contested collective intelligence. In: ACM Computer Supported Cooperative Work (CSCW 2010) - Workshop: Collective Intelligence In Organizations, February 6-10, 2010, Savannah, Georgia, USA. http://oro.open.ac.uk/19554
- 79. — semantic filter of argument map Visualizing multiple learners’ interpretations of global warming sources Connections have been filtered by a set of semantic relationships grouped as Consistency De Liddo, A. and Buckingham Shum, S. (2010). Cohere: A prototype for contested collective intelligence. In: ACM Computer Supported Cooperative Work (CSCW 2010) - Workshop: Collective Intelligence In Organizations, February 6-10, 2010, Savannah, Georgia, USA. http://oro.open.ac.uk/19554
- 80. “Semantic Google Scholar”: Query: What is the lineage of this idea? Buckingham Shum, S.J., Uren, V., Li, G., Sereno, B. and Mancini, C. (2007).Modelling Naturalistic Argumentation in Research Literatures: Representation and Interaction Design Issues. International Journal of Intelligent Systems, (Special Issue on Computational Models of Natural Argument, Eds: C. Reed and F. Grasso, 22, (1), pp.17-47. http:// 80 oro.open.ac.uk/6463
- 81. What are the habits of mind and skills that we need, to move from promising technologies, to sensemaking tools? 81
- 82. Human-Centred Computing for Sensemaking Services Interaction Interoperability Design Learning Domain Curve Discourse Mastery
- 83. Knowledge Art (Al Selvin) How can we add immediate value to team meeting with Design Rationale representations? Extract from a generic framework: Selvin, A., Buckingham Shum, S.J. & Aakhus, M. (2010). The Practice Level in Participatory Design Rationale: Studying Practitioner Moves and Choices. Human Technology: An Interdisciplinary Journal of Humans in ICT Environments (Special Issue on Creativity and Rationale, Ed. Jack Carroll), May 2010. 83 http://oro.open.ac.uk/20948
- 84. Knowledge Art (Al Selvin) How can we add immediate value to team meeting with Design Rationale representations? Extract from a generic framework: Selvin, A., Buckingham Shum, S.J. & Aakhus, M. (2010). The Practice Level in Participatory Design Rationale: Studying Practitioner Moves and Choices. Human Technology: An Interdisciplinary Journal of Humans in ICT Environments (Special Issue on Creativity and Rationale, Ed. Jack Carroll), May 2010. 84 http://oro.open.ac.uk/20948
- 85. Knowledge Art (Al Selvin) How can we add immediate value to team meeting with Design Rationale representations? Extract from a generic framework: Selvin, A., Buckingham Shum, S.J. & Aakhus, M. (2010). The Practice Level in Participatory Design Rationale: Studying Practitioner Moves and Choices. Human Technology: An Interdisciplinary Journal of Humans in ICT Environments (Special Issue on Creativity and Rationale, Ed. Jack Carroll), May 2010. 85 http://oro.open.ac.uk/20948
- 86. Learning to Learn: 7 Dimensions of “Learning Power” Factor analysis of the literature plus expert interviews: identified seven dimensions of effective “learning power”, since validated empirically with learners at many levels. (Deakin Crick, Broadfoot and Claxton, 2004) Being Stuck & Static Changing & Learning Data Accumulation Meaning Making Passivity Critical Curiosity Being Rule Bound Creativity Isolation & Dependence Learning Relationships Being Robotic Strategic Awareness Fragility & Dependence Resilience Professional development in schools, colleges and business: ViTaL: http://www.vitalhub.net/vp_research-elli.htm
- 87. Learning to Learn: 7 Dimensions of Learning Power Factor analysis of the literature plus expert interviews: identified seven dimensions of effective “learning power”, since validated empirically with learners at many levels. (Deakin Crick, Broadfoot and Claxton, 2004)
- 88. Learning to Learn: 7 Dimensions of Learning Power Factor analysis of the literature plus expert interviews: identified seven dimensions of effective “learning power”, since validated empirically with learners at many levels. (Deakin Crick, Broadfoot and Claxton, 2004)
- 89. ELLI profile showing pre/post stretch following mentoring and targetted intervention ELLI: Effective Lifelong Learning Inventory (Ruth Deakin Crick, U. Bristol) A web questionnaire generates a spider diagram summarising the learner’s self-perception: the basis for a mentored discussion and strategic priorities Changing and learning Critical Learning Curiosity relationships Meaning Making Strategic Awareness Creativity Resilience 89 ViTaL: http://www.vitalhub.net/vp_research-elli.htm
- 90. future trends 90
- 91. machine annotation of sensemaking within text (Ágnes Sándor, Xerox) 91
- 92. Sándor, Á., Vorndran, A. (2010). The detection of salient messages from social science research papers and its application in document search. Workshop Natural Language Processing in Social Sciences, May 10-14. Buenos Aires. Sándor, Á. (2007). Modeling metadiscourse conveying the author’s rhetorical strategy in biomedical research abstracts. Revue 92 Française de Linguistique Appliquée 200(2), pp. 97--109.
- 93. Sándor, Á., Vorndran, A. (2009). Detecting key sentences for automatic assistance in peer reviewing research articles in educational sciences. In Proceedings of the 2009 Workshop on Text and Citation Analysis for Scholarly Digital Libraries, ACL-IJCNLP 2009, Suntec, 93 Singapore, 7 August 2009 Singapore (2009), pp. 36--44. http://aye.comp.nus.edu.sg/nlpir4dl
- 94. adding software agents 94
- 95. 3rd International Conference on Computational Modelling of Argument Desenzano del Garda, Italy, 8-10 Sept. 2010 Paper, slides + blog: http://people.kmi.open.ac.uk/sbs Software Agents in Support of Human Argument Mapping Simon Buckingham Shum Maarten Sierhuis Knowledge Media Institute NASA Ames Research Center Open University Technical University of Delft Carnegie Mellon University SV Jack Park Matthew Brown Knowledge Media Institute Carnegie Mellon University SV Open University University of Utah http://creativecommons.org/licenses/by-nc/2.0/uk 95
- 96. Calling a Brahms agent to search remote maps Query 96
- 97. Returned Results 97
- 98. Dialogue Map with Query Results added 98
- 99. Human-readable Compendium map of an IBIS agent conversation 99
- 100. adding more formal logics to evaluate arguments see International Conferences on Computational Modelling of Argument: www.comma-conf.org 100
- 101. Articles, books, news, movies, software, user/developer community… http://projects.kmi.open.ac.uk/hyperdiscourse Compendium Institute 101