Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence
3 likes1,517 views
The document discusses the challenges and barriers to the adoption of Open Educational Resources (OER) due to a lack of evidence proving their effectiveness. It introduces the Olnet project's Evidence Hub, which aims to facilitate collaborative research and knowledge sharing within the OER community to enhance decision-making for policymakers. The Evidence Hub serves as a space to interrogate the open education movement, address key challenges, and improve educational outcomes through the use of unobstructed licenses.
![Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence Anna De Liddo & Rob Farrow Knowledge Media Institute/Institute of Educational Technology The Open University, UK [email_address] / [email_address] OER OpenOpen Event Open University, Wednesday 7 Dec olnet.org](https://image.slidesharecdn.com/deliddofarrow-openopen-dec7-111207112313-phpapp01/85/Building-and-Communicating-Evidence-of-Effectiveness-in-OER-through-Collective-Intelligence-1-320.jpg)
Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence
- 1. Building and Communicating Evidence of Effectiveness in OER through Collective Intelligence Anna De Liddo & Rob Farrow Knowledge Media Institute/Institute of Educational Technology The Open University, UK [email_address] / [email_address] OER OpenOpen Event Open University, Wednesday 7 Dec olnet.org
- 2. Despite the widespread diffusion of the Open Education movement, the level of adoption of OERs into common Educational Policy and Teaching Practices remains quite low. Why is this the case? olnet.org
- 3. The issue: lack of evidence of OER effectiveness We propose that one of the barriers to OER adoption is the lack of evidence of OER effectiveness . olnet.org
- 4. OLnet project: The wider research question olnet.org RQ: How can we help researchers and practitioners in the OER field to contribute to the evidences of OER effectiveness and to i nvestigate these evidences collaboratively?
- 5. Approach: Contested Collective Intelligence olnet.org Collective Intelligence : Need to build on collective insights and experiences, but adding a layer to structure and index that knowledge sharing so that it is not locked in minds or documents and it can be put in value Discourse : Sensemaking, and learning, occur through discourse: the sharing and critiquing of ideas in ways that both affirm and challenge Our approach to CI focuses on: capturing the hidden knowledge of the OER movement and leveraging it so that can be: debated ( building and confronting arguments) , evaluated (assessing evidence ), and put in value (distill claims used to inform practice and policy)
- 6. The Evidence Hub olnet.org What: The Evidence Hub provides the OER community with a space to harvest the evidence of OER effectiveness policy makers with a community-generated knowledge base to make evidence based decision on Educational Policy. How: The Evidence Hub provides an environment to systematically interrogate the Open Education movement on what are the Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources
- 7. The Evidence Hub olnet.org What: The Evidence Hub provides the OER community with a space to harvest the evidence of OER effectiveness policy makers with a community-generated knowledge base to make evidence based decision on Educational Policy. How: The Evidence Hub provides an environment to systematically interrogate the Open Education movement on what are the Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources OER Themes Themes are used to group elements across the different ecosystems
- 8. The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
- 9. The Discourse Ecosystem Elements: A Simplified Data Model olnet.org
- 10. A Simplified Data Model olnet.org
- 11. A Simplified Data Model olnet.org
- 12. A Simplified Data Model olnet.org
- 13. A Simplified Data Model olnet.org
- 14. A Simplified Data Model olnet.org
- 15. Evidence Types: From simple data, anecdotes and stories to literature Analysis and Experimental Results olnet.org
- 16. Social Ecosystems (Org and Projects) olnet.org
- 17. Social Ecosystems (Org and Projects) olnet.org
- 18. Social Ecosystems (Org and Projects) olnet.org
- 19. Social Ecosystems (Org and Projects) olnet.org
- 20. Social Ecosystems (Org and Projects) olnet.org
- 21. Social Ecosystems (Org and Projects) olnet.org
- 22. CI: Community Actions Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources Locating: Adding geo-location info
- 23. CI: Community Actions Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources Locating: Adding geo-location info Following: Expressing Interest
- 24. CI: Community Actions Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources Connecting: Adding to Widget Locating: Adding geo-location info Following: Expressing Interest
- 25. CI: Community Actions Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
- 26. CI: Community Actions Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources Theming: Adding OER Themes Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
- 27. CI: Community Actions Social Ecosystem People (Contributors) Projects Organizations Discourse Ecosystem Key challenges Issues, Solutions, Claims Evidence Resources Theming: Adding OER Themes Connecting: Adding to Widget Locating: Adding geo-location info Following: Promoting: Ordering-Prioritizing lists Voting Connections Expressing Interest
- 28. A Demo of the Evidence Hub…. olnet.org
- 30. Exploring the OER landscape through projects/organizations and their physical locations…
- 32. Navigating by theme… Creating new connections… Tagging…
- 36. Challenges & Solutions Using CI to both identify ‘challenges’ and find ‘solutions’ Capturing and visualizing relationships between disparate elements of OER world Providing a mechanic to assess the importance of problems and the viability of solutions Building up a picture of priorities, successes and failures
- 40. Key Challenges
- 41. Research, Evidence and Claims What makes a challenge important, or a solution meaningful? We need to find evidence for the different kinds of claims being made Evidence can be subjected to the same CI process, providing the OER movement with a basis for the claims it wants to make
- 45. • Unobstructed licenses expand student access to high-quality, up-to-date, engaging, and customized content more quickly, cost-effectively, and efficiently than today. • Unobstructed licenses unlock educational resources that are developed using taxpayer dollars so they can be shared, customized, and improved, yielding a far greater return on investment to the public. • Open educational resources with unobstructed licenses are the path forward to ensure every student has access to high-quality, engaging, personalized, and up-to-date content. • Ultimately, open educational resources with unobstructed licenses can help transform our schools by producing better equipped teachers, better prepared students, and better education outcomes Advocacy
- 46. www.ci.olnet.org / http://www.youtube.com/watch?v=Oo3xPyoiwYg
- 47. Future Research: Explore, Filter and Makesense When social and discourse elements become too many in number and complexity how can we make sense of them? Toward CI visualization and analysis… olnet.org
- 48. Watch the demo video at: http://www.youtube.com/watch?v=Fcn2ab9PYo4 Watch the Open Deliberation model video at: http://www.youtube.com/watch?v=vthygbKA2Mg Discourse Network Visualization
- 50. De Liddo, A., Sándor, Á .,Buckingham Shum, S., Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine Annotation Study, CSCW Journal (In Press) De Liddo, Anna and Buckingham Shum, Simon (2010). Capturing and representing deliberation in participatory planning practices. In: Fourth International Conference on Online Deliberation (OD2010), 30 Jun - 2 Jul 2010, Leeds, UK. Retrieved from http://oro.open.ac.uk/22279/ Buckingham Shum, Simon and De Liddo, Anna (2010). Collective intelligence for OER sustainability. In: OpenED2010: Seventh Annual Open Education Conference, 2-4 Nov 2010, Barcelona, Spain. Available at: http://oro.open.ac.uk/23352/ De Liddo, Anna (2010). From open content to open thinking. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (Ed-Media 2010), 29 Jun, Toronto, Canada. Available at: http://oro.open.ac.uk/22283/ De Liddo, Anna and Alevizou, Panagiota (2010). A method and tool to support the analysis and enhance the understanding of peer-to-peer learning experiences. In: OpenED2010: Seventh Annual Open Education Conference, 2-4 Nov 2010, Barcelona, Spain. Available at: http://oro.open.ac.uk/23392/ Thanks for Your Attention! Anna De Liddo References
Editor's Notes
- #30: Show evidence hub and information from flowers
- #31: Highlights of the organisation node page designed to show how the different data types fit together
- #33: This slide attempts to give a simple explanation of the data model used and to get from the idea of mapping organisations to the idea of mapping more ephemeral data and views on OER
- #34: Now looking at an individual theme... I would note the related organisations & possibility of following a theme. Themes provide the ‘glue’ for sticking together different kinds of data. I’ve added a link to the live page at the bottom so that you can just explore straight from here. Lots of the entries relating to copyright also relate to access. I suggest that you find a pathway to the access theme page and then cut back to use the next slide.
- #35: Again, a link to live site provided for convenience. At this point I would talk about how the themes provide ways of identifying challenges & associating them with possible solutions... So, moving on to the more practical aspects of the site.
- #36: Complex thematic map shows how these simple connections can capture the complexity of the OER world
- #37: Overview of the purpose of challenge and solution categories within EH
- #38: Example of challenge. Note url link to original identification of challenge. Two potential solutions have been proposed. These can be explored through the tinyurl link.
- #39: Example of solution. Formally proposed a link to an existing challenge (copyright) by proposing the use of an open web tool. Again, can be explored through tinyurl.
- #42: So far, we haven’t really spoken about evidence. But that’s got to be the main thrust of this.
- #43: NB Claims Garden entry. Example of a claim with links to nine pieces of evidence that have been cited in support of the claim. Note similar number of pieces of counter-evidence. It’s up to the OER community to decide for themselves. This is an illustration of the ‘storyteller’ or anecdotal evidence that is distilled within the hub.
- #44: Here is an evidence node. In this case, it’s a very recent JISC report which could be considered cutting edge research at the other end of the spectrum from anecdotal evidence. It shows the way that the EH can distill the different claims made in different discourses and bring them together in a way that doesn’t happen anywhere else. Tinyurl if you want to explore the ‘related claims’ which are supported by this piece of evidence. It might be worth pointing out at this stage that we’re just dealing with the metadata and not hosting (or deciding upon) the evidence ourselves.
- #45: Another example of an evidence node. This was a major UNESCO OER policy forum which produced a number of practical solutions... (leads into discussion of advocacy)
- #47: Show evidence hub and url, YouTube video guide