SlideShare a Scribd company logo
Does it matter how much open?
Impact in learning and degrees of
openness
Werner Westermann J.
13th
Open Education Conference
Richmond, Virginia 2016
Does it matter how much open? Impact in learning and degrees of openness
Does it matter how much open? Impact in learning and degrees of openness
Does it matter how much open? Impact in learning and degrees of openness
Rationale
• OER Adoption looking to assess its
Effectiveness
– Student 1st year Outcomes (performance)
– Very low retention (46%)
– Lack of basic knowledge and academic skills
• No prerequisite to enroll
• Very low socio-demographic profile
• Mixed methodology approach
– Quantitative
– Qualitative
• Focus groups with Students / Interview with teachers
• Survey to students
Treatment
• Comparison of groups:
– randomly assign students to the groups
– same teacher for all groups in each scenario
– alternatives to assure comparison
• Propensity Score Matching: estimation of the
probability of receiving an specific treatment
– mechanism of comparison
• Inverse Probability Weight: matching algorithm
compare results of most similar individuals
Does it matter how much open? Impact in learning and degrees of openness
OER Selection
• Khan Academy
– Extensive in resources and content
– “Mentor” creates a “Course” selecting and
sequencing resources to enrolled students
(Remix)
• Open Textbook
– Created by the teacher’s notes/resources
– Hosted in Wikiboks
– Printed copy from day 1
Does it matter how much open? Impact in learning and degrees of openness
Conclusions
• students of the face to face classes that
used a semi-open OER obtain significantly
better exam grades than students:
– that did not use any extra resource
– that used an open textbook as an extra
resource
• face-to-face students that used semi open
OER have significantly less attendance
levels than other examined students
Does it matter how open?
• Policy: as much open as possible
• Pedagogy: what better suites
learner/teacher
– Where’s the crossover?
OER
Type of Open License Level of Openness
Khan Academy Creative Commons Attribution-
NonCommercial-ShareAlike 3.0
United States License (CC BY-NC-
SA)
Less open, “Quasi open”
(1)
Open Textbook Creative Commons Attribution 4.0
International (CC BY)
Most Open, “True open”
(3)
Does it matter how open?
Does it matter how open?
• Kimmons, R. (2015), OER Quality and
Adaptation in K-12: Comparing Teacher
Evaluations of Copyright-Restricted,
Open, and Open/Adapted Textbooks
– open textbooks were of higher quality than
copyright-restricted textbooks
– open/adapted textbooks were evaluated as
having the highest quality
Larry Cuban
Hegarty, B. (2015), Attributes of Open
Pedagogy: A model for using OER
Project-based Learning
Design-based Learning
LOM Learning Design
Paulo Freire (1921-1997)
• Critical Pedagogy
– Pedagogy of the Oppressed
– Pedagogy for Liberation

More Related Content

PPTX
Teachers’ Perception of Open Educational Resources: Data Collection through W...
PDF
Teachers’ Perception of Open Educational Resources: Data Collection through W...
PDF
Teachers’ Perception of Open Educational Resources: Data Collection through W...
PPT
Evaluation of online learning
PPTX
Measure for Measure: Using collaborative assessment to build stronger informa...
PPTX
Library Strategies: For sustainable open education adoption and publishing
PPTX
Higher Education Faculty Perceptions of Quality of Open Educational Resources...
PPTX
2016-2017 Mentorship Program details
Teachers’ Perception of Open Educational Resources: Data Collection through W...
Teachers’ Perception of Open Educational Resources: Data Collection through W...
Teachers’ Perception of Open Educational Resources: Data Collection through W...
Evaluation of online learning
Measure for Measure: Using collaborative assessment to build stronger informa...
Library Strategies: For sustainable open education adoption and publishing
Higher Education Faculty Perceptions of Quality of Open Educational Resources...
2016-2017 Mentorship Program details

What's hot (20)

PDF
ABLE - Inside Government Nov 2017 - Rebecca Edwards
PPTX
Digital Learning Resources Network: Potential for B.C. Post-Secondary Institu...
PPTX
Making MOOCs and changing open educational practices
PPTX
Are we there yet? Peter Hickey
PPTX
Moocs: what the research tells us
PPTX
Effectiveness of OER use in students’ mathematical outcomes: A case study in ...
PPTX
Conceptualising Open Educational Practices in teacher education in East Africa
PPTX
Ccsse & millennials
PPTX
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...
PPTX
Open educational resources
PPT
Teaching The Teachers
PDF
Poster: Using Large-Scale LMS Data Portal Data to Improve Teaching and Learn...
PPT
Differentiation in Access to, and the Use and Sharing of (Open) Educational R...
PDF
A Study on Cost-Efficiency and Quality of OER Integrated Course Materials
PPTX
Alternative assessments
PPT
4 nur642designingcentury learningenvironments pp4
PPTX
The Teaching Excellence Framework: an opportunity for libraries to make an im...
PDF
ABLE - the NTU Student Dashboard - University of Derby
PPTX
ESL learner independence using 21st Century skills_ESL Pedagogy Research Proj...
PPTX
Future Online Learning Environment Project Update February 2015
ABLE - Inside Government Nov 2017 - Rebecca Edwards
Digital Learning Resources Network: Potential for B.C. Post-Secondary Institu...
Making MOOCs and changing open educational practices
Are we there yet? Peter Hickey
Moocs: what the research tells us
Effectiveness of OER use in students’ mathematical outcomes: A case study in ...
Conceptualising Open Educational Practices in teacher education in East Africa
Ccsse & millennials
Blackboard Analytics for Learn @JCU – a proactive approach to the use of data...
Open educational resources
Teaching The Teachers
Poster: Using Large-Scale LMS Data Portal Data to Improve Teaching and Learn...
Differentiation in Access to, and the Use and Sharing of (Open) Educational R...
A Study on Cost-Efficiency and Quality of OER Integrated Course Materials
Alternative assessments
4 nur642designingcentury learningenvironments pp4
The Teaching Excellence Framework: an opportunity for libraries to make an im...
ABLE - the NTU Student Dashboard - University of Derby
ESL learner independence using 21st Century skills_ESL Pedagogy Research Proj...
Future Online Learning Environment Project Update February 2015
Ad

Viewers also liked (20)

PPTX
UCT, Fort Hare or UNISA: Which university is OER ready?
PPTX
Reflections on developing an evaluation and communications strategy for the ...
PPTX
Dimensions of open research: critical reflections on openness in the ROER4D p...
PPTX
Open educational practices and resources in the Global South: Recommendations...
PPTX
OER and OEP towards Equitable and Quality Education for All
PDF
Development of the Open Educational Practices Impact Evaluation Index
PDF
OER-INTEGRATED TEACHING AND LEARNING IN A POST-WAR NORTHERN SRI LANKA
PPTX
The adoption and impact of OEP and OER in the Global South: Theoretical, conc...
PPTX
Understanding lecturers’ adoption of OER: a multi-factorial approach
PPTX
Exploring the cultural-historical factors influencing OER adoption in Mongoli...
PPTX
Making MOOCs and changing open educational practices
PPTX
Open Educational Resources: Development and Challenges for India
PPTX
Researching OER in the Open: developments and deliberations in the ROER4D pro...
PPTX
ROER4D - Short overview for Open Education Week 13 March 2015
PPTX
‘Open, ready and agile’: Developing a communications strategy for the Researc...
PPTX
ROER4D Update March 2016 - Presentation to the Hewlett Foundation
PPTX
Evaluation: a means to gain insights into and improve the ROER4D project
PPTX
ROER4D presentation to DFID
PPTX
Promising aspects of online education in Africa: OER, Open Textbooks & MOOCs
PDF
Researching OER in the open: Developments in the ROER4D project
UCT, Fort Hare or UNISA: Which university is OER ready?
Reflections on developing an evaluation and communications strategy for the ...
Dimensions of open research: critical reflections on openness in the ROER4D p...
Open educational practices and resources in the Global South: Recommendations...
OER and OEP towards Equitable and Quality Education for All
Development of the Open Educational Practices Impact Evaluation Index
OER-INTEGRATED TEACHING AND LEARNING IN A POST-WAR NORTHERN SRI LANKA
The adoption and impact of OEP and OER in the Global South: Theoretical, conc...
Understanding lecturers’ adoption of OER: a multi-factorial approach
Exploring the cultural-historical factors influencing OER adoption in Mongoli...
Making MOOCs and changing open educational practices
Open Educational Resources: Development and Challenges for India
Researching OER in the Open: developments and deliberations in the ROER4D pro...
ROER4D - Short overview for Open Education Week 13 March 2015
‘Open, ready and agile’: Developing a communications strategy for the Researc...
ROER4D Update March 2016 - Presentation to the Hewlett Foundation
Evaluation: a means to gain insights into and improve the ROER4D project
ROER4D presentation to DFID
Promising aspects of online education in Africa: OER, Open Textbooks & MOOCs
Researching OER in the open: Developments in the ROER4D project
Ad

Similar to Does it matter how much open? Impact in learning and degrees of openness (20)

PPTX
Opening Up an Open University
PPTX
Constellation of Open (Lahore)
PPTX
ExplOERing the Possibilities of Open Educational Resources
PDF
OER Evidence Report 2013-2014
PPTX
It's Not Just About the Money: Open Educational Resources and Practices
PPTX
Beyond OER: Robin DeRosa's Presentations for #RDRinYVR
PPTX
Open Education Research : Overview, Benefits and Challenges
PPTX
CCCOER Presents: OER Impact Research
PPTX
2014 oct7 cemca-hyd-session-1-introduction to OERs
PPTX
High Impact OER Adoption
PPTX
Open Educational Resources
PDF
The Future of Textbooks is OPEN (and the future has arrived)
PPTX
Let's Make a Plan: An OER Initiative for Your Institution
PDF
OER: Disruptive Innovative Solution to the Challenges of Education
PPTX
Reflecting on the Diverse Innovations and Impacts prompted by an OER project
PPTX
Identifying categories of OER users
PDF
OER Research Brief
PPT
Designing OER with Diversity in Mind
PPTX
Introduction to Open Educational Resources 2012
PPTX
OER Research Hub: Understanding the impact of open educational resources
Opening Up an Open University
Constellation of Open (Lahore)
ExplOERing the Possibilities of Open Educational Resources
OER Evidence Report 2013-2014
It's Not Just About the Money: Open Educational Resources and Practices
Beyond OER: Robin DeRosa's Presentations for #RDRinYVR
Open Education Research : Overview, Benefits and Challenges
CCCOER Presents: OER Impact Research
2014 oct7 cemca-hyd-session-1-introduction to OERs
High Impact OER Adoption
Open Educational Resources
The Future of Textbooks is OPEN (and the future has arrived)
Let's Make a Plan: An OER Initiative for Your Institution
OER: Disruptive Innovative Solution to the Challenges of Education
Reflecting on the Diverse Innovations and Impacts prompted by an OER project
Identifying categories of OER users
OER Research Brief
Designing OER with Diversity in Mind
Introduction to Open Educational Resources 2012
OER Research Hub: Understanding the impact of open educational resources

More from ROER4D (18)

PDF
Open education and social justice in the global south opportunities seized, m...
PPTX
A proposed social justice and intersectionality model for open education
PPTX
Open education and social justice in the global south opportunities seized, m...
PPTX
Open research ambitions, successes and recommendations: The ROER4D story
PPTX
Challenges of online learning for campus based universities open educational...
PPTX
Sweden south africa research
PPTX
OER 18 -
PPTX
OE Global presentation -
PPTX
The role of OER and OEP in promoting social inclusion in the Global South
PPTX
Open research and open education: Examples from the ROER4D project
PPTX
Factors enabling and constraining OER adoption and Open Education Practices: ...
PPTX
National, Provincial and Institutional Policy Influence on the Adoption of OE...
PPTX
Degrees of social inclusion: Emerging insights from the ROER4D project
PPTX
Degrees of social inclusion: Perspectives from the ROER4D project
PPTX
Developing a communications strategy for ROER4D - insights for the South Afri...
PPTX
The influence of institutional culture on lecturers’ agency in relation to OE...
PPTX
Understanding the nature of OEP for OER adoption in Global South contexts: Em...
PDF
The Potential Contribution of Open Educational Resources to e-Learning and Di...
Open education and social justice in the global south opportunities seized, m...
A proposed social justice and intersectionality model for open education
Open education and social justice in the global south opportunities seized, m...
Open research ambitions, successes and recommendations: The ROER4D story
Challenges of online learning for campus based universities open educational...
Sweden south africa research
OER 18 -
OE Global presentation -
The role of OER and OEP in promoting social inclusion in the Global South
Open research and open education: Examples from the ROER4D project
Factors enabling and constraining OER adoption and Open Education Practices: ...
National, Provincial and Institutional Policy Influence on the Adoption of OE...
Degrees of social inclusion: Emerging insights from the ROER4D project
Degrees of social inclusion: Perspectives from the ROER4D project
Developing a communications strategy for ROER4D - insights for the South Afri...
The influence of institutional culture on lecturers’ agency in relation to OE...
Understanding the nature of OEP for OER adoption in Global South contexts: Em...
The Potential Contribution of Open Educational Resources to e-Learning and Di...

Recently uploaded (20)

PDF
Yogi Goddess Pres Conference Studio Updates
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PPTX
Cell Structure & Organelles in detailed.
PDF
A systematic review of self-coping strategies used by university students to ...
PDF
RMMM.pdf make it easy to upload and study
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Yogi Goddess Pres Conference Studio Updates
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
Final Presentation General Medicine 03-08-2024.pptx
Microbial disease of the cardiovascular and lymphatic systems
Weekly quiz Compilation Jan -July 25.pdf
Supply Chain Operations Speaking Notes -ICLT Program
Cell Structure & Organelles in detailed.
A systematic review of self-coping strategies used by university students to ...
RMMM.pdf make it easy to upload and study
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Microbial diseases, their pathogenesis and prophylaxis
Final Presentation General Medicine 03-08-2024.pptx
Chinmaya Tiranga quiz Grand Finale.pdf
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
FourierSeries-QuestionsWithAnswers(Part-A).pdf
VCE English Exam - Section C Student Revision Booklet
Module 4: Burden of Disease Tutorial Slides S2 2025
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape

Does it matter how much open? Impact in learning and degrees of openness

  • 1. Does it matter how much open? Impact in learning and degrees of openness Werner Westermann J. 13th Open Education Conference Richmond, Virginia 2016
  • 5. Rationale • OER Adoption looking to assess its Effectiveness – Student 1st year Outcomes (performance) – Very low retention (46%) – Lack of basic knowledge and academic skills • No prerequisite to enroll • Very low socio-demographic profile • Mixed methodology approach – Quantitative – Qualitative • Focus groups with Students / Interview with teachers • Survey to students
  • 6. Treatment • Comparison of groups: – randomly assign students to the groups – same teacher for all groups in each scenario – alternatives to assure comparison • Propensity Score Matching: estimation of the probability of receiving an specific treatment – mechanism of comparison • Inverse Probability Weight: matching algorithm compare results of most similar individuals
  • 8. OER Selection • Khan Academy – Extensive in resources and content – “Mentor” creates a “Course” selecting and sequencing resources to enrolled students (Remix) • Open Textbook – Created by the teacher’s notes/resources – Hosted in Wikiboks – Printed copy from day 1
  • 10. Conclusions • students of the face to face classes that used a semi-open OER obtain significantly better exam grades than students: – that did not use any extra resource – that used an open textbook as an extra resource • face-to-face students that used semi open OER have significantly less attendance levels than other examined students
  • 11. Does it matter how open? • Policy: as much open as possible • Pedagogy: what better suites learner/teacher – Where’s the crossover? OER Type of Open License Level of Openness Khan Academy Creative Commons Attribution- NonCommercial-ShareAlike 3.0 United States License (CC BY-NC- SA) Less open, “Quasi open” (1) Open Textbook Creative Commons Attribution 4.0 International (CC BY) Most Open, “True open” (3)
  • 12. Does it matter how open?
  • 13. Does it matter how open? • Kimmons, R. (2015), OER Quality and Adaptation in K-12: Comparing Teacher Evaluations of Copyright-Restricted, Open, and Open/Adapted Textbooks – open textbooks were of higher quality than copyright-restricted textbooks – open/adapted textbooks were evaluated as having the highest quality
  • 15. Hegarty, B. (2015), Attributes of Open Pedagogy: A model for using OER
  • 19. Paulo Freire (1921-1997) • Critical Pedagogy – Pedagogy of the Oppressed – Pedagogy for Liberation