SlideShare a Scribd company logo
Session 2 - Learning, Design and Technology in Schools, Skills 
Training and Higher Education 
Developmental evaluation and the experience API 
Professor Robert Fitzgerald 
www.assess2learn.com.au 
www.assess2learn.com.au
Learning, design and technology: Developmental 
evaluation and the experience API 
Professor Robert Fitzgerald 
Faculty of Education, Science, Education and Technology, University of Canberra 
Rethinking Assessment and Learning, GLOBAL MINDSET, Australian Technology Park, 
Sydney, 29 October, 2014
INNOVATION RESEARCH EDUCATION
Learning, design and technology developmental evaluation and the experience api
Learning, design and technology developmental evaluation and the experience api
INSPIRE: Research, Education & Innovation 
http://www.ideo.com http://www.tpck.org 
• Design Thinking & STEM education 
• Next practice learning & design 
• Mastery pedagogies 
• Augmented reality 
• Location based education services 
• ICT4D – Pakistan & Cambodia 
• Google Glass & Wearables 
• National mentoring for Maths & 
Science teachers 
• The Experience API
Educational challenges 
• The “new normal” of increasing demand, diminishing resources, 
increased expectations and constant change 
• Widespread consensus that graduates are not well prepared for the 
world of work and subsequent lifelong learning (AAEG, 2011; Candy, 
1991; Candy, Crebert & O’Leary, 1994; Oliver, 2011; Shah & Nair, 
2011) 
• John Seely Brown argues we need to radically shift the focus of 
education from the development of skills & knowledge, to the 
cultivation of mindsets and dispositions (Thomas & Brown, 2011)
Source: OECD Education
Technology futures 
• Emerging forms of interactive media and information communication 
technology are reshaping almost every aspect of our work and 
social life; Boundaries are blurring 
• New practices and literacies are emerging from digital 
communications and culture that challenge our traditional ideas 
about the form and function of communication, learning and 
education 
• Technology is more than just a ‘tool’ but an evocative ‘object to think 
with’ and an engine of social and cultural change; Change is 
ecological not additive 
• Design thinking: New opportunities for participation and interaction 
arise from communities of interest where users are active designers 
& content creators re-mixing, re-purposing and re-distributing 
content
A lesson: ICT benefits depend on “capital” 
Capital = skills, interests, attitudes, resources 
s 
c 
I 
e 
n 
c 
e 
The capital gap 
Source: www.oecd.org
The barriers to transformation are not "conceptual, technical, or 
economic. The primary barriers are psychological, political, and 
cultural. We now have all the means necessary to implement effective 
educational models that can prepare all students for a future very 
different from the immediate past. Whether we have the professional 
commitment and the societal will to actualize such a vision remains to 
be seen.” 
Dede et al (2013) Educause Review
Feedback - Learning, change & evaluation 
• We know that feedback is the most effective way of improving 
student learning (Hattie, 2009) 
• Forms of Evaluation - Formative, Summative & Developmental 
(Patton, 2011) 
• Summative and formative evaluation are most often used to 
examine established programs 
• Developmental Evaluation (DE) is well-suited to emergent or 
developing systems 
• DE is a design-based research tool for understanding innovation 
and change in educational systems 
• Salient features 
– engage in simulations and/or rapid reconnaissance 
– deploy tools that develop maps of the territory; and 
– allow for revised and emergent modelling (Patton, 2011)
Technology Assisted Developmental 
Evaluation 
• ‘What? So What? Now What? (Gamble, 2008, p. 47) 
• Learning & change should be expansive and transferable and not 
limited to contemporaneous testing (Engeström, 2006; Wiggins & 
McTighe, 2011, p. 5) 
• The theoretical perspectives draws on Vygotsky (1978), Activity 
Theory (Engestrom, 2001), Variation Theory (Marton & Tsui, 2004) 
and the concept of Communities of Practice (Lave & Wenger, 1991) 
• Towards a Technology Assisted Developmental Evaluation (TADE) 
framework that helps teachers and institutions with their data work in 
ways that support educational decision making in a practical and 
accessible form (Leonard, Fitzgerald & Bacon [under review]) 
• “A system is not the sum of its parts, but rather, the product of the 
interaction of the parts” (Russell Ackoff)
Bernhardt, V. (2004). Data analysis for continuous school improvement (2nd ed.). Larchmont, NY: Eye on Education.
Learning everywhere 
Source: tincanapi.com/overview
INSPIREx: A data-driven educational environment 
based on Experience API 
Source: www.brightcookie.com
INSPIREx learning ecology 
Source: www.brightcookie.com
Personalised learning & The Quantified Self 
Source: economist.com
Source: www.cnet.com/news/lumosity-vs-elevate-brain-training-apps
Data for the learner 
• Quantified Self goes to school 
– self-knowledge through self-tracking 
– designing self-experiments 
• What does an increasing personalisation of education and learning 
mean for learners, teachers, institutions? 
• Implications for research – develop repeated measures and single 
subject designs 
• What changes are required when we shift from data about the 
learner to data for the learner? 
• How do we develop hindsight, oversight, foresight, insight in these 
new data rich environments? 
• What happens when learners tell ‘us’ when they are ready for 
learning?
Rob Fitzgerald 
robert.fitzgerald@canberra.edu.au 
Twitter: @rfitzgerald 
INSPIRE 
Website: inspire.edu.au 
Facebook: www.facebook.com/inspiredu2 
Twitter: @inspiredu2

More Related Content

PPTX
Digital learning futures: Communication and collaboration
PPTX
Educ9701 s2 2014 week 1 readings
PPT
Technology Use vs Technology Integration
PPSX
Pedagogical patterns for learning programming by mistakes (presentation) (1)
PPT
Pedagogical Design Tools: Planning for Learning with Purpose
PPT
Disussion of ibarrola
PPTX
SCALE-UP 'new ways of learning'
PPTX
Interactive Technology in Collaborative Classroom learning: Practice, Tools ...
Digital learning futures: Communication and collaboration
Educ9701 s2 2014 week 1 readings
Technology Use vs Technology Integration
Pedagogical patterns for learning programming by mistakes (presentation) (1)
Pedagogical Design Tools: Planning for Learning with Purpose
Disussion of ibarrola
SCALE-UP 'new ways of learning'
Interactive Technology in Collaborative Classroom learning: Practice, Tools ...

What's hot (20)

PPTX
Innovative Pedagogies - The role of digital technology
PPT
Digital Democracy
PPTX
What shapes what? Technologies and their relationship to learning
PPSX
Educ9701 week 1 readings
PPT
PPTX
PPTX
Comaparing-the-similarities-&-definition-of-educational-technology
PPTX
Sotel 2018 presentation - Web Design
PPTX
Technology determinism
PPT
Designing learning
PPT
“APPLYING THE MULTIMEDIA LEARNING THEORY IN THE PRIMARY SCHOOL"
PPTX
Developing Computational Thinking Practises through Digital Fabrication Activ...
PPT
PPTX
Current trends and emphasis
PPTX
My Portfolio in Educational Technology
PPTX
PREDICTING FUTURE OF EDTECH 2030 v2
PDF
Computing curriculum design workshop
ODP
Integration
PPTX
Incorporating Technology into Teaching
PDF
System Design for Sustainability for All. S.PSS Design applied to distributed...
Innovative Pedagogies - The role of digital technology
Digital Democracy
What shapes what? Technologies and their relationship to learning
Educ9701 week 1 readings
Comaparing-the-similarities-&-definition-of-educational-technology
Sotel 2018 presentation - Web Design
Technology determinism
Designing learning
“APPLYING THE MULTIMEDIA LEARNING THEORY IN THE PRIMARY SCHOOL"
Developing Computational Thinking Practises through Digital Fabrication Activ...
Current trends and emphasis
My Portfolio in Educational Technology
PREDICTING FUTURE OF EDTECH 2030 v2
Computing curriculum design workshop
Integration
Incorporating Technology into Teaching
System Design for Sustainability for All. S.PSS Design applied to distributed...
Ad

Viewers also liked (20)

PPT
Pubblicare Open Access
PPT
03inhaledexhaledair
PPT
A Blog’S Not Just For Christmas!
PPT
Welcome to Technology
PPT
PPT
Learntheory Engl
PPT
Ucan Do Iwb’s 2
PPT
Ending Open Access and Other Ideas to Transform High Seas Fisheries
PPT
Driver Flash para o ISFramework
PPT
elearning3
PPT
Bill Gates Life Is Not Fair - Get Used To
PDF
50 way to be a better photographer
PPTX
Building Website with SEO in Mind
PPTX
Using Visual Methods and Social Network Analysis to Explore Relationships in ...
PPTX
India health-systems
PPS
Hãy mỉm cười
PPT
PLAYA, Manuel Altolaguirre
PPT
Edukas Projekt
PPT
eFormular - küsimustiku loomine
PPT
Macedonia Icamp Short
Pubblicare Open Access
03inhaledexhaledair
A Blog’S Not Just For Christmas!
Welcome to Technology
Learntheory Engl
Ucan Do Iwb’s 2
Ending Open Access and Other Ideas to Transform High Seas Fisheries
Driver Flash para o ISFramework
elearning3
Bill Gates Life Is Not Fair - Get Used To
50 way to be a better photographer
Building Website with SEO in Mind
Using Visual Methods and Social Network Analysis to Explore Relationships in ...
India health-systems
Hãy mỉm cười
PLAYA, Manuel Altolaguirre
Edukas Projekt
eFormular - küsimustiku loomine
Macedonia Icamp Short
Ad

Similar to Learning, design and technology developmental evaluation and the experience api (20)

PPTX
Learner engagement
PPTX
Assessment, ePortfolios and Blackboard - Leslie McInnes, Educational Designer...
PDF
JTC May 2013 - Flexible Pathways Session
PPT
Keynote Speech, Vijay Kumar: Learning OUTed -- Open Ubiquitous Transformational
PPTX
EdTech Evidence Slideshare.pptx
PPT
Vijay Kumar Presentation - Sakai 09
PPTX
Don Knezek Global Education conference Keynote
PPTX
Learning Design and Technology
PPT
Hub DE summit Sydney
PPT
From institutional Policy to individual practice: Using Learning technologies...
PPTX
Mseit advisory mtgoctober2013
PPTX
PE_eLearning Presentation 2009
PPTX
Edutec 2013 Costa Rica
PPTX
Engineering Education 2012 Conference Coventry
PPTX
Digital literacy by Dr Qaisar Abbas
PPTX
Digifest 2017 - Learning Analytics & Learning Design
PPTX
Towards a shared understanding of emerging technologies: experiences in a col...
PPT
E assessment Josie Taylor
PPTX
Rae t4 d-knowledge-economy-sa-urs-dec2017
PPT
Horizon Report overview, spring 2009
Learner engagement
Assessment, ePortfolios and Blackboard - Leslie McInnes, Educational Designer...
JTC May 2013 - Flexible Pathways Session
Keynote Speech, Vijay Kumar: Learning OUTed -- Open Ubiquitous Transformational
EdTech Evidence Slideshare.pptx
Vijay Kumar Presentation - Sakai 09
Don Knezek Global Education conference Keynote
Learning Design and Technology
Hub DE summit Sydney
From institutional Policy to individual practice: Using Learning technologies...
Mseit advisory mtgoctober2013
PE_eLearning Presentation 2009
Edutec 2013 Costa Rica
Engineering Education 2012 Conference Coventry
Digital literacy by Dr Qaisar Abbas
Digifest 2017 - Learning Analytics & Learning Design
Towards a shared understanding of emerging technologies: experiences in a col...
E assessment Josie Taylor
Rae t4 d-knowledge-economy-sa-urs-dec2017
Horizon Report overview, spring 2009

More from Charles Darwin University (20)

PPTX
ESTeM Teaching & Learning Innovation Showcase
PPTX
Learning in the cloud, feet in the village
PPTX
ASLP2 Social Research ICT Workplan 2013
KEY
INSPIRE: A new learning centre, a new learning environment
PDF
James Dalziel - Using Learning Design for Innovative eTeaching
PPT
PPT
networklearning
PPT
Learning with Technology - week 2 lecture-social media
PPT
CCPMP SMS Information System – towards a hubs and spokes model
PPT
ASLP2 ICT social ecology project
PPTX
Learning Communities
PPT
ACT Principals Conference 2011
PPTX
Design thinking in wild learning
PPT
Digital futures and learning in the 21st century
PPTX
Leveraging low-cost mobile platform technology for pro-poor development
PPT
UCResearchstudents
PPTX
Hot Topics for Design in 2009 - Gaggle Presentation@ANU
PPT
CCPMP SMS Communications
ESTeM Teaching & Learning Innovation Showcase
Learning in the cloud, feet in the village
ASLP2 Social Research ICT Workplan 2013
INSPIRE: A new learning centre, a new learning environment
James Dalziel - Using Learning Design for Innovative eTeaching
networklearning
Learning with Technology - week 2 lecture-social media
CCPMP SMS Information System – towards a hubs and spokes model
ASLP2 ICT social ecology project
Learning Communities
ACT Principals Conference 2011
Design thinking in wild learning
Digital futures and learning in the 21st century
Leveraging low-cost mobile platform technology for pro-poor development
UCResearchstudents
Hot Topics for Design in 2009 - Gaggle Presentation@ANU
CCPMP SMS Communications

Recently uploaded (20)

PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
TR - Agricultural Crops Production NC III.pdf
PDF
Sports Quiz easy sports quiz sports quiz
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PDF
01-Introduction-to-Information-Management.pdf
PPTX
Cell Types and Its function , kingdom of life
PDF
Classroom Observation Tools for Teachers
PDF
RMMM.pdf make it easy to upload and study
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PPTX
Cell Structure & Organelles in detailed.
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
Anesthesia in Laparoscopic Surgery in India
PPTX
GDM (1) (1).pptx small presentation for students
PDF
Pre independence Education in Inndia.pdf
PPTX
Lesson notes of climatology university.
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Microbial disease of the cardiovascular and lymphatic systems
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
TR - Agricultural Crops Production NC III.pdf
Sports Quiz easy sports quiz sports quiz
O7-L3 Supply Chain Operations - ICLT Program
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
01-Introduction-to-Information-Management.pdf
Cell Types and Its function , kingdom of life
Classroom Observation Tools for Teachers
RMMM.pdf make it easy to upload and study
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Cell Structure & Organelles in detailed.
2.FourierTransform-ShortQuestionswithAnswers.pdf
Anesthesia in Laparoscopic Surgery in India
GDM (1) (1).pptx small presentation for students
Pre independence Education in Inndia.pdf
Lesson notes of climatology university.
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
STATICS OF THE RIGID BODIES Hibbelers.pdf
Microbial diseases, their pathogenesis and prophylaxis
Microbial disease of the cardiovascular and lymphatic systems

Learning, design and technology developmental evaluation and the experience api

  • 1. Session 2 - Learning, Design and Technology in Schools, Skills Training and Higher Education Developmental evaluation and the experience API Professor Robert Fitzgerald www.assess2learn.com.au www.assess2learn.com.au
  • 2. Learning, design and technology: Developmental evaluation and the experience API Professor Robert Fitzgerald Faculty of Education, Science, Education and Technology, University of Canberra Rethinking Assessment and Learning, GLOBAL MINDSET, Australian Technology Park, Sydney, 29 October, 2014
  • 6. INSPIRE: Research, Education & Innovation http://www.ideo.com http://www.tpck.org • Design Thinking & STEM education • Next practice learning & design • Mastery pedagogies • Augmented reality • Location based education services • ICT4D – Pakistan & Cambodia • Google Glass & Wearables • National mentoring for Maths & Science teachers • The Experience API
  • 7. Educational challenges • The “new normal” of increasing demand, diminishing resources, increased expectations and constant change • Widespread consensus that graduates are not well prepared for the world of work and subsequent lifelong learning (AAEG, 2011; Candy, 1991; Candy, Crebert & O’Leary, 1994; Oliver, 2011; Shah & Nair, 2011) • John Seely Brown argues we need to radically shift the focus of education from the development of skills & knowledge, to the cultivation of mindsets and dispositions (Thomas & Brown, 2011)
  • 9. Technology futures • Emerging forms of interactive media and information communication technology are reshaping almost every aspect of our work and social life; Boundaries are blurring • New practices and literacies are emerging from digital communications and culture that challenge our traditional ideas about the form and function of communication, learning and education • Technology is more than just a ‘tool’ but an evocative ‘object to think with’ and an engine of social and cultural change; Change is ecological not additive • Design thinking: New opportunities for participation and interaction arise from communities of interest where users are active designers & content creators re-mixing, re-purposing and re-distributing content
  • 10. A lesson: ICT benefits depend on “capital” Capital = skills, interests, attitudes, resources s c I e n c e The capital gap Source: www.oecd.org
  • 11. The barriers to transformation are not "conceptual, technical, or economic. The primary barriers are psychological, political, and cultural. We now have all the means necessary to implement effective educational models that can prepare all students for a future very different from the immediate past. Whether we have the professional commitment and the societal will to actualize such a vision remains to be seen.” Dede et al (2013) Educause Review
  • 12. Feedback - Learning, change & evaluation • We know that feedback is the most effective way of improving student learning (Hattie, 2009) • Forms of Evaluation - Formative, Summative & Developmental (Patton, 2011) • Summative and formative evaluation are most often used to examine established programs • Developmental Evaluation (DE) is well-suited to emergent or developing systems • DE is a design-based research tool for understanding innovation and change in educational systems • Salient features – engage in simulations and/or rapid reconnaissance – deploy tools that develop maps of the territory; and – allow for revised and emergent modelling (Patton, 2011)
  • 13. Technology Assisted Developmental Evaluation • ‘What? So What? Now What? (Gamble, 2008, p. 47) • Learning & change should be expansive and transferable and not limited to contemporaneous testing (Engeström, 2006; Wiggins & McTighe, 2011, p. 5) • The theoretical perspectives draws on Vygotsky (1978), Activity Theory (Engestrom, 2001), Variation Theory (Marton & Tsui, 2004) and the concept of Communities of Practice (Lave & Wenger, 1991) • Towards a Technology Assisted Developmental Evaluation (TADE) framework that helps teachers and institutions with their data work in ways that support educational decision making in a practical and accessible form (Leonard, Fitzgerald & Bacon [under review]) • “A system is not the sum of its parts, but rather, the product of the interaction of the parts” (Russell Ackoff)
  • 14. Bernhardt, V. (2004). Data analysis for continuous school improvement (2nd ed.). Larchmont, NY: Eye on Education.
  • 15. Learning everywhere Source: tincanapi.com/overview
  • 16. INSPIREx: A data-driven educational environment based on Experience API Source: www.brightcookie.com
  • 17. INSPIREx learning ecology Source: www.brightcookie.com
  • 18. Personalised learning & The Quantified Self Source: economist.com
  • 20. Data for the learner • Quantified Self goes to school – self-knowledge through self-tracking – designing self-experiments • What does an increasing personalisation of education and learning mean for learners, teachers, institutions? • Implications for research – develop repeated measures and single subject designs • What changes are required when we shift from data about the learner to data for the learner? • How do we develop hindsight, oversight, foresight, insight in these new data rich environments? • What happens when learners tell ‘us’ when they are ready for learning?
  • 21. Rob Fitzgerald robert.fitzgerald@canberra.edu.au Twitter: @rfitzgerald INSPIRE Website: inspire.edu.au Facebook: www.facebook.com/inspiredu2 Twitter: @inspiredu2

Editor's Notes

  • #5: The design
  • #6: Learning in action
  • #7: Inspired by design thinking, service design and “jams”, we use friendly competition to turn ideas into concrete designs, prototypes and plans of action
  • #13: Understood as an expansive activity, learning is about acquiring the tools of the learner’s socio-cultural context and ‘growing into the intellectual life of those around them’ (Vygotsky, 1978, p. 88) The use of those tools though, only makes sense when used for activity, that is the interaction between the learner and their context. In this formation, ‘learning’ is not an isolated product or ‘performance’, but rather is the integration of concept, learner, and their community. Learning connects ‘upwards, downwards and sideways’ (Engeström, 2006).