SlideShare a Scribd company logo
Evaluating an Instructional
Sequence for Scaffolding
Inquiry Learning with
Interactive Simulations
Xinxin Fan
The University of
Queensland
David Geelan
Griffith University
Wei Liang
Beijing Normal
University
So what?
The instructional approach we will describe
during this session has been demonstrated to
yield measurable (large) increases, relative to
‘normal’ teaching, in physics students’:
• Conceptual knowledge of physics concepts
(forces)
• Confidence in their own knowledge
• Skills in participating in inquiry learning
We suspect and hope that this approach has the
potential to support learning in other science
(STEM?) fields and levels.
Background
 Lots of good evidence that students enjoy
learning with visualisations
 Lots of teachers adopting them, lots of
money being spent developing, hosting and
sharing them
 Not much good quality quantitative
evidence of their educational effectiveness,
particularly at the high school level
Interactive Simulations
• Computer-based visualisations
• Are like ‘virtual laboratories’ (in some ways)
• Make it easy to do a number of experiments
quickly
• Students manipulate variables and generate data
Examples
Inquiry Sequence using Interactive
Simulations (ISIS) – outlined in a chapter by
Geelan and Fan in the forthcoming Springer
book edited by Eilam and Gilbert
• This instructional sequence is referenced
to a constructivist epistemology and
draws on conceptual change pedagogy
• It also draws on Vygotsky’s ZPD
• It is a scaffolded, supported approach to
inquiry learning, in which students
actively engage in ‘testing to destruction’
candidate concepts for explaining
phenomena
• It develops students’ understanding that
scientific concepts are those that have
(so far) survived such testing
The Zeroth Step
• First, decide whether you can use real
experiments instead of interactive
simulations
• Real experiments and experiences are
almost always better than virtual ones for
conceptual development
• Different tools can complement one
another for learning
Step One
• Elicitation and clarification of existing
conceptions and the ‘target’ scientific
conception
• Know the literature in relation to student
misconceptions in your subject area
• Well formulated questions, discussions,
possibly quizzes (use with care), POE
• Introduction of scientific concept
Step Two
• Outlining the predictions and implications
of students’ existing conceptions and the
scientific conception
• In relation to a specific experiment to be
completed using the interactive
simulation, ask students to make
predictions using the rival conceptions
Step Three
• Testing predictions of competing
conceptions using interactive simulations
• Use the interactive simulation to test the
predictions students make
• At every test, it should be clear to the
students what each concept predicts, and
what the findings mean
Step Four
• Clarification of findings and linking results
to the scientific conception
• Demonstrate and discuss how the findings
and results support the scientific concept
and do not support the misconception
• Ensure that students understand how the
theory predicts the observed results
Step Five
• Further testing to develop and deepen
understanding of the scientific conception
• Extend the experience to novel contexts
and problems
• Demonstrate the fruitfulness of the
scientific concept
Sequence and Repetition
• While some of these steps need to happen
before others, it may not be necessary for
the full sequence to be completed
• It may also be necessary to cycle through
the whole sequence or some subset of it
again to ensure understanding
• Like all models, it is (potentially) useful
rather than true
Evidence For Effectiveness
• In a preliminary study (as part of her PhD)
Xinxin Fan, supported by Wei Liang,
compared this sequence with ‘normal’
teaching in 4 classrooms (N=115) in two
schools in Beijing for 8 weeks
• Two teachers participated in the study.
Each received training and support in using
the instructional sequence, and each taught
one ‘experimental’ and one ‘control’ class
Research Design
• Force Concept Inventory (FCI)
• Addition of a 5-point Likert scale for
confidence
• Addition of an explanation of their answer by
students
• Classroom observations, interviews
• Also analysed by sex of students and academic
achievement level (thirds of class)
• Cronbach alpha coefficients of the conceptual
understanding test, confidence survey and
inquiry skills survey were .81, .94 and .87
respectively
Evidence For Effectiveness
Conceptual Understanding
• F (1, 115) = 25.11, p = .000, η2 = .18
• This is considered a large effect size,
equivalent to a Cohen’s d value of 0.94 :
students taught using the instructional
sequence with interactive simulations
significantly outperformed those taught
without it
Evidence For Effectiveness
• True for both sexes and across all
achievement levels
• ANCOVAs for conceptual understanding
revealed no significant differences in gains
for female vs male students and for levels of
academic achievements
Evidence For Effectiveness
• Confidence
• F (1, 115) = 15.65, p = .000, η2= .12
• (equivalent to d = 0.74)
• No significant differences for sex or level
Evidence For Effectiveness
• Inquiry Skills
• F (1, 115) = 71.36, p = .000, η2= .38
• (equivalent to d = 1.57)
• No significant differences for sex or level
Further Research
• Clearly, given the small sample size and the
specific Beijing context, our findings are tentative
at this point – we would like to replicate and
expand the study in multiple contexts
• It seems plausible that such an approach would be
quite easily adapted to chemistry learning,
although the affordances of the technology are
likely to be different
• Are there other contexts or content domains
across STEM Education where an approach of this
kind may have potential?
Example Question
Two metal balls are the same size but one weighs twice as much as the
other. The balls are dropped from the roof of a single story building at
the same instant. The time it takes the balls to reach the ground below
will be:
A. About half as long for the heavier ball as for the lighter one.
B. About half as long for the lighter ball as for the heavier one.
C. About the same for both balls.
D. Considerably less for the heavier ball, but not necessarily half as
long.
E. Considerably less for the lighter ball, but not necessarily half as
long.
: Could you please explain why you choose this answer? You can use
your physics knowledge or your own words to write down your
understanding.
: How sure are you of your answer to the question?
A. Very sure; B. Sure; C. Neutral; D. Unsure; E. Very unsure.
Sample Inquiry Skills Item
I understand the physical problems that I am exploring, but
there are still some people who do not understand what I said
or wrote.
5 = strongly agree; 4 = Agree; 3 = no opinion; 2 = disagree; 1 =
strongly disagree

More Related Content

PPT
5 E instructional model
PPT
Model model pembelajaran
PPTX
e5 presentation
PPT
5 es _for_elementary_science_2009-10_oct09
PPT
5 Es Power Point 03
PPTX
Presentation1 e5
DOCX
5 e model of instruction copy
PPTX
Infusing the 5 E Model with Digital Media
5 E instructional model
Model model pembelajaran
e5 presentation
5 es _for_elementary_science_2009-10_oct09
5 Es Power Point 03
Presentation1 e5
5 e model of instruction copy
Infusing the 5 E Model with Digital Media

What's hot (20)

PPTX
Improving instructional design via 5E model
PPT
Inquiry, Literacy, and the Learning Cycle Webinar 090910
PPTX
Classroom research
PPTX
Tap & the 5E lesson cycle
PPSX
Classroom research ELT
PDF
Classroom research
PPTX
First Asignment On Classroom Research
PPTX
Classroom research presentation
PPTX
Classroom Assessment Techqniques CATs-Emad Mansour
PPT
Tutorial: Case-based learning: Dr. Cary Engleberg
PDF
Performance assessment may 2015
PPT
Action research 2013 (2)
PDF
Mw+ppt+&+mm+sci+lesson+pdf
PPTX
Introducing action research
PPTX
What will they need? Pre-assessment techniques for instruction session.
PPTX
Pre assessment and lesson planning
PPTX
Learning by doing aalhe presentation handout
PPT
10 29 09 Day Of Differentiation
PPTX
CHECO Retreat - Changing landscape of teaching
PPT
Intro to inquiry
Improving instructional design via 5E model
Inquiry, Literacy, and the Learning Cycle Webinar 090910
Classroom research
Tap & the 5E lesson cycle
Classroom research ELT
Classroom research
First Asignment On Classroom Research
Classroom research presentation
Classroom Assessment Techqniques CATs-Emad Mansour
Tutorial: Case-based learning: Dr. Cary Engleberg
Performance assessment may 2015
Action research 2013 (2)
Mw+ppt+&+mm+sci+lesson+pdf
Introducing action research
What will they need? Pre-assessment techniques for instruction session.
Pre assessment and lesson planning
Learning by doing aalhe presentation handout
10 29 09 Day Of Differentiation
CHECO Retreat - Changing landscape of teaching
Intro to inquiry
Ad

Viewers also liked (20)

PPTX
Mobile diagnosis 2015 5 x 1000 28 aprile
PPSX
Photos
PPTX
Grand Chase
XLSX
Blanca nelly diaz
PPT
Healtheducation 090714065946 Phpapp02
PPSX
PPT
Advertising From Mad Men to Social Media Madness
PPTX
MobileDiagnosis:an appropriate technology
PPT
Montesori iedvesmota vide mājās
PPTX
Livia bellina atlanta global summit 2015
PPT
PP: God Bless America - Kate Smith
PPT
Evaluating the effectiveness of scientific visualizations in physics
DOC
1 25-07 january reflective paper
PPTX
Fun with Social, Windows 8 and Javascript
PPTX
Ist storyboard final
KEY
PDF
Terna 2010 consolidated results
PPTX
CASE Award presentation
PDF
BO Berrikuntza Sozial Enpresarialaren Bidaia Orria definitzeko Metodologia
Mobile diagnosis 2015 5 x 1000 28 aprile
Photos
Grand Chase
Blanca nelly diaz
Healtheducation 090714065946 Phpapp02
Advertising From Mad Men to Social Media Madness
MobileDiagnosis:an appropriate technology
Montesori iedvesmota vide mājās
Livia bellina atlanta global summit 2015
PP: God Bless America - Kate Smith
Evaluating the effectiveness of scientific visualizations in physics
1 25-07 january reflective paper
Fun with Social, Windows 8 and Javascript
Ist storyboard final
Terna 2010 consolidated results
CASE Award presentation
BO Berrikuntza Sozial Enpresarialaren Bidaia Orria definitzeko Metodologia
Ad

Similar to Evaluating an Instructional Sequence with Interactive Simulations (ISIS) (20)

PDF
Stephen Phillips - Implementing an inquiry based approach into our school
PPTX
Quantitative research
PPTX
Open Book Examination
DOC
740 feb 18
PPTX
AHTR SoTL Resources: Kelly Donahue-Wallace, Prove It! Publish It! SoTL Case ...
PPTX
Theory/literature vs practice - the flipped classroom
PDF
Fostering scientific critical thinking and creativity in higher education – C...
PPTX
Using active learning instructional strategies
PPTX
Active Learning in teaching learning in class
PPTX
NCERT Module Two - Course Design Using the 5E's
PPTX
The Adaptive Subject Pedagogy Model (PATT 38)
PDF
Qualitative management research: the experiences of teachers and learners - C...
PPT
Action_Research_Chapter1Introduction.ppt
PPT
TESTA - UNSW, Sydney Australia (September 2011)
PPT
Research Questions and Hypotheses
PDF
Declan Cathcart - Assessment of inquiry during a woodlice investigation
PDF
Declan Cathcart: Assessment of inquiry during a woodlice investigation
PPTX
TESTA Masterclass AHE Conference 2015
PPTX
TESTA, AHE Conference Masterclass (June 2015)
PPTX
The Practical Skills Passport: supporting student lab skills and confidence p...
Stephen Phillips - Implementing an inquiry based approach into our school
Quantitative research
Open Book Examination
740 feb 18
AHTR SoTL Resources: Kelly Donahue-Wallace, Prove It! Publish It! SoTL Case ...
Theory/literature vs practice - the flipped classroom
Fostering scientific critical thinking and creativity in higher education – C...
Using active learning instructional strategies
Active Learning in teaching learning in class
NCERT Module Two - Course Design Using the 5E's
The Adaptive Subject Pedagogy Model (PATT 38)
Qualitative management research: the experiences of teachers and learners - C...
Action_Research_Chapter1Introduction.ppt
TESTA - UNSW, Sydney Australia (September 2011)
Research Questions and Hypotheses
Declan Cathcart - Assessment of inquiry during a woodlice investigation
Declan Cathcart: Assessment of inquiry during a woodlice investigation
TESTA Masterclass AHE Conference 2015
TESTA, AHE Conference Masterclass (June 2015)
The Practical Skills Passport: supporting student lab skills and confidence p...

More from David Geelan (20)

PPTX
Teacher efficiency, effectiveness and efficacy
PPT
Teacher expertise
PPTX
Objectives for lecture 7 7801 edn
PPTX
Science curriculum and syllabus
PPTX
Curriculum and syllabus
PPT
Productive pedagogies
PPTX
Differentiated learning
PPT
Constructivism lite
PPT
Planning for instruction in science
PPTX
Matter and energy (and a little electricity)
PPT
Introduction to the 5Es Model
PPT
Metaphors we teach by
PPTX
Defining middle years
PPTX
Open teacher education
PPTX
Forces and motion
PPT
Inquiry
PPT
What is science
PPT
Curriculum
PPT
Science, technology and understanding
PPT
Science education for immortal cyborgs
Teacher efficiency, effectiveness and efficacy
Teacher expertise
Objectives for lecture 7 7801 edn
Science curriculum and syllabus
Curriculum and syllabus
Productive pedagogies
Differentiated learning
Constructivism lite
Planning for instruction in science
Matter and energy (and a little electricity)
Introduction to the 5Es Model
Metaphors we teach by
Defining middle years
Open teacher education
Forces and motion
Inquiry
What is science
Curriculum
Science, technology and understanding
Science education for immortal cyborgs

Recently uploaded (20)

PPTX
Pharma ospi slides which help in ospi learning
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
Computing-Curriculum for Schools in Ghana
PPTX
Institutional Correction lecture only . . .
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
Anesthesia in Laparoscopic Surgery in India
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PDF
Insiders guide to clinical Medicine.pdf
PDF
Pre independence Education in Inndia.pdf
PPTX
Pharmacology of Heart Failure /Pharmacotherapy of CHF
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PPTX
Lesson notes of climatology university.
Pharma ospi slides which help in ospi learning
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
Computing-Curriculum for Schools in Ghana
Institutional Correction lecture only . . .
102 student loan defaulters named and shamed – Is someone you know on the list?
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Abdominal Access Techniques with Prof. Dr. R K Mishra
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Renaissance Architecture: A Journey from Faith to Humanism
Supply Chain Operations Speaking Notes -ICLT Program
Anesthesia in Laparoscopic Surgery in India
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
Insiders guide to clinical Medicine.pdf
Pre independence Education in Inndia.pdf
Pharmacology of Heart Failure /Pharmacotherapy of CHF
STATICS OF THE RIGID BODIES Hibbelers.pdf
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Lesson notes of climatology university.

Evaluating an Instructional Sequence with Interactive Simulations (ISIS)

  • 1. Evaluating an Instructional Sequence for Scaffolding Inquiry Learning with Interactive Simulations Xinxin Fan The University of Queensland David Geelan Griffith University Wei Liang Beijing Normal University
  • 2. So what? The instructional approach we will describe during this session has been demonstrated to yield measurable (large) increases, relative to ‘normal’ teaching, in physics students’: • Conceptual knowledge of physics concepts (forces) • Confidence in their own knowledge • Skills in participating in inquiry learning We suspect and hope that this approach has the potential to support learning in other science (STEM?) fields and levels.
  • 3. Background  Lots of good evidence that students enjoy learning with visualisations  Lots of teachers adopting them, lots of money being spent developing, hosting and sharing them  Not much good quality quantitative evidence of their educational effectiveness, particularly at the high school level
  • 4. Interactive Simulations • Computer-based visualisations • Are like ‘virtual laboratories’ (in some ways) • Make it easy to do a number of experiments quickly • Students manipulate variables and generate data
  • 6. Inquiry Sequence using Interactive Simulations (ISIS) – outlined in a chapter by Geelan and Fan in the forthcoming Springer book edited by Eilam and Gilbert
  • 7. • This instructional sequence is referenced to a constructivist epistemology and draws on conceptual change pedagogy • It also draws on Vygotsky’s ZPD • It is a scaffolded, supported approach to inquiry learning, in which students actively engage in ‘testing to destruction’ candidate concepts for explaining phenomena • It develops students’ understanding that scientific concepts are those that have (so far) survived such testing
  • 8. The Zeroth Step • First, decide whether you can use real experiments instead of interactive simulations • Real experiments and experiences are almost always better than virtual ones for conceptual development • Different tools can complement one another for learning
  • 9. Step One • Elicitation and clarification of existing conceptions and the ‘target’ scientific conception • Know the literature in relation to student misconceptions in your subject area • Well formulated questions, discussions, possibly quizzes (use with care), POE • Introduction of scientific concept
  • 10. Step Two • Outlining the predictions and implications of students’ existing conceptions and the scientific conception • In relation to a specific experiment to be completed using the interactive simulation, ask students to make predictions using the rival conceptions
  • 11. Step Three • Testing predictions of competing conceptions using interactive simulations • Use the interactive simulation to test the predictions students make • At every test, it should be clear to the students what each concept predicts, and what the findings mean
  • 12. Step Four • Clarification of findings and linking results to the scientific conception • Demonstrate and discuss how the findings and results support the scientific concept and do not support the misconception • Ensure that students understand how the theory predicts the observed results
  • 13. Step Five • Further testing to develop and deepen understanding of the scientific conception • Extend the experience to novel contexts and problems • Demonstrate the fruitfulness of the scientific concept
  • 14. Sequence and Repetition • While some of these steps need to happen before others, it may not be necessary for the full sequence to be completed • It may also be necessary to cycle through the whole sequence or some subset of it again to ensure understanding • Like all models, it is (potentially) useful rather than true
  • 15. Evidence For Effectiveness • In a preliminary study (as part of her PhD) Xinxin Fan, supported by Wei Liang, compared this sequence with ‘normal’ teaching in 4 classrooms (N=115) in two schools in Beijing for 8 weeks • Two teachers participated in the study. Each received training and support in using the instructional sequence, and each taught one ‘experimental’ and one ‘control’ class
  • 16. Research Design • Force Concept Inventory (FCI) • Addition of a 5-point Likert scale for confidence • Addition of an explanation of their answer by students • Classroom observations, interviews • Also analysed by sex of students and academic achievement level (thirds of class) • Cronbach alpha coefficients of the conceptual understanding test, confidence survey and inquiry skills survey were .81, .94 and .87 respectively
  • 17. Evidence For Effectiveness Conceptual Understanding • F (1, 115) = 25.11, p = .000, η2 = .18 • This is considered a large effect size, equivalent to a Cohen’s d value of 0.94 : students taught using the instructional sequence with interactive simulations significantly outperformed those taught without it
  • 18. Evidence For Effectiveness • True for both sexes and across all achievement levels • ANCOVAs for conceptual understanding revealed no significant differences in gains for female vs male students and for levels of academic achievements
  • 19. Evidence For Effectiveness • Confidence • F (1, 115) = 15.65, p = .000, η2= .12 • (equivalent to d = 0.74) • No significant differences for sex or level
  • 20. Evidence For Effectiveness • Inquiry Skills • F (1, 115) = 71.36, p = .000, η2= .38 • (equivalent to d = 1.57) • No significant differences for sex or level
  • 21. Further Research • Clearly, given the small sample size and the specific Beijing context, our findings are tentative at this point – we would like to replicate and expand the study in multiple contexts • It seems plausible that such an approach would be quite easily adapted to chemistry learning, although the affordances of the technology are likely to be different • Are there other contexts or content domains across STEM Education where an approach of this kind may have potential?
  • 22. Example Question Two metal balls are the same size but one weighs twice as much as the other. The balls are dropped from the roof of a single story building at the same instant. The time it takes the balls to reach the ground below will be: A. About half as long for the heavier ball as for the lighter one. B. About half as long for the lighter ball as for the heavier one. C. About the same for both balls. D. Considerably less for the heavier ball, but not necessarily half as long. E. Considerably less for the lighter ball, but not necessarily half as long. : Could you please explain why you choose this answer? You can use your physics knowledge or your own words to write down your understanding. : How sure are you of your answer to the question? A. Very sure; B. Sure; C. Neutral; D. Unsure; E. Very unsure.
  • 23. Sample Inquiry Skills Item I understand the physical problems that I am exploring, but there are still some people who do not understand what I said or wrote. 5 = strongly agree; 4 = Agree; 3 = no opinion; 2 = disagree; 1 = strongly disagree