Using a digital tool to improve students’
algebraic expertise in the Netherlands:
crises, feedback and fading
Christian Bokhove
Southampton Education School
April 17th, 2014, BCME-8
Rationale
Algebraic skills
Year 12 students
Netherlands
often
disappointing
But even when rewriting
skills are OK…
…many things can go wrong
So conceptual understanding and
pattern recognition are important!
Use of ICT
So can’t we use ICT for acquiring,
practicing and assessing algebraic
expertise?
Research questions:
What is the effect of an intervention on the
development of algebraic expertise,
including both procedural skills and symbol
sense?
Which factors predict the resulting
algebraic performance?
Conceptual framework, elements of:
• Symbol sense – basic skills (e.g. Arcavi)
• Formative – summative assessment
(e.g. Black & Wiliam)
• Feedback
Research set-up
Rnd Focus Target N
Pre What software, what
characteristics?
Experts
1 Could it work? 1-to-1s,
qualitative
N=5
2 In what way can it
work?
2 classes in 1
school
N=31
3 Does it work? 9 schools,
quantitative
N=324
Third round design
• 324 students in 9 schools (N=324)
• Year 12, nature and health stream
• Digital module: 6 hours, 6 parts
• Teachers were free in how to deploy the
module, but were asked afterwards
• Data collection
–Scores pen-and-paper pre- and posttests
–Scores and logfiles
–Questionnaires
Equations: in-between steps, multiple
strategies allowed
Store student results, and use these as a
teacher to study misconceptions and for
starting classroom discussions
students
(i) students learn a lot from what goes wrong,
(ii) but students will not always overcome these if
no feedback is provided, and
(iii) that too much of a dependency on feedback
needs to be avoided, as summative assessment
typically does not provide feedback.
These three challenges are addressed by principles
for crises, feedback and fading, respectively.
Crisis-tasks
“students learn a lot from what goes wrong”
“Failure is, in a sense, the highway to success” - Keats
Feedback: overcoming a crisis
Screencast clips
“but students will not always overcome these if no feedback is provided”
Feedback: worked examples and hints
IDEAS feedback, webservice with Jeuring et al
Fading
“too much of a dependency on feedback needs to be avoided”
Posttest (M=78.71, SE=15.175) is significantly higher
than the pretest score (M=51.55, SE=21.094), t(285)=-
22.589, p<.001, r=.801, d=-1.34.
Symbol sense score on the posttest (M=1.462,
SE=1.504) is significantly higher than the pretest score
(M=-1.493, SE=2.339), t(285)=-20.602, p<.001, r=.773,
d=-1.22.
Effect
Significant
predictors higher
posttest score
• Previous knowledge
• Time spent in self-
test and summative-
test modes
• General attitude
towards mathematics
Non-significant
predictors higher
posttest score
• Gender
• Attitude towards ICT
• Total time spent on
module
• More time spent at
home or at school
Predictors
New developments
Christian Bokhove
Twitter: cbokhove
C.Bokhove@soton.ac.uk
www.bokhove.net
Thank you Discussion

More Related Content

PDF
2021 nyu-learn - ai for academic advising, a matter of trust
PPTX
AutomataTutor at ExCape14
PPTX
Outcomes Targeting Introduction
PDF
Maply TA - Toby Bailey
PPTX
Fractions Resources
PPTX
Adaptive Multilevel Clustering Model for the Prediction of Academic Risk
PPTX
Simple metrics for Curricular Analytics
PPT
Back to school_night_precalcu
2021 nyu-learn - ai for academic advising, a matter of trust
AutomataTutor at ExCape14
Outcomes Targeting Introduction
Maply TA - Toby Bailey
Fractions Resources
Adaptive Multilevel Clustering Model for the Prediction of Academic Risk
Simple metrics for Curricular Analytics
Back to school_night_precalcu

What's hot (19)

PPTX
Endings mathematics lessons
PPTX
Learning &amp; Teaching GCSE Mathematics
PPTX
Software Evaluation
PPTX
Measuring the impact of instant high quality feedback.
PPTX
SBAC Performance Task Overview
PPTX
AQT February PLC 2012
PDF
3 New Topics from HappyNumbers.com
PPTX
MLCS NADE 2014
PPTX
Electronic Management of Assessment - Professor Andrew Taylor
PPT
Fine tuning assessment for teaching and learning
PPT
Turning Point: Getting Started
PPT
ELPS 465 Class June 09 2011
PPS
Math early release
PPTX
PIR FACULTY TRAINING
PDF
Creating Technology Enhanced Items: An Assessment Authoring Workshop
PPTX
Using the Test Centre Tool: an opportunity to inform learning and teaching
PPTX
CloudBound K12 Presentation 2016
PPTX
ICTCM 2013 Presentation -- Dan DuPort
PDF
Problem solving content
Endings mathematics lessons
Learning &amp; Teaching GCSE Mathematics
Software Evaluation
Measuring the impact of instant high quality feedback.
SBAC Performance Task Overview
AQT February PLC 2012
3 New Topics from HappyNumbers.com
MLCS NADE 2014
Electronic Management of Assessment - Professor Andrew Taylor
Fine tuning assessment for teaching and learning
Turning Point: Getting Started
ELPS 465 Class June 09 2011
Math early release
PIR FACULTY TRAINING
Creating Technology Enhanced Items: An Assessment Authoring Workshop
Using the Test Centre Tool: an opportunity to inform learning and teaching
CloudBound K12 Presentation 2016
ICTCM 2013 Presentation -- Dan DuPort
Problem solving content
Ad

Viewers also liked (20)

DOCX
Que bonito suena
PDF
NMC 2012 Gebruik van ICT bij het leren van algebra
PPTX
Slides algebra concept_031012
PPT
Aaqm In Karachi
DOCX
Esquema 5
PPT
PDF
Relazione tecnica + quotazione + offerta biassiale
PDF
Q.U.I.Z. Finals (Kairos-2014, NLU, Delhi)
PDF
General Quiz(14th November, 2013)
PDF
Blitzkrieg Quiz - FMS Delhi
PPT
La revolution francaise
PPT
Cdm Overview
KEY
Katie Christmas List 2011
PPT
Germinal Groupe2
PDF
Q.U.I.Z. Prelims (Kairos-2014, NLU, Delhi)
PPT
Le sacre de_napoleon_1er
PPT
Session ICT Blackboard NCETM v1
PPTX
Society for Research into Higher Education conference presentation
PDF
F.L.A.M.E. Quiz
Que bonito suena
NMC 2012 Gebruik van ICT bij het leren van algebra
Slides algebra concept_031012
Aaqm In Karachi
Esquema 5
Relazione tecnica + quotazione + offerta biassiale
Q.U.I.Z. Finals (Kairos-2014, NLU, Delhi)
General Quiz(14th November, 2013)
Blitzkrieg Quiz - FMS Delhi
La revolution francaise
Cdm Overview
Katie Christmas List 2011
Germinal Groupe2
Q.U.I.Z. Prelims (Kairos-2014, NLU, Delhi)
Le sacre de_napoleon_1er
Session ICT Blackboard NCETM v1
Society for Research into Higher Education conference presentation
F.L.A.M.E. Quiz
Ad

Similar to Presentation BCME8 April 17th 2014 (20)

PPTX
ICME-12 presentation
PPTX
The Future of Assessment - Moodleposium 2015
PPTX
BOLD Presentation Zane
PPTX
Investigating learning strategies in a dispositional learning analytics conte...
PPTX
The technoserver
PPTX
TESTA Interactive Masterclass
PPTX
Technology-enhanced assessment and feedback: What should (and shouldn’t) we b...
PPTX
The why and what of testa
PPTX
When Student Confidence Clicks - Using Student Response Systems
PDF
Measuring, learning and applying multiplication facts.
PPTX
Classsourcing: Crowd-Based Validation of Question-Answer Learning Objects @ I...
PPTX
TESTA, Durham University (December 2013)
PPT
micro testing teaching learning analytics
PPTX
Pd continuum plan goodspiritmodule2 - catch-up module
PDF
Some experiences from evaluating and stress testing digital examination systems
PPTX
The power of learning analytics to unpack learning and teaching: a critical p...
PPTX
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
PPT
The challenges of Assessment and Feedback: findings from an HEA project
PPT
Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14
PPTX
Portsmouth BAM Knowledge and Learning SIG
ICME-12 presentation
The Future of Assessment - Moodleposium 2015
BOLD Presentation Zane
Investigating learning strategies in a dispositional learning analytics conte...
The technoserver
TESTA Interactive Masterclass
Technology-enhanced assessment and feedback: What should (and shouldn’t) we b...
The why and what of testa
When Student Confidence Clicks - Using Student Response Systems
Measuring, learning and applying multiplication facts.
Classsourcing: Crowd-Based Validation of Question-Answer Learning Objects @ I...
TESTA, Durham University (December 2013)
micro testing teaching learning analytics
Pd continuum plan goodspiritmodule2 - catch-up module
Some experiences from evaluating and stress testing digital examination systems
The power of learning analytics to unpack learning and teaching: a critical p...
TESTA, Presentation to the SDG Course Leaders, University of West of Scotlan...
The challenges of Assessment and Feedback: findings from an HEA project
Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14
Portsmouth BAM Knowledge and Learning SIG

More from Christian Bokhove (20)

PPTX
This is the new m*th! 2024 edition (researchEd Belfast 28-9-24)
PPTX
THE POTENTIAL OF SEQUENCE ANALYSIS FOR ANALYSING DATA FROM AN ONLINE MATHEM...
PPTX
Master Mathematics Teachers in Chinese primary schools
PPTX
Can data from largescale assessments ever be useful For mathematics education?
PPTX
Creating interactive digital books for the transition from secondary to under...
PPTX
Research on school inspections: What do we know?
PPTX
Master mathematics teachers: What do Chinese primary schools look like?
PPTX
The role of non-cognitive factors in science achievement: an analysis of PISA...
PPTX
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
PPTX
Cryptography
PPTX
Help-seeking in an online maths environment: A sequence analysis of log files
PPTX
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
PPTX
The challenge of proof in the transition from A-level mathematics to university
PPTX
How can we develop expansive, research-informed ITE ?
PPTX
Discussant EARLI sig 27
PPTX
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
PPTX
Transparency in Data Analysis
PPTX
Proof by induction in Calculus: Investigating first-year students’ examinatio...
PPTX
Evidence informed: Waar is de Bijsluiter?
PPTX
Methodological innovation for mathematics education research
This is the new m*th! 2024 edition (researchEd Belfast 28-9-24)
THE POTENTIAL OF SEQUENCE ANALYSIS FOR ANALYSING DATA FROM AN ONLINE MATHEM...
Master Mathematics Teachers in Chinese primary schools
Can data from largescale assessments ever be useful For mathematics education?
Creating interactive digital books for the transition from secondary to under...
Research on school inspections: What do we know?
Master mathematics teachers: What do Chinese primary schools look like?
The role of non-cognitive factors in science achievement: an analysis of PISA...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Cryptography
Help-seeking in an online maths environment: A sequence analysis of log files
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
The challenge of proof in the transition from A-level mathematics to university
How can we develop expansive, research-informed ITE ?
Discussant EARLI sig 27
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
Transparency in Data Analysis
Proof by induction in Calculus: Investigating first-year students’ examinatio...
Evidence informed: Waar is de Bijsluiter?
Methodological innovation for mathematics education research

Recently uploaded (6)

PPTX
StepOut – Where Strangers Become Friends
PPTX
Weather-Ready Storage_ Why the 13ft Pop-Up Locker in Ontario Excels in All Se...
DOC
BGSU毕业证学历认证,爱达荷大学毕业证国外大学毕业证
PPTX
Maximizing Space and Security with the 16ft Pop-Up Locker in Onterio.pptx
PPTX
Ecommerce design and development by php pptx
PPTX
Smart, Secure, Spacious _ 20ft Pop-Up Locker in Ontario.pptx
StepOut – Where Strangers Become Friends
Weather-Ready Storage_ Why the 13ft Pop-Up Locker in Ontario Excels in All Se...
BGSU毕业证学历认证,爱达荷大学毕业证国外大学毕业证
Maximizing Space and Security with the 16ft Pop-Up Locker in Onterio.pptx
Ecommerce design and development by php pptx
Smart, Secure, Spacious _ 20ft Pop-Up Locker in Ontario.pptx

Presentation BCME8 April 17th 2014

  • 1. Using a digital tool to improve students’ algebraic expertise in the Netherlands: crises, feedback and fading Christian Bokhove Southampton Education School April 17th, 2014, BCME-8
  • 2. Rationale Algebraic skills Year 12 students Netherlands often disappointing
  • 3. But even when rewriting skills are OK… …many things can go wrong
  • 4. So conceptual understanding and pattern recognition are important!
  • 6. So can’t we use ICT for acquiring, practicing and assessing algebraic expertise?
  • 7. Research questions: What is the effect of an intervention on the development of algebraic expertise, including both procedural skills and symbol sense? Which factors predict the resulting algebraic performance? Conceptual framework, elements of: • Symbol sense – basic skills (e.g. Arcavi) • Formative – summative assessment (e.g. Black & Wiliam) • Feedback
  • 8. Research set-up Rnd Focus Target N Pre What software, what characteristics? Experts 1 Could it work? 1-to-1s, qualitative N=5 2 In what way can it work? 2 classes in 1 school N=31 3 Does it work? 9 schools, quantitative N=324
  • 9. Third round design • 324 students in 9 schools (N=324) • Year 12, nature and health stream • Digital module: 6 hours, 6 parts • Teachers were free in how to deploy the module, but were asked afterwards • Data collection –Scores pen-and-paper pre- and posttests –Scores and logfiles –Questionnaires
  • 10. Equations: in-between steps, multiple strategies allowed
  • 11. Store student results, and use these as a teacher to study misconceptions and for starting classroom discussions students
  • 12. (i) students learn a lot from what goes wrong, (ii) but students will not always overcome these if no feedback is provided, and (iii) that too much of a dependency on feedback needs to be avoided, as summative assessment typically does not provide feedback. These three challenges are addressed by principles for crises, feedback and fading, respectively.
  • 13. Crisis-tasks “students learn a lot from what goes wrong” “Failure is, in a sense, the highway to success” - Keats
  • 14. Feedback: overcoming a crisis Screencast clips “but students will not always overcome these if no feedback is provided”
  • 15. Feedback: worked examples and hints IDEAS feedback, webservice with Jeuring et al
  • 16. Fading “too much of a dependency on feedback needs to be avoided”
  • 17. Posttest (M=78.71, SE=15.175) is significantly higher than the pretest score (M=51.55, SE=21.094), t(285)=- 22.589, p<.001, r=.801, d=-1.34. Symbol sense score on the posttest (M=1.462, SE=1.504) is significantly higher than the pretest score (M=-1.493, SE=2.339), t(285)=-20.602, p<.001, r=.773, d=-1.22. Effect
  • 18. Significant predictors higher posttest score • Previous knowledge • Time spent in self- test and summative- test modes • General attitude towards mathematics Non-significant predictors higher posttest score • Gender • Attitude towards ICT • Total time spent on module • More time spent at home or at school Predictors