Feedback designs to
promote dialogue
David Carless
University of Hong Kong
December 14, 2015
Open University of Catalonia
The University of Hong Kong
Overview
1. The wider feedback picture
2. Principles of dialogic feedback
3. Online dialogic feedback
4. Issues & Implications
The University of Hong Kong
SITUATING FEEDBACK
The University of Hong Kong
Bigger picture
Feedback as
assessment design
issue
Feedback as a
pedagogical issue
Feedback as a
relational issue
The University of Hong Kong
The University of Hong Kong
Productive assessment
task design
Understanding quality in the
discipline
Student engagement
with feedback
Learning-oriented assessment framework
Research process
The University of Hong Kong
Feedback by design
Merry, Price, Carless, & Taras (2013)
What does ‘feedback’ mean?
As dialogues around student work
The University of Hong Kong
As comments …
Providing information about performance
AND/
OR
Defining feedback
“A dialogic process in which learners make
sense of information from varied sources
and use it to enhance the quality of their
work or learning strategies”.
Carless (2015, p.192) building on Boud &
Molloy (2013)
The University of Hong Kong
Closing feedback loops
It’s only feedback
if students take
some action
The University of Hong Kong
FEEDBACK AS DIALOGUE
The University of Hong Kong
Dialogic feedback principles
• Process rather than product
• Prompting learner action
• Peers as active source of feedback
• Inner dialogue, internal feedback
The University of Hong Kong
Key aim of feedback
To enhance student
ability to self-monitor
their work in
progress
The University of Hong Kong
Dialogic feedback in practice
1. Teacher-facilitated dialogic feedback
2. Online dialogic feedback
3. Peer feedback and internal feedback
(Nicol, 2010)
The University of Hong Kong
Assessment dialogues
Discussing assessment processes to help
students understand rules of the game
(Carless, 2006)
The University of Hong Kong
Feedback designs
Activities in which students make judgments
The University of Hong Kong
Exemplars & feedback
Analysis of exemplars can support students
in decoding teacher feedback (Handley &
Williams 2011; To & Carless, 2015)
The University of Hong Kong
Guidance & feedback
Integrated cycles of guidance & feedback
within learning processes (Hounsell, 2007;
Hounsell et al. 2008)
The University of Hong Kong
Model of guidance & feedback
Preparatory Guidance
-Clarifying task
-Engaging with criteria
-Analyzing exemplars
Student self-monitoring
-Seeking & using feedback
-Peer review
-Self-evaluation
Ongoing clarification
-Opportunities for practice
-Apply criteria
-Review work in progress
Cumulative task designs
• Task 1  feedback  interlinked task 2
• Position students as active feedback
seekers & users
The University of Hong Kong
ONLINE FEEDBACK
STRATEGIES
The University of Hong Kong
Learning Management Systems
Storing and accessing feedback comments
Prompting students to act on prior feedback
(before receiving more feedback)
The University of Hong Kong
Use of Facebook
More attractive to students than Moodle
(Deng & Tavares, 2013)
History students uploaded drafts & received
peer feedback (Carless, 2015)
The University of Hong Kong
Assessed blog
Business case: participation grade included
blog contribution
“Having a grading allocation … gives some
life to the blog” (Carless, 2015, p. 124)
Sense of cumulativeness vs stating own
opinion
The University of Hong Kong
Non-assessed blog
Involved current students, past students and
practitioners in industry
“Students will treasure feedback if it
addresses their needs and interests”
The University of Hong Kong
Audio (& video) feedback
Providing recorded verbal commentary
(instead of written feedback?)
The University of Hong Kong
Audio feedback: pros
• Viewed positively by students (Lunt &
Curran, 2010)
• Shows concern; permits nuanced
feedback or detail (Savin-Baden, 2010)
• May resemble a dialogue (Nicol, 2010)
The University of Hong Kong
Audio feedback: cons
• ‘Moderate’ impact on student learning
(Gould & Day, 2013)
• Difficult in failure cases
• Workload? (Hennessy & Forester, 2014)
The University of Hong Kong
STUDENT ROLE IN SEEKING,
GENERATING & USING
FEEDBACK
The University of Hong Kong
Peer feedback
Potentially more
plentiful …
But peers often viewed
as lacking expertise
The University of Hong Kong
Composing peer feedback
Providing feedback more cognitively engaging
than receiving feedback (e.g. Nicol et al., 2014)
The University of Hong Kong
Sustainable feedback
Enhancing student role to generate & use
feedback (Carless et al., 2011; Hounsell,
2007)
The University of Hong Kong
SELECTED FEEDBACK
CHALLENGES
The University of Hong Kong
Confusion over purposes
Student & staff confusions over purposes of
feedback and what it can achieve (Price et
al., 2010)
The University of Hong Kong
Workload
Students (not staff) should work harder to
generate and use feedback
The University of Hong Kong
Shifts in priorities
The University of Hong Kong
Increase Decrease
In-class dialogic feedback within
course time
Unidirectional comments after
course completion
Written feedback comments on
first assessment task of module
Written feedback comments on
final task of module
Feedback for first year students Feedback for final year students
Failing to connect
Difficulties for lower achievers to make
sense of feedback (Orsmond & Merry, 2013)
The University of Hong Kong
Implications
The University of Hong Kong
Feedback literacy
Teachers need to
help students
understand
purposes of
feedback & how
they can use it
The University of Hong Kong
Good feedback practice
Integration of feedback & task design;
Timely dialogues: online & peer feedback;
Development of student self-regulation for
sustainable feedback
The University of Hong Kong
THANK YOU
The University of Hong Kong

More Related Content

PPT
Relieving feedback frustrations
PPT
Scaling up assessment for learning
PPT
Developing sustainable feedback
PPT
Oct 21 Learning-oriented assessment
PPT
Assessment Issues & Strategies
PPT
Towards productive teacher-student partnerships in feedback processes
PPT
Learning-oriented assessment
PPT
Beyond teacher comments: Designing for student uptake of feedback
Relieving feedback frustrations
Scaling up assessment for learning
Developing sustainable feedback
Oct 21 Learning-oriented assessment
Assessment Issues & Strategies
Towards productive teacher-student partnerships in feedback processes
Learning-oriented assessment
Beyond teacher comments: Designing for student uptake of feedback

What's hot (20)

PPT
Towards deeper and more sustained implementation of Assessment for learning
PPT
Supporting Students in Generating and Using Feedback
PPT
Assessment possibilities
PPT
Learning-oriented assessment in higher education
PPT
Designing for student uptake of feedback in EAP
PPT
Assessment and feedback in large classes
PPT
Teaching for quality student learning
PPT
Technology-facilitated feedback processes
PPTX
Students' responses to learning oriented assessment
PPT
Researching Excellence in Assessment and Feedback
PPT
Feedback literacy as a key to ongoing improvement
PPT
Technology-enabled learning-oriented assessment
PPT
Learner agency, feedback and learning analytics
PPT
Designing satisfying feedback experiences
PPTX
Effective Assessment and feedback designs
PPT
Developing staff and student feedback literacy in partnership
PPT
The Student Experience of Feedback: Longitudinal perspectives
PPT
Feedback for student learning as partnership between teachers and students
PPTX
Analyzing exemplars
PPT
Feedback for the longer term: enhancing student feedback literacy
Towards deeper and more sustained implementation of Assessment for learning
Supporting Students in Generating and Using Feedback
Assessment possibilities
Learning-oriented assessment in higher education
Designing for student uptake of feedback in EAP
Assessment and feedback in large classes
Teaching for quality student learning
Technology-facilitated feedback processes
Students' responses to learning oriented assessment
Researching Excellence in Assessment and Feedback
Feedback literacy as a key to ongoing improvement
Technology-enabled learning-oriented assessment
Learner agency, feedback and learning analytics
Designing satisfying feedback experiences
Effective Assessment and feedback designs
Developing staff and student feedback literacy in partnership
The Student Experience of Feedback: Longitudinal perspectives
Feedback for student learning as partnership between teachers and students
Analyzing exemplars
Feedback for the longer term: enhancing student feedback literacy
Ad

Viewers also liked (12)

DOC
RAVI SINGH RESUME
DOCX
Usman Afzal2
DOCX
Updated_Resume_12_16
PDF
DOCX
Executive sales manager resume
PPT
Licencias creative commons
PDF
The READ article
PPTX
Prospective Students Information Session
PPTX
Los Fullerenos
PPTX
Fullerenos y nanotecnologia
PPTX
Emerging Trends in Foreign Language Teaching with ICT
DOCX
ManishaShah resume.2015
RAVI SINGH RESUME
Usman Afzal2
Updated_Resume_12_16
Executive sales manager resume
Licencias creative commons
The READ article
Prospective Students Information Session
Los Fullerenos
Fullerenos y nanotecnologia
Emerging Trends in Foreign Language Teaching with ICT
ManishaShah resume.2015
Ad

Similar to Feedback by design (20)

PPT
Developing feedback as dialogue
PPT
Promoting student engagement with feedback
PPT
Shared feedback literacy: Designing for productive feedback experiences
PPT
Learners seeking, generating and using feedback inputs: The role of student a...
PPT
Partnership with students in designing feedback processes for large classes
PPT
Keynote sustainable feedback
PPT
Supporting the development of student feedback literacy
PPT
Integrating the development of student and staff feedback literacy
PDF
Feedback Pack Week 1 what is feedback literacy
PPT
Towards making feedback processes satisfying for teachers and useful for stud...
PPT
Designing feedback processes for large classes
PPT
Making sense of feedback
PPT
Students’ experiences of feedback
PPT
Effective feedback in medical education
PPT
Teacher feedback literacy, designing learning environments & prospects for ch...
PPT
Students generating and using feedback in online learning environments
PPT
Teacher feedback literacy & feedback designs for student learning
PPT
Feedback literacy for digital futures
PPT
Feedback requests in ELT and beyond
PPT
Developing staff & student feedback literacy
Developing feedback as dialogue
Promoting student engagement with feedback
Shared feedback literacy: Designing for productive feedback experiences
Learners seeking, generating and using feedback inputs: The role of student a...
Partnership with students in designing feedback processes for large classes
Keynote sustainable feedback
Supporting the development of student feedback literacy
Integrating the development of student and staff feedback literacy
Feedback Pack Week 1 what is feedback literacy
Towards making feedback processes satisfying for teachers and useful for stud...
Designing feedback processes for large classes
Making sense of feedback
Students’ experiences of feedback
Effective feedback in medical education
Teacher feedback literacy, designing learning environments & prospects for ch...
Students generating and using feedback in online learning environments
Teacher feedback literacy & feedback designs for student learning
Feedback literacy for digital futures
Feedback requests in ELT and beyond
Developing staff & student feedback literacy

More from David Carless (15)

PPTX
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
PPT
Assessment values & their enactment in the generative AI era
PPT
Learner feedback seeking: prospects and challenges
PPT
Assessment and feedback re-designs for the generative AI era
PPT
Feedback literacy for automated feedback
PPTX
The making of feedback literacy: a critical review of an emerging concept
PPT
New directions for feedback seeking research and practice
PPT
Improvement begins with I: The value of feedback literacy
PPT
Assessment and feedback for learning: Beyond closed book exams
PPT
Assessment for digital futures
PPT
Feedback literacy research and practice: state-of-the art and future directions
PPTX
Creating learning environments for self-generated feedback to thrive
PPT
Sustainable assessment & online learning environments
PPT
Feedback in online learning environments
PPT
Towards broader conceptions of feedback
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Assessment values & their enactment in the generative AI era
Learner feedback seeking: prospects and challenges
Assessment and feedback re-designs for the generative AI era
Feedback literacy for automated feedback
The making of feedback literacy: a critical review of an emerging concept
New directions for feedback seeking research and practice
Improvement begins with I: The value of feedback literacy
Assessment and feedback for learning: Beyond closed book exams
Assessment for digital futures
Feedback literacy research and practice: state-of-the art and future directions
Creating learning environments for self-generated feedback to thrive
Sustainable assessment & online learning environments
Feedback in online learning environments
Towards broader conceptions of feedback

Recently uploaded (20)

PDF
Complications of Minimal Access-Surgery.pdf
PDF
My India Quiz Book_20210205121199924.pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PPTX
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
PPTX
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
PDF
HVAC Specification 2024 according to central public works department
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
PPTX
Introduction to pro and eukaryotes and differences.pptx
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
advance database management system book.pdf
PDF
International_Financial_Reporting_Standa.pdf
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
DOCX
Cambridge-Practice-Tests-for-IELTS-12.docx
Complications of Minimal Access-Surgery.pdf
My India Quiz Book_20210205121199924.pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
Chinmaya Tiranga quiz Grand Finale.pdf
A powerpoint presentation on the Revised K-10 Science Shaping Paper
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
Environmental Education MCQ BD2EE - Share Source.pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
HVAC Specification 2024 according to central public works department
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
Introduction to pro and eukaryotes and differences.pptx
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
advance database management system book.pdf
International_Financial_Reporting_Standa.pdf
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
Cambridge-Practice-Tests-for-IELTS-12.docx

Feedback by design

  • 1. Feedback designs to promote dialogue David Carless University of Hong Kong December 14, 2015 Open University of Catalonia The University of Hong Kong
  • 2. Overview 1. The wider feedback picture 2. Principles of dialogic feedback 3. Online dialogic feedback 4. Issues & Implications The University of Hong Kong
  • 4. Bigger picture Feedback as assessment design issue Feedback as a pedagogical issue Feedback as a relational issue The University of Hong Kong
  • 5. The University of Hong Kong Productive assessment task design Understanding quality in the discipline Student engagement with feedback Learning-oriented assessment framework
  • 8. Merry, Price, Carless, & Taras (2013)
  • 9. What does ‘feedback’ mean? As dialogues around student work The University of Hong Kong As comments … Providing information about performance AND/ OR
  • 10. Defining feedback “A dialogic process in which learners make sense of information from varied sources and use it to enhance the quality of their work or learning strategies”. Carless (2015, p.192) building on Boud & Molloy (2013) The University of Hong Kong
  • 11. Closing feedback loops It’s only feedback if students take some action The University of Hong Kong
  • 12. FEEDBACK AS DIALOGUE The University of Hong Kong
  • 13. Dialogic feedback principles • Process rather than product • Prompting learner action • Peers as active source of feedback • Inner dialogue, internal feedback The University of Hong Kong
  • 14. Key aim of feedback To enhance student ability to self-monitor their work in progress The University of Hong Kong
  • 15. Dialogic feedback in practice 1. Teacher-facilitated dialogic feedback 2. Online dialogic feedback 3. Peer feedback and internal feedback (Nicol, 2010) The University of Hong Kong
  • 16. Assessment dialogues Discussing assessment processes to help students understand rules of the game (Carless, 2006) The University of Hong Kong
  • 17. Feedback designs Activities in which students make judgments The University of Hong Kong
  • 18. Exemplars & feedback Analysis of exemplars can support students in decoding teacher feedback (Handley & Williams 2011; To & Carless, 2015) The University of Hong Kong
  • 19. Guidance & feedback Integrated cycles of guidance & feedback within learning processes (Hounsell, 2007; Hounsell et al. 2008) The University of Hong Kong
  • 20. Model of guidance & feedback Preparatory Guidance -Clarifying task -Engaging with criteria -Analyzing exemplars Student self-monitoring -Seeking & using feedback -Peer review -Self-evaluation Ongoing clarification -Opportunities for practice -Apply criteria -Review work in progress
  • 21. Cumulative task designs • Task 1  feedback  interlinked task 2 • Position students as active feedback seekers & users The University of Hong Kong
  • 23. Learning Management Systems Storing and accessing feedback comments Prompting students to act on prior feedback (before receiving more feedback) The University of Hong Kong
  • 24. Use of Facebook More attractive to students than Moodle (Deng & Tavares, 2013) History students uploaded drafts & received peer feedback (Carless, 2015) The University of Hong Kong
  • 25. Assessed blog Business case: participation grade included blog contribution “Having a grading allocation … gives some life to the blog” (Carless, 2015, p. 124) Sense of cumulativeness vs stating own opinion The University of Hong Kong
  • 26. Non-assessed blog Involved current students, past students and practitioners in industry “Students will treasure feedback if it addresses their needs and interests” The University of Hong Kong
  • 27. Audio (& video) feedback Providing recorded verbal commentary (instead of written feedback?) The University of Hong Kong
  • 28. Audio feedback: pros • Viewed positively by students (Lunt & Curran, 2010) • Shows concern; permits nuanced feedback or detail (Savin-Baden, 2010) • May resemble a dialogue (Nicol, 2010) The University of Hong Kong
  • 29. Audio feedback: cons • ‘Moderate’ impact on student learning (Gould & Day, 2013) • Difficult in failure cases • Workload? (Hennessy & Forester, 2014) The University of Hong Kong
  • 30. STUDENT ROLE IN SEEKING, GENERATING & USING FEEDBACK The University of Hong Kong
  • 31. Peer feedback Potentially more plentiful … But peers often viewed as lacking expertise The University of Hong Kong
  • 32. Composing peer feedback Providing feedback more cognitively engaging than receiving feedback (e.g. Nicol et al., 2014) The University of Hong Kong
  • 33. Sustainable feedback Enhancing student role to generate & use feedback (Carless et al., 2011; Hounsell, 2007) The University of Hong Kong
  • 35. Confusion over purposes Student & staff confusions over purposes of feedback and what it can achieve (Price et al., 2010) The University of Hong Kong
  • 36. Workload Students (not staff) should work harder to generate and use feedback The University of Hong Kong
  • 37. Shifts in priorities The University of Hong Kong Increase Decrease In-class dialogic feedback within course time Unidirectional comments after course completion Written feedback comments on first assessment task of module Written feedback comments on final task of module Feedback for first year students Feedback for final year students
  • 38. Failing to connect Difficulties for lower achievers to make sense of feedback (Orsmond & Merry, 2013) The University of Hong Kong
  • 40. Feedback literacy Teachers need to help students understand purposes of feedback & how they can use it The University of Hong Kong
  • 41. Good feedback practice Integration of feedback & task design; Timely dialogues: online & peer feedback; Development of student self-regulation for sustainable feedback The University of Hong Kong
  • 42. THANK YOU The University of Hong Kong

Editor's Notes

  • #32: http://pixgood.com/2-students-talking.html
  • #33: http://i811.photobucket.com/albums/zz31/angelsofhope_picture/Kinder/r8w2fc.jpg