SlideShare a Scribd company logo
Designing satisfying feedback
experiences
@CarlessDavid
HKU, Faculty of Education
workshop
February 25, 2022
The University of Hong Kong
Overview
1. A modified teacher role in feedback
2. Designing satisfying feedback
3. Workload-friendly practices
4. Implications via six propositions
The University of Hong Kong
Key feedback challenges
End-loaded assessment
Too much unidirectional teacher feedback
Human nature: Emotions & affect
The University of Hong Kong
Student frustrations
Feedback often comes at the end, too late for
students to act …
… a perversely belated revelation of things that
should have been clear earlier (Crook et al. 2006)
The University of Hong Kong
I want
guidance
Differentiating feedback from grading/marking
End of module – mainly summative grading
VS
During module – potential for students to act
on guidance
(see also Winstone & Boud, 2020)
The University of Hong Kong
Deploy teacher workload wisely
Reduce teacher commentary at times when
it cannot be taken up (Boud & Molloy, 2013)
The University of Hong Kong
Feedback graveyards
The University of Hong Kong
Proposition 1
Reflect on the value of detailed end-of-
semester commentary & consider more
productive alternatives
The University of Hong Kong
RESEARCH EVIDENCE FROM HONG
KONG
The University of Hong Kong
Mismatched views
Teachers think their feedback is more useful
than their students do (Carless, 2006)
The University of Hong Kong
Feedback & teacher education
Talk more with students about feedback &
its role in learning
Model & share your own feedback
experiences & emotions
The University of Hong Kong
Proposition 2
Dedicate curriculum time to
communicate about feedback as a
concept; & discuss students’
expectations of feedback
The University of Hong Kong
Timing of critique
For students the Grade is the Feedback!
“I welcome critical feedback when I can use
it to improve my grade but critical feedback
at the end is no use” (student, Carless 2020)
The University of Hong Kong
Assessment & feedback sequences
Task 1  feedback  interlinked task 2
Position students as feedback users
The University of Hong Kong
DESIGNING SATISFYING
FEEDBACK EXPERIENCES
The University of Hong Kong
Satisfying feedback experiences
Making feedback satisfying for teachers is
just as important as making it worthwhile for
students (Boud & Molloy, 2013)
The University of Hong Kong
What students might want
For students, what would represent positive
outcomes of feedback processes?
The University of Hong Kong
Student desired outcomes
Support to achieve high grades
Feedback they can use
Perceptions of care, respect
Perceptions of fairness
The University of Hong Kong
Key challenges for change
Regulations & procedures inhibit agency in
feedback processes (Gravett 2020)
AND
How feedback is framed in QA encourages
delivery models (Winstone et al. 2021)
The University of Hong Kong
Multiple functions of ‘feedback’
Competing audiences & functions of teacher
comments:
- Justifying grade
- Offering advice
- Specific vs generic comments
- Quality assurance dimensions
(Winstone & Carless, 2021)
The University of Hong Kong
POTENTIAL WAYS FORWARD
The University of Hong Kong
Modified teacher role
Design learning environments for students
to generate feedback inputs
The University of Hong Kong
Proposition 3
Adopt a role as an orchestrator of
feedback opportunities, more than as a
provider of comments
The University of Hong Kong
Peer feedback key rationale
Comparing own work in progress with that of
several others
(Nicol, 2021)
The University of Hong Kong
PRACTICAL IMPLICATIONS
The University of Hong Kong
Shifts in priorities
Carless (2015) p. 240
The University of Hong Kong
Increase Decrease
Guidance within the taught
curriculum
Unidirectional comments at
end
Feedback comments on first
assessment task of module
Feedback comments on final
task of module
Feedback for first year
students
Feedback for final year
students
Proposition 4
Design guidance & clarification of
expectations during the module
The University of Hong Kong
Within module guidance
• Students co-creating or engaging with criteria
• Strategic use of exemplars
• Building capacities for self-assessment
• Oral feedback exchanges
• Effective digital communication
The University of Hong Kong
Begin a written dialogue
On their assignment (or draft), students
complete the following prompt:
“I would most like feedback on ….”
The University of Hong Kong
Proposition 5
Implement practical means of injecting
more dialogue into feedback
interactions
The University of Hong Kong
Drawing on previous feedback
“The previous feedback that I have used to
strengthen this assignment is ….”
The University of Hong Kong
Proposition 6
Design for student uptake of feedback
The University of Hong Kong
References
Boud, D., & Molloy, E. (2013). Decision-making for feedback. In D. Boud & E. Molloy (Eds.), Feedback in
Higher and Professional Education. London: Routledge.
Carless, D. (2006). Differing perceptions in the feedback process. Studies in Higher Education, 31(2),
219-233.
Carless, D. (2015). Excellence in University Assessment: Learning from award-winning practice. London:
Routledge.
Carless, D. (2020). A Longitudinal Inquiry into Students’ Experiences of Feedback: A Need for Teacher-
Student Partnerships. Higher Education Research and Development 39(3): 425-438.
Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback
literacy, Teaching in Higher Education. https://doi.org/10.1080/13562517.2020.1782372
Crook, C., Gross, H., & Dymott, R. (2006). Assessment relationships in higher education: The tension of
process and practice. British Educational Research Journal, 32(1), 95-114.
Nicol, D. (2021) The power of internal feedback: Exploiting natural comparison processes. Assessment &
Evaluation in Higher Education, 46(5), 756-778. https://doi.org/10.1080/02602938.2020.1823314
Winstone, N., Ajjawi, R., Dirkx, K., & Boud, D. (2021). Measuring what matters: The positioning of
students in feedback processes within national student satisfaction surveys. Studies in Higher
Education. doi:10.1080/03075079.2021.1916909
Winstone, N., & Boud, D. (2020). The need to disentangle assessment and feedback in higher education.
Studies in Higher Education. doi:10.1080/03075079.2020.1779687
Winstone, N., & Carless, D. (2021). Who is feedback for? The influence of accountability and quality
assurance agendas on the enactment of feedback processes. Assessment in Education, 28(3), 261-
278. doi:10.1080/0969594X.2021.1926221
The University of Hong Kong
THANK YOU
The University of Hong Kong
What staff might want
For staff, what would represent positive
outcomes of feedback processes?
The University of Hong Kong
Staff desired outcomes
Students engaging
Students taking responsibility
Students taking action
Workload friendly
The University of Hong Kong
https://www.dylanwiliamcenter.com/feedbac
k-for-learning-make-time-to-save-time/
The University of Hong Kong
“Feedback should
be more work for
the recipient than
the donor”
Towards virtuous cycles
Teachers designing potentially positive
feedback experiences for students
Students engaging and acting
The University of Hong Kong
Digital interaction
Prioritizing learner generation of insights
Designing for dialogue & uptake
The University of Hong Kong
Peer feedback key steps
1. Students draft attempt at divergent task;
2. Students review other attempts;
3. Peer feedback composed & received;
4. Opportunities to revise work.
The University of Hong Kong
Implementing peer feedback
• Scaffolding & coaching
• Selling benefits
• Modelling
• Multiple reviews e.g. trios
• Leveraging comparisons
• Opportunities for dialogue then revision
The University of Hong Kong
The University of Hong Kong
DISCOUNT CODE:
FLR40
The University of Hong Kong

More Related Content

PPT
19 Nov08 Student Engagement K Duffner
PPT
Shared feedback literacy: Designing for productive feedback experiences
PPT
The Student Experience of Feedback: Longitudinal perspectives
PPT
Researching Excellence in Assessment and Feedback
PPT
Towards productive teacher-student partnerships in feedback processes
PPT
Learning-oriented assessment in higher education
PPT
Developing feedback as dialogue
PPT
Assessment and feedback in large classes
19 Nov08 Student Engagement K Duffner
Shared feedback literacy: Designing for productive feedback experiences
The Student Experience of Feedback: Longitudinal perspectives
Researching Excellence in Assessment and Feedback
Towards productive teacher-student partnerships in feedback processes
Learning-oriented assessment in higher education
Developing feedback as dialogue
Assessment and feedback in large classes

What's hot (20)

PPT
Oct 21 Learning-oriented assessment
PPT
Teacher feedback literacy, designing learning environments & prospects for ch...
PPT
Sustainable assessment & online learning environments
PPT
Assessment Issues & Strategies
PPT
Assessment for digital futures
PPT
Assessment possibilities
PPT
Supporting the development of student feedback literacy
PPT
AHE Feedback Literacy
PPT
Developing staff and student feedback literacy in partnership
PPT
Improvement begins with I: The value of feedback literacy
PPT
Towards broader conceptions of feedback
PPT
Feedback for student learning as partnership between teachers and students
PPT
Feedback for the longer term: enhancing student feedback literacy
PPTX
Creating learning environments for self-generated feedback to thrive
PPT
Developing students' feedback through literacy
PPT
Developing staff & student feedback literacy
PPT
Assessment and feedback for learning: Beyond closed book exams
PPT
Integrating the development of student and staff feedback literacy
PPT
Teacher feedback literacy & feedback designs for student learning
PPT
Partnership with students in designing feedback processes for large classes
Oct 21 Learning-oriented assessment
Teacher feedback literacy, designing learning environments & prospects for ch...
Sustainable assessment & online learning environments
Assessment Issues & Strategies
Assessment for digital futures
Assessment possibilities
Supporting the development of student feedback literacy
AHE Feedback Literacy
Developing staff and student feedback literacy in partnership
Improvement begins with I: The value of feedback literacy
Towards broader conceptions of feedback
Feedback for student learning as partnership between teachers and students
Feedback for the longer term: enhancing student feedback literacy
Creating learning environments for self-generated feedback to thrive
Developing students' feedback through literacy
Developing staff & student feedback literacy
Assessment and feedback for learning: Beyond closed book exams
Integrating the development of student and staff feedback literacy
Teacher feedback literacy & feedback designs for student learning
Partnership with students in designing feedback processes for large classes
Ad

Similar to Designing satisfying feedback experiences (20)

PPT
Beyond teacher comments: Designing for student uptake of feedback
PPT
Learners seeking, generating and using feedback inputs: The role of student a...
PPT
Towards making feedback processes satisfying for teachers and useful for stud...
PPT
Supporting Students in Generating and Using Feedback
PPT
Designing feedback processes for large classes
PDF
Feedback Pack Week 1 what is feedback literacy
PPTX
Feedback Pack Week 1.pptx
PPT
Relieving feedback frustrations
PPT
Students generating and using feedback in online learning environments
PPT
Keynote sustainable feedback
PPT
Students’ experiences of feedback
PPT
Feedback literacy for digital futures
PPT
Feedback by design
PPT
Feedback literacy research and practice: state-of-the art and future directions
PPT
New directions for feedback seeking research and practice
PPT
Learner feedback seeking: prospects and challenges
PPT
Developing sustainable feedback
PPTX
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
PPT
Feedback requests in ELT and beyond
PPT
Feedback literacy as a key to ongoing improvement
Beyond teacher comments: Designing for student uptake of feedback
Learners seeking, generating and using feedback inputs: The role of student a...
Towards making feedback processes satisfying for teachers and useful for stud...
Supporting Students in Generating and Using Feedback
Designing feedback processes for large classes
Feedback Pack Week 1 what is feedback literacy
Feedback Pack Week 1.pptx
Relieving feedback frustrations
Students generating and using feedback in online learning environments
Keynote sustainable feedback
Students’ experiences of feedback
Feedback literacy for digital futures
Feedback by design
Feedback literacy research and practice: state-of-the art and future directions
New directions for feedback seeking research and practice
Learner feedback seeking: prospects and challenges
Developing sustainable feedback
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback requests in ELT and beyond
Feedback literacy as a key to ongoing improvement
Ad

More from David Carless (6)

PPT
Assessment values & their enactment in the generative AI era
PPT
Assessment and feedback re-designs for the generative AI era
PPT
Feedback literacy for automated feedback
PPTX
The making of feedback literacy: a critical review of an emerging concept
PPT
Feedback in online learning environments
PPT
Teaching for quality student learning
Assessment values & their enactment in the generative AI era
Assessment and feedback re-designs for the generative AI era
Feedback literacy for automated feedback
The making of feedback literacy: a critical review of an emerging concept
Feedback in online learning environments
Teaching for quality student learning

Recently uploaded (20)

PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PDF
advance database management system book.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
RMMM.pdf make it easy to upload and study
PDF
Trump Administration's workforce development strategy
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
PDF
A systematic review of self-coping strategies used by university students to ...
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PDF
Empowerment Technology for Senior High School Guide
PDF
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
PPTX
Lesson notes of climatology university.
PDF
Hazard Identification & Risk Assessment .pdf
PPTX
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
PPTX
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PPTX
History, Philosophy and sociology of education (1).pptx
Practical Manual AGRO-233 Principles and Practices of Natural Farming
advance database management system book.pdf
Weekly quiz Compilation Jan -July 25.pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
RMMM.pdf make it easy to upload and study
Trump Administration's workforce development strategy
Supply Chain Operations Speaking Notes -ICLT Program
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
A systematic review of self-coping strategies used by university students to ...
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
Empowerment Technology for Senior High School Guide
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
Lesson notes of climatology university.
Hazard Identification & Risk Assessment .pdf
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
History, Philosophy and sociology of education (1).pptx

Designing satisfying feedback experiences

  • 1. Designing satisfying feedback experiences @CarlessDavid HKU, Faculty of Education workshop February 25, 2022 The University of Hong Kong
  • 2. Overview 1. A modified teacher role in feedback 2. Designing satisfying feedback 3. Workload-friendly practices 4. Implications via six propositions The University of Hong Kong
  • 3. Key feedback challenges End-loaded assessment Too much unidirectional teacher feedback Human nature: Emotions & affect The University of Hong Kong
  • 4. Student frustrations Feedback often comes at the end, too late for students to act … … a perversely belated revelation of things that should have been clear earlier (Crook et al. 2006) The University of Hong Kong I want guidance
  • 5. Differentiating feedback from grading/marking End of module – mainly summative grading VS During module – potential for students to act on guidance (see also Winstone & Boud, 2020) The University of Hong Kong
  • 6. Deploy teacher workload wisely Reduce teacher commentary at times when it cannot be taken up (Boud & Molloy, 2013) The University of Hong Kong
  • 8. Proposition 1 Reflect on the value of detailed end-of- semester commentary & consider more productive alternatives The University of Hong Kong
  • 9. RESEARCH EVIDENCE FROM HONG KONG The University of Hong Kong
  • 10. Mismatched views Teachers think their feedback is more useful than their students do (Carless, 2006) The University of Hong Kong
  • 11. Feedback & teacher education Talk more with students about feedback & its role in learning Model & share your own feedback experiences & emotions The University of Hong Kong
  • 12. Proposition 2 Dedicate curriculum time to communicate about feedback as a concept; & discuss students’ expectations of feedback The University of Hong Kong
  • 13. Timing of critique For students the Grade is the Feedback! “I welcome critical feedback when I can use it to improve my grade but critical feedback at the end is no use” (student, Carless 2020) The University of Hong Kong
  • 14. Assessment & feedback sequences Task 1  feedback  interlinked task 2 Position students as feedback users The University of Hong Kong
  • 16. Satisfying feedback experiences Making feedback satisfying for teachers is just as important as making it worthwhile for students (Boud & Molloy, 2013) The University of Hong Kong
  • 17. What students might want For students, what would represent positive outcomes of feedback processes? The University of Hong Kong
  • 18. Student desired outcomes Support to achieve high grades Feedback they can use Perceptions of care, respect Perceptions of fairness The University of Hong Kong
  • 19. Key challenges for change Regulations & procedures inhibit agency in feedback processes (Gravett 2020) AND How feedback is framed in QA encourages delivery models (Winstone et al. 2021) The University of Hong Kong
  • 20. Multiple functions of ‘feedback’ Competing audiences & functions of teacher comments: - Justifying grade - Offering advice - Specific vs generic comments - Quality assurance dimensions (Winstone & Carless, 2021) The University of Hong Kong
  • 21. POTENTIAL WAYS FORWARD The University of Hong Kong
  • 22. Modified teacher role Design learning environments for students to generate feedback inputs The University of Hong Kong
  • 23. Proposition 3 Adopt a role as an orchestrator of feedback opportunities, more than as a provider of comments The University of Hong Kong
  • 24. Peer feedback key rationale Comparing own work in progress with that of several others (Nicol, 2021) The University of Hong Kong
  • 26. Shifts in priorities Carless (2015) p. 240 The University of Hong Kong Increase Decrease Guidance within the taught curriculum Unidirectional comments at end Feedback comments on first assessment task of module Feedback comments on final task of module Feedback for first year students Feedback for final year students
  • 27. Proposition 4 Design guidance & clarification of expectations during the module The University of Hong Kong
  • 28. Within module guidance • Students co-creating or engaging with criteria • Strategic use of exemplars • Building capacities for self-assessment • Oral feedback exchanges • Effective digital communication The University of Hong Kong
  • 29. Begin a written dialogue On their assignment (or draft), students complete the following prompt: “I would most like feedback on ….” The University of Hong Kong
  • 30. Proposition 5 Implement practical means of injecting more dialogue into feedback interactions The University of Hong Kong
  • 31. Drawing on previous feedback “The previous feedback that I have used to strengthen this assignment is ….” The University of Hong Kong
  • 32. Proposition 6 Design for student uptake of feedback The University of Hong Kong
  • 33. References Boud, D., & Molloy, E. (2013). Decision-making for feedback. In D. Boud & E. Molloy (Eds.), Feedback in Higher and Professional Education. London: Routledge. Carless, D. (2006). Differing perceptions in the feedback process. Studies in Higher Education, 31(2), 219-233. Carless, D. (2015). Excellence in University Assessment: Learning from award-winning practice. London: Routledge. Carless, D. (2020). A Longitudinal Inquiry into Students’ Experiences of Feedback: A Need for Teacher- Student Partnerships. Higher Education Research and Development 39(3): 425-438. Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback literacy, Teaching in Higher Education. https://doi.org/10.1080/13562517.2020.1782372 Crook, C., Gross, H., & Dymott, R. (2006). Assessment relationships in higher education: The tension of process and practice. British Educational Research Journal, 32(1), 95-114. Nicol, D. (2021) The power of internal feedback: Exploiting natural comparison processes. Assessment & Evaluation in Higher Education, 46(5), 756-778. https://doi.org/10.1080/02602938.2020.1823314 Winstone, N., Ajjawi, R., Dirkx, K., & Boud, D. (2021). Measuring what matters: The positioning of students in feedback processes within national student satisfaction surveys. Studies in Higher Education. doi:10.1080/03075079.2021.1916909 Winstone, N., & Boud, D. (2020). The need to disentangle assessment and feedback in higher education. Studies in Higher Education. doi:10.1080/03075079.2020.1779687 Winstone, N., & Carless, D. (2021). Who is feedback for? The influence of accountability and quality assurance agendas on the enactment of feedback processes. Assessment in Education, 28(3), 261- 278. doi:10.1080/0969594X.2021.1926221 The University of Hong Kong
  • 34. THANK YOU The University of Hong Kong
  • 35. What staff might want For staff, what would represent positive outcomes of feedback processes? The University of Hong Kong
  • 36. Staff desired outcomes Students engaging Students taking responsibility Students taking action Workload friendly The University of Hong Kong
  • 37. https://www.dylanwiliamcenter.com/feedbac k-for-learning-make-time-to-save-time/ The University of Hong Kong “Feedback should be more work for the recipient than the donor”
  • 38. Towards virtuous cycles Teachers designing potentially positive feedback experiences for students Students engaging and acting The University of Hong Kong
  • 39. Digital interaction Prioritizing learner generation of insights Designing for dialogue & uptake The University of Hong Kong
  • 40. Peer feedback key steps 1. Students draft attempt at divergent task; 2. Students review other attempts; 3. Peer feedback composed & received; 4. Opportunities to revise work. The University of Hong Kong
  • 41. Implementing peer feedback • Scaffolding & coaching • Selling benefits • Modelling • Multiple reviews e.g. trios • Leveraging comparisons • Opportunities for dialogue then revision The University of Hong Kong
  • 42. The University of Hong Kong DISCOUNT CODE: FLR40
  • 43. The University of Hong Kong