SlideShare a Scribd company logo
Towards broader
conceptions of feedback
Professor David Carless,
University of Hong Kong,
Hong Kong Association for Applied
Linguistics (HAAL),
November 7th 2019
The University of Hong Kong
Overview
1. Feedback in AL vs elsewhere
2. Activating students in feedback
3. Designing effective feedback processes
4. Challenges & Implications
The University of Hong Kong
CNEC Lee I Yao Memorial Secondary
School, Kwai Shing (1988-89)
The University of Hong Kong
Written corrective feedback
The University of Hong Kong
Icy Lee (2019)
The University of Hong Kong
Major problem
Students tend to be too passively positioned
in feedback processes
The University of Hong Kong
Key aim of feedback
To enhance student
ability to self-monitor
their work in
progress
The University of Hong Kong
Sustainable feedback
Students seeking, generating & using
feedback from peers & self as part of self-
regulated learning (Carless et al., 2011)
The University of Hong Kong
Information  action
(Winstone & Carless, 2019)
The University of Hong Kong
Social constructivist
Action on feedback is constructed through
learner agency & interaction (O’Donovan,
Rust & Price, 2016).
The University of Hong Kong
The University of Hong Kong
DISCOUNT CODE:
FLR40
Towards broader conceptions of feedback
The University of Hong Kong
Designing effective
feedback processes
The University of Hong Kong
Chapter 2
Chapter 9 Chapter 3
Chapter 4
Chapter 5
Chapter 6
Chapter 7
Chapter 8
Designing effective
feedback processes
Each chapter
• Synthesis of key literature
• Two key examples from literature
• A case study based on interview data
The University of Hong Kong
CHAPTER 8
IMPLEMENTING PEER
FEEDBACK
The University of Hong Kong
The University of Hong Kong
Defining peer feedback (PF)
“A communication process through which
learners enter into dialogues related to
performance & standards” (Liu & Carless,
2006, p. 280)
Also peer response (Liu & Hansen, 2002)
Peer review (Harland et al., 2017)
The University of Hong Kong
Main challenges
• Students don’t take it seriously
• Poor quality PF
• Students prefer teacher feedback
• Classmates may steal ideas
The University of Hong Kong
Composing peer feedback
Providing feedback more cognitively engaging
than receiving feedback (e.g. Nicol et al., 2014)
The University of Hong Kong
The University of Hong Kong
To give is better than to receive
Students taught to give PF, improved writing
more than students taught to use PF
Explanation: You review in your own ZPD
but may not receive in your ZPD
(Lundstrom & Baker, 2009)
The University of Hong Kong
Cumulative peer feedback
Need for multiple cumulative experiences of
peer review during a programme
(Harland et al., 2017).
Year 1
Year 2
Year 3
Professor Hui-Tzu Min,
National Cheng Kung University, Taiwan
The University of Hong Kong
Training for PF
Used sample essay to model feedback
Implemented two cycles of PF
Coached students in improving PF
(see also Min, 2006)
The University of Hong Kong
4 step training procedure
Peer feedback as:
1. Clarifying the writer’s intention
2. Identifying potential problems
3. Explaining the nature of the problems
4. Making specific suggestions
The University of Hong Kong
Design features
Student writing: same genre, different topics
Randomly assigned trios
Written feedback + oral dialogue
The University of Hong Kong
Positive outcomes
Students appreciated & used peer feedback
Students got better at giving peer feedback
Lower achievers benefitted significantly
(Winstone & Carless, 2019, chapter 8)
The University of Hong Kong
COMMENTS OR QUESTIONS
RELATED TO PEER FEEDBACK
The University of Hong Kong
ENABLING DIALOGUE IN
FEEDBACK PROCESSES
(CHAPTER 6)
The University of Hong Kong
Dialogic feedback
Feedback needs to generate practical forms
of dialogue
The University of Hong Kong
The University of Hong Kong
Interactive coversheet (Chapter 6)
Invite students to state what feedback they
want (Bloxham & Campbell, 2010)
Variation 1
Students complete the following prompt:
“I would most like feedback on ….”
The University of Hong Kong
Variation 2
“The previous feedback that I have used to
strengthen this assignment is ….”
(Barton et al. 2016)
The University of Hong Kong
ELT Variation A
Students complete the following prompt:
“The grammar item I would like to receive
focused corrective feedback on is …”
The University of Hong Kong
ELT Variation B
“I would most like to receive feedback on”
(choose one):
grammar accuracy;
content and ideas;
other (pls specify)
The University of Hong Kong
TEACHER & STUDENT
FEEDBACK LITERACY
The University of Hong Kong
Feedback literacy
Know-how about how to maximise the
benefits of feedback processes
The University of Hong Kong
Shared responsibilities
Shared responsibilities in designing & acting
on feedback (Nash & Winstone, 2017)
The University of Hong Kong
Towards broader conceptions of feedback
Student feedback literacy
The University of Hong Kong
Making
Judgments
Appreciating
Feedback
Managing
Affect
Taking Action
(Carless & Boud, 2018)
Conclusion
The University of Hong Kong
Broader conceptions of feedback
Beyond teacher telling to highlight:
• Peer feedback
• Student self-evaluation
• Student feedback seeking
• Dialogic interaction
The University of Hong Kong
Recommendations
Minimise teacher telling
Focus on students’ needs & interests
Involve students actively
Mutual development of feedback literacy
The University of Hong Kong
References
Barton, K. L., Schofield, S. J., McAleer, S., & Ajjawi, R. (2016). Translating evidence-based guidelines to improve
feedback practices: The interact case study. BMC Medical Education, 16(1). doi:10.1186/s12909-016-0562-z
Bloxham, S. & Campbell. L. (2010). Generating dialogue in assessment feedback: Exploring the use of interactive cover
sheets. Assessment & Evaluation in Higher Education, 35(3), 291-300.
Carless, D. & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback.
Assessment & Evaluation in Higher Education https://doi.org/10.1080/02602938.2018.1463354
Carless, D., Salter, D., Yang, M. & Lam, J. (2011). Developing sustainable feedback practices. Studies in Higher
Education, 36(4), 395-407.
Harland, T., Wald, N., & Randhawa, H. (2017). Student peer review: Enhancing formative feedback with a rebuttal.
Assessment & Evaluation in Higher Education, 42(5), 801-811.
Liu, J., & Hansen, J. G. (2002). Peer response in second language writing classrooms. Michigan: University of Michigan
Press.
Lundstrom, K., & Baker, K. (2009). To give is better than to receive: The benefits of peer review to the reviewer’s own
writing. Journal of Second Language Writing, 18(1), 30-43.
Min, H.-T. (2006). The Effects of Trained Peer Review on EFL Students’ Revision Types and Writing Quality. Journal of
Second Language Writing 15 (2): 118-141.
Nash, R., & Winstone, N. (2017). Responsibility-sharing in the giving and receiving of assessment feedback. Frontiers
in Psychology, 8, 1519. https://doi.org/10.3389/fpsyg.2017.01519
Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review
perspective. Assessment & Evaluation in Higher Education, 39(1), 102-122.
O’Donovan, B., Rust, C., & Price, M. (2016). A scholarly approach to solving the feedback dilemma in practice.
Assessment & Evaluation in Higher Education, 41(6), 938–949.
The University of Hong Kong
QUESTIONS
COMMENTS
The University of Hong Kong
Towards broader conceptions of feedback
Key Rationales for PF
Involve students in dialogue
around the quality of work
Inform student self-evaluation
Potentially timely &
sustainable
The University of Hong Kong
The University of Hong Kong
Peer feedback trios
Peer feedback trios facilitate composing and
receiving more than one peer review
(van den Berg, Admiraal & Pilot, 2006)
The University of Hong Kong
Grading peer feedback
Grading student peer reviews enhances
student motivation & accountability
The University of Hong Kong
ICS Variation
1. The strengths are …
2. The aspects for development are …
3. I would like feedback on …
The University of Hong Kong
The University of Hong Kong

More Related Content

PPT
Feedback literacy for digital futures
PPT
Assessment for digital futures
PPT
Feedback for student learning as partnership between teachers and students
PPT
Teacher feedback literacy, designing learning environments & prospects for ch...
PPT
Assessment and feedback in large classes
PPT
AHE Feedback Literacy
PPT
Sustainable assessment & online learning environments
PPT
Integrating the development of student and staff feedback literacy
Feedback literacy for digital futures
Assessment for digital futures
Feedback for student learning as partnership between teachers and students
Teacher feedback literacy, designing learning environments & prospects for ch...
Assessment and feedback in large classes
AHE Feedback Literacy
Sustainable assessment & online learning environments
Integrating the development of student and staff feedback literacy

What's hot (20)

PPTX
Creating learning environments for self-generated feedback to thrive
PPT
Assessment and feedback for learning: Beyond closed book exams
PPT
Assessment possibilities
PPT
Partnership with students in designing feedback processes for large classes
PPT
Feedback for the longer term: enhancing student feedback literacy
PPT
Developing students' feedback through literacy
PPT
Promoting student engagement with feedback
PPT
Feedback literacy research and practice: state-of-the art and future directions
PPT
Teacher feedback literacy & feedback designs for student learning
PPT
Researching Excellence in Assessment and Feedback
PPT
Feedback literacy as a key to ongoing improvement
PPT
Feedback in online learning environments
PPT
Towards productive teacher-student partnerships in feedback processes
PPTX
Effective learning-oriented assessment: Developing student feedback literacy
PPT
Developing staff & student feedback literacy
PPT
Oct 21 Learning-oriented assessment
PPT
Shared feedback literacy: Designing for productive feedback experiences
PPT
Improvement begins with I: The value of feedback literacy
PPT
Supporting the development of student feedback literacy
PPT
Students generating and using feedback in online learning environments
Creating learning environments for self-generated feedback to thrive
Assessment and feedback for learning: Beyond closed book exams
Assessment possibilities
Partnership with students in designing feedback processes for large classes
Feedback for the longer term: enhancing student feedback literacy
Developing students' feedback through literacy
Promoting student engagement with feedback
Feedback literacy research and practice: state-of-the art and future directions
Teacher feedback literacy & feedback designs for student learning
Researching Excellence in Assessment and Feedback
Feedback literacy as a key to ongoing improvement
Feedback in online learning environments
Towards productive teacher-student partnerships in feedback processes
Effective learning-oriented assessment: Developing student feedback literacy
Developing staff & student feedback literacy
Oct 21 Learning-oriented assessment
Shared feedback literacy: Designing for productive feedback experiences
Improvement begins with I: The value of feedback literacy
Supporting the development of student feedback literacy
Students generating and using feedback in online learning environments
Ad

Similar to Towards broader conceptions of feedback (20)

PPT
HKBU Peer Feedback May 2017
PPT
Implementing Peer Feedback
PPT
Implementing peer feedback
PPT
Peer feedback dialogues
PPT
Collaborative assessment
PPT
Designing for student uptake of feedback in EAP
PPT
Supporting Students in Generating and Using Feedback
PPT
Developing feedback as dialogue
PPT
Developing sustainable feedback
PPT
Beyond teacher comments: Designing for student uptake of feedback
PPT
Keynote sustainable feedback
PPT
Towards making feedback processes satisfying for teachers and useful for stud...
PDF
Feedback Pack Week 1 what is feedback literacy
PPT
Developing staff and student feedback literacy in partnership
PPT
The Student Experience of Feedback: Longitudinal perspectives
PPT
New directions for feedback seeking research and practice
PPT
Students’ experiences of feedback
PPT
Learner agency, feedback and learning analytics
PPT
Designing feedback processes for large classes
PPT
Feedback requests in ELT and beyond
HKBU Peer Feedback May 2017
Implementing Peer Feedback
Implementing peer feedback
Peer feedback dialogues
Collaborative assessment
Designing for student uptake of feedback in EAP
Supporting Students in Generating and Using Feedback
Developing feedback as dialogue
Developing sustainable feedback
Beyond teacher comments: Designing for student uptake of feedback
Keynote sustainable feedback
Towards making feedback processes satisfying for teachers and useful for stud...
Feedback Pack Week 1 what is feedback literacy
Developing staff and student feedback literacy in partnership
The Student Experience of Feedback: Longitudinal perspectives
New directions for feedback seeking research and practice
Students’ experiences of feedback
Learner agency, feedback and learning analytics
Designing feedback processes for large classes
Feedback requests in ELT and beyond
Ad

More from David Carless (9)

PPTX
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
PPT
Assessment values & their enactment in the generative AI era
PPT
Learner feedback seeking: prospects and challenges
PPT
Assessment and feedback re-designs for the generative AI era
PPT
Feedback literacy for automated feedback
PPTX
The making of feedback literacy: a critical review of an emerging concept
PPT
Learners seeking, generating and using feedback inputs: The role of student a...
PPT
Designing satisfying feedback experiences
PPT
Teaching for quality student learning
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Assessment values & their enactment in the generative AI era
Learner feedback seeking: prospects and challenges
Assessment and feedback re-designs for the generative AI era
Feedback literacy for automated feedback
The making of feedback literacy: a critical review of an emerging concept
Learners seeking, generating and using feedback inputs: The role of student a...
Designing satisfying feedback experiences
Teaching for quality student learning

Recently uploaded (20)

PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Anesthesia in Laparoscopic Surgery in India
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PPTX
Lesson notes of climatology university.
PPTX
Cell Types and Its function , kingdom of life
PPTX
GDM (1) (1).pptx small presentation for students
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
O7-L3 Supply Chain Operations - ICLT Program
PPTX
Pharma ospi slides which help in ospi learning
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Classroom Observation Tools for Teachers
2.FourierTransform-ShortQuestionswithAnswers.pdf
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Anesthesia in Laparoscopic Surgery in India
Final Presentation General Medicine 03-08-2024.pptx
human mycosis Human fungal infections are called human mycosis..pptx
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Lesson notes of climatology university.
Cell Types and Its function , kingdom of life
GDM (1) (1).pptx small presentation for students
Supply Chain Operations Speaking Notes -ICLT Program
O7-L3 Supply Chain Operations - ICLT Program
Pharma ospi slides which help in ospi learning
O5-L3 Freight Transport Ops (International) V1.pdf
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
102 student loan defaulters named and shamed – Is someone you know on the list?
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
Final Presentation General Medicine 03-08-2024.pptx
Microbial diseases, their pathogenesis and prophylaxis
Classroom Observation Tools for Teachers

Towards broader conceptions of feedback

  • 1. Towards broader conceptions of feedback Professor David Carless, University of Hong Kong, Hong Kong Association for Applied Linguistics (HAAL), November 7th 2019 The University of Hong Kong
  • 2. Overview 1. Feedback in AL vs elsewhere 2. Activating students in feedback 3. Designing effective feedback processes 4. Challenges & Implications The University of Hong Kong
  • 3. CNEC Lee I Yao Memorial Secondary School, Kwai Shing (1988-89) The University of Hong Kong
  • 4. Written corrective feedback The University of Hong Kong
  • 5. Icy Lee (2019) The University of Hong Kong
  • 6. Major problem Students tend to be too passively positioned in feedback processes The University of Hong Kong
  • 7. Key aim of feedback To enhance student ability to self-monitor their work in progress The University of Hong Kong
  • 8. Sustainable feedback Students seeking, generating & using feedback from peers & self as part of self- regulated learning (Carless et al., 2011) The University of Hong Kong
  • 9. Information  action (Winstone & Carless, 2019) The University of Hong Kong
  • 10. Social constructivist Action on feedback is constructed through learner agency & interaction (O’Donovan, Rust & Price, 2016). The University of Hong Kong
  • 11. The University of Hong Kong DISCOUNT CODE: FLR40
  • 13. The University of Hong Kong
  • 14. Designing effective feedback processes The University of Hong Kong Chapter 2 Chapter 9 Chapter 3 Chapter 4 Chapter 5 Chapter 6 Chapter 7 Chapter 8 Designing effective feedback processes
  • 15. Each chapter • Synthesis of key literature • Two key examples from literature • A case study based on interview data The University of Hong Kong
  • 16. CHAPTER 8 IMPLEMENTING PEER FEEDBACK The University of Hong Kong
  • 17. The University of Hong Kong
  • 18. Defining peer feedback (PF) “A communication process through which learners enter into dialogues related to performance & standards” (Liu & Carless, 2006, p. 280) Also peer response (Liu & Hansen, 2002) Peer review (Harland et al., 2017) The University of Hong Kong
  • 19. Main challenges • Students don’t take it seriously • Poor quality PF • Students prefer teacher feedback • Classmates may steal ideas The University of Hong Kong
  • 20. Composing peer feedback Providing feedback more cognitively engaging than receiving feedback (e.g. Nicol et al., 2014) The University of Hong Kong
  • 21. The University of Hong Kong
  • 22. To give is better than to receive Students taught to give PF, improved writing more than students taught to use PF Explanation: You review in your own ZPD but may not receive in your ZPD (Lundstrom & Baker, 2009) The University of Hong Kong
  • 23. Cumulative peer feedback Need for multiple cumulative experiences of peer review during a programme (Harland et al., 2017). Year 1 Year 2 Year 3
  • 24. Professor Hui-Tzu Min, National Cheng Kung University, Taiwan The University of Hong Kong
  • 25. Training for PF Used sample essay to model feedback Implemented two cycles of PF Coached students in improving PF (see also Min, 2006) The University of Hong Kong
  • 26. 4 step training procedure Peer feedback as: 1. Clarifying the writer’s intention 2. Identifying potential problems 3. Explaining the nature of the problems 4. Making specific suggestions The University of Hong Kong
  • 27. Design features Student writing: same genre, different topics Randomly assigned trios Written feedback + oral dialogue The University of Hong Kong
  • 28. Positive outcomes Students appreciated & used peer feedback Students got better at giving peer feedback Lower achievers benefitted significantly (Winstone & Carless, 2019, chapter 8) The University of Hong Kong
  • 29. COMMENTS OR QUESTIONS RELATED TO PEER FEEDBACK The University of Hong Kong
  • 30. ENABLING DIALOGUE IN FEEDBACK PROCESSES (CHAPTER 6) The University of Hong Kong
  • 31. Dialogic feedback Feedback needs to generate practical forms of dialogue The University of Hong Kong
  • 32. The University of Hong Kong Interactive coversheet (Chapter 6) Invite students to state what feedback they want (Bloxham & Campbell, 2010)
  • 33. Variation 1 Students complete the following prompt: “I would most like feedback on ….” The University of Hong Kong
  • 34. Variation 2 “The previous feedback that I have used to strengthen this assignment is ….” (Barton et al. 2016) The University of Hong Kong
  • 35. ELT Variation A Students complete the following prompt: “The grammar item I would like to receive focused corrective feedback on is …” The University of Hong Kong
  • 36. ELT Variation B “I would most like to receive feedback on” (choose one): grammar accuracy; content and ideas; other (pls specify) The University of Hong Kong
  • 37. TEACHER & STUDENT FEEDBACK LITERACY The University of Hong Kong
  • 38. Feedback literacy Know-how about how to maximise the benefits of feedback processes The University of Hong Kong
  • 39. Shared responsibilities Shared responsibilities in designing & acting on feedback (Nash & Winstone, 2017) The University of Hong Kong
  • 41. Student feedback literacy The University of Hong Kong Making Judgments Appreciating Feedback Managing Affect Taking Action (Carless & Boud, 2018)
  • 43. Broader conceptions of feedback Beyond teacher telling to highlight: • Peer feedback • Student self-evaluation • Student feedback seeking • Dialogic interaction The University of Hong Kong
  • 44. Recommendations Minimise teacher telling Focus on students’ needs & interests Involve students actively Mutual development of feedback literacy The University of Hong Kong
  • 45. References Barton, K. L., Schofield, S. J., McAleer, S., & Ajjawi, R. (2016). Translating evidence-based guidelines to improve feedback practices: The interact case study. BMC Medical Education, 16(1). doi:10.1186/s12909-016-0562-z Bloxham, S. & Campbell. L. (2010). Generating dialogue in assessment feedback: Exploring the use of interactive cover sheets. Assessment & Evaluation in Higher Education, 35(3), 291-300. Carless, D. & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education https://doi.org/10.1080/02602938.2018.1463354 Carless, D., Salter, D., Yang, M. & Lam, J. (2011). Developing sustainable feedback practices. Studies in Higher Education, 36(4), 395-407. Harland, T., Wald, N., & Randhawa, H. (2017). Student peer review: Enhancing formative feedback with a rebuttal. Assessment & Evaluation in Higher Education, 42(5), 801-811. Liu, J., & Hansen, J. G. (2002). Peer response in second language writing classrooms. Michigan: University of Michigan Press. Lundstrom, K., & Baker, K. (2009). To give is better than to receive: The benefits of peer review to the reviewer’s own writing. Journal of Second Language Writing, 18(1), 30-43. Min, H.-T. (2006). The Effects of Trained Peer Review on EFL Students’ Revision Types and Writing Quality. Journal of Second Language Writing 15 (2): 118-141. Nash, R., & Winstone, N. (2017). Responsibility-sharing in the giving and receiving of assessment feedback. Frontiers in Psychology, 8, 1519. https://doi.org/10.3389/fpsyg.2017.01519 Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102-122. O’Donovan, B., Rust, C., & Price, M. (2016). A scholarly approach to solving the feedback dilemma in practice. Assessment & Evaluation in Higher Education, 41(6), 938–949. The University of Hong Kong
  • 48. Key Rationales for PF Involve students in dialogue around the quality of work Inform student self-evaluation Potentially timely & sustainable The University of Hong Kong
  • 49. The University of Hong Kong
  • 50. Peer feedback trios Peer feedback trios facilitate composing and receiving more than one peer review (van den Berg, Admiraal & Pilot, 2006) The University of Hong Kong
  • 51. Grading peer feedback Grading student peer reviews enhances student motivation & accountability The University of Hong Kong
  • 52. ICS Variation 1. The strengths are … 2. The aspects for development are … 3. I would like feedback on … The University of Hong Kong
  • 53. The University of Hong Kong

Editor's Notes

  • #21: http://i811.photobucket.com/albums/zz31/angelsofhope_picture/Kinder/r8w2fc.jpg