SlideShare a Scribd company logo
Assessment Issues &
Strategies
David Carless
University of Hong Kong
Presentation at Hong Kong Shue
Yan University, March 26, 2018
The University of Hong Kong
Overview
1. Learning-oriented assessment
2. Good assessment designs
3. Barriers & challenges
4. Conclusions & implications
The University of Hong Kong
What comes to mind when you
think of “assessment”?
The University of Hong Kong
Competing assessment functions
The University of Hong Kong
Learning-oriented assessment
 To alleviate
competing priorities
The University of Hong Kong
 circumnavigate
formative/summative divides
and
A focus on student learning
 By prioritizing student learning as a key aim of
all assessment
The University of Hong Kong
The University of Hong Kong
Productive assessment
task design
Development of student self-
evaluative capacities
Student engagement
with feedback
Learning-oriented assessment framework
(Carless, 2015)
Assessment Issues & Strategies
The University of Hong Kong
HISTORY
EXAMPLE
History Assessment
Fieldwork report (30%): Museum visit
Individual project (40%): draft 10%, final 30%
Participation (30%):
tutorial participation 15%
short weekly written responses 15%
(cf. Carless & Zhou, 2015)
The University of Hong Kong
Museum report
1000 words or podcast
Issues: key messages; use of space;
coverage and omissions
The University of Hong Kong
Sample Project
Walking tour of sites of Hong Kong identity
The University of Hong Kong
Project stages
• Topic brief
• Draft (10%)
• Final version (30%)
The University of Hong Kong
Use of Social Media
Students could upload drafts of work in
progress & receive peer feedback
The University of Hong Kong
The University of Hong Kong
LAW EXAMPLE
Tort Law
• Core 1st
year course: 180+ students
The University of Hong Kong
Tort Law Assessment
Reflective Media Diary (20%)
1st
sem test (20%)
Final Exam (60%)
[or 40% + 20% research essay]
The University of Hong Kong
Reflective Media Diary (RMD)
• Identify tort-related events; track
developments; provide legal analysis;
• Portfolio-style: collecting, selecting &
editing material over time.
The University of Hong Kong
RMD features
Steady student engagement
Promotes reading habits
Incomplete, authentic problems
Workload friendly for teachers
The University of Hong Kong
Use of exemplars
Sharing of samples to illustrate expectations
The University of Hong Kong
Same-day exam feedback
Discussion immediately after exam
The University of Hong Kong
Exam debriefing
Supplemented by online discussion
Novel angles added to marking scheme
The University of Hong Kong
TASK DESIGN
PRINCIPLES
The University of Hong Kong
(1) Integrated with instruction and ILOs
The University of Hong Kong
Constructive
alignment
(2) Spreads student effort
The University of Hong Kong
(3) Mirrors real-life uses of the discipline
The University of Hong Kong
(4) Integrated and coherent
The University of Hong Kong
(5) Incorporates feedback dialogues
The University of Hong Kong
(6) Supports students in appreciating quality
The University of Hong Kong
(7) Flexibility & choice
The University of Hong Kong
(8) Encourages deep approaches to
learning
The University of Hong Kong
Summary of principles
1. Alignment
2. Spreading effort
3. Authenticity
4. Integrated/coherent
5. Feedback designs
6. Developing student connoisseurship
7. Flexibility or choice
8. Deep approaches to learning
The University of Hong Kong
Issues & Challenges
The University of Hong Kong
Double duty (Boud, 2000)
Competing priorities in
assessment
Reliability, Fairness,
Workload, QA etc
The University of Hong Kong
Marking & Grading
End of semester grading involves:
-Awarding a grade
-Justifying the grade
-Providing specific comments
-Providing generic comments
-Reciprocity
The University of Hong Kong
Staff frustrations
• Heavy marking load
• Students don’t collect feedback
• Students mainly interested in the grade
• Students lack motivation to act
…..
The University of Hong Kong
Student frustrations
Feedback often seems like a perversely belated
revelation of things that should have been made
clear earlier (Crook, Gross & Dymott, 2006)
The University of Hong Kong
Suggested shifts in priorities
The University of Hong Kong
Increase Decrease
In-class dialogic feedback within
module time
Unidirectional comments after
completion of module
Written feedback comments on
first assessment task of module
Written feedback comments on
final task of module
Feedback for first year students Feedback for final year students
Trust or distrust?
Distrust as barrier for assessment change
(Carless, 2009)
The University of Hong Kong
Teacher autonomy?
Many teachers lack autonomy: pulled in
different directions by competing priorities
(James, 2014)
The University of Hong Kong
CONCLUSION
The University of Hong Kong
Communication about assessment
Rationales
The University of Hong Kong
Potential benefits
Processes
Tackling challenges
Teacher X factor
Teacher determination to overcome barriers
& strive for learning-oriented assessment
The University of Hong Kong
References
Boud, D. (2000). Sustainable assessment: Rethinking assessment for the
learning society. Studies in Continuing Education, 22(2), 151-167.
Carless, D. (2009). Trust, distrust and their impact on assessment reform.
Assessment and Evaluation in Higher Education, 34(1), 79-89.
Carless, D. (2015). Exploring learning-oriented assessment processes. Higher
Education, 69(6), 963-976.
Carless, D. & J. Zhou (2015). Starting small in assessment change: Short in-
class written responses. Assessment and Evaluation in Higher Education,
41(7), 1114-1127
Crook, C., Gross, H. & Dymott, R. (2006). Assessment relationships in higher
education: The tension of process and practice. British Educational
Research Journal, 32(1), 95-114.
James, D. (2014). Investigating the curriculum through assessment practice in
higher education: The value of a ‘learning cultures’ approach. Higher
Education, 67(2), 155-169.
The University of Hong Kong
THANK YOU
The University of Hong Kong

More Related Content

PPTX
Effective Assessment and feedback designs
PPT
Towards productive teacher-student partnerships in feedback processes
PPT
Technology-facilitated feedback processes
PPT
Researching Excellence in Assessment and Feedback
PPT
Improvement begins with I: The value of feedback literacy
PPTX
Students' responses to learning oriented assessment
PPT
Assessment possibilities
PPT
Oct 21 Learning-oriented assessment
Effective Assessment and feedback designs
Towards productive teacher-student partnerships in feedback processes
Technology-facilitated feedback processes
Researching Excellence in Assessment and Feedback
Improvement begins with I: The value of feedback literacy
Students' responses to learning oriented assessment
Assessment possibilities
Oct 21 Learning-oriented assessment

What's hot (20)

PPT
Feedback for the longer term: enhancing student feedback literacy
PPT
Assessment and feedback in large classes
PPT
Shared feedback literacy: Designing for productive feedback experiences
PPT
Learning-oriented assessment in higher education
PPT
Learning from the assessment practices of award-winning teachers
PPT
Learning-oriented assessment
PPT
Integrating the development of student and staff feedback literacy
PPT
Teacher feedback literacy, designing learning environments & prospects for ch...
PPT
Feedback requests in ELT and beyond
PPT
Designing satisfying feedback experiences
PPT
AHE Feedback Literacy
PPT
Assessment for digital futures
PPT
Towards broader conceptions of feedback
PPT
Feedback literacy for digital futures
PPT
The Student Experience of Feedback: Longitudinal perspectives
PPT
Supporting Students in Generating and Using Feedback
PPT
Beyond teacher comments: Designing for student uptake of feedback
PPT
Sustainable assessment & online learning environments
PPT
Feedback for student learning as partnership between teachers and students
PPT
Scaling up assessment for learning
Feedback for the longer term: enhancing student feedback literacy
Assessment and feedback in large classes
Shared feedback literacy: Designing for productive feedback experiences
Learning-oriented assessment in higher education
Learning from the assessment practices of award-winning teachers
Learning-oriented assessment
Integrating the development of student and staff feedback literacy
Teacher feedback literacy, designing learning environments & prospects for ch...
Feedback requests in ELT and beyond
Designing satisfying feedback experiences
AHE Feedback Literacy
Assessment for digital futures
Towards broader conceptions of feedback
Feedback literacy for digital futures
The Student Experience of Feedback: Longitudinal perspectives
Supporting Students in Generating and Using Feedback
Beyond teacher comments: Designing for student uptake of feedback
Sustainable assessment & online learning environments
Feedback for student learning as partnership between teachers and students
Scaling up assessment for learning
Ad

Similar to Assessment Issues & Strategies (20)

PPTX
Effective learning-oriented assessment: Developing student feedback literacy
PPT
Authentic assessment
PPT
Effective Assessment Designs
PPT
Designing effective assessment
PPT
Mission impossible?
PPT
Teaching for quality student learning
PPTX
Assessment for student learning
PPT
Assessment and feedback for learning: Beyond closed book exams
PPT
Excellence in University Assessment
PPT
Developing sustainable feedback
PPT
Assessment values & their enactment in the generative AI era
PPT
Technology-enabled learning-oriented assessment
PPT
Relieving feedback frustrations
PPTX
Short written responses
PPT
Assessment in HE: Beginning teach in HE
PPT
Developing feedback as dialogue
PPT
Keynote sustainable feedback
PPT
Scaling up Assessment for Learning
PPT
CITERS Keynote
PPT
Learner agency, feedback and learning analytics
Effective learning-oriented assessment: Developing student feedback literacy
Authentic assessment
Effective Assessment Designs
Designing effective assessment
Mission impossible?
Teaching for quality student learning
Assessment for student learning
Assessment and feedback for learning: Beyond closed book exams
Excellence in University Assessment
Developing sustainable feedback
Assessment values & their enactment in the generative AI era
Technology-enabled learning-oriented assessment
Relieving feedback frustrations
Short written responses
Assessment in HE: Beginning teach in HE
Developing feedback as dialogue
Keynote sustainable feedback
Scaling up Assessment for Learning
CITERS Keynote
Learner agency, feedback and learning analytics
Ad

More from David Carless (16)

PPTX
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
PPT
Learner feedback seeking: prospects and challenges
PPT
Assessment and feedback re-designs for the generative AI era
PPT
Feedback literacy for automated feedback
PPT
Towards making feedback processes satisfying for teachers and useful for stud...
PPTX
The making of feedback literacy: a critical review of an emerging concept
PPT
New directions for feedback seeking research and practice
PPT
Learners seeking, generating and using feedback inputs: The role of student a...
PPT
Supporting the development of student feedback literacy
PPT
Feedback literacy research and practice: state-of-the art and future directions
PPT
Teacher feedback literacy & feedback designs for student learning
PPT
Developing staff & student feedback literacy
PPTX
Creating learning environments for self-generated feedback to thrive
PPT
Students generating and using feedback in online learning environments
PPT
Feedback in online learning environments
PPT
Partnership with students in designing feedback processes for large classes
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Learner feedback seeking: prospects and challenges
Assessment and feedback re-designs for the generative AI era
Feedback literacy for automated feedback
Towards making feedback processes satisfying for teachers and useful for stud...
The making of feedback literacy: a critical review of an emerging concept
New directions for feedback seeking research and practice
Learners seeking, generating and using feedback inputs: The role of student a...
Supporting the development of student feedback literacy
Feedback literacy research and practice: state-of-the art and future directions
Teacher feedback literacy & feedback designs for student learning
Developing staff & student feedback literacy
Creating learning environments for self-generated feedback to thrive
Students generating and using feedback in online learning environments
Feedback in online learning environments
Partnership with students in designing feedback processes for large classes

Recently uploaded (20)

PPTX
Introduction to Building Materials
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
PPTX
Computer Architecture Input Output Memory.pptx
PPTX
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
advance database management system book.pdf
PDF
Hazard Identification & Risk Assessment .pdf
PDF
HVAC Specification 2024 according to central public works department
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
PDF
Empowerment Technology for Senior High School Guide
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
Indian roads congress 037 - 2012 Flexible pavement
PDF
1_English_Language_Set_2.pdf probationary
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
Introduction to Building Materials
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
LDMMIA Reiki Yoga Finals Review Spring Summer
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
Computer Architecture Input Output Memory.pptx
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
advance database management system book.pdf
Hazard Identification & Risk Assessment .pdf
HVAC Specification 2024 according to central public works department
What if we spent less time fighting change, and more time building what’s rig...
FORM 1 BIOLOGY MIND MAPS and their schemes
Empowerment Technology for Senior High School Guide
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
Indian roads congress 037 - 2012 Flexible pavement
1_English_Language_Set_2.pdf probationary
Share_Module_2_Power_conflict_and_negotiation.pptx
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
Practical Manual AGRO-233 Principles and Practices of Natural Farming
Unit 4 Computer Architecture Multicore Processor.pptx

Assessment Issues & Strategies

  • 1. Assessment Issues & Strategies David Carless University of Hong Kong Presentation at Hong Kong Shue Yan University, March 26, 2018 The University of Hong Kong
  • 2. Overview 1. Learning-oriented assessment 2. Good assessment designs 3. Barriers & challenges 4. Conclusions & implications The University of Hong Kong
  • 3. What comes to mind when you think of “assessment”? The University of Hong Kong
  • 4. Competing assessment functions The University of Hong Kong
  • 5. Learning-oriented assessment  To alleviate competing priorities The University of Hong Kong  circumnavigate formative/summative divides and
  • 6. A focus on student learning  By prioritizing student learning as a key aim of all assessment The University of Hong Kong
  • 7. The University of Hong Kong Productive assessment task design Development of student self- evaluative capacities Student engagement with feedback Learning-oriented assessment framework (Carless, 2015)
  • 9. The University of Hong Kong HISTORY EXAMPLE
  • 10. History Assessment Fieldwork report (30%): Museum visit Individual project (40%): draft 10%, final 30% Participation (30%): tutorial participation 15% short weekly written responses 15% (cf. Carless & Zhou, 2015) The University of Hong Kong
  • 11. Museum report 1000 words or podcast Issues: key messages; use of space; coverage and omissions The University of Hong Kong
  • 12. Sample Project Walking tour of sites of Hong Kong identity The University of Hong Kong
  • 13. Project stages • Topic brief • Draft (10%) • Final version (30%) The University of Hong Kong
  • 14. Use of Social Media Students could upload drafts of work in progress & receive peer feedback The University of Hong Kong
  • 15. The University of Hong Kong LAW EXAMPLE
  • 16. Tort Law • Core 1st year course: 180+ students The University of Hong Kong
  • 17. Tort Law Assessment Reflective Media Diary (20%) 1st sem test (20%) Final Exam (60%) [or 40% + 20% research essay] The University of Hong Kong
  • 18. Reflective Media Diary (RMD) • Identify tort-related events; track developments; provide legal analysis; • Portfolio-style: collecting, selecting & editing material over time. The University of Hong Kong
  • 19. RMD features Steady student engagement Promotes reading habits Incomplete, authentic problems Workload friendly for teachers The University of Hong Kong
  • 20. Use of exemplars Sharing of samples to illustrate expectations The University of Hong Kong
  • 21. Same-day exam feedback Discussion immediately after exam The University of Hong Kong
  • 22. Exam debriefing Supplemented by online discussion Novel angles added to marking scheme The University of Hong Kong
  • 24. (1) Integrated with instruction and ILOs The University of Hong Kong Constructive alignment
  • 25. (2) Spreads student effort The University of Hong Kong
  • 26. (3) Mirrors real-life uses of the discipline The University of Hong Kong
  • 27. (4) Integrated and coherent The University of Hong Kong
  • 28. (5) Incorporates feedback dialogues The University of Hong Kong
  • 29. (6) Supports students in appreciating quality The University of Hong Kong
  • 30. (7) Flexibility & choice The University of Hong Kong
  • 31. (8) Encourages deep approaches to learning The University of Hong Kong
  • 32. Summary of principles 1. Alignment 2. Spreading effort 3. Authenticity 4. Integrated/coherent 5. Feedback designs 6. Developing student connoisseurship 7. Flexibility or choice 8. Deep approaches to learning The University of Hong Kong
  • 33. Issues & Challenges The University of Hong Kong
  • 34. Double duty (Boud, 2000) Competing priorities in assessment Reliability, Fairness, Workload, QA etc The University of Hong Kong
  • 35. Marking & Grading End of semester grading involves: -Awarding a grade -Justifying the grade -Providing specific comments -Providing generic comments -Reciprocity The University of Hong Kong
  • 36. Staff frustrations • Heavy marking load • Students don’t collect feedback • Students mainly interested in the grade • Students lack motivation to act ….. The University of Hong Kong
  • 37. Student frustrations Feedback often seems like a perversely belated revelation of things that should have been made clear earlier (Crook, Gross & Dymott, 2006) The University of Hong Kong
  • 38. Suggested shifts in priorities The University of Hong Kong Increase Decrease In-class dialogic feedback within module time Unidirectional comments after completion of module Written feedback comments on first assessment task of module Written feedback comments on final task of module Feedback for first year students Feedback for final year students
  • 39. Trust or distrust? Distrust as barrier for assessment change (Carless, 2009) The University of Hong Kong
  • 40. Teacher autonomy? Many teachers lack autonomy: pulled in different directions by competing priorities (James, 2014) The University of Hong Kong
  • 42. Communication about assessment Rationales The University of Hong Kong Potential benefits Processes Tackling challenges
  • 43. Teacher X factor Teacher determination to overcome barriers & strive for learning-oriented assessment The University of Hong Kong
  • 44. References Boud, D. (2000). Sustainable assessment: Rethinking assessment for the learning society. Studies in Continuing Education, 22(2), 151-167. Carless, D. (2009). Trust, distrust and their impact on assessment reform. Assessment and Evaluation in Higher Education, 34(1), 79-89. Carless, D. (2015). Exploring learning-oriented assessment processes. Higher Education, 69(6), 963-976. Carless, D. & J. Zhou (2015). Starting small in assessment change: Short in- class written responses. Assessment and Evaluation in Higher Education, 41(7), 1114-1127 Crook, C., Gross, H. & Dymott, R. (2006). Assessment relationships in higher education: The tension of process and practice. British Educational Research Journal, 32(1), 95-114. James, D. (2014). Investigating the curriculum through assessment practice in higher education: The value of a ‘learning cultures’ approach. Higher Education, 67(2), 155-169. The University of Hong Kong
  • 45. THANK YOU The University of Hong Kong