SlideShare a Scribd company logo
Utilizing Multiple Grader
Rubrics for Practical
Assessment of Student
Performance
Sherry Jimenez, Ed.D.
Assistant Dean for Educational Development
Sarah Zahl, Ph.D.
Director of Educational Assessment
Agenda
• Audience Response
• MUCOM Brief Overview
• Multiple Grader Rubrics
o Assessment Types and Examples
o Tracking outcomes in rubrics
• Recommendations
• Q&A
Poll Question 1
• Indicate the discipline in which you are or will
be utilizing ExamSoft
– Dental
– PA
– Pharmacy
– Nursing
– Medicine
– Podiatry
– Other
Poll Question 2
MU-COM Overview
• Competency Based Curricular Design
• Systems based/integrated curriculum
o Course Director, multiple internal faculty and
external clinicians
o e.g. Cardiovascular course + OSCE
• iPad exclusive
• Building a culture of evidence among
faculty/students/administrators
Tracking Student
Performance
• Competencies
• COMLEX blueprint
• System
• Discipline
• Learning Domains
• Course specific outcomes
National Board of Osteopathic Medical Examiners
Fundamental Osteopathic Medical Competencies
COMLEX Blueprint
Use of Rubrics
• Lab Practicals: Osteopathic Manipulative Medicine
(OMM) Lab
• Simulations
• Objective Structured Clinical Examinations (OSCE)
• Small Group Evaluations: Clinical Medicine
Small Group Evaluations
Small Group Evaluations
– Grading Process
Small Group Evaluations
– Grading Process
• Complete the administrative planning process
externally before using ExamSoft
• Pre-assign faculty graders and students
• Pre-assign assessment area (region)
• Prepare extra materials and guides
• Communication
OSCE
• Humanistic rubric, SOAP note, SP evaluation, self-
assessment
Lab Practicals
• Paper  Very complex online process 
streamlined process in ExamSoft
Old process: multiple
stations, partner flip,
multiple regions,
multiple graders and
students at each
station
New process: one
station, partner flip
only, one region (pre-
determined but
surprise to student)
Outcomes
• Culture shift –modifying structure
• Positive feedback – ease of evaluation
• Immediate faculty feedback – inter-rater
• Timeliness of student feedback
• Pairing rubric data with written exam data to
develop longitudinal reports
• Continuous refinement
Parting Thoughts
• How are you currently assessing student
performance in practical settings?
• How could you incorporate multiple grader rubrics
in your curriculum?
Q&A
• Questions?
• Discussion
Contact info
sjimenez@marian.edu szahl@marian.edu
Click to edit Master title style
Click to edit Master subtitle style
For More Information:
Call: 1.866.429.8889
Email: info@examsoft.com
Visit: learn.examsoft.com

More Related Content

PPTX
Building a scalable ePortfolio based assessment strategy to connect clinical ...
PDF
Digital learning and assessment presentation
PPTX
Ifta Internship
PPT
Designing and Developing Assessments - the Assessment Matrix and Training for...
PPT
Prium Vienna 2008 Eval 2 * PRIUM Project : What is next ?
PPTX
Getting Student to Think About Their Thinking Using ExamSoft Features
PPTX
Queens College Assessment and ePortfolio for 5.6.11
PPTX
Assessing Online Courses - CA12
Building a scalable ePortfolio based assessment strategy to connect clinical ...
Digital learning and assessment presentation
Ifta Internship
Designing and Developing Assessments - the Assessment Matrix and Training for...
Prium Vienna 2008 Eval 2 * PRIUM Project : What is next ?
Getting Student to Think About Their Thinking Using ExamSoft Features
Queens College Assessment and ePortfolio for 5.6.11
Assessing Online Courses - CA12

What's hot (19)

PPTX
The hidden achievement factor - SXSW
PPT
SACS Readiness Week: Graduate and Post-Baccalaureate Programs
PPTX
Student Achievement Initiative: Adjunct Faculty Orientation
PPTX
Evaluation in distance education @ VIVES: some tools and trends - Jean-Claude...
PPT
Assessment in the Department of Communicative Disorders - Radford
PPT
Adjunct Faculty Orientation: Academic Affairs
PPTX
Woolley final presentation
PDF
Assessing Online Courses - CA12
PPTX
National university assessment process
PPTX
LRT Talks 20140611 EUNIS Umea
PDF
ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
PPTX
Improving Student Learning and Meeting Program Requirements by Implementing F...
PPTX
Assessments We Use
PPTX
Social impact of Technology-Driven Education
PPTX
PPTX
Data Warehouse Tube Map Update
PPT
Assessment in Distance Education
PPTX
LRT Talks 20150415 Talis Insight Birmingham
PPTX
Amy Driscoll: Signature Assignments
The hidden achievement factor - SXSW
SACS Readiness Week: Graduate and Post-Baccalaureate Programs
Student Achievement Initiative: Adjunct Faculty Orientation
Evaluation in distance education @ VIVES: some tools and trends - Jean-Claude...
Assessment in the Department of Communicative Disorders - Radford
Adjunct Faculty Orientation: Academic Affairs
Woolley final presentation
Assessing Online Courses - CA12
National university assessment process
LRT Talks 20140611 EUNIS Umea
ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring
Improving Student Learning and Meeting Program Requirements by Implementing F...
Assessments We Use
Social impact of Technology-Driven Education
Data Warehouse Tube Map Update
Assessment in Distance Education
LRT Talks 20150415 Talis Insight Birmingham
Amy Driscoll: Signature Assignments
Ad

Similar to Utilizing Multiple Grader Rubrics for Practical Assessment of Student Performance (20)

PDF
OBE_An_overview.pdf
PPT
Assessment in language learning classrooms: More questions than answers
PPTX
Evaluating the Quality of Online Teaching
PPTX
Evaluating Quality of Online Teaching
PPTX
OSCE: Objective Structured Clnical Examination
PPTX
Interview presentation.pptx
PPTX
Using Exam Analytics to Evaluate Student Use of Lecture Capture Recordings
PPTX
Unit 7 assessment in higher education
PDF
Assessment and evaluation in Nursing Education .pdf
PPTX
Tracking systems for VET graduates- methodology and tools
PPTX
Governance Day 042718
PDF
Addressing the question of quality in e learning umass it conference 2008
PPTX
ARLG 2019: Myer have we made a difference
PPTX
Online assessment
PPTX
NCA Residency Session 7 March 8 2017
PPTX
Introduction to Usability Testing for Survey Research
PPTX
Promoting Best Practices through Collaboration, Staff Training-1
PPTX
offshore lecture 1 12th SEptember 2015 IPGKSAH.pptx
PDF
Assessment in CBME Competency Based Medical Education Dr Girish .B CISP 2 MCI
PPTX
HE Course and Module Evaluation Conference - Suzanne Cholerton
OBE_An_overview.pdf
Assessment in language learning classrooms: More questions than answers
Evaluating the Quality of Online Teaching
Evaluating Quality of Online Teaching
OSCE: Objective Structured Clnical Examination
Interview presentation.pptx
Using Exam Analytics to Evaluate Student Use of Lecture Capture Recordings
Unit 7 assessment in higher education
Assessment and evaluation in Nursing Education .pdf
Tracking systems for VET graduates- methodology and tools
Governance Day 042718
Addressing the question of quality in e learning umass it conference 2008
ARLG 2019: Myer have we made a difference
Online assessment
NCA Residency Session 7 March 8 2017
Introduction to Usability Testing for Survey Research
Promoting Best Practices through Collaboration, Staff Training-1
offshore lecture 1 12th SEptember 2015 IPGKSAH.pptx
Assessment in CBME Competency Based Medical Education Dr Girish .B CISP 2 MCI
HE Course and Module Evaluation Conference - Suzanne Cholerton
Ad

More from ExamSoft (20)

PPTX
More Than Assessment: Using computer-based testing software to deliver instru...
PPTX
Creating Test Items Using NCLEX® Alternative Item Types
PPTX
Psychometrics 201: Putting assessment data into action
PPT
Programs Coming Together Using ExamSoft to assess interprofessional education...
PPTX
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
PPTX
Last Minute Tips to Positively Impact Your Students This Semester
PPTX
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
PPTX
Check, Check, Check in the Simulation Lab
PPTX
Retiring Exam Questions? How to Use These Items in Formative Assessments
PPTX
Using ExamSoft to Evaluate NCLEX Test Plan Success
PDF
Using ExamSoft Rubrics to Assess Student Medical Research
PDF
Improve your test item writing skills to help create better nursing exams
PPTX
Psychometrics 101: Know What Your Assessment Data is Telling You
PPTX
From Conception to Execution: Strategies for designing and implementing a com...
PPTX
What's in it for me-- said the student, faculty, and curriculum
PPTX
"What's in it for me?" said the Student, Faculty, and Curriculum
PPTX
Closing the Loop on Clinical Competency Based Assessments
PPTX
Using Exam Data for Scholarly Activities
PPTX
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
PPTX
Stop the cheating! best practices to minimize security risks on exams
More Than Assessment: Using computer-based testing software to deliver instru...
Creating Test Items Using NCLEX® Alternative Item Types
Psychometrics 201: Putting assessment data into action
Programs Coming Together Using ExamSoft to assess interprofessional education...
5 Tips for Course Alignment: Improve student outcomes while mapping your curr...
Last Minute Tips to Positively Impact Your Students This Semester
Using the NCLEX RN Blueprint as a Guide for Testing in a Nursing Baccalaureat...
Check, Check, Check in the Simulation Lab
Retiring Exam Questions? How to Use These Items in Formative Assessments
Using ExamSoft to Evaluate NCLEX Test Plan Success
Using ExamSoft Rubrics to Assess Student Medical Research
Improve your test item writing skills to help create better nursing exams
Psychometrics 101: Know What Your Assessment Data is Telling You
From Conception to Execution: Strategies for designing and implementing a com...
What's in it for me-- said the student, faculty, and curriculum
"What's in it for me?" said the Student, Faculty, and Curriculum
Closing the Loop on Clinical Competency Based Assessments
Using Exam Data for Scholarly Activities
Communication is Key! Using ExamSoft to Keep Everyone Involved In the Teachin...
Stop the cheating! best practices to minimize security risks on exams

Recently uploaded (20)

PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PDF
Trump Administration's workforce development strategy
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PPTX
B.Sc. DS Unit 2 Software Engineering.pptx
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
advance database management system book.pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
1_English_Language_Set_2.pdf probationary
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PDF
IGGE1 Understanding the Self1234567891011
PDF
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
PPTX
Introduction to Building Materials
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
Empowerment Technology for Senior High School Guide
PDF
Indian roads congress 037 - 2012 Flexible pavement
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
Trump Administration's workforce development strategy
Practical Manual AGRO-233 Principles and Practices of Natural Farming
B.Sc. DS Unit 2 Software Engineering.pptx
Chinmaya Tiranga quiz Grand Finale.pdf
advance database management system book.pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
1_English_Language_Set_2.pdf probationary
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
Paper A Mock Exam 9_ Attempt review.pdf.
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
IGGE1 Understanding the Self1234567891011
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
Introduction to Building Materials
Share_Module_2_Power_conflict_and_negotiation.pptx
Empowerment Technology for Senior High School Guide
Indian roads congress 037 - 2012 Flexible pavement
LDMMIA Reiki Yoga Finals Review Spring Summer

Utilizing Multiple Grader Rubrics for Practical Assessment of Student Performance

  • 1. Utilizing Multiple Grader Rubrics for Practical Assessment of Student Performance Sherry Jimenez, Ed.D. Assistant Dean for Educational Development Sarah Zahl, Ph.D. Director of Educational Assessment
  • 2. Agenda • Audience Response • MUCOM Brief Overview • Multiple Grader Rubrics o Assessment Types and Examples o Tracking outcomes in rubrics • Recommendations • Q&A
  • 3. Poll Question 1 • Indicate the discipline in which you are or will be utilizing ExamSoft – Dental – PA – Pharmacy – Nursing – Medicine – Podiatry – Other
  • 5. MU-COM Overview • Competency Based Curricular Design • Systems based/integrated curriculum o Course Director, multiple internal faculty and external clinicians o e.g. Cardiovascular course + OSCE • iPad exclusive • Building a culture of evidence among faculty/students/administrators
  • 6. Tracking Student Performance • Competencies • COMLEX blueprint • System • Discipline • Learning Domains • Course specific outcomes
  • 7. National Board of Osteopathic Medical Examiners Fundamental Osteopathic Medical Competencies COMLEX Blueprint
  • 8. Use of Rubrics • Lab Practicals: Osteopathic Manipulative Medicine (OMM) Lab • Simulations • Objective Structured Clinical Examinations (OSCE) • Small Group Evaluations: Clinical Medicine
  • 10. Small Group Evaluations – Grading Process
  • 11. Small Group Evaluations – Grading Process • Complete the administrative planning process externally before using ExamSoft • Pre-assign faculty graders and students • Pre-assign assessment area (region) • Prepare extra materials and guides • Communication
  • 12. OSCE • Humanistic rubric, SOAP note, SP evaluation, self- assessment
  • 13. Lab Practicals • Paper  Very complex online process  streamlined process in ExamSoft Old process: multiple stations, partner flip, multiple regions, multiple graders and students at each station New process: one station, partner flip only, one region (pre- determined but surprise to student)
  • 14. Outcomes • Culture shift –modifying structure • Positive feedback – ease of evaluation • Immediate faculty feedback – inter-rater • Timeliness of student feedback • Pairing rubric data with written exam data to develop longitudinal reports • Continuous refinement
  • 15. Parting Thoughts • How are you currently assessing student performance in practical settings? • How could you incorporate multiple grader rubrics in your curriculum?
  • 18. Click to edit Master title style Click to edit Master subtitle style For More Information: Call: 1.866.429.8889 Email: info@examsoft.com Visit: learn.examsoft.com