SlideShare a Scribd company logo
Page 1
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
Using Rubrics in Student Assessment
A rubric is a guide
to assist the
marker to make
consistent and
reliable judgments
about the quality of
student work.
Contents Page no.
1. 	 What is a rubric? 2
2. 	 Why use rubrics? 2
3. 	 When to use rubrics 3
4. 	 Types of rubrics 4
4.1 	 Analytic rubrics 4
4.2 	 Holistic rubrics 7
5. 	 What kind of rubric is right for your assessment task? 9
5.1 	 Pros and cons of analytic and holistic rubrics 9
5.2 	 Two known issues with analytic rubrics 9
6. 	 Collaborative rubric construction 10
6.1 	 Whole-of-course approach to rubric development 10
6.2 	 Moderation of rubrics 11
7. 	 Examples of rubrics 12
7.1 	 Collections of rubrics 12
7.2 	 Specific rubrics 12
8. 	 Rubric Quality Checklist 13
9. 	 References 14
Page 2
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
1. What is a rubric?
A rubric is a guide to assist the marker to make consistent and reliable judgments about the quality of
student work. They also can be used to provide feedback to students about the quality of their work and
how they might improve.
Rubrics are commonly presented in the form of a matrix that includes:
•	 Marking criteria – the elements that the marker will consider when judging a piece of work (such as
quality of argument, research, technical aspects, etc)
•	 Grading standards – descriptive statements about the level of each criteria , often expressed on a
scale (such as High Distinction, Distinction, Credit, Pass, Fail, or a number score).
Rubrics may vary in complexity from simple tables to very detailed matrices that provide description of
each dimension of quality and characterise each level of accomplishment.
Rubrics can be adapted to grade many different types of assignments including essays, reports,, oral
presentations, group work, research papers and many more.
Above all, rubrics should be simple and clear so that students can readily understand and engage with
them.
2. Why use rubrics?
Rubrics bring transparency to assessment and marking for both staff and students. Clear criteria and
standards:
•	 Enable markers to form a shared understanding about how grades should be awarded
•	 Explicitly communicate to students what is valued in the completion of a task
•	 Help to clarify and articulate industry or discipline standards
•	 Provide students with more detailed understanding of how to improve
•	 Increase efficiency and consistency of marking and moderation processes.
Rubrics are useful in all three stages of the assessment process.
Before assessment occurs Rubrics have the dual purposes: for students it unpacks what is
required in the assessment task. It provides important cues about the
expected elements and approaches. For the marking team, the rubric
provides an opportunity to unpack and moderate understandings
about criteria and standards before marking commences
During the assessment
process
Rubrics provide markers with a detailed framework for consistently
judging individual student submissions. They also provide prompts
to markers for the provision of systematic feedback on student
performance against each criterion
Page 3
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
After assessment occurs Rubrics provide important information to students about the quality
of their performance against the specified criteria. Rubrics allow
students to diagnose their strengths and weaknesses and where
they can improve. They also provide transparency to students about
standards, and how grades are derived.
3. When to use rubrics?
All assessment types can be marked using rubrics. However, caution should be taken when deciding the
form the rubric should take. Detailed atomized rubrics may trivialise the components of the assessment
task and can skew the final assignment grade. A staff member explains:
	 I thought I had allowed for all possibilities when I set up the marking criteria. However, when I collated
the result from each criteria I was surprised the student had achieved a credit, when in fact they could
not even solve the problem presented.
To overcome the difficulties associated with overly-detailed rubrics and to help in the construction
of standards researchers have proposed frameworks to assist in the design effective rubrics. These
frameworks help us to see the range of potential student responses to a task – from very basic responses
to highly sophisticated ones. Bloom’s Taxonomy is one tool that proposes a hierarchy of assessment
tasks, SOLO taxonomy is another which focuses on criteria and standards. Perry (1999) presents a third
option based on levels of moral and ethical reasoning. Orrell (2010) presents a generic assessment rubric
as a tool to design a unit specific rubric.
Table 1:   Modified Structure of the Observed Learning Outcome (SOLO) taxonomy (based on Biggs & Tang, 2007, p.
197)
Descriptive knowledge Procedural knowledge Level name
Memorise, identify, recite Count, match, order Uni-structural
Describe, classify Compute, illustrate Multi-structural
Compare and contrast, explain, argue, analyse Apply, construct, translate, solve near
problem, predict within same domain
Relational
Theorise, hypothesise, generalise Reflect and improve, invent, create, solve
unseen problems, predict to unknown
domain
Extended
Abstract
Page 4
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
4. Types of rubrics
There are two kinds of rubrics in common usage – analytic and holistic:
Analytic rubrics are used when making
judgements about each criteria separately
and then combining each judgement
to make a decision on the quality of the
response.
Holistic rubrics – used when making an
overall or holistic judgement about the
quality of the response.
4.1Analyticrubrics
Analytic rubrics are the most common kind of rubric. They are used when the judgment of the
assessment task can be partitioned into discrete elements or criteria each of which are assessed
individually. The results for each criterion are then aggregated to provide an overall grade for the task.
In some instances each criteria are weighted relative to their importance to achieving the learning
outcomes for the assessment task.
A simple analytical rubric can be seen below. This example contains criteria but no standards. Student
performance for each criterion is indicated along a continuum from High Distinction to Fail.
Assignment 1 – Online Discussion – 10%
Criteria HD D Cr P F
The relevance and coherence of your contributions in relation to the
questions posed.
The extent to which your contributions have contributed to the online
debate and expanded or commented on the views of other contributors.
Evidence that your comments are informed, where appropriate, by the
texts and resources in unit, and other scholarly commentary.
The timeliness of contributions in relation to the unit schedule.
This rubric provides useful descriptive information relative to the criteria but does not describe
standards of performance beyond a letter symbol. This may be acceptable in some cases (particularly
for minor or relatively simple assessment tasks) but will be insufficient for more substantial assessment
items.
The following example is a more complex analytic rubric which contains both criteria and standards
(adapted from Lombardi, 2008). A description is provided for each standard relative to each criterion
along with the percentage weighting. This rubric provides more guidance to students about expected
Page 5
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
standard for each element of the task. From this type of rubric students gain insight into how they
might, in practical terms, improve their performance.
Analytic rubric for student participation in group work
Criteria
Level of Student Performance
D/HD Credit Pass Fail
Workload
20%
Did a full share of
the work – or more;
knows what needs
to be done and does
it; volunteers to help
others.
Did an equal share of
the work; does work
when asked; works
hard most of the
time.
Did almost as much
work as others;
seldom asks for help.
Did less work than
others; doesn’t get
caught up after
absence; doesn’t ask
for help.
Getting organised
10%
Took the initiative
proposing meeting
times and getting
group organised.
Worked agreeably
with partner(s)
concerning times
and places to meet.
Could be coaxed into
meeting with other
partner(s).
Did not meet
partner(s) at agreed
times and places.
Participation in
discussions
30%
Provided many
good ideas for the
unit development;
inspired
others; clearly
communicated
desires, ideas,
personal needs, and
feelings.
Participated in
discussions; shared
feelings and
thoughts.
Listened mainly;
on some occasions,
made suggestions.
Seemed bored with
conversations about
the unit; rarely spoke
up, and ideas were
off the mark.
Meeting deadlines
10%
Completed assigned
work ahead of time.
Completed assigned
work on time.
Needed some
reminding; work
was late but it didn’t
impact grade.
Needed much
reminding; work was
late and it did impact
quality of work or
grade.
Showing up for
meetings
Score 10%
Showed up for
meetings punctually,
sometimes ahead of
time.
Showed up for
meetings on time.
Showed up late,
but it wasn’t a
big problem for
completing work.
No show or
extremely late; feeble
or no excuse offered.
Providing Feedback
Score 10%
Habitually provides
dignified, clear, and
respectful feedback.
Gave feedback that
did not offend.
Provided some
feedback; sometimes
hurt feelings of
others with feedback
or made irrelevant
comments.
Was openly rude
when giving
feedback.
Receiving Feedback
Score 10%
Graciously accepted
feedback.
Accepted feedback. Reluctantly accepted
feedback.
Refused to listen to
feedback.
Page 6
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
The second example below is a rubric from mathematical problem solving. It also provides guidance to
students on what is expected and was used significantly in the pre-marking process with large group of
tutors.
Analytic rubric for mathematical problem solving and reporting
Criteria High
Distinction
Distinction Credit Pass Fail
Definition of
the explicitness
in problem
description
Weighting 5%
Aim outlines the
purpose of the
investigation
specifically,
explicitly, and
relevantly.
Aim outlines the
purpose of the
investigation
with minor lapse
in explicitness,
specificity or
relevance.
Aim outlines the
purpose of the
investigation
with some lapse
in explicitness,
specificity or
relevance.
Aim outlines the
purpose of the
investigation
with substantial
lapse in
explicitness,
specificity or
relevance.
Aim not given
or does not
satisfactorily
outline the
purpose of the
investigation.
Clarity and
correctness of
method
Weighting 35%
Innovative and
correct method
of solution to
problem.
Above average
and substantially
correct method
of solution to the
problem.
Average and
mostly correct
and complete
method of
solution to the
problem.
Sound but
partially
incomplete
or incorrect
method of
solution to
problem.
Solution to
problem not
described, or not
correct.
Correctness of
mathematics
Weighting 40%
All calculations/
algebra/graphs
complete and
correct.
Only minor
errors or
omissions in
calculations/
algebra/graphs.
Calculations/
algebra/graphs
partially correct
or complete.
Calculations/
algebra/graphs
half correct or
complete.
Calculations/
algebra/graphs
incorrect or not
present.
Logical and
connected
conclusion
Weighting 10%
Conclusion
is explicit,
logically and
mathematically
correct and
consistent with
the aim, method
and results.
Conclusion has
minor lapse in
explicitness,
logical and
mathematical
correctness or
consistency with
the aim, method
and results.
Conclusion has
some lapse in
explicitness,
logical and
mathematical
correctness or
consistency with
the aim, method
and results.
Conclusion has
substantial lapse
in explicitness,
logical and
mathematical
correctness or
consistency with
the aim, method
and results.
Conclusion is
not present or
not explicit, not
logically and
mathematically
correct, or not
consistent with
the aim, method
and results.
Written
mathematical
communication
Weighting 10%
Written
expression of
high level of
achievement
using
sophisticated
mathematical
language.
Written
expression of
high level of
achievement
with some use
of appropriate
mathematical
language.
Written
expression of
average level
with some use
of appropriate
mathematical
language.
Written
expression
sound with
little use of
appropriate
mathematical
language.
Written
expression not
included or very
poor.
Page 7
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
4.2Holisticrubrics
Holistic rubrics are used when it is more difficult or not desirable to partition a task into separate criteria.
For example, in some tasks, the criteria are intertwined and overlap too much. This often occurs in
complex, extended abstract or creative tasks where there are a variety of ways to go about the task and
the task cannot easily be partitioned into components. In such cases we make holistic judgments about
the work, rather than analytical judgments based on individual criteria.
In holistic rubrics, the standards are articulated by a detailed descriptive statement, as follows:
Holistic rubric for multi-media project
Grade Description of Grade
High
Distinction
The project is realised to a very high professional standard. Technically it is fully functional and meets
all specifications. It demonstrates high levels of creativity and innovation both in terms of its function
and usability. It has a high level of aesthetic appeal. It has been carefully quality controlled to ensure full
functionality and that no errors are evident. This product has real‘wow’factor.
Distinction The project is realised to a high professional standard, with a good level of function and meets most
specifications. It demonstrates occasional levels of creativity and innovation and is attractive and
aesthetically engaging. While there may be a few errors, these are of a minor nature. Generally the product
would be well-regarded by industry standards.
Credit The project is realised to an acceptable professional standard with generally adequate levels of function and
generally meets specifications, although there are a number of problems evident. There is some evidence of
creativity and innovation although these are not sustained or notable. Further experimentation and testing
could have improved this product considerably. Generally it would not be well regarded by industry and
would need more work before release, but still shows good developing competence.
Pass The project was completed, but to a less than acceptable industry standard. Functionality was problematic
and often did not meet required specifications. There is little evidence of creativity or innovation in the
project. Numerous errors crept into the work. Significant further work would be required to bring this up to
industry standards, but overall it demonstrates sufficient competence to merit a passing grade.
Fail The project is incomplete and/or work well below industry standards. Functionality is poor or absent.
Failure to meet project specifications. Numerous errors. Little or no innovation or aesthetic appeal. A large
volume of work required to bring the project up to industry standards. Insufficient effort or competence
demonstrated to achieve a passing grade.
Page 8
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
Holistic rubric for essay
Grade Description of Grade
High
Distinction
This essay commands attention because of its insightful development and mature style. The response to the
text is convincing and elaborated upon with well-chosen and correctly referenced examples. It is written
with aptly chosen words, effectively constructed sentences and a keen observation of the conventions of
written English.
Distinction This essay provides a thoughtful and well reasoned response to the text with appropriate and correctly
referenced examples. The sentences are constructed and words chosen to communicate clearly to the
reader. The conventions of written English have been well observed.
Credit This essay provides a competently reasoned response to the text with some appropriate and mostly
correctly referenced examples. The sentence structure and choice of words have sufficient precision to
communicate the message to the reader. The conventions of written English have been observed.
Pass This essay is satisfactory. It provides an adequate response to the text with sufficient examples and
adequate reasoning. The examples are mostly adequately referenced. The sentence structure and choice
of words communicates adequately to the reader. The conventions of written English need to be observed
more closely.
Fail This essay fails to respond appropriately to the text. The responses are simplistic or incoherent and suggest
some significant misunderstanding of the text. The writing lacks appropriate structure and has a pattern of
errors in word choice with poor grammatical expression. Correctly referenced examples are absent or poorly
presented. More attention needs to be paid to the conventions of written English.
Holistic rubric for online participation
Grade Descriptor of Grade
High
Distinction
In addition to qualities of a distinction grade, contributions at this level demonstrate a sophisticated
synthesis of theoretical understanding and reflection on practice, as well as a high level collegiality in
engaging with others.
Distinction •	 Contribution to the discussion is relevant, succinct and timely.
•	 Contributions demonstrate deep engagement with issues and recognition and evaluation of differing
perspectives.
•	 Contributions are informed by significant reading and critical reflection on own professional practice.
•	 Contributions advance and extend the debate and demonstrate high level of online communication skills
Credit •	 Contribution to the discussion is relevant, succinct and timely.
•	 Contributions demonstrate a good understanding of basic issues and own professional practice
•	 Contributions are informed by reading and reflection and not only personal opinion.
Clear efforts are evident to engage with others’views and to advance the debate in constructive ways.
Page 9
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
Grade Descriptor of Grade
Pass •	 Some contribution to discussion is evident but may also be untimely.
•	 Contributions make some points that demonstrate basic understanding but do not generally advance the
debate.
•	 Contributions suggest only minimal engagement with literature and tend to reflect only personal
opinion.
Fail Fails to make necessary contributions and/or contributions are very late. Comments are generally not
scholarly and do not contribute to the debate.
5. What kind of rubric is right for your assessment task?
5.1Prosandconsofanalyticandholisticrubrics
The advantages and disadvantages of each type of rubric depend on the situation they are used in and
how they are used.
Analytic Holistic
Pros •	 Useful when task is composed of discrete skills or
knowledge
•	 Provides direct advice on set criteria
•	 Shows students specific strengths and weaknesses
•	 Easier to moderate marking in large classes with
large number of markers
•	 Can take more time to develop.
•	 Useful for tasks that contain inter-related skills and
knowledge
•	 Useful for tasks that are holistic in nature e.g. works
of art, creative writing, engineering design, essays,
projects
•	 Can focus on higher order, inter-related knowledge
and skills
•	 May be more authentic in nature
•	 Can be quicker to develop.
Cons •	 Can over-partition a task so that the result is
biased towards small skills rather than the overall
achievement
•	 Can produce a biased results if criteria are not
carefully selected
•	 Can focus on detailed, lower level skills rather than
deeper understanding and knowledge.
•	 Can be more difficult to moderate in large classes
with large number of markers
•	 May not provide the detailed feedback students
expect
•	 Can produce a biased result if markers are not clear
on what is required.
5.2Twoknownissueswithanalyticrubrics
Two respected researchers of assessment in higher education have warned teachers about taking
rubrics a step too far.
Sadler (2010) asks us to be cautious about using criteria in rubrics that do not contribute to achievement
of learning outcomes. He claims that these lead to a mistrust in the integrity of the grade. Typically
Page 10
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
such criteria include technical requirements that are aimed to change student behaviours or improve
learning. He lists the following practices that can undermine achievement and misrepresent a grade.
•	 Marks awarded for attendance at, or participation in, lectures, a minimum proportion of classes,
group discussions, laboratory sessions or e-learning chat rooms
•	 Marks awarded for completion of specified activities, including practice exercises, log books,
reflective journals, posts to online forums and discussion boards without reference to learning
outcomes
•	 Marks awarded for inclusion of a specified component in a work submitted (eg ‘at least 20
references’)
•	 Marks awarded for completion of interim drafts or project stages
•	 Marks deducted for late submission of a response to an assessment task
•	 Marks deducted non-conformity with regulative specifications, such as maximum word length (for
an essay)
•	 Marks deducted for plagiarism.
Further details on this issue are available at UQ Assessment Brief on Fidelity as a precondition for integrity
in grading academic achievement (2011).
Rust’s (2011) concern lies with the automatic use of numbers or marks to determine achievement. He
proposes that because of the way numbers are presented for very different assessment types and then
calculated and recalculated to produce a final grade, a biased result may be obtained. This result may
obscure the actual student’s performance. He presents seven arguments against traditional practices in
the use of numbers as the basis of making assessment judgements.
Further details on this issue are available at UQ Assessment Brief on The unscholarly use of numbers in our
assessment practices: What will make us change? (2011).
Caution should be used in developing rubrics – complex mathematical formulas or fine grained analytic
rubrics can bias a grade resulting in a final judgment which runs counter expectations.
6. Collaborative rubric construction
6.1Whole-of-courseapproachtorubricdevelopment
The Australian Government, professions and the wider community increasingly require assurance of
outcomes standards in university award programs. In particular, the Australian Qualifications Framework
(AQF) specifies generic learning outcomes for courses at each AQF level. More and more course
coordinators are using rubrics to define the standard of specific generic skills.
Page 11
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
These course rubrics are different from the marking rubrics described above. Oliver (2012)1
presents an
array of these rubrics and states that these rubrics:
•	 communicate to graduates what is expected by or even beyond graduation
•	 enable those teaching in the course to reach a shared understanding of the standards expected of
students and graduates
•	 can act as a broad guide to the standards expected in specific assessment tasks throughout the
degree.
Such rubrics encourage a whole-of-course approach to assessment and the articulations of standards
between units.
6.2Moderationofrubrics
Moderation of rubrics is part of the wider moderation of assessment which seeks to ensure that
procedures and practices are valid and reliable and are aligned with its stated standards, principles and
ethos. Moderation of rubrics is implemented at three stages within the assessment process:
•	 Designing phase: judging the appropriateness of the associated rubric before release to students
•	 Marking phase: ensuring that all markers have shared understanding of rubric criteria and standard
before marking commences
•	 Awarding of grades: confirm that the grades are correct, fair and consistent before release to
students.
In the designing phase the designer and moderator (the academic colleagues designated to review the
unit assessment) will:
•	 ensure the rubric fits with unit learning outcomes, focuses on higher-order learning, uses
appropriate marking criteria and standards
•	 ensure that the rubric fits with other rubrics to determine the appropriateness in relation to
progressive learning during the course.
In the marking phase, the unit assessors will ensure the markers have shared understanding of the rubric
through (as in SCU Assessment Policy):
•	 discussion within the marking team about a sample of submitted papers prior to the
commencement of marking
•	 members of marking team are paired – each member marking a sample of the other’s papers.
In the awarding of grades, the unit assessors will again ensure that the rubric has been used consistently
in the judging of final grades through (as in SCU Assessment Policy):
•	 sampling by Unit Assessor of marked scripts across each band (i.e. HD, D, etc.) to ensure consistency
with adjustment as necessary
1	 Oliver , B. (2012) Assuring graduate outcomes. Available from http://boliver.ning.com/page/standards-rubrics-1
Page 12
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
•	 sampling by Unit Assessor of marked scripts that are on the border between grades with adjustment
as necessary
•	 provision to markers of sample responses for short answer questions; and/or
•	 double blind marking of all submitted papers followed by a discussion where both markers reach
agreement on grade to be awarded (appropriate for honours or higher degree marking).
7. Examples of rubrics
A good rubric is one that communicates clearly to students and the marking team about the criteria
upon which judgments should be made, and the levels of achievement or standards. They are important
teaching tools that provide transparency to assessment. Rubrics naturally differ according to the nature
of the assessment task and its particular requirements and emphases. We provide a few examples to
guide the development of your rubrics. There are many websites with examples. As always, one needs
to use discernment as some rubrics may be overly complex.
7.1Collectionsofrubrics
Rubrics based on Research Skills Framework http://www.adelaide.edu.au/clpd/rsd/framework/
•	 University of Adelaide http://www.adelaide.edu.au/erga/rubrics/
•	 Carnegie Melon University http://www.cmu.edu/teaching/designteach/teach/rubrics.html
7.2Specificrubrics
Rubric type Example URL
Essay rubrics First year generic essay http://www.teaching-learning.utas.edu.au/assessment/criteria-
sheets
First year paper and critical
reading assessment
http://a-s.clayton.edu/ksweeney1/grading_rubric.htm
Holistic rubric for a History
essay
http://faculty.uncfsu.edu/jibrooks/frms/rubricessay.htm
Class participation
rubric
http://faculty.uncfsu.edu/jibrooks/frms/rubricpart.htm
Research paper rubric http://faculty.uncfsu.edu/jibrooks/frms/rubricrsrch.htm
Annotated
bibliography rubric
http://faculty.uncfsu.edu/jibrooks/frms/rubricannbib.htm
Page 13
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
8. Rubric Quality Checklist
The following checklist has been adapted from the one provided by Stevens and Levi (2005, p. 94) to
assist with refining and polishing the details of your rubric. It is a checklist for rubric design and a useful
tool as rubrics are likely to develop and improve over time as they are used and reflected upon by both
teaching staff and students.
Rubric Part Questions to consider Yes No
The marking criteria Does each criterion cover important parts of the final student
performance?
Do the criteria capture some key themes in your teaching?
Are the criteria clear?
Are the criteria distinctly different from each other?
Descriptions of levels of
performance (standards)
Do the descriptions match the criteria?
Are the descriptions clear and different from each other?
If you used points, is there a clear basis for assigning points for each
criteria?
If using a three-to-five level rubric, are the descriptions appropriately
and equally weighted across the three-to-five levels?
The levels Do the descriptors under each level truly represent that level of
performance?
If not using traditional grade labels (P, C, D, HD), are the scale labels
encouraging and still quite informative?
Does the rubric have a reasonable number of levels for the stage of the
student and the complexity of the assignment?
The overall rubric Does the rubric clearly connect to the learning outcomes that it is
designed to measure?
Can the rubric be understood by external audiences (avoids jargon and
technical language)?
Does it reflect teachable skills?
Does the rubric reward or penalise students based on skills unrelated to
the outcome being measure?
Fairness and sensibility Is the rubric fair to all students and free of bias?
Will the rubric be useful for students as performance feedback?
Does the rubric make sense to the reader?
Page 14
Last edited 8 October 2014.  CRICOS Provider: 01241G
Assessment
9. References
Biggs, J., & Tang, C. (2007). Teaching for quality learning at university (3rd ed.). Buckingham, UK: McGraw Hill & Open University
Press.
Lombardi, M. M. (2008). Making the grade: The role of assessment in authentic learning. Educause Learning Initiative (ELI) Paper 1,
January 2008. [Online]. Available from http://www.educause.edu/ir/library/pdf/ELI3019.pdf
Orrell, J. (2003). A generic assessment rubric. Presented at the 2010 L&T Forum, University of New South Wales. [Online].
Available from http://teaching.unsw.edu.au/generic-assessment-rubric-pdf
Perry, J. W. G. (1999). Forms of intellectual and ethical development in the college years. San Francisco: Jossey-Bass.
Rust, Chris. (2011). The unscholarly use of numbers in our assessment practices. What will make us change? International Journal
for the Scholarship of Teaching and Learning, 5(1). [Online].Available from http://academics.georgiasouthern.edu/ijsotl/
v5n1/invited_essays/Rust/index.html
Sadler, D. R. (2010). Fidelity as a precondition for integrity in grading academic achievement, Assessment & Evaluation in Higher
Education, 35(6), 727–743.
Stevens, D. D., & Levi, A. J. (2005). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback and
promote student learning. Sterling, VA: Stylus Publishing.

More Related Content

PPT
Specific Approaches To Curriculum Development
PPTX
Assessment literacy
PPTX
Rubric Development for Teachers
PPTX
Design of effective learning classroom
PDF
Effective Classroom Observations
PPT
Outcome-Based Education
PPTX
Improving Student Learning: Assessment, Evaluation and Reporting in the ELA C...
PPT
Curriculum evaluation
Specific Approaches To Curriculum Development
Assessment literacy
Rubric Development for Teachers
Design of effective learning classroom
Effective Classroom Observations
Outcome-Based Education
Improving Student Learning: Assessment, Evaluation and Reporting in the ELA C...
Curriculum evaluation

What's hot (20)

DOCX
Models, Principles and Development of Curriculum Design
PDF
Provincial secretariat of education Pakistan /// Directorate at Provinci...
DOCX
Classroom management and organization
PPT
Ppt summative assessment
PPTX
Feedback assessment
PPTX
THE ROLE OF TEACHER IN SOCIETY
PPTX
Instructions in the classroom
PPTX
Schoo Meetings and Establishing Communication Network
PPTX
Curriculum constrction sem i evaluation models
PPTX
Taba model of curriculum development
PPT
Effective lesson planning
PPT
The 21st Century Classroom
PPTX
Characteristics of a Good Curriculum
PPTX
Reconstructing teacher education: issues and remedies
PPTX
Comparison of Teacher Education in Pakistan with Other Developed Countries
PDF
Assessment and feedback lecture
PPT
Criteria for evaluating the curriculum
PPT
Classroom assessment
PPTX
Teaching Skills "Set induction & presentation & lesson plan"
PPTX
Concept of Classroom Assessment
Models, Principles and Development of Curriculum Design
Provincial secretariat of education Pakistan /// Directorate at Provinci...
Classroom management and organization
Ppt summative assessment
Feedback assessment
THE ROLE OF TEACHER IN SOCIETY
Instructions in the classroom
Schoo Meetings and Establishing Communication Network
Curriculum constrction sem i evaluation models
Taba model of curriculum development
Effective lesson planning
The 21st Century Classroom
Characteristics of a Good Curriculum
Reconstructing teacher education: issues and remedies
Comparison of Teacher Education in Pakistan with Other Developed Countries
Assessment and feedback lecture
Criteria for evaluating the curriculum
Classroom assessment
Teaching Skills "Set induction & presentation & lesson plan"
Concept of Classroom Assessment
Ad

Similar to 13. using rubrics in student assessment (20)

PDF
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
PPT
Rubrics
PPT
Creating Rubrics
PPTX
Online Course Assessment Part 2
PPT
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
PPTX
Rubric training .pptx
DOCX
Module 4, ed 103
PPT
Intro to rubrics
PPT
Intro to rubrics
PPT
Assessment for Learning I
PPTX
Rubrics
PPTX
RUBRICS.pptx
DOCX
A7: Major Assessment #3: Collaborative Adult Learning Project,
DOCX
Assessment primer
PPT
Alternative Assessment Techniques
PPTX
Performance based assessment
PPTX
Performance based assessment
PDF
4.1 rubric workshop handout mary allen
PPTX
Assessment Rubrics
PDF
Formative Evaluation - Instructional Design and Development
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
Rubrics
Creating Rubrics
Online Course Assessment Part 2
Rubric\'s Cube--Complimenting, Critiquing, and Challenging Student Work (NELB...
Rubric training .pptx
Module 4, ed 103
Intro to rubrics
Intro to rubrics
Assessment for Learning I
Rubrics
RUBRICS.pptx
A7: Major Assessment #3: Collaborative Adult Learning Project,
Assessment primer
Alternative Assessment Techniques
Performance based assessment
Performance based assessment
4.1 rubric workshop handout mary allen
Assessment Rubrics
Formative Evaluation - Instructional Design and Development
Ad

More from Cate Atehortua (20)

DOCX
Expo clase
PPTX
Técnicas e instrumentos de evaluación
PPT
Caracteristicas de la evaluacion
PPT
Instrumentos de evaluacion
PPTX
El examen
PDF
La evaluacion del proceso de formacion
PDF
La evaluacion de los aprendizajes
PDF
Aqui el que manda soy yo
PDF
Recorrido de la evaluacion
PDF
7. wiliam 2011 what is assesssment for learning
PDF
8. brown & hudson 1998 the alternatives in language assessment
PDF
evaluacion aprendizajes-contexto-otras-lenguas
PPT
Definicion de evaluacion
PPTX
Elaboracion de rubricas
PPT
Solar system
PPTX
Pronouns
PPTX
Preposition of place
PPTX
Elements of the house
PPTX
Ppt my blog
PPTX
The parts of the house
Expo clase
Técnicas e instrumentos de evaluación
Caracteristicas de la evaluacion
Instrumentos de evaluacion
El examen
La evaluacion del proceso de formacion
La evaluacion de los aprendizajes
Aqui el que manda soy yo
Recorrido de la evaluacion
7. wiliam 2011 what is assesssment for learning
8. brown & hudson 1998 the alternatives in language assessment
evaluacion aprendizajes-contexto-otras-lenguas
Definicion de evaluacion
Elaboracion de rubricas
Solar system
Pronouns
Preposition of place
Elements of the house
Ppt my blog
The parts of the house

Recently uploaded (20)

PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PPTX
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
PDF
Complications of Minimal Access Surgery at WLH
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
GDM (1) (1).pptx small presentation for students
PDF
A systematic review of self-coping strategies used by university students to ...
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
Cell Types and Its function , kingdom of life
PPTX
Institutional Correction lecture only . . .
PDF
01-Introduction-to-Information-Management.pdf
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
Classroom Observation Tools for Teachers
PPTX
Pharma ospi slides which help in ospi learning
PPTX
Microbial diseases, their pathogenesis and prophylaxis
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Supply Chain Operations Speaking Notes -ICLT Program
Chinmaya Tiranga quiz Grand Finale.pdf
Module 4: Burden of Disease Tutorial Slides S2 2025
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
Complications of Minimal Access Surgery at WLH
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Final Presentation General Medicine 03-08-2024.pptx
GDM (1) (1).pptx small presentation for students
A systematic review of self-coping strategies used by university students to ...
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
STATICS OF THE RIGID BODIES Hibbelers.pdf
Cell Types and Its function , kingdom of life
Institutional Correction lecture only . . .
01-Introduction-to-Information-Management.pdf
human mycosis Human fungal infections are called human mycosis..pptx
Classroom Observation Tools for Teachers
Pharma ospi slides which help in ospi learning
Microbial diseases, their pathogenesis and prophylaxis

13. using rubrics in student assessment

  • 1. Page 1 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment Using Rubrics in Student Assessment A rubric is a guide to assist the marker to make consistent and reliable judgments about the quality of student work. Contents Page no. 1. What is a rubric? 2 2. Why use rubrics? 2 3. When to use rubrics 3 4. Types of rubrics 4 4.1 Analytic rubrics 4 4.2 Holistic rubrics 7 5. What kind of rubric is right for your assessment task? 9 5.1 Pros and cons of analytic and holistic rubrics 9 5.2 Two known issues with analytic rubrics 9 6. Collaborative rubric construction 10 6.1 Whole-of-course approach to rubric development 10 6.2 Moderation of rubrics 11 7. Examples of rubrics 12 7.1 Collections of rubrics 12 7.2 Specific rubrics 12 8. Rubric Quality Checklist 13 9. References 14
  • 2. Page 2 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment 1. What is a rubric? A rubric is a guide to assist the marker to make consistent and reliable judgments about the quality of student work. They also can be used to provide feedback to students about the quality of their work and how they might improve. Rubrics are commonly presented in the form of a matrix that includes: • Marking criteria – the elements that the marker will consider when judging a piece of work (such as quality of argument, research, technical aspects, etc) • Grading standards – descriptive statements about the level of each criteria , often expressed on a scale (such as High Distinction, Distinction, Credit, Pass, Fail, or a number score). Rubrics may vary in complexity from simple tables to very detailed matrices that provide description of each dimension of quality and characterise each level of accomplishment. Rubrics can be adapted to grade many different types of assignments including essays, reports,, oral presentations, group work, research papers and many more. Above all, rubrics should be simple and clear so that students can readily understand and engage with them. 2. Why use rubrics? Rubrics bring transparency to assessment and marking for both staff and students. Clear criteria and standards: • Enable markers to form a shared understanding about how grades should be awarded • Explicitly communicate to students what is valued in the completion of a task • Help to clarify and articulate industry or discipline standards • Provide students with more detailed understanding of how to improve • Increase efficiency and consistency of marking and moderation processes. Rubrics are useful in all three stages of the assessment process. Before assessment occurs Rubrics have the dual purposes: for students it unpacks what is required in the assessment task. It provides important cues about the expected elements and approaches. For the marking team, the rubric provides an opportunity to unpack and moderate understandings about criteria and standards before marking commences During the assessment process Rubrics provide markers with a detailed framework for consistently judging individual student submissions. They also provide prompts to markers for the provision of systematic feedback on student performance against each criterion
  • 3. Page 3 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment After assessment occurs Rubrics provide important information to students about the quality of their performance against the specified criteria. Rubrics allow students to diagnose their strengths and weaknesses and where they can improve. They also provide transparency to students about standards, and how grades are derived. 3. When to use rubrics? All assessment types can be marked using rubrics. However, caution should be taken when deciding the form the rubric should take. Detailed atomized rubrics may trivialise the components of the assessment task and can skew the final assignment grade. A staff member explains: I thought I had allowed for all possibilities when I set up the marking criteria. However, when I collated the result from each criteria I was surprised the student had achieved a credit, when in fact they could not even solve the problem presented. To overcome the difficulties associated with overly-detailed rubrics and to help in the construction of standards researchers have proposed frameworks to assist in the design effective rubrics. These frameworks help us to see the range of potential student responses to a task – from very basic responses to highly sophisticated ones. Bloom’s Taxonomy is one tool that proposes a hierarchy of assessment tasks, SOLO taxonomy is another which focuses on criteria and standards. Perry (1999) presents a third option based on levels of moral and ethical reasoning. Orrell (2010) presents a generic assessment rubric as a tool to design a unit specific rubric. Table 1:   Modified Structure of the Observed Learning Outcome (SOLO) taxonomy (based on Biggs & Tang, 2007, p. 197) Descriptive knowledge Procedural knowledge Level name Memorise, identify, recite Count, match, order Uni-structural Describe, classify Compute, illustrate Multi-structural Compare and contrast, explain, argue, analyse Apply, construct, translate, solve near problem, predict within same domain Relational Theorise, hypothesise, generalise Reflect and improve, invent, create, solve unseen problems, predict to unknown domain Extended Abstract
  • 4. Page 4 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment 4. Types of rubrics There are two kinds of rubrics in common usage – analytic and holistic: Analytic rubrics are used when making judgements about each criteria separately and then combining each judgement to make a decision on the quality of the response. Holistic rubrics – used when making an overall or holistic judgement about the quality of the response. 4.1Analyticrubrics Analytic rubrics are the most common kind of rubric. They are used when the judgment of the assessment task can be partitioned into discrete elements or criteria each of which are assessed individually. The results for each criterion are then aggregated to provide an overall grade for the task. In some instances each criteria are weighted relative to their importance to achieving the learning outcomes for the assessment task. A simple analytical rubric can be seen below. This example contains criteria but no standards. Student performance for each criterion is indicated along a continuum from High Distinction to Fail. Assignment 1 – Online Discussion – 10% Criteria HD D Cr P F The relevance and coherence of your contributions in relation to the questions posed. The extent to which your contributions have contributed to the online debate and expanded or commented on the views of other contributors. Evidence that your comments are informed, where appropriate, by the texts and resources in unit, and other scholarly commentary. The timeliness of contributions in relation to the unit schedule. This rubric provides useful descriptive information relative to the criteria but does not describe standards of performance beyond a letter symbol. This may be acceptable in some cases (particularly for minor or relatively simple assessment tasks) but will be insufficient for more substantial assessment items. The following example is a more complex analytic rubric which contains both criteria and standards (adapted from Lombardi, 2008). A description is provided for each standard relative to each criterion along with the percentage weighting. This rubric provides more guidance to students about expected
  • 5. Page 5 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment standard for each element of the task. From this type of rubric students gain insight into how they might, in practical terms, improve their performance. Analytic rubric for student participation in group work Criteria Level of Student Performance D/HD Credit Pass Fail Workload 20% Did a full share of the work – or more; knows what needs to be done and does it; volunteers to help others. Did an equal share of the work; does work when asked; works hard most of the time. Did almost as much work as others; seldom asks for help. Did less work than others; doesn’t get caught up after absence; doesn’t ask for help. Getting organised 10% Took the initiative proposing meeting times and getting group organised. Worked agreeably with partner(s) concerning times and places to meet. Could be coaxed into meeting with other partner(s). Did not meet partner(s) at agreed times and places. Participation in discussions 30% Provided many good ideas for the unit development; inspired others; clearly communicated desires, ideas, personal needs, and feelings. Participated in discussions; shared feelings and thoughts. Listened mainly; on some occasions, made suggestions. Seemed bored with conversations about the unit; rarely spoke up, and ideas were off the mark. Meeting deadlines 10% Completed assigned work ahead of time. Completed assigned work on time. Needed some reminding; work was late but it didn’t impact grade. Needed much reminding; work was late and it did impact quality of work or grade. Showing up for meetings Score 10% Showed up for meetings punctually, sometimes ahead of time. Showed up for meetings on time. Showed up late, but it wasn’t a big problem for completing work. No show or extremely late; feeble or no excuse offered. Providing Feedback Score 10% Habitually provides dignified, clear, and respectful feedback. Gave feedback that did not offend. Provided some feedback; sometimes hurt feelings of others with feedback or made irrelevant comments. Was openly rude when giving feedback. Receiving Feedback Score 10% Graciously accepted feedback. Accepted feedback. Reluctantly accepted feedback. Refused to listen to feedback.
  • 6. Page 6 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment The second example below is a rubric from mathematical problem solving. It also provides guidance to students on what is expected and was used significantly in the pre-marking process with large group of tutors. Analytic rubric for mathematical problem solving and reporting Criteria High Distinction Distinction Credit Pass Fail Definition of the explicitness in problem description Weighting 5% Aim outlines the purpose of the investigation specifically, explicitly, and relevantly. Aim outlines the purpose of the investigation with minor lapse in explicitness, specificity or relevance. Aim outlines the purpose of the investigation with some lapse in explicitness, specificity or relevance. Aim outlines the purpose of the investigation with substantial lapse in explicitness, specificity or relevance. Aim not given or does not satisfactorily outline the purpose of the investigation. Clarity and correctness of method Weighting 35% Innovative and correct method of solution to problem. Above average and substantially correct method of solution to the problem. Average and mostly correct and complete method of solution to the problem. Sound but partially incomplete or incorrect method of solution to problem. Solution to problem not described, or not correct. Correctness of mathematics Weighting 40% All calculations/ algebra/graphs complete and correct. Only minor errors or omissions in calculations/ algebra/graphs. Calculations/ algebra/graphs partially correct or complete. Calculations/ algebra/graphs half correct or complete. Calculations/ algebra/graphs incorrect or not present. Logical and connected conclusion Weighting 10% Conclusion is explicit, logically and mathematically correct and consistent with the aim, method and results. Conclusion has minor lapse in explicitness, logical and mathematical correctness or consistency with the aim, method and results. Conclusion has some lapse in explicitness, logical and mathematical correctness or consistency with the aim, method and results. Conclusion has substantial lapse in explicitness, logical and mathematical correctness or consistency with the aim, method and results. Conclusion is not present or not explicit, not logically and mathematically correct, or not consistent with the aim, method and results. Written mathematical communication Weighting 10% Written expression of high level of achievement using sophisticated mathematical language. Written expression of high level of achievement with some use of appropriate mathematical language. Written expression of average level with some use of appropriate mathematical language. Written expression sound with little use of appropriate mathematical language. Written expression not included or very poor.
  • 7. Page 7 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment 4.2Holisticrubrics Holistic rubrics are used when it is more difficult or not desirable to partition a task into separate criteria. For example, in some tasks, the criteria are intertwined and overlap too much. This often occurs in complex, extended abstract or creative tasks where there are a variety of ways to go about the task and the task cannot easily be partitioned into components. In such cases we make holistic judgments about the work, rather than analytical judgments based on individual criteria. In holistic rubrics, the standards are articulated by a detailed descriptive statement, as follows: Holistic rubric for multi-media project Grade Description of Grade High Distinction The project is realised to a very high professional standard. Technically it is fully functional and meets all specifications. It demonstrates high levels of creativity and innovation both in terms of its function and usability. It has a high level of aesthetic appeal. It has been carefully quality controlled to ensure full functionality and that no errors are evident. This product has real‘wow’factor. Distinction The project is realised to a high professional standard, with a good level of function and meets most specifications. It demonstrates occasional levels of creativity and innovation and is attractive and aesthetically engaging. While there may be a few errors, these are of a minor nature. Generally the product would be well-regarded by industry standards. Credit The project is realised to an acceptable professional standard with generally adequate levels of function and generally meets specifications, although there are a number of problems evident. There is some evidence of creativity and innovation although these are not sustained or notable. Further experimentation and testing could have improved this product considerably. Generally it would not be well regarded by industry and would need more work before release, but still shows good developing competence. Pass The project was completed, but to a less than acceptable industry standard. Functionality was problematic and often did not meet required specifications. There is little evidence of creativity or innovation in the project. Numerous errors crept into the work. Significant further work would be required to bring this up to industry standards, but overall it demonstrates sufficient competence to merit a passing grade. Fail The project is incomplete and/or work well below industry standards. Functionality is poor or absent. Failure to meet project specifications. Numerous errors. Little or no innovation or aesthetic appeal. A large volume of work required to bring the project up to industry standards. Insufficient effort or competence demonstrated to achieve a passing grade.
  • 8. Page 8 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment Holistic rubric for essay Grade Description of Grade High Distinction This essay commands attention because of its insightful development and mature style. The response to the text is convincing and elaborated upon with well-chosen and correctly referenced examples. It is written with aptly chosen words, effectively constructed sentences and a keen observation of the conventions of written English. Distinction This essay provides a thoughtful and well reasoned response to the text with appropriate and correctly referenced examples. The sentences are constructed and words chosen to communicate clearly to the reader. The conventions of written English have been well observed. Credit This essay provides a competently reasoned response to the text with some appropriate and mostly correctly referenced examples. The sentence structure and choice of words have sufficient precision to communicate the message to the reader. The conventions of written English have been observed. Pass This essay is satisfactory. It provides an adequate response to the text with sufficient examples and adequate reasoning. The examples are mostly adequately referenced. The sentence structure and choice of words communicates adequately to the reader. The conventions of written English need to be observed more closely. Fail This essay fails to respond appropriately to the text. The responses are simplistic or incoherent and suggest some significant misunderstanding of the text. The writing lacks appropriate structure and has a pattern of errors in word choice with poor grammatical expression. Correctly referenced examples are absent or poorly presented. More attention needs to be paid to the conventions of written English. Holistic rubric for online participation Grade Descriptor of Grade High Distinction In addition to qualities of a distinction grade, contributions at this level demonstrate a sophisticated synthesis of theoretical understanding and reflection on practice, as well as a high level collegiality in engaging with others. Distinction • Contribution to the discussion is relevant, succinct and timely. • Contributions demonstrate deep engagement with issues and recognition and evaluation of differing perspectives. • Contributions are informed by significant reading and critical reflection on own professional practice. • Contributions advance and extend the debate and demonstrate high level of online communication skills Credit • Contribution to the discussion is relevant, succinct and timely. • Contributions demonstrate a good understanding of basic issues and own professional practice • Contributions are informed by reading and reflection and not only personal opinion. Clear efforts are evident to engage with others’views and to advance the debate in constructive ways.
  • 9. Page 9 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment Grade Descriptor of Grade Pass • Some contribution to discussion is evident but may also be untimely. • Contributions make some points that demonstrate basic understanding but do not generally advance the debate. • Contributions suggest only minimal engagement with literature and tend to reflect only personal opinion. Fail Fails to make necessary contributions and/or contributions are very late. Comments are generally not scholarly and do not contribute to the debate. 5. What kind of rubric is right for your assessment task? 5.1Prosandconsofanalyticandholisticrubrics The advantages and disadvantages of each type of rubric depend on the situation they are used in and how they are used. Analytic Holistic Pros • Useful when task is composed of discrete skills or knowledge • Provides direct advice on set criteria • Shows students specific strengths and weaknesses • Easier to moderate marking in large classes with large number of markers • Can take more time to develop. • Useful for tasks that contain inter-related skills and knowledge • Useful for tasks that are holistic in nature e.g. works of art, creative writing, engineering design, essays, projects • Can focus on higher order, inter-related knowledge and skills • May be more authentic in nature • Can be quicker to develop. Cons • Can over-partition a task so that the result is biased towards small skills rather than the overall achievement • Can produce a biased results if criteria are not carefully selected • Can focus on detailed, lower level skills rather than deeper understanding and knowledge. • Can be more difficult to moderate in large classes with large number of markers • May not provide the detailed feedback students expect • Can produce a biased result if markers are not clear on what is required. 5.2Twoknownissueswithanalyticrubrics Two respected researchers of assessment in higher education have warned teachers about taking rubrics a step too far. Sadler (2010) asks us to be cautious about using criteria in rubrics that do not contribute to achievement of learning outcomes. He claims that these lead to a mistrust in the integrity of the grade. Typically
  • 10. Page 10 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment such criteria include technical requirements that are aimed to change student behaviours or improve learning. He lists the following practices that can undermine achievement and misrepresent a grade. • Marks awarded for attendance at, or participation in, lectures, a minimum proportion of classes, group discussions, laboratory sessions or e-learning chat rooms • Marks awarded for completion of specified activities, including practice exercises, log books, reflective journals, posts to online forums and discussion boards without reference to learning outcomes • Marks awarded for inclusion of a specified component in a work submitted (eg ‘at least 20 references’) • Marks awarded for completion of interim drafts or project stages • Marks deducted for late submission of a response to an assessment task • Marks deducted non-conformity with regulative specifications, such as maximum word length (for an essay) • Marks deducted for plagiarism. Further details on this issue are available at UQ Assessment Brief on Fidelity as a precondition for integrity in grading academic achievement (2011). Rust’s (2011) concern lies with the automatic use of numbers or marks to determine achievement. He proposes that because of the way numbers are presented for very different assessment types and then calculated and recalculated to produce a final grade, a biased result may be obtained. This result may obscure the actual student’s performance. He presents seven arguments against traditional practices in the use of numbers as the basis of making assessment judgements. Further details on this issue are available at UQ Assessment Brief on The unscholarly use of numbers in our assessment practices: What will make us change? (2011). Caution should be used in developing rubrics – complex mathematical formulas or fine grained analytic rubrics can bias a grade resulting in a final judgment which runs counter expectations. 6. Collaborative rubric construction 6.1Whole-of-courseapproachtorubricdevelopment The Australian Government, professions and the wider community increasingly require assurance of outcomes standards in university award programs. In particular, the Australian Qualifications Framework (AQF) specifies generic learning outcomes for courses at each AQF level. More and more course coordinators are using rubrics to define the standard of specific generic skills.
  • 11. Page 11 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment These course rubrics are different from the marking rubrics described above. Oliver (2012)1 presents an array of these rubrics and states that these rubrics: • communicate to graduates what is expected by or even beyond graduation • enable those teaching in the course to reach a shared understanding of the standards expected of students and graduates • can act as a broad guide to the standards expected in specific assessment tasks throughout the degree. Such rubrics encourage a whole-of-course approach to assessment and the articulations of standards between units. 6.2Moderationofrubrics Moderation of rubrics is part of the wider moderation of assessment which seeks to ensure that procedures and practices are valid and reliable and are aligned with its stated standards, principles and ethos. Moderation of rubrics is implemented at three stages within the assessment process: • Designing phase: judging the appropriateness of the associated rubric before release to students • Marking phase: ensuring that all markers have shared understanding of rubric criteria and standard before marking commences • Awarding of grades: confirm that the grades are correct, fair and consistent before release to students. In the designing phase the designer and moderator (the academic colleagues designated to review the unit assessment) will: • ensure the rubric fits with unit learning outcomes, focuses on higher-order learning, uses appropriate marking criteria and standards • ensure that the rubric fits with other rubrics to determine the appropriateness in relation to progressive learning during the course. In the marking phase, the unit assessors will ensure the markers have shared understanding of the rubric through (as in SCU Assessment Policy): • discussion within the marking team about a sample of submitted papers prior to the commencement of marking • members of marking team are paired – each member marking a sample of the other’s papers. In the awarding of grades, the unit assessors will again ensure that the rubric has been used consistently in the judging of final grades through (as in SCU Assessment Policy): • sampling by Unit Assessor of marked scripts across each band (i.e. HD, D, etc.) to ensure consistency with adjustment as necessary 1 Oliver , B. (2012) Assuring graduate outcomes. Available from http://boliver.ning.com/page/standards-rubrics-1
  • 12. Page 12 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment • sampling by Unit Assessor of marked scripts that are on the border between grades with adjustment as necessary • provision to markers of sample responses for short answer questions; and/or • double blind marking of all submitted papers followed by a discussion where both markers reach agreement on grade to be awarded (appropriate for honours or higher degree marking). 7. Examples of rubrics A good rubric is one that communicates clearly to students and the marking team about the criteria upon which judgments should be made, and the levels of achievement or standards. They are important teaching tools that provide transparency to assessment. Rubrics naturally differ according to the nature of the assessment task and its particular requirements and emphases. We provide a few examples to guide the development of your rubrics. There are many websites with examples. As always, one needs to use discernment as some rubrics may be overly complex. 7.1Collectionsofrubrics Rubrics based on Research Skills Framework http://www.adelaide.edu.au/clpd/rsd/framework/ • University of Adelaide http://www.adelaide.edu.au/erga/rubrics/ • Carnegie Melon University http://www.cmu.edu/teaching/designteach/teach/rubrics.html 7.2Specificrubrics Rubric type Example URL Essay rubrics First year generic essay http://www.teaching-learning.utas.edu.au/assessment/criteria- sheets First year paper and critical reading assessment http://a-s.clayton.edu/ksweeney1/grading_rubric.htm Holistic rubric for a History essay http://faculty.uncfsu.edu/jibrooks/frms/rubricessay.htm Class participation rubric http://faculty.uncfsu.edu/jibrooks/frms/rubricpart.htm Research paper rubric http://faculty.uncfsu.edu/jibrooks/frms/rubricrsrch.htm Annotated bibliography rubric http://faculty.uncfsu.edu/jibrooks/frms/rubricannbib.htm
  • 13. Page 13 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment 8. Rubric Quality Checklist The following checklist has been adapted from the one provided by Stevens and Levi (2005, p. 94) to assist with refining and polishing the details of your rubric. It is a checklist for rubric design and a useful tool as rubrics are likely to develop and improve over time as they are used and reflected upon by both teaching staff and students. Rubric Part Questions to consider Yes No The marking criteria Does each criterion cover important parts of the final student performance? Do the criteria capture some key themes in your teaching? Are the criteria clear? Are the criteria distinctly different from each other? Descriptions of levels of performance (standards) Do the descriptions match the criteria? Are the descriptions clear and different from each other? If you used points, is there a clear basis for assigning points for each criteria? If using a three-to-five level rubric, are the descriptions appropriately and equally weighted across the three-to-five levels? The levels Do the descriptors under each level truly represent that level of performance? If not using traditional grade labels (P, C, D, HD), are the scale labels encouraging and still quite informative? Does the rubric have a reasonable number of levels for the stage of the student and the complexity of the assignment? The overall rubric Does the rubric clearly connect to the learning outcomes that it is designed to measure? Can the rubric be understood by external audiences (avoids jargon and technical language)? Does it reflect teachable skills? Does the rubric reward or penalise students based on skills unrelated to the outcome being measure? Fairness and sensibility Is the rubric fair to all students and free of bias? Will the rubric be useful for students as performance feedback? Does the rubric make sense to the reader?
  • 14. Page 14 Last edited 8 October 2014.  CRICOS Provider: 01241G Assessment 9. References Biggs, J., & Tang, C. (2007). Teaching for quality learning at university (3rd ed.). Buckingham, UK: McGraw Hill & Open University Press. Lombardi, M. M. (2008). Making the grade: The role of assessment in authentic learning. Educause Learning Initiative (ELI) Paper 1, January 2008. [Online]. Available from http://www.educause.edu/ir/library/pdf/ELI3019.pdf Orrell, J. (2003). A generic assessment rubric. Presented at the 2010 L&T Forum, University of New South Wales. [Online]. Available from http://teaching.unsw.edu.au/generic-assessment-rubric-pdf Perry, J. W. G. (1999). Forms of intellectual and ethical development in the college years. San Francisco: Jossey-Bass. Rust, Chris. (2011). The unscholarly use of numbers in our assessment practices. What will make us change? International Journal for the Scholarship of Teaching and Learning, 5(1). [Online].Available from http://academics.georgiasouthern.edu/ijsotl/ v5n1/invited_essays/Rust/index.html Sadler, D. R. (2010). Fidelity as a precondition for integrity in grading academic achievement, Assessment & Evaluation in Higher Education, 35(6), 727–743. Stevens, D. D., & Levi, A. J. (2005). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback and promote student learning. Sterling, VA: Stylus Publishing.