What is ‘Best Practice’ in Educational Assessment? Geoff N Masters
Assessment is a key element in all  educational reform efforts.
Assessment practices can have a powerful influence on what is taught, on students and their families.
17 March 2008   Police suspect examination stress as the reason for the suicide of a 13-year-old girl. 14 March 2008   Parents of a 15-year-old boy attribute his suicide to pressure of an upcoming English examination. The Times of India , 24 March 2008
In this presentation, I will outline what I consider to be five features of  ‘best-practice’  educational assessment.
The Role of Assessment A traditional view… The role of  teachers  is to teach. The role of  students  is to learn what teachers teach. The role of  assessment  is to evaluate how well students have learnt what teachers have taught. focus is on  judging students
best practice 1.  assessment is used as a vital element in   the educational  decision making loop
… educational decisions are based on a sound  understanding of the  current situation,  … understanding of current situation understanding of current situation
… on expert knowledge about  how  to improve, … knowledge about how to improve understanding of current situation
… and are made possible by access to    the required  resources . required resources understanding of current situation knowledge about how to improve
Actions are taken in the interests of  improved student learning… ACTION understanding of current situation knowledge about how to improve required resources improved learning outcomes
… and, ultimately, improved life consequences… ACTION improved learning outcomes understanding of current situation knowledge about how to improve required resources improved life consequences
… and a feedback / evaluation cycle is built in  to ensure learning from practice. ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources feedback / evaluation ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources
Assessment  provides essential information at  key points in this loop… ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources feedback / evaluation ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources
understanding of current situation understanding the  status quo
ACTION improved learning outcomes measuring learning and evaluating action
feedback / evaluation improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve building knowledge and improving practice
In other words, in best-practice systems, assessment has a much broader role than  judging how well individuals have learnt  what they have been taught.
Users of Assessment A traditional view… Assessment tells  parents  how well their children have learnt what has been taught. Assessment is used for entry into  selective schools ,  universities  and  employment .
best practice 1.  assessment plays a vital role in the    educational decision making loop 2.  assessment informs educational    decision making  at all levels
system managers school leaders classroom teachers students / parents best practice ACTION feedback / evaluation improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources
The Conceptualization of Assessment A traditional view… Assessment is the process of establishing how much of what was taught a student successfully learnt.   e.g., “90% of test correct”   “performed above 85% of age group”
best practice 1.  assessment plays a vital role in the    educational decision making loop 2.  assessment informs educational    decision making  at all levels 3.  assessment is used to establish  where   students are  in their learning
“ The most important single factor influencing learning is what the learner already knows.  Ascertain this and teach him [sic] accordingly. ” Ausubel (1968)
“ There is a good deal of evidence that learning is enhanced when teachers pay attention to the  knowledge and beliefs that learners bring to the  learning task, use this knowledge as a starting point for new instruction, and monitor students’ changing conceptions as instruction proceeds .” Bransford, Brown and Cocking (2000)
Best-practice assessment systems map and describe growth in an area of learning across the years of school...
 
 
… and report achievement against a ‘map’ of progress…
deal with difficult texts and to complete sophisticated reading tasks. They can deal with information that is difficult to find in unfamiliar texts, especially in the presence of closely competing information, show detailed understanding of these texts and sort out which information is relevant to the task. They are able to evaluate texts critically, draw on specialized knowledge to build hypotheses, and cope with concepts that may be contrary to expectations. cope with difficult tasks, such as locating embedded information, construing meaning of part  of a text through considering the text as a whole, and dealing with ambiguities and negatively worded ideas. They show accurate understanding of complex texts and are able to evaluate texts critically. deal with moderately complex reading tasks, such as finding several pieces of relevant information and sorting out detailed competing information requiring consideration of many criteria to compare, contrast or categorise. They are able to make links between different  parts of a text and to understand text in a detailed way in relation to everyday knowledge. cope with basic reading tasks, such as locating straightforward information, making low-level inferences, using some outside knowledge to help understand a well defined part of a text,  and applying their own experience and attitudes to help explain a feature of a text. deal with only the least complex reading tasks developed for PISA, such as finding explicitly stated pieces of information and recognising the main theme or author’s purpose in a text on  a familiar topic when the required information is readily accessible in the text. They are also  able to make a connection between common, everyday knowledge and information in the text. 5 4 3 2 1 Level reading
… which can then be used to display and study  achievement to inform decision making…
mathematics achievement
reading achievement
socioeconomic status reading achievement
The Focus of Assessment A traditional view… Assessment is focused on how well student can recall facts and apply algorithms. (factual and procedural knowledge)
best practice 1.  assessment plays a vital role in the  educational decision making loop 2.  assessment informs educational  decision making  at all levels assessment is used to establish  where  students are  in their learning 4.   assessment promotes and evaluates deep understanding
best practice Best-practice assessment systems are not limited to  tests of factual and procedural knowledge... “ One of the hallmarks of the new science of learning is its emphasis on learning with understanding…. The knowledge of experts is not simply a list of facts and formulas that are relevant to their domain; instead, their knowledge is organised around core concepts or ‘big ideas’ that guide their thinking… ” Bransford, Brown and Cocking (2000)
… include tasks designed to reveal students’  understandings of concepts and principles…
A man holding a heavy ball runs at a constant velocity past a camera on a  tripod fixed on the ground.  Snapshot A shows the man releasing the ball.
ball was released from here Snapshot B.  Sketch as accurately as you can the path of the falling ball  as seen by the photographer standing on the ground.
… and to assess higher-order  reasoning  skills…
The image above suggests that we A   cannot escape conformity. B   can effectively disguise ourselves. C   appear to be anonymous but are unique. D   appear to be unique but are anonymous.
The Culture that Assessment Promotes A traditional view… Assessment promotes a ‘performance’ culture characterized by: -- external drivers -- competition for grades/rewards -- fear of failure.
best practice 1.  assessment plays a vital role in the  educational decision making loop 2.  assessment informs educational  decision making  at all levels assessment is used to establish  where   students are  in their learning assessment promotes and evaluates deep understanding   5.  assessment supports the development    of classroom  learning cultures
best practice Best-practice assessment systems support ‘learning oriented’ rather than ‘performance oriented’ cultures...
… not driven by competition and/or fear of  failure, but encourage risk-taking, tolerate mistakes  and provide feedback that allows students to monitor  their own progress.  skills required for the future
How can we better support students to monitor their own progress over time?
© Copyright 2008 | Sitemap | Search |  Webmaster Student Progress Report Lauren Peace
LAUREN PEACE This is how I  looked when    I started school This is me now !! © Copyright 2008 | Sitemap | Search |  Webmaster How is Lauren doing? Most recent report Reading Writing Mathematics Science Art Physical Education Music Personal and Social skills Lauren’s teacher Lauren’s class Special activities Homework  Back to home page Back to entry page NEWSLETTER Click on the icon above to take you to the newsletter.
© Copyright 2008 | Sitemap | Search |  Webmaster Is Lauren’s writing getting better? Is Lauren’s writing what we would expect at Grade 3? Test results What does writing progress look like? LAUREN’S WRITING Teacher’s comment Lauren has described the task clearly.  She is using full stops and capital letters correctly and her spelling of simple words and some difficult words is accurate.   Lauren’s comment This is not my very best writing.  I’m better at writing stories because I like them more and then I don’t make so many mistakes.  I am trying to concentrate harder.
Thank You Professor Geoff N Masters Chief Executive Officer Australian Council for Educational Research 19 Prospect Hill Rd Camberwell, VIC Australia  3124 www.acer.edu.au

More Related Content

PDF
Open Book Examination
PPTX
Design Thinking Online Assessment
PPTX
Assessment for higher education (for biology faculty seminar)
PPT
Assessment Assumptions
PPTX
TEST, MEASUREMENT, ASSESSMENT, AND EVALUATION (DINI & ORNELA)
PPT
Assessment In Practice Presentation
PDF
Lorna Earl Rethinking Classroom Assessment With Purpose In Mind
PPTX
Assessment dr. asmma'
Open Book Examination
Design Thinking Online Assessment
Assessment for higher education (for biology faculty seminar)
Assessment Assumptions
TEST, MEASUREMENT, ASSESSMENT, AND EVALUATION (DINI & ORNELA)
Assessment In Practice Presentation
Lorna Earl Rethinking Classroom Assessment With Purpose In Mind
Assessment dr. asmma'

What's hot (20)

PDF
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
PPT
Assessing for Improvement: learning outcomes assessment for library instruction
PPT
Assessment Of Student Learning
DOC
article
PPTX
Asl 2 lecture 3
PPTX
Pedagogic Assessment
PPTX
Assessment that Informs Instruction
PPTX
2014 Student Learning Outcomes
DOC
report in chem
PPTX
Assessment techniques
PPTX
New trends in evaluation v kamat
PPTX
Types of Assessment in Classroom
PPTX
Assessment-Related Principles
PPTX
Differentiated Assessment
PPTX
Group1 Assessment
PDF
Week 1 unit 3 ~ intro and theories of formative and summative assessment
PDF
Educational Assessment and Evaluation
PPTX
Open book system
PDF
Assessment and feedback lecture
PDF
Assessments for learning -B.ed Second year notes
Foreign Language Classroom Assessment in Support of Teaching and Learning wit...
Assessing for Improvement: learning outcomes assessment for library instruction
Assessment Of Student Learning
article
Asl 2 lecture 3
Pedagogic Assessment
Assessment that Informs Instruction
2014 Student Learning Outcomes
report in chem
Assessment techniques
New trends in evaluation v kamat
Types of Assessment in Classroom
Assessment-Related Principles
Differentiated Assessment
Group1 Assessment
Week 1 unit 3 ~ intro and theories of formative and summative assessment
Educational Assessment and Evaluation
Open book system
Assessment and feedback lecture
Assessments for learning -B.ed Second year notes
Ad

Viewers also liked (20)

PDF
5 Characteristics of Excellent Instructional Designers
PPT
Twenty Global Problems by Wagle
PPT
T8 Chinese Teacher Preparation in North America: Meeting the Growing Demand f...
PPT
Ho CLTA Collaborating with Universities in China
PPT
Modernizing Curriculum and Instruction: The Case of Mathematics in the United...
PPT
Q10 Incorporating Chinese Guest Teachers for Strong, Sustainable Programs
PPT
Creating Global Connections- Empowering Students Through Service Learning
PPT
Ingold Curran Liu Designing Startalk Teacher Programs
PPTX
Packard Liu Setting the Research Agenda
PPT
Harvey Greenwich Village Chinese
PPT
Confucius Classrooms Initiative
PPT
Introduction To Ethical Literacy
PPT
I3 Assessing Chinese Language Proficiency in Young Students: Strategies and ...
PPT
Preparing Teachers To Teach About The World
PPT
Australia's e-Learning System
PPT
Internationalizing STEM by Moss
5 Characteristics of Excellent Instructional Designers
Twenty Global Problems by Wagle
T8 Chinese Teacher Preparation in North America: Meeting the Growing Demand f...
Ho CLTA Collaborating with Universities in China
Modernizing Curriculum and Instruction: The Case of Mathematics in the United...
Q10 Incorporating Chinese Guest Teachers for Strong, Sustainable Programs
Creating Global Connections- Empowering Students Through Service Learning
Ingold Curran Liu Designing Startalk Teacher Programs
Packard Liu Setting the Research Agenda
Harvey Greenwich Village Chinese
Confucius Classrooms Initiative
Introduction To Ethical Literacy
I3 Assessing Chinese Language Proficiency in Young Students: Strategies and ...
Preparing Teachers To Teach About The World
Australia's e-Learning System
Internationalizing STEM by Moss
Ad

Similar to What is ‘Best Practice’ in Educational Assessment? (18)

PDF
Importance Of Formative And Summative Assessment
PDF
Essay On Assessment For Learning
PDF
Summative Assessment
PPTX
Day 2 presentation what is assessment
DOCX
Learning modules marketing messages.docx
PDF
Purpose Of Assessment For Learning
PDF
Types Of Assessment
PDF
The Assessment Of Formative Assessment
PPTX
Day 2 presentation what is assessment
PPTX
EDUC 209 _ REPORT.pptx
PPT
Abcsassessment
PPTX
Assessment of learning
PDF
Formative Reflective Assessment
PPTX
Day 3 presesntation morning
Importance Of Formative And Summative Assessment
Essay On Assessment For Learning
Summative Assessment
Day 2 presentation what is assessment
Learning modules marketing messages.docx
Purpose Of Assessment For Learning
Types Of Assessment
The Assessment Of Formative Assessment
Day 2 presentation what is assessment
EDUC 209 _ REPORT.pptx
Abcsassessment
Assessment of learning
Formative Reflective Assessment
Day 3 presesntation morning

Recently uploaded (20)

PPTX
B.Sc. DS Unit 2 Software Engineering.pptx
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
Uderstanding digital marketing and marketing stratergie for engaging the digi...
PPTX
Virtual and Augmented Reality in Current Scenario
PDF
My India Quiz Book_20210205121199924.pdf
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
International_Financial_Reporting_Standa.pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PPTX
Introduction to pro and eukaryotes and differences.pptx
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PDF
Empowerment Technology for Senior High School Guide
PPTX
History, Philosophy and sociology of education (1).pptx
B.Sc. DS Unit 2 Software Engineering.pptx
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
What if we spent less time fighting change, and more time building what’s rig...
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
Chinmaya Tiranga quiz Grand Finale.pdf
Uderstanding digital marketing and marketing stratergie for engaging the digi...
Virtual and Augmented Reality in Current Scenario
My India Quiz Book_20210205121199924.pdf
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
Environmental Education MCQ BD2EE - Share Source.pdf
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Unit 4 Computer Architecture Multicore Processor.pptx
International_Financial_Reporting_Standa.pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Introduction to pro and eukaryotes and differences.pptx
TNA_Presentation-1-Final(SAVE)) (1).pptx
Empowerment Technology for Senior High School Guide
History, Philosophy and sociology of education (1).pptx

What is ‘Best Practice’ in Educational Assessment?

  • 1. What is ‘Best Practice’ in Educational Assessment? Geoff N Masters
  • 2. Assessment is a key element in all educational reform efforts.
  • 3. Assessment practices can have a powerful influence on what is taught, on students and their families.
  • 4. 17 March 2008 Police suspect examination stress as the reason for the suicide of a 13-year-old girl. 14 March 2008 Parents of a 15-year-old boy attribute his suicide to pressure of an upcoming English examination. The Times of India , 24 March 2008
  • 5. In this presentation, I will outline what I consider to be five features of ‘best-practice’ educational assessment.
  • 6. The Role of Assessment A traditional view… The role of teachers is to teach. The role of students is to learn what teachers teach. The role of assessment is to evaluate how well students have learnt what teachers have taught. focus is on judging students
  • 7. best practice 1. assessment is used as a vital element in the educational decision making loop
  • 8. … educational decisions are based on a sound understanding of the current situation, … understanding of current situation understanding of current situation
  • 9. … on expert knowledge about how to improve, … knowledge about how to improve understanding of current situation
  • 10. … and are made possible by access to the required resources . required resources understanding of current situation knowledge about how to improve
  • 11. Actions are taken in the interests of improved student learning… ACTION understanding of current situation knowledge about how to improve required resources improved learning outcomes
  • 12. … and, ultimately, improved life consequences… ACTION improved learning outcomes understanding of current situation knowledge about how to improve required resources improved life consequences
  • 13. … and a feedback / evaluation cycle is built in to ensure learning from practice. ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources feedback / evaluation ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources
  • 14. Assessment provides essential information at key points in this loop… ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources feedback / evaluation ACTION improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources
  • 15. understanding of current situation understanding the status quo
  • 16. ACTION improved learning outcomes measuring learning and evaluating action
  • 17. feedback / evaluation improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve building knowledge and improving practice
  • 18. In other words, in best-practice systems, assessment has a much broader role than judging how well individuals have learnt what they have been taught.
  • 19. Users of Assessment A traditional view… Assessment tells parents how well their children have learnt what has been taught. Assessment is used for entry into selective schools , universities and employment .
  • 20. best practice 1. assessment plays a vital role in the educational decision making loop 2. assessment informs educational decision making at all levels
  • 21. system managers school leaders classroom teachers students / parents best practice ACTION feedback / evaluation improved learning outcomes improved life consequences understanding of current situation knowledge about how to improve required resources
  • 22. The Conceptualization of Assessment A traditional view… Assessment is the process of establishing how much of what was taught a student successfully learnt. e.g., “90% of test correct” “performed above 85% of age group”
  • 23. best practice 1. assessment plays a vital role in the educational decision making loop 2. assessment informs educational decision making at all levels 3. assessment is used to establish where students are in their learning
  • 24. “ The most important single factor influencing learning is what the learner already knows. Ascertain this and teach him [sic] accordingly. ” Ausubel (1968)
  • 25. “ There is a good deal of evidence that learning is enhanced when teachers pay attention to the knowledge and beliefs that learners bring to the learning task, use this knowledge as a starting point for new instruction, and monitor students’ changing conceptions as instruction proceeds .” Bransford, Brown and Cocking (2000)
  • 26. Best-practice assessment systems map and describe growth in an area of learning across the years of school...
  • 27.  
  • 28.  
  • 29. … and report achievement against a ‘map’ of progress…
  • 30. deal with difficult texts and to complete sophisticated reading tasks. They can deal with information that is difficult to find in unfamiliar texts, especially in the presence of closely competing information, show detailed understanding of these texts and sort out which information is relevant to the task. They are able to evaluate texts critically, draw on specialized knowledge to build hypotheses, and cope with concepts that may be contrary to expectations. cope with difficult tasks, such as locating embedded information, construing meaning of part of a text through considering the text as a whole, and dealing with ambiguities and negatively worded ideas. They show accurate understanding of complex texts and are able to evaluate texts critically. deal with moderately complex reading tasks, such as finding several pieces of relevant information and sorting out detailed competing information requiring consideration of many criteria to compare, contrast or categorise. They are able to make links between different parts of a text and to understand text in a detailed way in relation to everyday knowledge. cope with basic reading tasks, such as locating straightforward information, making low-level inferences, using some outside knowledge to help understand a well defined part of a text, and applying their own experience and attitudes to help explain a feature of a text. deal with only the least complex reading tasks developed for PISA, such as finding explicitly stated pieces of information and recognising the main theme or author’s purpose in a text on a familiar topic when the required information is readily accessible in the text. They are also able to make a connection between common, everyday knowledge and information in the text. 5 4 3 2 1 Level reading
  • 31. … which can then be used to display and study achievement to inform decision making…
  • 35. The Focus of Assessment A traditional view… Assessment is focused on how well student can recall facts and apply algorithms. (factual and procedural knowledge)
  • 36. best practice 1. assessment plays a vital role in the educational decision making loop 2. assessment informs educational decision making at all levels assessment is used to establish where students are in their learning 4. assessment promotes and evaluates deep understanding
  • 37. best practice Best-practice assessment systems are not limited to tests of factual and procedural knowledge... “ One of the hallmarks of the new science of learning is its emphasis on learning with understanding…. The knowledge of experts is not simply a list of facts and formulas that are relevant to their domain; instead, their knowledge is organised around core concepts or ‘big ideas’ that guide their thinking… ” Bransford, Brown and Cocking (2000)
  • 38. … include tasks designed to reveal students’ understandings of concepts and principles…
  • 39. A man holding a heavy ball runs at a constant velocity past a camera on a tripod fixed on the ground. Snapshot A shows the man releasing the ball.
  • 40. ball was released from here Snapshot B. Sketch as accurately as you can the path of the falling ball as seen by the photographer standing on the ground.
  • 41. … and to assess higher-order reasoning skills…
  • 42. The image above suggests that we A cannot escape conformity. B can effectively disguise ourselves. C appear to be anonymous but are unique. D appear to be unique but are anonymous.
  • 43. The Culture that Assessment Promotes A traditional view… Assessment promotes a ‘performance’ culture characterized by: -- external drivers -- competition for grades/rewards -- fear of failure.
  • 44. best practice 1. assessment plays a vital role in the educational decision making loop 2. assessment informs educational decision making at all levels assessment is used to establish where students are in their learning assessment promotes and evaluates deep understanding 5. assessment supports the development of classroom learning cultures
  • 45. best practice Best-practice assessment systems support ‘learning oriented’ rather than ‘performance oriented’ cultures...
  • 46. … not driven by competition and/or fear of failure, but encourage risk-taking, tolerate mistakes and provide feedback that allows students to monitor their own progress. skills required for the future
  • 47. How can we better support students to monitor their own progress over time?
  • 48. © Copyright 2008 | Sitemap | Search | Webmaster Student Progress Report Lauren Peace
  • 49. LAUREN PEACE This is how I looked when I started school This is me now !! © Copyright 2008 | Sitemap | Search | Webmaster How is Lauren doing? Most recent report Reading Writing Mathematics Science Art Physical Education Music Personal and Social skills Lauren’s teacher Lauren’s class Special activities Homework Back to home page Back to entry page NEWSLETTER Click on the icon above to take you to the newsletter.
  • 50. © Copyright 2008 | Sitemap | Search | Webmaster Is Lauren’s writing getting better? Is Lauren’s writing what we would expect at Grade 3? Test results What does writing progress look like? LAUREN’S WRITING Teacher’s comment Lauren has described the task clearly. She is using full stops and capital letters correctly and her spelling of simple words and some difficult words is accurate. Lauren’s comment This is not my very best writing. I’m better at writing stories because I like them more and then I don’t make so many mistakes. I am trying to concentrate harder.
  • 51. Thank You Professor Geoff N Masters Chief Executive Officer Australian Council for Educational Research 19 Prospect Hill Rd Camberwell, VIC Australia 3124 www.acer.edu.au