SlideShare a Scribd company logo
4
Most read
9
Most read
21
Most read
Presented By:
Muhammad Munsif
(M.phil Education)
(2019-21)
munsifsail@gmail.com
Slideshare Link
Presented to:
Dr. Muhammad Iqbal
University of Education
Lahore
Angoff Method
 What is Standard Setting
 What is cut Score
 What is borderline students
 What is purpose of Standard setting
 Importance of Standard Setting in Education
 Angoff Method
 Overview of Angoff Method
 Procedure of Angoff Method
 Standard Setting is the methodology used to define
levels of achievement or proficiency and the cut score
corresponding to those levels. For that reasons standard
setting is a critical components of the test development
process.
 In brief, standard setting refers to the process of
establishing one or more cut scores on examination.
 Standard setting is the mechanism by reach to real
calculate a pass mark for examination a paper to
ensure the competent paper are going to and
incompetence once are staying behind and not able to
go ahead.
 These Standards set are like rules and laws which can
be achievable. It is like bar not too much high to
achieve, not too much low down to achieve very easy.
 A cut score is the point that set that predetermine level,
it differentiates between those who pass and fail.
 The cut scores divided the distribution of examinees
test performance into two or more categories. Such as
(Pass/fail, Award /deny in license, or grant / Without a
credential).
 Multiple cut scores may also be set to more finest
students into categories.
 (E.g) Students may be classified as advanced,
proficient, Needs improvement or unsatisfactory.
 As a researcher has pointed out, establishing cut scores
can literally be a matter of life and death.
 Absolute : Passing score is depend on the minimal
mastery of the study content( Criterion referenced).
 Relative : Passing score is dependent on performance
of a reference group ( Norm reference ).
 It sets a clear and measure goals.
 It informs instruction.
 Standard setting measures a achievement.
 It is important to take strong decisions in education
system.
 Angoff Method Introduced by William Angoff.
 One of the most preferred widely and frequently used methods.
 The Angoff Method allows expert judges to determine an
appropriate pass marks is based on the content of the examination
and not on group performance.
 Angoff method relies on subject-matter experts(SMEs)who examine
the content of each the questions(items) and then predict how many
minimally-qualified candidates would answer the item correctly.
The average of the judges predictions for test question becomes its
predicated difficulty.
 In the original Angoff method, experts determine the probabilities.
 They select any probability ranging from 0 to 1(0.9,0.44,0.56).
 The Angoff method is a widely used standard setting approach in the test in
test development.
 It is the kind of study that test developers used to determine the passing
percentage ( cut score)for the test.
 The passing grade of a test can't be decided arbitrarily; it must be justified
with empirical.
 The average of these probabilities across judges or raters is the cutoff score
 Absolute method
 Test centered Method
 Written and practical Exam
 Angoff Method that uses a group of experts to judge
how difficult each items is in exam determine the cut
score.
 The cut score is like a line of stands that divides the
students in two groups. First, who are above the cut
score called pass and second, who are below the cut
score called fail.
 This methods calculate cut- marks of based on
performances of the candidate in relation to standard of
Content based( Absolute).
 It involves judgment being made on exam items.( Test-
Centered ).
 In Angoff, a group of subject expert are asked “what
percentage of borderline candidates would answer this
items correctly?” before making a judgment , the
experts must agree on the definition of a “borderline
candidate”.
 All judges must have same definition of borderline
candidate for the Angoff cut-off score to be reliable.
This requires a good understanding of what makes a
candidate competent enough to be passing, hence why
judges must be subject experts.
A sort of students who is
just minimal competent so
administrative allow them
to progress actually they are
not brilliant not average
only they are just fine in
ordered to make them
promote on the behalf of
guide line of examination.
E.g: If the passing marks are
50 and some students got 49
or 48 out of hundred.
These are borderline
students.
 Each experts judgment for an item should be same or
within a close, define range ( around 10%). The mean
of everyone's judgment is calculated for each item; this
is often referred to as the predicated difficulty.
 Each predicated difficulty( mean) is added and together
and divided by the total number of items in the
examination to get cut- off percentage. This percentage
of the total marks for the exam indicates the cut- off
mark.
These are major reasons to used Angoff method
 This method is defensible, reliable , test centered and it
is absolute method.
 Easy for use
 For this judges have minimal training is required who
make the judgments about cut-of score.
 Wide accepted.
For this method Experts took following steps:
 Selection participant
 Take the assessment
 Rate the items( According to level of achievement and level
of difficulty)
 Review
 Determine the cut score of a test
 Hold up in the court
 Reflect the difficulty of content
 Simple when you know how
 Need back up
 Long process
 Confidence is the key
 Recyclable
 Time and Place
 To summarize, Angoff is a standard setting method that
requires subject expert making judgment about how
difficult each item in an exam by predicting the
percentage of borderline candidates that would get
question correct. It is widely used in high stake exams
and holds up in court challenged
Angoff method ppt
Angoff method ppt
1) In Angoff Method , Probability range of cut score from ………………….
A) 2 to 5 B) 0 to 1 C) -1 to + 1 D) 1 to 2
2) Which Method more relies on Subject-matter experts(SMEs)……..
A) Hofstee Method B) Eble Method C) Nedelsky Method D) Angoff Method
3) Passing score is depend on the minimal mastery of the study content based is ……
A ) Relative B) Absolute C) Norm reference D) Non of them
4) ………………who is just minimal competent so administrative allow them to
progress
A) Brilliant Student B) Grounded Student C) Borderline student D) Average Student
5) A …………..is the point that set that predetermine level, it differentiates
between those who pass and fail
A ) Cut score B) Borderline score C ) Pass score D ) All of them
6) Passing score is dependent on performance of a reference group
A) Norm reference B) Absolute C) Criterion reference D) Non of them
 1) B
 2) D
 3) B
 4) C
 5) A
 6) A

More Related Content

PPT
Standard Setting In Medical Exams
PDF
MCQs - Item Writing & Item analysis
PPTX
Assesment and evaluation
PPT
Quality of assessment
PPTX
MCQ test item analysis
PPTX
Introduction to assessment
PPTX
Workshop on ospe and osce
Standard Setting In Medical Exams
MCQs - Item Writing & Item analysis
Assesment and evaluation
Quality of assessment
MCQ test item analysis
Introduction to assessment
Workshop on ospe and osce

What's hot (20)

PPTX
Introduction to standard setting (cutscores)
PPT
Test Administration
PPTX
Curriculum Evaluation
PPT
Two phases of establishing cutoff score
DOCX
Internal versus external examination
PPTX
Standardized testsand classroom test
PPTX
Assessment system at Elementary level in Pakistan.
PPT
Principles of assessment
PPTX
What are the different assessment types?
PPTX
Assessment techniques
PPTX
Administering test week 14
PPT
Reliability and validity
PPTX
Item analysis in education
PPTX
Definition of Assessment,
PPTX
Quantitative Item Analysis
PPTX
Monika seminar
PPTX
Curriculum development in pakistan
PPTX
Summative and formative evaluation in the process of curriculum development
PPT
Multiple choice tests
Introduction to standard setting (cutscores)
Test Administration
Curriculum Evaluation
Two phases of establishing cutoff score
Internal versus external examination
Standardized testsand classroom test
Assessment system at Elementary level in Pakistan.
Principles of assessment
What are the different assessment types?
Assessment techniques
Administering test week 14
Reliability and validity
Item analysis in education
Definition of Assessment,
Quantitative Item Analysis
Monika seminar
Curriculum development in pakistan
Summative and formative evaluation in the process of curriculum development
Multiple choice tests
Ad

Similar to Angoff method ppt (20)

PPTX
Aligning tests to standards
PPTX
Scoring and grading ppt
PDF
A Standard Setting Method Designed For Complex Performance Assessments With M...
PPTX
grading (1).pptx,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
PPTX
Grading System BEd notes first year.pptx
PPTX
educatiinar.pptx
PPTX
grading.pptx
PPTX
The nedelsky method
PPTX
Administration of the Test and Analysis of Students’ Performance
PPTX
administrating test,scoring,grading vs marks
PPTX
GRADING-AND-REPORTING-SYSTEMS REPORT.pptx
PDF
ADMINISTRATION SCORING AND REPORTING.pdf
PPT
PPTX
Norm referenced grading system
PPTX
objective test scoring and essay scoring
PPTX
scoring_moderation.pptx
PPTX
Program evaluation
PPTX
Administering,scoring and reporting a test ppt
PPT
Mariela.assess score evaluate
PPT
Types of Test for Assessing Learning.ppt
Aligning tests to standards
Scoring and grading ppt
A Standard Setting Method Designed For Complex Performance Assessments With M...
grading (1).pptx,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
Grading System BEd notes first year.pptx
educatiinar.pptx
grading.pptx
The nedelsky method
Administration of the Test and Analysis of Students’ Performance
administrating test,scoring,grading vs marks
GRADING-AND-REPORTING-SYSTEMS REPORT.pptx
ADMINISTRATION SCORING AND REPORTING.pdf
Norm referenced grading system
objective test scoring and essay scoring
scoring_moderation.pptx
Program evaluation
Administering,scoring and reporting a test ppt
Mariela.assess score evaluate
Types of Test for Assessing Learning.ppt
Ad

More from munsif123 (20)

PPTX
On Page SEO presentations
PPTX
Big shadow test
PPTX
Computer based test designs (cbt)
PPTX
Test construction
PPTX
Test equating using irt. final
PPTX
Simultaneously assembly
PPTX
Portfolios in Education
PPT
Instrument development process
PPTX
Advanced assessment and evaluation (role of assessment and measurement in tea...
PPTX
Alternative assessment strategies
PPTX
Anecdotal record in education
PPTX
Role of objective Assessment and Evaluation
PPTX
Principles of assessment
PPT
vertical Moderate Standard setting
PPTX
Angoff method ppt
PPTX
American psychology Association
PPTX
Student diversity
PPT
Rationalism
PPTX
Allala iqbal & bertrand Russell
PPT
Assure model
On Page SEO presentations
Big shadow test
Computer based test designs (cbt)
Test construction
Test equating using irt. final
Simultaneously assembly
Portfolios in Education
Instrument development process
Advanced assessment and evaluation (role of assessment and measurement in tea...
Alternative assessment strategies
Anecdotal record in education
Role of objective Assessment and Evaluation
Principles of assessment
vertical Moderate Standard setting
Angoff method ppt
American psychology Association
Student diversity
Rationalism
Allala iqbal & bertrand Russell
Assure model

Recently uploaded (20)

PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PPTX
GDM (1) (1).pptx small presentation for students
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
Complications of Minimal Access Surgery at WLH
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
Anesthesia in Laparoscopic Surgery in India
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PPTX
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
PDF
01-Introduction-to-Information-Management.pdf
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Abdominal Access Techniques with Prof. Dr. R K Mishra
Module 4: Burden of Disease Tutorial Slides S2 2025
GDM (1) (1).pptx small presentation for students
human mycosis Human fungal infections are called human mycosis..pptx
Complications of Minimal Access Surgery at WLH
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
STATICS OF THE RIGID BODIES Hibbelers.pdf
Anesthesia in Laparoscopic Surgery in India
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Microbial diseases, their pathogenesis and prophylaxis
Final Presentation General Medicine 03-08-2024.pptx
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
01-Introduction-to-Information-Management.pdf
O5-L3 Freight Transport Ops (International) V1.pdf
O7-L3 Supply Chain Operations - ICLT Program
Supply Chain Operations Speaking Notes -ICLT Program
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf

Angoff method ppt

  • 1. Presented By: Muhammad Munsif (M.phil Education) (2019-21) munsifsail@gmail.com Slideshare Link Presented to: Dr. Muhammad Iqbal University of Education Lahore Angoff Method
  • 2.  What is Standard Setting  What is cut Score  What is borderline students  What is purpose of Standard setting  Importance of Standard Setting in Education  Angoff Method  Overview of Angoff Method  Procedure of Angoff Method
  • 3.  Standard Setting is the methodology used to define levels of achievement or proficiency and the cut score corresponding to those levels. For that reasons standard setting is a critical components of the test development process.  In brief, standard setting refers to the process of establishing one or more cut scores on examination.
  • 4.  Standard setting is the mechanism by reach to real calculate a pass mark for examination a paper to ensure the competent paper are going to and incompetence once are staying behind and not able to go ahead.  These Standards set are like rules and laws which can be achievable. It is like bar not too much high to achieve, not too much low down to achieve very easy.
  • 5.  A cut score is the point that set that predetermine level, it differentiates between those who pass and fail.  The cut scores divided the distribution of examinees test performance into two or more categories. Such as (Pass/fail, Award /deny in license, or grant / Without a credential).
  • 6.  Multiple cut scores may also be set to more finest students into categories.  (E.g) Students may be classified as advanced, proficient, Needs improvement or unsatisfactory.  As a researcher has pointed out, establishing cut scores can literally be a matter of life and death.
  • 7.  Absolute : Passing score is depend on the minimal mastery of the study content( Criterion referenced).  Relative : Passing score is dependent on performance of a reference group ( Norm reference ).
  • 8.  It sets a clear and measure goals.  It informs instruction.  Standard setting measures a achievement.  It is important to take strong decisions in education system.
  • 9.  Angoff Method Introduced by William Angoff.  One of the most preferred widely and frequently used methods.  The Angoff Method allows expert judges to determine an appropriate pass marks is based on the content of the examination and not on group performance.  Angoff method relies on subject-matter experts(SMEs)who examine the content of each the questions(items) and then predict how many minimally-qualified candidates would answer the item correctly. The average of the judges predictions for test question becomes its predicated difficulty.
  • 10.  In the original Angoff method, experts determine the probabilities.  They select any probability ranging from 0 to 1(0.9,0.44,0.56).  The Angoff method is a widely used standard setting approach in the test in test development.  It is the kind of study that test developers used to determine the passing percentage ( cut score)for the test.  The passing grade of a test can't be decided arbitrarily; it must be justified with empirical.  The average of these probabilities across judges or raters is the cutoff score
  • 11.  Absolute method  Test centered Method  Written and practical Exam  Angoff Method that uses a group of experts to judge how difficult each items is in exam determine the cut score.  The cut score is like a line of stands that divides the students in two groups. First, who are above the cut score called pass and second, who are below the cut score called fail.
  • 12.  This methods calculate cut- marks of based on performances of the candidate in relation to standard of Content based( Absolute).  It involves judgment being made on exam items.( Test- Centered ).
  • 13.  In Angoff, a group of subject expert are asked “what percentage of borderline candidates would answer this items correctly?” before making a judgment , the experts must agree on the definition of a “borderline candidate”.  All judges must have same definition of borderline candidate for the Angoff cut-off score to be reliable. This requires a good understanding of what makes a candidate competent enough to be passing, hence why judges must be subject experts.
  • 14. A sort of students who is just minimal competent so administrative allow them to progress actually they are not brilliant not average only they are just fine in ordered to make them promote on the behalf of guide line of examination. E.g: If the passing marks are 50 and some students got 49 or 48 out of hundred. These are borderline students.
  • 15.  Each experts judgment for an item should be same or within a close, define range ( around 10%). The mean of everyone's judgment is calculated for each item; this is often referred to as the predicated difficulty.  Each predicated difficulty( mean) is added and together and divided by the total number of items in the examination to get cut- off percentage. This percentage of the total marks for the exam indicates the cut- off mark.
  • 16. These are major reasons to used Angoff method  This method is defensible, reliable , test centered and it is absolute method.  Easy for use  For this judges have minimal training is required who make the judgments about cut-of score.  Wide accepted.
  • 17. For this method Experts took following steps:  Selection participant  Take the assessment  Rate the items( According to level of achievement and level of difficulty)  Review  Determine the cut score of a test
  • 18.  Hold up in the court  Reflect the difficulty of content  Simple when you know how
  • 19.  Need back up  Long process  Confidence is the key  Recyclable  Time and Place
  • 20.  To summarize, Angoff is a standard setting method that requires subject expert making judgment about how difficult each item in an exam by predicting the percentage of borderline candidates that would get question correct. It is widely used in high stake exams and holds up in court challenged
  • 23. 1) In Angoff Method , Probability range of cut score from …………………. A) 2 to 5 B) 0 to 1 C) -1 to + 1 D) 1 to 2 2) Which Method more relies on Subject-matter experts(SMEs)…….. A) Hofstee Method B) Eble Method C) Nedelsky Method D) Angoff Method 3) Passing score is depend on the minimal mastery of the study content based is …… A ) Relative B) Absolute C) Norm reference D) Non of them 4) ………………who is just minimal competent so administrative allow them to progress A) Brilliant Student B) Grounded Student C) Borderline student D) Average Student 5) A …………..is the point that set that predetermine level, it differentiates between those who pass and fail A ) Cut score B) Borderline score C ) Pass score D ) All of them 6) Passing score is dependent on performance of a reference group A) Norm reference B) Absolute C) Criterion reference D) Non of them
  • 24.  1) B  2) D  3) B  4) C  5) A  6) A