SlideShare a Scribd company logo
Reliability & Validity - 4 of 5




By Ravi Kumar,
Think Assessments, Think RK!




Industry practices in assessment work flow
Reliability & Validity - 4 of 5




Industry practices in assessment work flow
Reliability & Validity - 4 of 5




    “Reliability can be defined as
     the degree of consistency
     between two measures of the
     same thing.”




Industry practices in assessment work flow                                     3
Reliability & Validity - 4 of 5




    Kuder-Richardson Estimates


                       n   pq 
      KR 20 rXX          1     
                     n 1     0 
                                2




        n = number of items in the test
        p = proportion of students who answered an item correctly
        q = proportion of students who answered an item incorrectly




Industry practices in assessment work flow                                     4
Reliability & Validity - 4 of 5




     Cronbach’s Alpha

                           n
                                2
                  n    i 
                   1  i 1 2 
                n 1        0 
                     
                                
                                 



Industry practices in assessment work flow                                     5
Reliability & Validity - 4 of 5




Industry practices in assessment work flow                                     6
Reliability & Validity - 4 of 5




     Test  Length
     Speed

     Group homogeneity

     Difficulty of Items

     Objectivity




Industry practices in assessment work flow                                     7
Reliability & Validity - 4 of 5




    “Validity can be defined as the
     degree of accuracy with which the
     test measures whatever it
     purports to measure i.e. to serve
     the purpose for which it was
     designed.”



Industry practices in assessment work flow                                     8
Reliability & Validity - 4 of 5




     Content          related validity

     Criterion  related validity
       (Predictive validity)

     Construct            related validity



Industry practices in assessment work flow                                     9
Reliability & Validity - 4 of 5




    “Content Validity is a matter of determining
      whether the sample is representative of the
      larger universe it is supposed to represent.”

       A test or exam can be built with high
       content validity by:
       ◦ Identifying the subject matter topics and behavioral outcomes to
         be measured.

       ◦ Building a Table of Specifications that specify the sample of items
         to be used.

       ◦ Constructing a test that closely fits the specifications.



Industry practices in assessment work flow                                      10
Reliability & Validity - 4 of 5




    “ Criterion Validity involves
      correlating between test scores
      and scores in the course or
      performance rating on the job.”




Industry practices in assessment work flow                                     11
Reliability & Validity - 4 of 5




    “Construct Related Validity is to be
     established with scores correlated
     to those who possess these traits
     or constructs.”




Industry practices in assessment work flow                                     12
Reliability & Validity - 4 of 5




Industry practices in assessment work flow                                     13
Reliability & Validity - 4 of 5




Industry practices in assessment work flow                                     14

More Related Content

PPTX
Value analysis and value engineering
PPSX
Value Engineering And Value Analysis
PDF
Dinesh CV
PDF
Value Analysis
PDF
A_Brief_Insight_on_Independent_Testing
PDF
A Study Report on Value Analysis and Value Engineering (VAVE)
PPTX
Business Success Through VA/VE
PPT
NQC Presentation On Validation And Moderation
Value analysis and value engineering
Value Engineering And Value Analysis
Dinesh CV
Value Analysis
A_Brief_Insight_on_Independent_Testing
A Study Report on Value Analysis and Value Engineering (VAVE)
Business Success Through VA/VE
NQC Presentation On Validation And Moderation

What's hot (20)

PDF
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
PDF
IRJET- Overview of Value Engineering and Value Analysis
PDF
Apex Unit Testing in the Real World
PPTX
PPTX
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
DOC
Inf 336 Inspiring Innovation--tutorialrank.com
PPT
Quality - A Priority In Service Engagements
PPT
AJRA Test Strategy Discussion
PPSX
Usability Testing Plan & Report
PPT
Istqb fl chap_6_edited
PPT
Istqb fl chap_4_edited
PPT
'Architecture Testing: Wrongly Ignored!' by Peter Zimmerer
PDF
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
PDF
Nature vs. Nurture: Building Great Test Teams
PPTX
Requirements Driven Risk Based Testing
PDF
02 - Testing Management - Crash Slides
PDF
Fundamentals of Testing (2013)
PPTX
The Risky Business of Testing by Shaminder Rai and Dave Patel
PDF
Industrialization of testing
DOCX
Agile testing
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
IRJET- Overview of Value Engineering and Value Analysis
Apex Unit Testing in the Real World
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Inf 336 Inspiring Innovation--tutorialrank.com
Quality - A Priority In Service Engagements
AJRA Test Strategy Discussion
Usability Testing Plan & Report
Istqb fl chap_6_edited
Istqb fl chap_4_edited
'Architecture Testing: Wrongly Ignored!' by Peter Zimmerer
Quality engineering in the digital age... Why? How? (ASQF Keynote by Rik Mars...
Nature vs. Nurture: Building Great Test Teams
Requirements Driven Risk Based Testing
02 - Testing Management - Crash Slides
Fundamentals of Testing (2013)
The Risky Business of Testing by Shaminder Rai and Dave Patel
Industrialization of testing
Agile testing
Ad

Viewers also liked (15)

PDF
PPT
Tongue crib
PPTX
Home value charting
PDF
Интернет для Бизнеса - Рома Рыбальченко - Возможности Universal analytics для...
PPTX
Home value charting
PPTX
Интернет для Бизнеса - Олег Костюкевич и Евгений Карцан - Google+ for business
PPSX
Introduction To Assessments I
PPTX
Интернет для Бизнеса - Вячеслав Вареня - Меры принятые вручную
PPTX
Google analytics
PDF
Интернет для Бизнеса - Дмитрий Латанский - Привлечение брендового трафика для...
PDF
Capital City Scape sec-66 Gurgaon 9999993877
DOC
PPTX
Step by step fixed orthodontics
PPS
Aothuat magic
ZIP
Ford ka workshop_manual
Tongue crib
Home value charting
Интернет для Бизнеса - Рома Рыбальченко - Возможности Universal analytics для...
Home value charting
Интернет для Бизнеса - Олег Костюкевич и Евгений Карцан - Google+ for business
Introduction To Assessments I
Интернет для Бизнеса - Вячеслав Вареня - Меры принятые вручную
Google analytics
Интернет для Бизнеса - Дмитрий Латанский - Привлечение брендового трафика для...
Capital City Scape sec-66 Gurgaon 9999993877
Step by step fixed orthodontics
Aothuat magic
Ford ka workshop_manual
Ad

Similar to Reliability And Validity Iv (20)

PPTX
Assessment of Learning
PPTX
Validity, reliabiltiy and alignment to determine the effectiveness of assessment
PDF
ACT Enhancing the Quality of Training & Assessment - v1.2 - 11.06.2010
PDF
ACT Enhancing the Quality of Training & Assessment - v1.2 - 11.06.2010
PPTX
Validity, reliability & practicality
PPT
Quality of assessment
PDF
Discretion-Related Validity
PDF
x0fvczbar1oe5tlcyejk-signature-c58029e22a38c87603622a799f3bf90fcdb07c8711de19...
PPTX
Theoretical Constructs and Best Practice in Assessment
PPTX
Arte387 Ch8
PPT
Arte387Ch8
PDF
A guide-to-internal-quality-assurance
PPTX
Validity_and_Reliability_Presentation.pptx
PPTX
LESSON 1 RELIABILITY AND VALIDITY for Statech12
PDF
Test quality validity
PDF
10 steps to_training_and_assessment-1
PPT
Test characteristics
PPTX
Validity of Assessment Tools
PPT
Validity And Reliabilty
PPTX
ELTLAE Group 2.pptx
Assessment of Learning
Validity, reliabiltiy and alignment to determine the effectiveness of assessment
ACT Enhancing the Quality of Training & Assessment - v1.2 - 11.06.2010
ACT Enhancing the Quality of Training & Assessment - v1.2 - 11.06.2010
Validity, reliability & practicality
Quality of assessment
Discretion-Related Validity
x0fvczbar1oe5tlcyejk-signature-c58029e22a38c87603622a799f3bf90fcdb07c8711de19...
Theoretical Constructs and Best Practice in Assessment
Arte387 Ch8
Arte387Ch8
A guide-to-internal-quality-assurance
Validity_and_Reliability_Presentation.pptx
LESSON 1 RELIABILITY AND VALIDITY for Statech12
Test quality validity
10 steps to_training_and_assessment-1
Test characteristics
Validity of Assessment Tools
Validity And Reliabilty
ELTLAE Group 2.pptx

Reliability And Validity Iv

  • 1. Reliability & Validity - 4 of 5 By Ravi Kumar, Think Assessments, Think RK! Industry practices in assessment work flow
  • 2. Reliability & Validity - 4 of 5 Industry practices in assessment work flow
  • 3. Reliability & Validity - 4 of 5 “Reliability can be defined as the degree of consistency between two measures of the same thing.” Industry practices in assessment work flow 3
  • 4. Reliability & Validity - 4 of 5 Kuder-Richardson Estimates n   pq  KR 20 rXX  1   n 1  0  2 n = number of items in the test p = proportion of students who answered an item correctly q = proportion of students who answered an item incorrectly Industry practices in assessment work flow 4
  • 5. Reliability & Validity - 4 of 5 Cronbach’s Alpha  n 2 n   i   1  i 1 2  n 1  0      Industry practices in assessment work flow 5
  • 6. Reliability & Validity - 4 of 5 Industry practices in assessment work flow 6
  • 7. Reliability & Validity - 4 of 5  Test Length  Speed  Group homogeneity  Difficulty of Items  Objectivity Industry practices in assessment work flow 7
  • 8. Reliability & Validity - 4 of 5 “Validity can be defined as the degree of accuracy with which the test measures whatever it purports to measure i.e. to serve the purpose for which it was designed.” Industry practices in assessment work flow 8
  • 9. Reliability & Validity - 4 of 5  Content related validity  Criterion related validity (Predictive validity)  Construct related validity Industry practices in assessment work flow 9
  • 10. Reliability & Validity - 4 of 5 “Content Validity is a matter of determining whether the sample is representative of the larger universe it is supposed to represent.” A test or exam can be built with high content validity by: ◦ Identifying the subject matter topics and behavioral outcomes to be measured. ◦ Building a Table of Specifications that specify the sample of items to be used. ◦ Constructing a test that closely fits the specifications. Industry practices in assessment work flow 10
  • 11. Reliability & Validity - 4 of 5 “ Criterion Validity involves correlating between test scores and scores in the course or performance rating on the job.” Industry practices in assessment work flow 11
  • 12. Reliability & Validity - 4 of 5 “Construct Related Validity is to be established with scores correlated to those who possess these traits or constructs.” Industry practices in assessment work flow 12
  • 13. Reliability & Validity - 4 of 5 Industry practices in assessment work flow 13
  • 14. Reliability & Validity - 4 of 5 Industry practices in assessment work flow 14