Chapter 4 b
Download as PPT, PDF0 likes234 views
The document outlines the key steps in the test construction process: 1. Defining the test purpose and what construct it aims to measure. 2. Selecting an appropriate scaling method such as nominal, ordinal, interval or ratio scales. 3. Constructing initial test items that sample different cognitive domains and difficulty levels. 4. Testing items through analysis to evaluate item difficulty, reliability, validity, and discrimination. 5. Revising the test based on item analysis and feedback. 6. Publishing the finalized test along with manuals for administration and interpretation.
Chapter 4 b
- 2. The test construction process • Defining the Test • Selecting Scaling Method • Constructing the items • Testing the items • Revising the test • Publishing the test
- 3. Defining the Test • Explain the test purpose explicitly and propose a fresh focus for what the test intend to measure, for example, intelligence. • K-ABC
- 4. Selecting Scaling Method • The immediate purpose of psychological testing is to assign numbers to responses on a test so that the examinee can be judged to have more or less of the characteristic measured. • Levels of Measurement: Stevens (1946) • Nominal scale, ordinal scale, interval scale, ratio scale
- 5. Selecting Scaling Method • Nominal scale: allows for categorizing • Ordinal scale: allows for ranking • Interval scale: uses equal intervals • Ratio scale: possesses real zero point
- 6. Representative scaling methods • Expert rankings • Method of equal-appearing intervals • Likert scales • Method of empirical keying • Rational scale construction (internal consistency)
- 7. Constructing the Items • Should item content be homogeneous or varied? • What range of difficulty should the items cover? • How many initial items should be constructed? • Which cognitive processes and item domains should be tapped? • What kind of test item should be used?
- 8. Testing the Items • In conducting a thorough item analysis, the test developer might make use of item- difficulty index, item-reliability index, item- validity index, item-characteristic curve, and an index of item discrimination.
- 9. Item-difficulty index • Generally, item difficulties that hover around 0.5, ranging between 0.3 and 0.7, maximize the information the test provides about differences between examinees. • However, this rule of thumb is subject to one important qualification and one very significant exception.
- 10. Item-reliability index • The product of point-biserial correlation and dispersion (standard deviation) of a item is the item-reliability index.
- 11. item-validity index • The point-biserial correlation between the item score and the score on the criterion variable is computed first. • Thus, the item-validity index consists of the product of the standard deviation and the point-biserial correlation.
- 13. Item-discrimination index • An ideal test item is one that most of the high scores pass and most of the low scores fail.
- 14. Revising the Test • Cross Validation • Validity Shrinkage • Feedback from Examinees
- 15. Publishing the Test • Production of Testing Materials • Technical Manual and User’s Manual • Testing is Big Business