Designing multiple choice questions by Tiyagu
Download as PPTX, PDF0 likes37 views
The document discusses the design and strategies for creating effective multiple choice questions (MCQs) in educational assessments. It emphasizes the importance of clear and straightforward language in question stems, the necessity of plausible distractors, and the need for various question formats to minimize guesswork. Additionally, it incorporates Bloom's taxonomy to categorize assessment items and encourages the use of correct and grammatically consistent options.
Designing multiple choice questions by Tiyagu
- 1. Designing Multiple Choice Questions K.THIYAGU, Assistant Professor, Department of Education, Central University of Kerala, Kasaragod CC-BY-NC- SA 1
- 3. Students can escape from bad teaching… CC-BY-NC- SA 3 But they can’t escape from the bad assessment,,
- 4. When the cook tastes the soup, CC-BY-NC- SA 4 that’s formative assessment; When the customer tastes the soup, that’s summative assessment. Paul black
- 5. Process of assigning numbers to qualities or characteristics of an object or person according to some rule or scale and analyzing that data based on psychometric and statistical theory The process of gathering, describing, or quantifying information about performance Summary of How Evaluation, Assessment, Measurement and Testing Terms Are Related Evaluation Examining information about many components of the thing being evaluated (e.g., student work, schools, or a specific educational program) and comparing or judging its quality, worth or effectiveness in order to make decisions CC-BY-NC- SA 5 Based on Assessment Includes Measurement Specific way to measureperformanceis Testing A method used to measure the level of achievement or performance
- 6. MCQ CC-BY-NC- SA 6 Students select the correct answer from alternative responses. Each item has • Item stem • Correct or keyed option • Several distractor options Format • Complete question • Incomplete question (Clegg & Cashin, 1986)
- 7. Multiple Choice Test Strategies There is not always a perfect answer, so choose the best answer. Read all possible responses. Cross out incorrect answers (distracters- decoys). Treat each option as a true/false question. CC-BY-NC- SA 7
- 8. Parts of MCQ Stem Options Key Distractors CC-BY-NC- SA 8
- 9. • Question or Incomplete Statement or Picture STEM • Suggested answers or Completions OPTIONS • Incorrect Responses DISTRACTERS • Correct Response KEY CC-BY-NC- SA 9
- 10. Components of an MCQ Good MCQ Well formed STEM Clearly correct answer Plausible distractors Options ck 10 +/- fee CCd -BY-b NC-
- 12. Stems Use clear, straight forward language Aim to write as a complete sentence Avoid use of unnecessary content Avoid the use of negatives. If you must use them embolden them to make them stand out Avoid giving clues in the question e.g an/a Avoid veering away from the content/cognitive level that you aimed to address Considerations CC-BY-NC- SA 12
- 14. Stem: Question Form Which is the same as Seven hundred and twenty? A. 7 + 100 +20 B. 90 x 8 C. 80 x 90 D. 700 - 20 CC-BY-NC- SA 14
- 15. Stem: Completion Form Seven hundred & twenty is the same as A. 7 + 100 +20 B. 90 x 8 C. 80 x 90 D. 700 - 20 CC-BY-NC- SA 15
- 16. Stem: Direction Form Multiply 90 into 8 A. B. C. D CC-BY-NC- SA 16
- 17. Avoid Awkward Stems Awkward Stem If there are 9 chairs in the classroom and 16 children in the class, the classroom lacks how many chairs? A. 6 B. 7 C. 8 D. 9 Improved Stem There are 16 children and 9 chairs in the classroom. How many more chairs are needed? CC-BY-NC- SA 17 A. 6 B. 7 C. 8 D. 9
- 18. Present a definite, explicit singular question or problem in the stem.. Poor Psychology … Better The science of mind and behaviour is called…. CC-BY-NC- SA 18 Poor Mathematics is … Better The queen of science is……
- 19. Use negatively questions sparingly. When used, underline and / or capitalized the negative word. Poor Which of the following is not related to search engine? Better CC-BY-NC- SA 19 Which of the following is NOT related to search engine?
- 20. When possible state the stem as direct question rather than as incomplete statement. Poor Inductive method propounded by … Better CC-BY-NC- SA 20 Who is propounded the inductive method?
- 21. Include the stem any word (s) that might otherwise be repeated in each alternative. Poor In the national elections in the US, the president is officially A. Chosen by the people B. Chosen by electoral college C. Chosen by members of congress D. Chosen by the House of Representatives Better In the national elections in the US, the president is officially chosen by A. the people B. electoral college C. members of congress D. House of Representatives CC-BY-NC- SA 21
- 22. CC-BY-NC- SA 22
- 24. Options Distractors should be worded in a similar way to the correct answer and of a similar length (but not too close to cause confusion) Avoid repeating the same content in the options – move it to the stem if possible Avoid ‘all of the above’/ ‘none of the above Aim to use common misconceptions/student errors as distractors Distractors should be plausible There should be a sufficient number of distractors. Correct answer & Distractors CC-BY-NC- SA 24
- 25. Alternatives should be as closely related to each other as possible Four or more options must be provided in each items to minimize guessing. A uniform number of options in each item must be used. Alternatives should be arranged accordingly to length: from shortest to longest or vice versa The order of correct answers in all items is randomly arranged rather than following a regular pattern All options must be grammatically consistent. Eg: if the stem is singular, the options are all singular. CC-BY-NC- SA 25
- 26. Not Given None of the above Both A & B All of the above Avoid Using CC-BY-NC- SA 26
- 27. A chain of island is called an A. Archipelago B. Peninsula C. Continent D. Isthmus Avoid - Grammatical Clue CC-BY-NC- SA 27
- 28. The reliability of test can be estimated by the coefficient of A. Measurement B. Correlation C. Testing D. Error Avoid – Verbal Association CC-BY-NC- SA 28
- 29. The height to which a water dam is build depends on A. The length of the reserve behind the dam B. The volume of water behind the dam C. The height of water behind the dam D. The strength of the reinforcing wall Avoid – Connection between stem and answer CC-BY-NC- SA 29
- 30. CC-BY-NC- SA 30
- 32. Evaluation Synthesis Analysis Application Comprehension Knowledge Creating Evaluation Analysis Application Comprehension Knowledge Original Version: Bloom et.al. (1956) Revised Version: Anderson & Krathwohi (2001) Bloom’s Taxonomy of Learning CC-BY-NC- SA 32
- 33. CC-BY-NC- SA 33
- 34. CC-BY-NC- SA 34
- 35. LOTS (Lower Order Thinking Skills) Knowledge Comprehension Application HOTS (Higher Order Thinking Skills) Analysis Synthesis Evaluation CC-BY-NC- SA 35
- 36. CC-BY-NC- SA 36
- 37. CC-BY-NC- SA 37
- 38. CC-BY-NC- SA 38
- 39. CC-BY-NC- SA 39
- 41. CC-BY-NC- SA 41
- 42. CC-BY-NC- SA 42
- 49. CC-BY-NC- SA 49
- 50. CC-BY-NC- SA 50
- 51. CC-BY-NC- SA 51
- 52. Actions verbs – Identified by PSG CC-BY-NC- SA 52 • Choose • Find • Identity • Indicate • Label • Match • Mention • Name • State • What • When • Where • Which • Who
- 53. Good teaching is more a giving of right questions… than CC-BY-NC- SA 53 a giving of right answers.
- 54. CC-BY-NC- SA 54