Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom
Download as PPTX, PDF1 like1,263 views
The document discusses automated essay scoring (AES), a method that uses computer programs to grade essays, aiming for cost efficiency and quicker feedback in education. It highlights the effectiveness of AES in providing scores comparable to human ratings but raises concerns about its limitations and the impact on writing proficiency assessments. The author advocates for a balanced approach that emphasizes humanistic pedagogy while integrating technology in the writing classroom.
Is There a Robot in This Class?: The Mechanization of Student, Teacher, and Text in the Writing Classroom
- 1. IS THERE A ROBOT IN THIS CLASS? THE MECHANIZATION OF STUDENT, TEACHER, AND TEXT IN THE WRITING CLASSROOM @JasonCKTham
- 2. DEFINITION Automated essay scoring (AES) is the use of specialized computer programs to assign grades to essays written in an educational setting. It is a method of educational assessment and an application of natural language processing. Its objective is to classify a large set of textual entities into a small number of discrete categories, corresponding to the possible grades – for example, the numbers 1 to 6. Therefore, it can be considered a problem of statistical classification.
- 5. The transferability of skills and cost to how students perceive writing…
- 6. THE APPEAL
- 7. “More information analysis than regurgitation… to assess students’ writing and reasoning abilities.”
- 8. “Partially replacing human graders with computer grading programs could help make those tests cheaper, and get results back to students and teachers faster.”
- 9. THE NEW “DEEP BLUE VS. KASPAROV”
- 11. “The results demonstrated that overall, automated essay scoring was capable of producing scores similar to human scores for extended-response writing items with equal performance for both source-based and traditional writing genre.
- 14. Any student who can read can be taught to score very highly on a machine-graded test.
- 17. Agreement with human ratings is not necessarily the best or only measure of students’ writing proficiency (or the evidence of proficiency in an essay)… The limitation of human scoring as a yardstick for automated scoring is underscored by the human ratings used for some of the tasks in this study, which displayed strange statistical properties and in some cases were in conflict with documented adjudication procedures.
- 18. If you go to a business school or an engineering school, they’re not looking for creative writers. They’re looking for people who can communicate ideas. And that’s what the technology is best at evaluating.
- 19. Wait, what?
- 21. Teach students to think rhetorically about literacy and their writing.
- 22. Propel research on humanistic pedagogy and AES programs
- 23. Advocate for the true purposes of writing
- 24. CCCC Position Statement on Teaching, Learning, and Assessing Writing in Digital Environment Standards for the Assessment of Reading and Writing (rev. ed., 2009) Framework for Success in Postsecondary Writing (2011) Framework for 21st Century Curriculum and Assessment (2008, 2013)
- 25. CONCLUSION