Iswi reception dec 2010
Download as PPTX, PDF1 like224 views
Criterion is a writing assessment tool that provides automated feedback on student writing submissions. Several studies found that Criterion helped improve student writing in the following ways: 1) Students who submitted multiple drafts to Criterion had higher average writing scores than those who only submitted one draft. 2) Students with lower initial scores were able to improve their writing to the level of students with higher initial scores by submitting multiple drafts to Criterion. 3) Classes that used Criterion showed greater overall improvements in student writing from first to last drafts, especially when instructors engaged in discussions about how to use Criterion's feedback.
Iswi reception dec 2010
- 1. Does Criterion help students improve their writing?Hank DelcoreJennifer L. Ivie
- 2. Automatically-Generated DataStudents who made two submissions to ETS Criterion had higher average holistic scores than students who only made one submission.Students with lower initial holistic scores were able to raise their scores, with subsequent submissions, to the same level as those whose initial holistic scores were higher.Intervening variables?
- 3. Faculty Scoring PanelOverall, student writing improved in classes that used ETS Criterion.The greatest improvements from first to last submission were made in classes in which the instructors engaged students in substantial discussions of writing and how to use Criterion.Intervening variables?
- 4. Music 187Control group study across three sections of Music 187 (Jazz and Rock), an IC course.Group 1: no CriterionGroup 2: required 2-4 submissionsGroup 3: unlimited submissionsGroup 2 has significantly higher instructor-assigned grades than Group 1.Groups 1 and 3 had no significant difference in grades.
- 5. Collegiate Learning AssessmentAsignificant difference was found between Criterion users and Criterion non-users on the CLA performance task.No significant differences were found between the two groups on any of the analytic writing task scores.
- 6. Faculty/Student Survey HighlightsStudents felt that Criterion…helps with writing mechanics.…did not help them improve their writing skills.But, ESL students were more likely than English as First Language students to respond that Criterion helped them improve their writing. And, they ESL students preferred Criterion feedback to instructor feedback.Faculty felt that Criterion…did not reduce their workload.…did not do as much as they had hoped.…made grading simpler.…encouraged students to spend more time improving their writing.… overall improved student writing.
- 7. Faculty Learning CommunityFaculty commented positively on…the ease and convenience of using ETS Criterion.…the added ability it gave them to focus on course content rather than grammar and mechanics.…the fact that students using Criterion were more engaged with the writing process.Drawbacks included…the inability of the program to recognize technical terms or subject-specific writing conventions.…perceived inaccuracies in holistic scoring.…lack of compatibility with TurnItIn and Blackboard.
- 8. ConclusionSome evidence that Criterion helps students improve writing, likely in combination with good instructor practices.Criterion seems to help most with mechanics.Convergence of survey and FLC data: faculty agree that students who use Criterion are more engaged with the writing process.Next steps…