Formative evaluation of student learning and course design made simple: Fevatools Jim Julius, ITS
- 1. Fevatools: A Toolkit to jump-start formative assessment of student learning and course designJim JuliusSDSU Course Design InstituteMay 26, 2010
- 2. Guiding QuestionsWhat does it mean to bring an inquiry mindset to course design?How should one decide what kind of feedback to seek?What tools are available to collect feedback?What do I do with the data?
- 3. Summative
- 4. Formative
- 5. What (and why) are you measuring?Outcomes: tell you what you got, not how or whyInputsProcesses Seeking continuous improvement
- 7. What (and why) are you measuring?
- 8. Outcomes
- 10. Refining type and quality of learning materials & activitiesOptimized Hybrid or Fully OnlineClassesConventionalFace-to-FaceClassesCycle 1Cycle 2Cycle 3Cycle 4
- 11. Narrowing Your Inquiry + Selecting Useful Toolshttp://fevatools.wikispaces.com
- 12. Data from M. LaumakispICT fellow in 2005Began teaching parallel 500-student sections of PSYCH 101 in 2006, one traditional and one hybridFirst fully online PSYCH 101, Summer 2008Grade data, attendance data, IDEA survey, clicker survey, observational protocols all part of data gathering
- 13. SALGHow much did the following aspects of the class help your learning?Rated from 1 (no help) to 5 (great help)
- 14. Summer 2008 Fully Online: SALG Data
- 15. SALG Data over time & format
- 16. Community of Inquiry SurveyStatements rated from 1 (strongly disagree) to 5 (strongly agree)Based on the Community of Inquiry framework’s three elements:Social PresenceCognitive PresenceTeaching Presence
- 17. Community of Inquiry Survey
- 18. What would you like to further explore?
Editor's Notes
- #7: Evaluating the cooking environment / experience: organization, tools, ingredients, recipe. How do you know if it’s “good enough”? How do you know what’s possible?
- #8: Summative and formative assessment are often referred to in a learning context as assessment of learning and assessment for learning respectively. Assessment of learning is generally summative in nature and intended to measure learning outcomes and report those outcomes to students, parents, and administrators. Assessment of learning generally occurs at the conclusion of a class, course, semester, or academic year. Assessment for learning is generally formative in nature and is used by teachers to consider approaches to teaching and next steps for individual learners and the class. (from Wikipedia assessment article)In reality, formative evaluation of course design potentially could subsume just about all of both of the other circles. Everything is data. But our attention to this may be limited. We need to know what we want to know.
- #9: Achievement: what students know and are able to do at end of course: distinguish "enduring understandings”, "important to know and do" and "worth being familiar with”Satisfaction Retention Success Achievement External proficiencies Real-world performance
- #10: Learner characteristics (demographics, prior experience, learning styles/preferences)Design (consider carefully the elements of the design you really want to examine; be sure they are documented)Learning resources (support, intervention, materials of all sorts - and how/when they are used)ContextFaculty Development