VCCS NH'10: Refining Course Management Systems: Listening to Those Who Do It and Use It
Download as PPT, PDF1 like1,029 views
The document discusses the use and implications of course management systems (CMS) in educational settings, highlighting that faculty often use CMS primarily for course administration rather than pedagogical innovation. It details a research design that involved qualitative interviews to gather data on user experiences with CMS, aiming to improve the next generation of Sakai, a CMS employed at Virginia Tech. The research has progressed to the point of creating user personas based on interviews with various educational stakeholders to guide future development.
![Thank you! Questions? Contact Information Amber D. Evans [email_address] Teggin Summers [email_address] Samantha Blevins [email_address]](https://image.slidesharecdn.com/vccssession2-100420163506-phpapp01/85/VCCS-NH-10-Refining-Course-Management-Systems-Listening-to-Those-Who-Do-It-and-Use-It-23-320.jpg)
VCCS NH'10: Refining Course Management Systems: Listening to Those Who Do It and Use It
- 1. Refining Course Management Systems: Listening to Those Who Do It and Use It Presented by Amber D. Evans Teggin Summers Samantha Blevins April 7, 2010
- 2. Topics Introduction CMS/CLE & Pedagogy Research Design Research Progress Conclusion & QA
- 3. CMS/CLE & Pedagogy Amber D. Evans
- 4. Does using a CMS imply or impose Pedagogy? Glenda Morgan (2003) found: CMS use is on the rise, Important goals for faculty included “supplementing lecture materials, increasing transparency and feedback” Instructors “reported that their communication with students increased as a result of using the CMS,” “ Accidental Pedagogy” Faculty look to a CMS to provide organizational tools. Using these tools causes faculty to “rethink and restructure their courses” (pg. 4)
- 5. Does using a CMS imply or impose Pedagogy? Lisa M. Lane (2007, 2008, 2009) reported: Most users used CMS for course administration. Communication, Lecture materials, Email, Gradebook Length of CMS time didn’t change their use. CMS encourages novice instructors to "plug in" their content under the appropriate category. Student-centered tools were “added as ‘features’ (some at additional cost) that simply make a heavy program even heavier” (para. 5, 2007). Novice Web users suffer the most. Unaware and “inclined to utilize only the aspects they understand from a non-web context” (screen 4).
- 6. Does using a CMS imply or impose Pedagogy? Lisa M. Lane (2009) asks: “ Today’s CMSs can be customized, changed and adapted, so why aren’t faculty tinkering with them in an effort to make their individual pedagogies work online?” We at VT and in the Sakai community ask: Why can’t we tinker with the CLE in an effort to make faculty pedagogies work online?
- 7. Research Design Samantha Blevins
- 8. Research Design: Purpose Contextual Inquiry Ethnographic interviewing technique Gathers qualitative data Combines interviews and observation Takes place in interviewee’s work setting Based on master-apprentice model of learning Observing and asking questions about what they are doing and why Discovery process instead of evaluation
- 9. Research Design: Purpose Four phases to Contextual Design Interview Traditional Interview Overview of interviewee’s work Establish trust with interviewee The ‘switch’ To master-apprentice relation Observation The interviewee “runs the show” Summarization Interviewer summarizes what they learned to the interviewee
- 10. Research Design: Purpose Goal of contextual inquiry To provide evidence for goal-directed design User-centered methodology Allows research team to create composite user personas from the collected data Created personas can be used to determine when a common need can be met by either common or different interfaces
- 11. Research Design: Purpose Our overall goal is to help improve the next generation of Sakai (known at Virginia Tech as “Scholar”) Interviews were conducted with Teaching Assistants Instructors Staff Students
- 12. Research Design: Procedures One, 60-minute interview with observation notes Interviews were audio-taped Two researchers were present One to conduct the interview One to take notes and observe
- 13. Research Design: Procedures Notes of the interview were then turned into summaries Summaries were used to create the user personas The audio-recordings are currently being transcribed Transcripts will then be coded for major themes
- 14. Research Progress Amber D. Evans
- 15. Sakai Community http://www.sakaiproject.org/ Over 160+ institutions This project is being lead by the User Experience staff at Stanford University. Completed all persona compositions Created Activity Requirements & Framework for how to structure, setup, and assess Assignments, Grading / Feedback Still collecting info about instructional designers.
- 16. VT Contribution At VT we conducted 9 interviews 4 Instructors, 1 Graduate Teaching Assistant, 2 Students (1 Graduate, 1 Undergraduate), and 2 Instructional Designers. Currently summarizing the personas for the Instructional Designers. Next steps: Build out the personas Create “Requirements Definition” Problem Set Creation Provide process to Sakai Developers
- 17. Examples & Samples Amber D. Evans
- 18. Instructor/Staff: Problem Sets Chikako Nakamura Japanese instructor Terry Heinlein Majors Bio coordinator Bob Murphy Online Math Professor Amanda Harper Instructional Tech Associate
- 19. Instructors: Writing Denise Garza Freshman Writing Lecturer Landon Jones Associate Professor, Philosophy Irina Nemkova Graduate Teaching Assistant Jan Nelson Nursing Practicum Instructor
- 20. Review submission status Review individuals Activity deployment Course planning Activity creation Activity creators Activity evaluators
- 21. Review submission status Review individuals Activity deployment Course planning Activity creation
- 22. References Example Instructor/Staff processes and workflow slides are credited to Keli Aman and Jackie Mai from Stanford University. Lane, Lisa M. (2007). “Course Management Systems and Pedagogy.” LisaHistory.net website. Retrieved 28 February 2009 from http://lisahistory.net/pages/CMSandPedagogy.htm Lane, Lisa M. (2008). “Toolbox or trap? Course management systems and pedagogy.” EDUCAUSE Quarterly 31(2). Retreived 31 March 2009 from http://www.educause.edu/EDUCAUSE+Quarterly/EDUCAUSEQuarterlyMagazineVolum/ToolboxorTrapCourseManagementS/162865 Lane, Lisa M. (2009). “Insidious pedagogy: How course management systems impact teaching.” First Monday, 14(10). Retrieved 6 April 2009 from http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/2530/2303 Morgan, Glenda. "Faculty use of course management systems." Educause Center for Applied Research, 2003. Retrieved 1 May 2007 from http://www.educause.edu/ir/library/pdf/ERS0302/ekf0302.pdf
- 23. Thank you! Questions? Contact Information Amber D. Evans [email_address] Teggin Summers [email_address] Samantha Blevins [email_address]
Editor's Notes
- #5: Does using a CMS/CLE imply or impose certain pedagogy? (Amber) "3 perspectives presented: ISD, Instructors, GTAs and how CMS may imply pedagogies." Discuss the (in progress) research we are doing and what we've discovered thus far. Amber is leading this presentation. Amber and/or Sam is responsible for info about implied pedagogies, the info about the collected summaries (what we have done and learned so far), and info about what Contextual Inquiry and Goal-Directed Design research is. Teggin will be unavailable to present. Accidental Pedagogy: Faculty teaching is improved through the use of the CMS, but this is a side effect of the use of the software rather than a direct result of its use. Quotes from pg. 4 of Morgan, G.
- #6: "3 perspectives presented: ISD, Instructors, GTAs and how CMS may imply pedagogies." Discuss the (in progress) research we are doing and what we've discovered thus far. Amber is leading this presentation. Amber and/or Sam is responsible for info about implied pedagogies, the info about the collected summaries (what we have done and learned so far), and info about what Contextual Inquiry and Goal-Directed Design research is. Teggin will be unavailable to present. Does using a CMS/CLE imply or impose certain pedagogy? (Amber) Toolbox or Trap? Course Management Systems and Pedagogy ( Lane, 2008, EDUCAUSE Quarterly, vol. 31, no. 2 (April--June 2008)) Course Management Systems and Pedagogy (Lane, 2007) Lane conducted surveys of Blackboard/WebCT, Moodle, and other CMS users
- #16: The research thus far (Amber) Sakai community still collecting interview summaries for personas that are missing or are incomplete (i.e., ISD), although all other personas have been created (see PPT attachment ) and their " Requirements Definitions " are being drafted by the team at Stanford. Eight institutions, 30 interviews 20 instructors, 3 instructional staff, 3 undergraduates, 4 graduates 2 students, 2 instructors representing courses completely online
- #17: “ Requirements Definition” Creating problem and vision statement Identifying persona expectations Constructing context scenarios-- ”describe the broad context in which usage patterns are exhibited and include environmental and organizational considerations.” Identify requirements : action, object, context Problem Set Creation Describe the assumptions, steps, and process
- #19: This Slide and Notes are credited to Keli Aman and Jackie Mai from Stanford University. Chikako does it all: creates and deploys activities, gives detailed feedback to freeform response Terry reedits autograded problem sets from multiple reviewer, deploys, deals with problems Bob conceptualized all activities and runs an online class and gives feedback, but creation is done by Amanda Amanda is only involved in creation of activities--randomized tests, modules 8 persona for Instructor and staff Types of learning activities used in class: variations in form, purpose, & peer involvement What they are involved in : plan the schedule and flow of the course; or just involved in activity creation, manually evaluate student work, or monitor submission status and grades Small variations in attitude towards technology
- #20: This Slide and Notes are credited to Keli Aman and Jackie Mai from Stanford University. Denise reviews freshman students papers and drafts, gives lots of feedback Landon teaches upperclassmen and grad students, works with 2 graduate teaching assistants, including Irina Irina does all the grading of student papers and participation in discussion. Jan runs a practicum, where nursing students work in a clinic. Students are required to keep a weekly journal. 8 persona for Instructor and staff Types of learning activities used in class: variations in form, purpose, & peer involvement What they are involved in : plan the schedule and flow of the course; or just involved in activity creation, manually evaluate student work, or monitor submission status and grades Small variations in attitude towards technology
- #21: This Slide and Notes are credited to Keli Aman and Jackie Mai from Standford University.
- #22: This Slide and Notes are credited to Keli Aman and Jackie Mai from Standford University.