![Contacts Questions and feeback: [email_address] Lydia Li, Stanford University Project Manager [email_address] Homepage: http://confluence.sakaiproject.org/confluence/display/SAM](https://image.slidesharecdn.com/sakaitests-091006122018-phpapp01/85/Sakai-Tests-104-320.jpg)
Sakai Tests
- 1. Christine Doherty Lydia Li Karen Tsao Stanford University (aka Tests & Quizzes) S akai A ssessment M anager I G O
- 2. Agenda Feature Overview Demo of Features 2.5 Highlights 2.6 Roadmap Quick Create Demo Q&A
- 3. What are SAMigo’s features: Assessment Authoring Assessment Publishing Assessment-Taking Management Assessment Grading Question Pools Management Assessment-Type Management
- 4. Pedagogical Flexibility Online test Self-study questions Homework, problem-sets Paper, code, or project submission Language drills Quick knowledge probes Surveys Others???
- 5. Organize & Publish Assessments Core (pending) Assessments for a course Starting page for assessment authoring Can be exported/imported in QTI XML format When ready, published via Settings Published Assessments for student assessment-taking When students respond, Scores link appears Can change release, due, retract dates, plus some feedback and grading settings Can remove published assessments * New in 2.5
- 7. Question Types Auto-scored Multiple Choice (single and multiple correct) Survey (multiple choice, different rating scales available) Fill in the Blank Numeric Response Matching True/False Manually scored Short Answer/Essay Audio Recording File Upload
- 10. Rich-Text & Attachments At all levels of assessment authoring: Assessment/Part Headers Questions Selections Feedback
- 26. * New in 2.5
- 29. * New in 2.5
- 32. * New in 2.5
- 39. Import/Export Supports QTI v 1.2 Export types: IMS QTI-compliant XML or IMS Content Packaging (for use with attachments) Useful for Making copies of core assessment in same site Copying assessment to different site
- 46. Settings Configures delivery of assessments (how they appear to students) Options include: display/organization late handling number of submissions feedback options high security and time limit for high stakes testing Most settings are not editable after publishing , so it is very important for instructors to review these carefully before publishing
- 50. * New in 2.5
- 51. Save Settings and Publish - to release to students Save Settings - to make changes to core assessment settings, can publish assessement at later time
- 53. Publishing Release assessment to students Copy of core assessment -- core assessment can be modified without affecting published version (and released with new title) Can set Available Date in future -- useful for instructors who want to do bulk of setup early Can retract any time, making assessment unavailable to all students
- 56. Published Inactive Assessments Retracted assessments will not appear to any students Assessments that are past the due date will not appear to students, with following exception: When late submission is allowed, students who have not submitted will get “one last chance” to submit
- 58. Taking an Assessment (Students) Take an Assessment section List determined by available, due, and retract dates Submit for Grading and Save for Later options Table of Contents and Mark for Review features available in non-linear assessment organization Submitted Assessments section Provides submission confirmation with timestamp Depending on settings, students can review scores, feedback, grader’s comments, statistics
- 67. Grading Workflows Ability to grade all questions for one student or grade all responses to one question Manual adjustments can be made to individual questions or entire assessment Comments can be made for individual questions or entire assessment Display of scores can be filtered by section
- 68. Other Grading Features Email students from Scores page Allow Retake for individual student Download All function for file upload questions -- generates zip file of all student submissions Statistics and histograms Export students' responses to Excel file (New in 2.5)
- 69. Grading Settings Anonymous grading OR show student identities Send scores to Gradebook -- this can be toggled on and off after assessment is published Record highest score OR last score
- 77. * New in 2.5
- 85. Question Pools Organize questions into multiple subpools Move/copy/remove multiple questions to other pool * New in 2.5 Author questions from within Pool Manager Import questions from IMS QTI-compliant XML file Randomly draw from pools for an assessment IMPORTANT NOTE: Question pools belong to an individual user only, available across all user’s sites
- 88. Assessment Types Create assessment “types” for different disciplines, different uses Hide complexity by selecting which settings are visible to the instructor. Pre-set defaults by making setting choices for the type (e.g., Self-study always has immediate feedback)
- 95. 2.5 Highlights Adjust score in edit assessment screen * Remove published assessments Allow feedback to be viewed right after an assessment is submitted Export students' responses to Excel file ** Reset point values of questions when a random draw from pool part is created * Move/copy/remove multiple questions to other pool * Copy all questions in a part to a selected pool * Event logging for user operations * Contributed by Rutgers University ** Partly based on contributions from Rutgers University
- 96. 2.6 Roadmap Edit a published assessment Includes editing content of existing questions and most settings Does not include editing parts, reordering parts or questions, adding or removing questions Ability to regrade auto-scored questions for existing submissions Copy a (core) pending assessment Share question pools * Release assessment to one or more groups/sections ** Statistics for item analysis ** * Based on contributions from Universidad Politecnica de Valencia ** Contributed by University of Cape Town
- 97. Quick Create Contributed by Claremont McKenna College and UC Davis Disabled by default, but can be turned on in sakai properties Efficiency created by reducing number of clicks, pages loading and saving Useful for transferring assessments created in other applications or LMS (e.g., MS Word, WebCT), no need to paste into different fields Rich text and attachments can be added later, through edit assessment screen
- 103. Questions?
- 104. Contacts Questions and feeback: [email_address] Lydia Li, Stanford University Project Manager [email_address] Homepage: http://confluence.sakaiproject.org/confluence/display/SAM
Editor's Notes
- #2: Brief background and introductions, tech demo at 6:30 PM
- #4: <show front page> This is the control center for instructors. This is where they see the status of their assessments and can navigate to carry out functions: Authoring Assessments Create New Assessments Questions and Sections Publishing-organization Settings To which groups When released, due, retracted Late Handling Feedback Layout Grading Responses Auto Manual Question Pools Sets of questions with metadata Import and Export Publishing Templates Create types for different use cases Hide complexity from instructors Assessment-taking Management Saves and submissions Timed Assessments
- #6: Show the main authoring page with list of assessments
- #7: Core Assessments are the library of assessments. They can be exported, imported, and published. Published Assessments are those given to course. They can be taken and graded.
- #8: Auto-scored: correct answer is defined and system scores after submission, survey always zero points Manually scored: set to zero, needs instructor or TA to assign scores
- #9: Add questions in edit assessment page
- #10: Top drop-down menu will insert question at very end of assessment (end of last part). Other drop-down menus will insert question at end of part.
- #11: Attachments of jpg, gif, mov, swf will display inline during delivery (preview or students taking assessment) <Show question Authoring>
- #27: Can edit point values in edit assessment screen, all questions at once. This is more efficient than having to go into the edit screen for each question and makes it easier for instructors to change point values relative to other questions. Contributed by Rutgers
- #30: Can copy all questions in a part to a question pool with Copy to Pool link on edit assessment screen, saves user from having to go into edit question screens and saving to pool one by one. Contributed by Rutgers
- #31: Can copy all questions in a part to a question pool with Copy to Pool link on edit assessment screen, saves user from having to go into edit question screens and saving to pool one by one. Contributed by Rutgers
- #33: Can change the point value for random draw questions from pool just for particular assessment, does not affect content in actual pool. Contributed by Rutgers
- #35: Use drop-down menus with numbers to reorder parts or reorder questions within parts. You can edit the first part to replace Default with a name. You can also Remove or Edit parts and questions
- #36: Preview Assessment used to check delivery flow (aka student view). Only thing missing is the initial assessment list that students see. Changes to settings will be reflected in preview (assignment organization, for example).
- #37: Begin page shows when student clicks on title of assessment. The red text boxes appear only in preview mode. Click done to go back to authoring.
- #39: Click Settings to publish/release to students. Click Assessments at top left to go back to main authoring screen.
- #48: Settings available from edit assessment scren or main T&Q page
- #53: Copy released to students, core assessment remains intact can be edited independently of published version and released under new title
- #55: Settings link under title of published assessment allows you to make changes to delivery dates (as well as some Feedback settings and the option to send Scores to Gradebook)
- #59: Save for Later useful for long problem sets where student will want to complete work in more than one session. Also useful if only one submission allowed. Mark for Review useful for high stakes testing, with a lot of questions. Bookmarks questions student would like to check before submitting.
- #62: Example of jpg file displaying inline. Mark for Review feature, show TOC for non-linear access.
- #63: Mark for Review indicated by question mark. Click on question text for non-linear access to questions. Can be useful to students if they are editing a saved submission or reviewing long assessment that displays in many pages, so they don’t have to click through each page to submit.
- #64: Submit for Grading will make responses available to instructor. If student clicks on title of assessment in Take an Assessment (assuming multiple submissions), answers fields will be blank -- not populated with previous responses. Save for Later will store responses and will populate this work next time student clicks on the assessment title in Take an Assessment.
- #67: First two questions were auto-scoring types (fill in the blank and multiple choice) so scores and answer keys appear. Third question will show zero points until grader inputs score manually.
- #72: Anonymous grading may be used to hide student identities from TAs, maintains objectivity and secures student privacy. Responses are not associated with names, but Submission Status indicates which students submitted assessment. Total Score can be manually adjusted, useful for penalty for late submission.
- #73: Allow Retake capability for individual students, applicable when student runs out of submissions or due date has passed and instructor wants to allow student to submit again. This avoids having to release the assessment to the whole class to handle edge case problems.
- #74: Any question score can be adjusted manually. Comments can also be included for individual questions or whole assessment.
- #75: View all responses to question at one time. Large science classes (several hundrred students) use this when they have multiple TAs sharing grading duties. Different TAs grade different questions.
- #76: Adjust for partial credit when scoring rules are too rigid.
- #77: Useful for evaulating the assessment or the learning needs of students, questions that were confusing to a lot of students or topics that need more attention.
- #78: Allows more complex analysis and manipulation by having actual responses in spreadsheet, not just correct/incorrect status.
- #79: Student identites showing, email students feedback directly from scores page
- #80: Filter scores display by section -- useful for large classes and shared grading. TA role only sees students that are in their assigend sections.
- #82: Very useful for file submission assessments. Creates zip file with all submitted files.
- #83: Sending scores to gradebook with Grading Options toggle
- #85: This option can be turned on and off after assessment is published.
- #88: This Add link leads to question authoring page, selecting question type, entering question/answer text, etc. Multiple questions can be checked and Remove, Copy, Move links will activate. Contributed by Rutgers
- #89: <show templates>
- #91: Need to me a member of Administration Workspace to edit or remove these system-wide assessment types, meant to be managed by LMS support team.
- #93: Uncheck settings that you don’t want end-users to be able to set or see when using an assessment type.
- #95: Since High Security settings were deselected as editiable, they don’t show in the Settings page for an assessment using the Problem Set assessment type. They are not relevant to this type of assessment.
- #96: SHOW CONFLUENCE PAGE
- #97: Show edit published assessment workflow
- #105: Mention tech demo at Marriott, 6:30 PM