sakai tests
TRANSCRIPT
![Page 1: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/1.jpg)
Christine DohertyLydia Li
Karen Tsao Stanford University
(aka Tests & Quizzes)
S akaiA ssessment M anager IGO
![Page 2: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/2.jpg)
Agenda
• Feature Overview• Demo of Features• 2.5 Highlights• 2.6 Roadmap• Quick Create Demo• Q&A
![Page 3: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/3.jpg)
What are SAMigo’s features:
• Assessment Authoring• Assessment Publishing• Assessment-Taking Management• Assessment Grading• Question Pools Management• Assessment-Type Management
![Page 4: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/4.jpg)
Pedagogical Flexibility
• Online test• Self-study questions• Homework, problem-sets• Paper, code, or project submission• Language drills• Quick knowledge probes• Surveys• Others???
![Page 5: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/5.jpg)
Organize & Publish Assessments
• Core (pending) Assessments for a course– Starting page for assessment authoring– Can be exported/imported in QTI XML format– When ready, published via Settings
• Published Assessments for student assessment-taking– When students respond, Scores link appears– Can change release, due, retract dates, plus
some feedback and grading settings– Can remove published assessments * New in 2.5
![Page 6: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/6.jpg)
![Page 7: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/7.jpg)
Question Types
Auto-scored• Multiple Choice (single and multiple correct)• Survey (multiple choice, different rating scales
available)• Fill in the Blank• Numeric Response• Matching• True/False
Manually scored• Short Answer/Essay• Audio Recording• File Upload
![Page 8: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/8.jpg)
![Page 9: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/9.jpg)
![Page 10: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/10.jpg)
Rich-Text & Attachments
• At all levels of assessment authoring:– Assessment/Part Headers – Questions– Selections– Feedback
![Page 11: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/11.jpg)
Create an Assessment
![Page 12: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/12.jpg)
![Page 13: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/13.jpg)
![Page 14: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/14.jpg)
![Page 15: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/15.jpg)
![Page 16: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/16.jpg)
![Page 17: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/17.jpg)
![Page 18: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/18.jpg)
![Page 19: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/19.jpg)
![Page 20: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/20.jpg)
![Page 21: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/21.jpg)
![Page 22: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/22.jpg)
![Page 23: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/23.jpg)
![Page 24: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/24.jpg)
![Page 25: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/25.jpg)
![Page 26: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/26.jpg)
* New in 2.5
![Page 27: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/27.jpg)
![Page 28: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/28.jpg)
![Page 29: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/29.jpg)
* New in 2.5
![Page 30: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/30.jpg)
![Page 31: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/31.jpg)
![Page 32: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/32.jpg)
* New in 2.5
![Page 33: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/33.jpg)
![Page 34: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/34.jpg)
![Page 35: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/35.jpg)
![Page 36: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/36.jpg)
![Page 37: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/37.jpg)
![Page 38: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/38.jpg)
![Page 39: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/39.jpg)
Import/Export
• Supports QTI v 1.2• Export types: IMS QTI-compliant XML or IMS
Content Packaging (for use with attachments)• Useful for
– Making copies of core assessment in same site– Copying assessment to different site
![Page 40: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/40.jpg)
![Page 41: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/41.jpg)
![Page 42: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/42.jpg)
![Page 43: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/43.jpg)
![Page 44: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/44.jpg)
![Page 45: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/45.jpg)
![Page 46: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/46.jpg)
Settings• Configures delivery of assessments (how they
appear to students)
• Options include: – display/organization– late handling– number of submissions – feedback options – high security and time limit for high stakes testing
• Most settings are not editable after publishing, so it is very important for instructors to review these carefully before publishing
![Page 47: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/47.jpg)
![Page 48: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/48.jpg)
![Page 49: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/49.jpg)
![Page 50: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/50.jpg)
* New in 2.5
![Page 51: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/51.jpg)
Save Settings and Publish - to release to students
Save Settings - to make changes to core assessment settings,
can publish assessement at later time
![Page 52: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/52.jpg)
![Page 53: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/53.jpg)
Publishing
• Release assessment to students• Copy of core assessment -- core assessment
can be modified without affecting published version (and released with new title)
• Can set Available Date in future -- useful for instructors who want to do bulk of setup early
• Can retract any time, making assessment unavailable to all students
![Page 54: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/54.jpg)
![Page 55: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/55.jpg)
![Page 56: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/56.jpg)
Published Inactive Assessments
• Retracted assessments will not appear to any students
• Assessments that are past the due date will not appear to students, with following exception:– When late submission is allowed, students who
have not submitted will get “one last chance” to submit
![Page 57: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/57.jpg)
![Page 58: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/58.jpg)
Taking an Assessment (Students)
• Take an Assessment section– List determined by available, due, and retract dates– Submit for Grading and Save for Later options– Table of Contents and Mark for Review features
available in non-linear assessment organization
• Submitted Assessments section– Provides submission confirmation with timestamp– Depending on settings, students can review scores,
feedback, grader’s comments, statistics
![Page 59: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/59.jpg)
![Page 60: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/60.jpg)
![Page 61: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/61.jpg)
![Page 62: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/62.jpg)
![Page 63: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/63.jpg)
![Page 64: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/64.jpg)
![Page 65: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/65.jpg)
![Page 66: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/66.jpg)
![Page 67: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/67.jpg)
Grading Workflows
• Ability to grade all questions for one student or grade all responses to one question
• Manual adjustments can be made to individual questions or entire assessment
• Comments can be made for individual questions or entire assessment
• Display of scores can be filtered by section
![Page 68: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/68.jpg)
Other Grading Features
• Email students from Scores page• Allow Retake for individual student• Download All function for file upload
questions -- generates zip file of all student submissions
• Statistics and histograms• Export students' responses to Excel file (New
in 2.5)
![Page 69: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/69.jpg)
Grading Settings
• Anonymous grading OR show student identities
• Send scores to Gradebook -- this can be toggled on and off after assessment is published
• Record highest score OR last score
![Page 70: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/70.jpg)
![Page 71: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/71.jpg)
![Page 72: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/72.jpg)
![Page 73: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/73.jpg)
![Page 74: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/74.jpg)
![Page 75: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/75.jpg)
![Page 76: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/76.jpg)
![Page 77: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/77.jpg)
* New in 2.5
![Page 78: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/78.jpg)
![Page 79: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/79.jpg)
![Page 80: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/80.jpg)
![Page 81: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/81.jpg)
![Page 82: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/82.jpg)
![Page 83: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/83.jpg)
![Page 84: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/84.jpg)
![Page 85: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/85.jpg)
Question Pools
• Organize questions into multiple subpools • Move/copy/remove multiple questions to
other pool * New in 2.5• Author questions from within Pool Manager• Import questions from IMS QTI-compliant
XML file• Randomly draw from pools for an assessment• IMPORTANT NOTE: Question pools belong
to an individual user only, available across all user’s sites
![Page 86: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/86.jpg)
![Page 87: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/87.jpg)
![Page 88: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/88.jpg)
Assessment Types
• Create assessment “types” for different disciplines, different uses
• Hide complexity by selecting which settings are visible to the instructor.
• Pre-set defaults by making setting choices for the type (e.g., Self-study always has immediate feedback)
![Page 89: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/89.jpg)
Assessment Creation Workflow
![Page 90: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/90.jpg)
![Page 91: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/91.jpg)
![Page 92: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/92.jpg)
![Page 93: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/93.jpg)
![Page 94: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/94.jpg)
![Page 95: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/95.jpg)
2.5 Highlights• Adjust score in edit assessment screen *• Remove published assessments• Allow feedback to be viewed right after an assessment is
submitted• Export students' responses to Excel file **• Reset point values of questions when a random draw
from pool part is created *• Move/copy/remove multiple questions to other pool *• Copy all questions in a part to a selected pool *• Event logging for user operations
* Contributed by Rutgers University** Partly based on contributions from Rutgers University
![Page 96: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/96.jpg)
2.6 Roadmap• Edit a published assessment
– Includes editing content of existing questions and most settings
– Does not include editing parts, reordering parts or questions, adding or removing questions
– Ability to regrade auto-scored questions for existing submissions
• Copy a (core) pending assessment• Share question pools *• Release assessment to one or more groups/sections **• Statistics for item analysis **
* Based on contributions from Universidad Politecnica de Valencia** Contributed by University of Cape Town
![Page 97: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/97.jpg)
Quick Create• Contributed by Claremont McKenna College and
UC Davis• Disabled by default, but can be turned on in sakai
properties• Efficiency created by reducing number of clicks,
pages loading and saving• Useful for transferring assessments created in other
applications or LMS (e.g., MS Word, WebCT), no need to paste into different fields
• Rich text and attachments can be added later, through edit assessment screen
![Page 98: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/98.jpg)
![Page 99: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/99.jpg)
![Page 100: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/100.jpg)
![Page 101: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/101.jpg)
![Page 102: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/102.jpg)
![Page 103: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/103.jpg)
Questions?
![Page 104: Sakai Tests](https://reader034.vdocuments.mx/reader034/viewer/2022042602/55999d4b1a28ab800d8b483a/html5/thumbnails/104.jpg)
Contacts
Questions and feeback: [email protected]
Lydia Li, Stanford University Project Manager [email protected]
Homepage:http://confluence.sakaiproject.org/confluence/display/SAM