60
Tests & Quizzes (aka SAMigo) Christine Doherty, Stanford University June 16, 2011

Tests and Quizzes (Samigo) 2011

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Tests and Quizzes (Samigo) 2011

Tests & Quizzes (aka SAMigo)

Christine Doherty, Stanford UniversityJune 16, 2011

Page 2: Tests and Quizzes (Samigo) 2011

Agenda

• Future of T&Q: Development Dilemmas• Community Contribution• 2.8 Highlights• 2.9 Plans• Q&A

Page 3: Tests and Quizzes (Samigo) 2011

Future of T&Q:Development Dilemmas

Page 4: Tests and Quizzes (Samigo) 2011

Guiding Principles

Flexibility/FreedomReliability/Error-Free

Page 5: Tests and Quizzes (Samigo) 2011

Development Focus

Improve UI/InteractionAdd New Features

Page 6: Tests and Quizzes (Samigo) 2011

Project Management

Stanford as GatekeeperModularize/Distribute

Page 7: Tests and Quizzes (Samigo) 2011

Community Contribution

Page 8: Tests and Quizzes (Samigo) 2011

New Release Process

http://confluence.sakaiproject.org/confluence/display/SAM

Page 9: Tests and Quizzes (Samigo) 2011

Rationale

• User experience reviews are critical:

• New features can cause clutter in UI, confusion, bad user experience

• New features can clash with existing or planned features and lead to unexpected behavior

• Stanford only has one designer to tackle the workload, so we need help

Page 10: Tests and Quizzes (Samigo) 2011

Requirements for Contributions

Clear specs are a must:

• Rationale for new feature/enhancement

• Description of expected behavior

• Documentation of all affected screens

• Screen shots desirable

Page 11: Tests and Quizzes (Samigo) 2011

TimelineDate Milestone

June 1 Contributor submits design specs for new feature or enhancement via JIRA. SAMigo developers route spec to UX team for review.

Jun 15 Stanford provides initial feedback on specs

July 1 Contributor responds with revisions July 15 Stanford gives second round of feedback August 15 Contributed code QA'ed to revised spec and submitted to

Stanford September 1 SAMigo code freeze for release; Sakai QA team begins

Page 12: Tests and Quizzes (Samigo) 2011

2.8 Highlights

Page 13: Tests and Quizzes (Samigo) 2011

Respondus Integration before 2.8

Respondus Sakai – T&Q

Question Types ChangedMissing Metadata

Page 14: Tests and Quizzes (Samigo) 2011

Respondus Integration in 2.8

Respondus Sakai – T&Q

QTI XML or Zip file from RespondusImports to Sakai Tests & Quizzes

Page 15: Tests and Quizzes (Samigo) 2011

Respondus Integration

Page 16: Tests and Quizzes (Samigo) 2011

Respondus Integration

Page 17: Tests and Quizzes (Samigo) 2011

Respondus Integration

Respondus Sakai – T&Q

Respondus Sakai – T&Q

Page 18: Tests and Quizzes (Samigo) 2011

Record Average Score

• New Feature: ability to record average score for multiple submissions

• Redesigned UI for student’s Submitted Assessments list to accommodate displaying average scores

• Contributed by Rice University

Page 19: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 20: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 21: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 22: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 23: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 24: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 25: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 26: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 27: Tests and Quizzes (Samigo) 2011

Record Average Score

Page 28: Tests and Quizzes (Samigo) 2011

Release Scores Only

• Based on feedback from instructors wanting to show students their scores without allowing them to see questions again (since questions are reused in subsequent tests)

• Solution is to separate out scores from rest of feedback options

Page 29: Tests and Quizzes (Samigo) 2011

Release Scores Only to Students

Page 30: Tests and Quizzes (Samigo) 2011

Release Scores Only

Page 31: Tests and Quizzes (Samigo) 2011

Clarification of Settings

Page 32: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook for non-submission records

• Clash of scoring rules in Tests & Quizzes and Gradebook caused inability to set zero scores for non-submission records for inclusion in course grade calculation

• Solution is to allow instructors to explicitly enter a zero score for a non-submission record that gets sent to gradebook

• Patch contributed by Longsight

Page 33: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook for non-submission records

Page 34: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook for non-submission records

Page 35: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook for non-submission records

Page 36: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook

Page 37: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook for non-submission records

Page 38: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook for non-submission records

Page 39: Tests and Quizzes (Samigo) 2011

Send zero scores to Gradebook for non-submission records

Page 40: Tests and Quizzes (Samigo) 2011

Rich Text Entry for Short Answer/Essay

• Instructors from several institutions requested a way for students to enter rich text in essay questions for equations, foreign characters, or just general formatting

• Solution is to present students with the ability to use the FCKeditor in Short Answer/Essay questions.

• Contributed by Longsight

Page 41: Tests and Quizzes (Samigo) 2011

Rich Text Entry for Short Answer/Essay

Page 42: Tests and Quizzes (Samigo) 2011

Rich-text for Short Answer

Page 43: Tests and Quizzes (Samigo) 2011

Rich-text for Short Answer

Page 44: Tests and Quizzes (Samigo) 2011

Publish Action

• Based on feedback that Settings and Publish actions were redundant, both leading to Settings page

• Solution is to link Publish action to Publish Assessment page where settings are verified and notification added (if desired)

Page 45: Tests and Quizzes (Samigo) 2011

Publish Action

Page 46: Tests and Quizzes (Samigo) 2011

Publish Action

Page 47: Tests and Quizzes (Samigo) 2011

Publish Action

Page 48: Tests and Quizzes (Samigo) 2011

Publish Action

Page 49: Tests and Quizzes (Samigo) 2011

Remove Assessment Types

• Assessment Types often prove to be confusing to instructors, since they may not know what the labels mean and what settings go with them

• One solution is to remove any trace of assessment types with a sakai property (samigo.showAssessmentTypes=False)

• Contributed by Longsight

Page 50: Tests and Quizzes (Samigo) 2011

Remove Assessment Types

Page 51: Tests and Quizzes (Samigo) 2011

Remove Assessment Types

Page 52: Tests and Quizzes (Samigo) 2011

Remove Assessment Types

Page 53: Tests and Quizzes (Samigo) 2011

2.9 Plans

Page 54: Tests and Quizzes (Samigo) 2011

Stanford contributions for 2.9

• Restyling and rewriting of warning messages

• Reset selection and warning messages redraw at current question, instead of top of page

• Reworking automatic submission logic

• Validation for numeric response questions

• Count Characters button for Short Answer/Essay questions

• Render part information and images in Print view

Page 55: Tests and Quizzes (Samigo) 2011

Community contributions for 2.9

• Redesign of main Assessments page (Longsight)

• Calculated question type (University of Dayton)

• Survey – Matrix of Choices question type (Rutgers)

• Extended Matching Item question type (University of Cape Town)

Page 56: Tests and Quizzes (Samigo) 2011

Redesign of Main Assessments Page

Page 57: Tests and Quizzes (Samigo) 2011

Redesign of Main Assessments Page

Page 58: Tests and Quizzes (Samigo) 2011

Contacts

Questions and feedback: [email protected]

Lydia Li, Stanford University Project Manager [email protected]

Karen Tsao Samigo Developer [email protected]

Homepage:http://confluence.sakaiproject.org/confluence/display/SAM

Page 59: Tests and Quizzes (Samigo) 2011

Online Final Exams Using Sakai at Stanford University

Jamie Tsui

9:45 AM - 10:15 AM in Beaudry B

Page 60: Tests and Quizzes (Samigo) 2011

Questions?