31
Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, [email protected] Beth Fahlberg School of Nursing, [email protected]

Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, [email protected] Beth Fahlberg School of Nursing, [email protected]

Embed Size (px)

Citation preview

Page 1: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Rubrics: From Creation to Use in Learn@UW

John ThomsonDoIT Academic Technology, [email protected] FahlbergSchool of Nursing, [email protected]

Page 2: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Introduction to rubrics

1.Examples, benefits, drawbacks

2.Electronic rubrics in D2L (Learn@UW)

3.Experiences in a teaching team

4.Group work

5.Quick demonstration

Page 3: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

What is a rubric?

Page 4: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Traditional rubric used in grading

Page 5: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Benefits of using rubrics

• Facilitates feedback

• Promotes grading consistency

Provides direction for students before and after an assignment

Page 6: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Drawbacks of traditional* rubrics* Paper or document file rubric

• Cumbersome & inefficient

Process of grading using doc file rubrics

1. Open/ find student assignment

2. Open correct rubric file

3. Remember to save the rubric as a new file with the student's name in a place you can find it later

4. Grade assignment & enter feedback

5. Add up points

6. Enter grade in online gradebook

7. Upload correct file for correct student and assignment

Page 7: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Drawbacks of traditional* rubrics* Paper or document file rubric

• Challenging to use information for assessment of learning outcomes

Possibility of error at several points

Page 8: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Paper RubricsSuch Fun!

http://magazine.uchicago.edu/0106/features/

Page 9: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

WHAT IF???

Rubrics could be efficient as well as effective?

Page 10: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Rubrics in Learn@UW

Page 11: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 12: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 13: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Learn@UW Rubric- graded assignment

Page 14: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Learn@UW Rubric performance feedback

Page 15: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Grades & feedback easily edited & transferred from rubric to gradebook

Page 16: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Benefits of Learn@UW Rubrics

• Saves time!!

• Reduces error

• Promotes effective communicationo Faculty-studento Faculty-faculty

• Ease of access & revision

Page 17: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Experiences of teaching team

Barb King

Paul Larson

Fanglin Kuo

• Rubrics were efficient for grading papers

• Promoted consistency and communication between graders

Nursing 433 Fall 2012

Page 18: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Clinical assessment rubric

Document converted to online format, piloted with one group at two points in time

Challenges:

• Making criteria specific enough

• Differentiating between each level

Additional challenges with graded rubrics

• Ensuring assigned points are internally consistent with expectations and syllabus

Nursing 319, Spring 2013

Page 19: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Experiences using L@UW rubric for clinical performance evaluation

• At clinical site

• Reading weekly journals

Better & more frequent feedback for students

Streamlined evaluation process

Observations of performance and learning easily entered:

Page 20: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Rubric development in Learn@UW

1.Plan

2.Draft in D2L

3.Publish to grade student work

Page 21: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Rubric development in Learn@UW

Lingo:

• Analytic vs Holistic

• Criteria & Levels

• Range

Best used in:

• Dropbox

• Gradebook

Page 22: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 23: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 24: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 25: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Be sure to distinguish between different criteria

Page 26: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 27: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 28: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu
Page 29: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Group work: creating a rubric

Find a partner!

Using one of the example assignments, or one of your own, draft a rubric.

Use the VALUE rubric as an example of good level definitions.

Be ready to trade your rubric with another pair.

Page 30: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Resources

VALUE rubrics from AACU - institutional rubrics for essential learning outcomes

http://www.aacu.org/value/rubrics/

iRubric - example rubrics from a number of disciplineshttp://www.rcampus.com/indexrubric.cfm

Rubrics orientation in Desire2Learn (Learn@UW)https://kb.wisc.edu/27857

Creating & Editing a Rubrichttps://kb.wisc.edu/27621

Page 31: Rubrics: From Creation to Use in Learn@UW John Thomson DoIT Academic Technology, jcthomsonjr@doit.wisc.edu Beth Fahlberg School of Nursing, fahlberg@wisc.edu

Thanks!

Q&A