RUBRICS: BUILDING, GRADING, AND - northeastern.edu · • Can edit rubrics in section and...

RUBRICS: BUILDING, GRADING, AND PROVIDING TARGETED FEEDBACK TO STUDENTS

(BLACKBOARD AND TURNITIN)

CPS FACULTY CONFERENCE 2018

2

AQA Director, Assessment: Dr. Mamta SaxenaAssociate Director, Assessment: Melanie Kasparian

Instructional Designer: Donna DiGiovanniCPS Faculty: Dr. Hattie Hammonds

3

4

• Collect data about program outcomes to inform the teaching and learning at the program level

• Promote a culture of assessment and inquiry to achieve college and program goals and mission

• Provide a shared understanding of good assessment practices

Annual Report Stages

IV: Act I: Define

III: Analyze II: Collect

AQA Mission and Goals

How Can We Help You?

Program Evaluation

Data Collection

Assessment Cycle

5

Assessment Support• Developing Learning

Outcomes• Crafting Assignments• Capstone Experiences• Assessment Measurement

AND…

Workshop Outcomes

At the end of the workshop, you will be able to:

• Build rubrics in Blackboard and Turnitin

• Grade with rubrics in Blackboard and Turnitin

• Offer targeted feedback using rubrics

• Download and interpret Rubric Evaluation Reports and data ONLY for Blackboard rubrics

6

Questions

• How many of you are familiar with rubrics?

• How many of you use or have used rubrics in your class?

• What are some ways you currently use rubrics?

• What were some of the challenges you faced when using rubrics?

7

RUBRICS: QUICK REFRESHER

CPS FACULTY CONFERENCE 2018

8

CPS Rubrics Framework

9

VALUE Rubrics accessed by:

42,000 individuals

4,200 unique institutions

2,800 colleges and universities.

Maintaining Course Alignment via Rubrics

10

Assessments

Outcomes Activities

What kind of tasks will show if students have achieved the

identified outcomes?

What do we want students to be able to

do when they complete the course?

What kind of activities will reinforce the

learning outcomes and prepare students for

assessments?

Using Rubrics

A rubric is an assessment tool that uses clearly specified

criteria and proficiency levels to measure or

judge student achievement or mastery of a given task or skills

11

Why Use Rubrics?

Spells out Expectations

Helps scaffold learning

Informs students on

performance

Reinforces adherence to

learning

Makes grading

more transparent

Makes grading more

consistent

12

Elements of a Rubric

13

RUBRICS: BUILDING IN BLACKBOARD

CPS FACULTY CONFERENCE 2018

14

Create a Blackboard Rubric

15

Spend time writing useful feedback for each cell.

Create a Blackboard Rubric

16

Associate Rubric with a Gradable Item

17

RUBRICS: GRADING IN BLACKBOARD

CPS FACULTY CONFERENCE 2018

18

Grade using a Rubric

19

Grade using a Rubric

Click this icon to view the rubric in a separate window

20

21

Grade Center with Rubric Grade

22

23

My Grades Student View

RUBRICS: REPORTS FOR BLACKBOARD RUBRICS

CPS FACULTY CONFERENCE 2018

24

25

Rubric Evaluation Reports

26

Sample Rubric Report

72% of students exemplified strong analysis and evaluation (meets or above standards).

Sample Data

27

38%

17%

68%

12%

0% 20% 40% 60% 80%

Business Knowledge

Research Competency

Teamwork

Ethics

Meeting Learning Outcomes

Percent ofStudents at aCompetencyLevel

Goal: 65%

Resources & Support

Rubrics Repository: For trainings, please watch the following videos:Building and Using RubricsExporting and Importing Rubrics

Rubrics Module, Webinars & Best Practices Guide: Coming soon!

IRC Training, December 3rd at 12:15-1:15pm-d.digiovanni@northeastern.edu as the registration contact: http://www.northeastern.edu/nuolirc/events/grading-with-rubrics-tips-and-best-practices/

Center for Advancing Teaching and Learning Through Research: CATLR Workshops

Support:• Program Manager• Instructional Designer• Assessment Support, AQA

28

RUBRICS: BUILDING & GRADING IN TURNITINFACULTY PERSPECTIVE

CPS FACULTY CONFERENCE 2018

29

Why use Turnitin for building rubrics or grading assignments?

1. Papers are already submitted for plagiarism.2. Rubrics can be built in the same location where you

check student papers for plagiarism.3. No need to download paper, save, track changes, save

again and upload to Grade Center.4. Comments/feedback can be made directly in a student’s

paper using Quickmarks or a comment bubble.5. Grades in TurnItIn can be synched to Grade Center;

there is no need to input manually.

30

Building Rubrics with Turnitin

31

Select the week that you want to place the

TurnItIn assignment in

Building Rubrics with Turnitin

32

Click on “Assessments” and scroll down and

select “TurnItInAssignment”

Building Rubrics with Turnitin

33

Now you are on the screen where you can

create a TurnItInAssignment

Building Rubrics with Turnitin

34

Set your assignment’s “Start Date”, “Due Date”

and “Post Date” (the date you want this

assignment’s grades to be available to students

in TurnItIn)

Click on “Optional Settings” to locate the place where you can

build a rubric

Create an Assignment name

and give the maximum points allowed on the

assignment

Building Rubrics with Turnitin

35

Decide if you want students to turn in assignments late

Decide if you want to see how similar your students’ papers are to other sources and

whether you want students to see that

information

Decide if you want to exclude references

and quotes from being screened for

plagiarism

Building Rubrics with Turnitin

36

Most of the choices on this screen are pre-selected; you

can change if desired

Building Rubrics with Turnitin

37

Launch the Rubric/Form

Manager to start building your TurnItIn rubric

Building Rubrics with Turnitin

38

This is what your blank rubric will look like.

1. Name your rubric. 2. Decide what criterion

you want to evaluate and the percentage each criterion counts. You can add criterion by clicking on the “+” sign. Criterion percentages must equal 100%.

3. Select the scales/grades that correspond with

your criterion. You can add criterion

and scales by clicking on the “plus signs”.

Building Rubrics with Turnitin

39

1. This is an example of a rubric I used last quarter in EDU 7214.

2. Pay particular attention to the scales and grades that you use…this will affect the grade that students receive if the scales are too high/low.

Building Rubrics with Turnitin

40

Once you build the rubric, select it for the assignment you are grading. Go to the bottom of the screen and submit your choice.

Building Rubrics with Turnitin

41

If you’ve done everything correctly, then this is the screen you should see.

Building Rubrics with Turnitin

42

This is what students will see when they go to

submit their assignment to

TurnItIn

Building Rubrics with Turnitin

43

This page shows that the Practice Assignment was 17% similar to other sources, was submitted on-time and is ready to grade with the rubric you created.

Building Rubrics with Turnitin

44

This is a breakdown of the sources that made up the 17% similarity.

Building Rubrics with Turnitin

45

While you’re evaluating a student’s paper in TurnItIn, you can put commonly used Quickmarkssuch as C/S (comma splice), Frag (fragment). You can also add your own Quickmarks.

Building Rubrics with Turnitin

46

Building Rubrics with Turnitin

47

Once you’re done reading and typing comments or putting in Quickmarks, then you click on this button to use the rubric you created to grade the paper. After inputting the scores that you desire, click “Submit”.

Building Rubrics with Turnitin

48

The grade you gave on the rubric now appears on the main assignment page.

In order to get the grade from TurnItIn into Blackboard’s Grade Center, click on “Roster Sync” and the grade will transfer automatically.

Questions???

Contact InformationDr. Hattie Hammonds

LecturerNortheastern University

h.hammonds@northeastern.edu

(I reside in NC and am a full-time teacher, so responses will be after 3:00 pm most days).

49

Pros and Cons: BB vs. Turnitin Rubrics

50

Blackboard Rubrics • Connects to any grade center column, in

particular Assignment items

• Can use points, weights, or ranges

• Autograded

• Can provide feedback within each cell

• Data shows overall and row-level rubric scores

• Data is presented for overall class, not by individual student

• Can edit rubrics in section and import/export to other sections

Recommendation: • Use BB rubrics for summative, final grading and Turnitin for formative feedback and plagiarism

check. If you use Turnitin for summative, you can attach the rubric to the grade center column and use that to grade.

• If you teach a course that has a signature assignment for a program student learning outcome measure, you MUST use the Blackboard rubrics.

Turitin Rubrics • Grading occurs in same place as paper if

Turnitin item is created and graded

• Can use weights or points

• Autograded

• Can provide feedback within each cell, and within line of paper

• Data shows overall and row-level rubric scores

• Data is presented for overall class, and by individual student

• Editing has restrictions as rubric lives with Turnitin account user

Allan, J. (1996). Learning outcomes in higher education. Studies in Higher Education, 21(1) 93-108.

Anderson, L.W., Krathwohl, D.R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s Taxonomy of educational objectives. New York: Longman.

Brady, L. (1996). Outcome-based education: A critique. The Curriculum Journal, 7(1): 5-16.

Driscoll, A., & Wood, S. (2007). Developing Outcomes-based assessment for learner-centerededucation: A faculty introduction. Sterling, VA: Stylus.

Jonassen, D. H. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology: Research and Development, 45(1), 65-94.

Wiggins, G. P. (1998). Educative assessment: Designing assessment to inform and improve student performance. San Francisco, CA: Jossey-Bass A Wiley Imprint.

Maki, P.L. (2017). Real-time student assessment: Meeting the imperative for improved time to degree, closing the opportunity gap, and assuring student competencies for 21rst century. Sterling, VA: Stylus.

References

51