1

Teacher Hand Scoring Training

Smarter Balanced IABs – ELA

Presented by Karlyn Davis-Weltonkdw26@uw.edu

2

Today’s Learning Goals and Success Criteria

Learning Targets Learn to use the Smarter

Balanced Hand Scoring Training Guides and Exemplar Packets.

Gain a better understanding of the implications of this work in regards to instructional practices.

Become familiar with how to use the AVA for instructional purposes.

Success Criteria Be able to use the Hand Scoring

Materials to score student work.

Based on my new learning, I have at least two or more ideas I can take back to my classroom that will impact my Common Core aligned lesson plans.

Be able to use the AVA to impact classroom instruction.

3

Training Agenda

Accessing materials in the THSS on WCAPHand Scoring Materials & Exemplar

PacketsEntering your students’ scores into THSSDown loading the reports from ORSAccessing the AVA

4

LET’S REVIEW: Scavenger HuntLog into WCAP Portal: http://wa.portal.airast.org/

5

Click AVA-Sign In

Select Grade 4

6

Click Selected Test Icon

Choose Gr. 4 IAB Reading Informational Text

7

Click TIDE Icon & Log In

8

Click THSS Materials Icon

OR

9

THSS Materials: (Grade 4) 51478Choose THSS Materials

Pull up both the Training Guide (TG) and Exemplars (EX) for Reading Informational Text (Grade 4 #51478)

10

Needed Materials: Quick Check

Pull out your…

1. Training Guide (TG) & Exemplars (EX) for Reading Informational Text (Grade 4 #51478)

2. Assignment Template for Module #13

3. Red, Blue, & Green colored pencil or pens

11

12

Training Guide: What does it include?Stimulus (p. 2 & 3) Passage Item Stem (p. 4) QuestionTarget-specific Rubric (p. 4)Condition Code Document (p. 5)Target Chart (p. 7) Targets in Claim 1

13

Activity 1: Training Guide

Read the first page of the training guide. Write down questions you have on your assignment template

Read the item stem (page 4). Carefully read the stimulus (page 2-3). Mark

the text accordingly.

14

Assignment Template: Question #1You are welcome to pause the

video at this point to read through the Training Guide material

Write down questions on your Assignment Template.

15

Activity 2: Closer Look at Rubric CriteriaWith your critical friend… Examine the rubric (page 4).

• Circle the qualifiers that determine a 2 or a 1 point response.

• What do you notice about score point 0?

Pay close attention to the three bullet points at each score point.

16

A Closer Look at this Rubric

Let’s underline these qualifiers that justify a level 2, 1, 0.

Take out your colored pencils or markers (Red, Blue, & Green)

17

Color-coding Qualifiers in the RubricUnderline the qualifiers (sentences) that justify a level 2, 1, 0

Red – Talks about the evidence to determine a central idea

Blue – Cites the evidence Green – Ties together their evidence and citing

with their explanation.

18

Assignment Template: Question #2You are welcome to pause the video at this point to complete the task. Task: Circle the qualifiers that determine a 2 or a 1 point on your Assignment Template.

19

Let’s see how you are doing…

20

Rubric for Target 9 ● Central Ideas

Score Rationale2 A response:

Gives sufficient evidence of the ability to determine a central idea OR to summarize what happens during or after a key event

Includes specific examples/details that make clear reference to the text Adequately explains the central idea OR summarizes with relevant information based on

the text1 A response:

Gives limited evidence of the ability to determine a central idea OR to summarize what happens during or after a key event

Includes vague/limited examples/details that make reference to the text Provides a limited explanation of the central idea OR summarizes with vague/limited

information based on the text0 A response:

Gives no evidence of the ability to determine a central idea, or to summarize what happens during or after a key eventOR Gives the central idea OR summarizes, but includes no examples/details that make reference to the textOR Gives the central idea or summary, but includes no explanation OR no relevant information from the text

Scoring Rules: Items are worth a possible two points (0, 1, 2) and responses are hand‐scored. Rubrics should be customized for the individual item.

21

Now finish underlining “0”You are welcome to pause the video at this point to complete the task.

22

Assignment Template: Question #3

Discuss with your critical friend…

• What did you notice about the qualifiers that determined a 2 or a 1 point response?

• What did you notice about score point 0?

You are welcome to pause the video at this point to complete the task.

23

Let’s Check Our ResponsesDid you notice that the three bullet points for each score point…

• Gives the answer (either states a central idea OR provides an inference/conclusion).

• Gives evidence from the text.

• Provides an explanation for the evidence.

24

Needed Materials: Quick Check

Pull out your…

1. Exemplar Set (Grade 4 #51478)

2. Assignment Template for Module #13

25

26

Exemplar Set: What does it include?

1. Prep Set “Salt” (p. 1)2. Check Set “Salt” (p.12)3. Key (for Scoring) (p. 24)

27

Activity 4: The Prep SetOpen your Prep Set to page 2. Peruse the table at the top of the page.

28

Activity 4: The Prep Set Review the item stem – it should match what you

saw in the Training Guide

29

Activity 4: The Prep Set Read the student response (these responses are

from the SBA field test 2014)

30

Activity 4: The Prep Set Read the comments (the comments are from

professional scorers)

31

Activity 4: Guided Practice

Follow the directions provided on the next 7 slides

32

Item Stem:What is the main idea of the passage “Salt.” Use details from the passage to support your answer. Student Response: the main idea is that you can use salt in many ways to use salt. Like it said people use salt to put on fish and meat to keep it from turning rotten and use it to get the ice of the road and when people use to sell it it was expensive. Page 2

Grade 4 #51478 SaltTarget 9

Score point 2

33

Student response:the main idea is that you can use salt in many ways to use salt. Like it said people use salt to put on fish and meat to keep it from turning rotten and use it to get the ice of the road and when people use to sell it it was expensive. (p. 2)

34

You can use salt in many ways to use salt

Criteria 1Determines the

main idea

35

Criteria 2Evidence from

the text

• use salt to put on fish and meat• get the ice of the road

36

• to keep it from turning rotten

Criteria 3Explains

37

Item Stem:What is the main idea of the passage “Salt.” Use details from the passage to support your answer.

Student Response:The main idea of the story is, that we need salt to survive. I think this because in the passage it said, we need salt to live because we 3 ounces of salt. If we don’t have enough salt we could get really sick. (p. 5)

Grade 4 #51478 SaltTarget 9

Score point 1

38

Item Stem:What is the main idea of the passage “Salt.” Use details from the passage to support your answer.

Student Response:The main idea is that they are talking about like how salt water and sea water are different. (p. 9)

Grade 4 #51478 SaltTarget 9

Score point 0

39

Activity 5: Calibrating Score Points Follow the directions provided on the

next 2 slides

40

Main Idea Comparison

Score 2: you can use salt in many ways to use salt. Score 1: we need salt to survive

Score 0: how salt water is different than sea water.

sufficient

limitedInaccurate main idea

and no details or explanatio

n

41

Explanation Comparison

Score 2: keep it from turning rotten

Score 1: If we don’t have enough salt we could get really sick.

Score 0:

clear

specific

vague limite

d

Provides no explanation

42

Tips regarding Holistic Scoring To receive a score point 2, all parts of the student’s response

do not have to fall into the 2 point criteria.• Example: a student’s response may be sufficient in their ability to

determine the main idea (first bullet point) and their examples (second bullet point) but have a vague or limited explanation (third bullet point) and still score a 2.

• Example: a student’s response may be limited in their ability to determine the main idea (first bullet point) but their examples (second bullet point) and explanation (third bullet point) are adequate/sufficient and still score a 2.

The same theory works for scoring a 1.

43

Activity 6: Marking and Discussing Student Responses in the Prep Set

With your critical friend, you will …

Return to the Prep Set and complete the rest of the pages by highlighting the criteria from the rubric

Use the comments from each page to clarify score points

44

Scoring Note: Please note: In the comment section of some of

the score point 1 papers you will notice the statement “no explanation provided.”

This phrase may be misleading. The score points are correct and the rubric is

accurate.

45

Activity 7: Score the Check Set

With your critical friend, you will … Examine the check set

• Notice the table is similar to the Prep Set except the score point is missing.

Complete all 10 pages by highlighting each criteria and determining a score point.

46

Activity 8 : Check for UnderstandingWith your critical friend, you will …

Examine the key• Check score points and comments• Discuss aha’s and noticing's

47

Activity 9 – Next Steps

What have you learned and how will that inform your instruction?

48

ScoringAccessing the WCAP Portal and the

THSS

49

Teacher Hand Scoring

System (THSS)

Sign into the WCAP Portalhttp://wa.portal.airast.org/

50

The THSS Click on the Interim Teacher Hand Scoring System Score your students’ responses

Look for common patterns of strengths and weaknesses

Jot down any information you want to save – once you submit you will not see the

student papers.

51

52

53

Be sure to submit the score.

54

55

Click AVA-Sign In

Select Grade 4

56

Click Selected Test Icon

Choose Gr. 4 IAB Reading Informational Text

57

Application Viewing Assessment (AVA)Here are some ways to use this tool with your instruction in the classroom.

1. Preview this prior to giving the test. 2. Create a hard copy of the test and have students use this

along with the on-line test. 3. Later on, review their work to see what questions students

found problematic.4. From the hand scoring tool, prior to submitting their scores,

write down some of your student responses that were a 2 pt, 1 pt., 0 pt.

5. Next, share the rubric and explain how the 2 pt. was scored. 6. Have students practice with a 1 pt. to make the response a 2

pt.

58

What other suggestions do you have? Add your ideas and suggestions to the Assignment

Template.

59

Assignment for Module #13

60

Assignment for Module #13

61

Assignment for Module #13