EngageNY.org

SLO Results Analysis

For District Leaders, Principals, and Teachers

2

At the end of this video, you will be able to:

EngageNY.org

1. • Consider systems for scoring summative

assessments used with SLOs.

2. • Use the SLO calculator tool to support the

calculation of HEDI ratings.

3. • Reflect on SLO Results to Inform

Instructional Decisions and Approaches

2

3

Four phases of the SLO Process

1. Preparation

2. Development

3. Implementation

4. Results Analysis

3 EngageNY.org

3

4

SLOs at the end of a school year…

• Thinking strategically about the Results Analysis phase of the

SLO process offers important benefits for instructional

planning.

4

Results Analysis

Close-out

1. Administer the summative assessments.

2. Gather summative assessment results (score and record).

3. Calculate outcomes and translate to HEDI scores.

4. Report results.

Reflection

5. Organize, review, and reflect on data to inform classroom, school-wide,

and district-wide decisions around student academic goals and

instructional decisions.

EngageNY.org

4

5

Scoring Summative Assessments

EngageNY.org 5

6

Close-out: Scoring Summative

Assessments

• Please see Section G of the APPR Guidance for

information regarding the vested interest rule:

http://engageny.org/sites/default/files/resource/attac

hments/appr-field-guidance.pdf

• Remember: Teachers and principals cannot score

assessments in which they have a vested interest.

6 6 6 EngageNY.org 6

7

Close-out: Scoring Summative

Assessments

Sample SLO scoring options:

1. Expert Panel

2. Blind Distribution

3. Strategic Rotation

EngageNY.org 7

8

Close-out: Scoring Summative

Assessments, “Expert Panel”

8

Example of a Review Team:

Teacher from Middle School 1

Teacher from Middle School 2

District Central Office Personnel

Content Expert from BOCES

EngageNY.org 8

9

Close-out: Suggestions for Training

Individuals for “Expert Panels”

• Develop scoring guides, rubrics, and protocols.

• Articulate expectations for submission in

advance (especially important for work products

and “real-time” summative assessments)

• Practice scoring real student work using the

developed materials.

• Arrange for inter-rater agreement and reliability.

EngageNY.org 9

10

Close-out: Scoring Summative

Assessments, “Blind Distribution”

10

Blind Distribution

Random portion of

summative assessments

Random portion of

summative assessments

Random portion of

summative assessments

Random portion of

summative assessments

EngageNY.org 10

11

Close-out: Scoring Summative

Assessments, “Strategic Rotation”

11

Sample rotation

EngageNY.org 11

12

Calculating Outcomes and

Translating Results to HEDI Scores

EngageNY.org 12

13

Close-out: Calculating Outcomes

A: Student

Names

B: Baseline

Scores C: Targets

D:

Summative

Assessment

Scores

E: (D minus

C)

Student U 17 80

Student V 10 70

Student W 12 75

Student X 18

Student Y 14

Student Z 22

13

Student Teacher Course/Period

Code

Student V A 1234

Student W A 1234

Student X A 1234

Student Y A 1234

Student Z A 1234

EngageNY.org 13

14

Close-out: Calculating Outcomes

A: Student

Names

B: Baseline

Scores C: Targets

D:

Summative

Assessment

Scores

E: (D minus

C)

14 EngageNY.org 14

15

Close-out: Calculating Outcomes

A: Student

Names

B: Baseline

Scores C: Targets

D:

Summative

Assessment

Scores

E: (D minus

C)

15 EngageNY.org 15

16

Close-out: Calculating Outcomes

A: Student

Names

B: Baseline

Scores C: Targets

D:

Summative

Assessment

Scores

E: (D minus

C)

Student V 30 70 81 11

Student W 52 75 68 -7

Student X 60 80 94 14

Student Y 48 75 77 2

Student Z 65 80 80 0

4/5 (80%)

16 EngageNY.org 16

17

Close-out: Calculating Outcomes

Weighting Multiple SLOs

Sample teacher with three SLOs:

1.An SLO with 50 students earning 14 points on the district-approved HEDI scale

2.A second SLO which earned 16 points with 39 students, and

3.A third SLO which earned 11 points with 18 students.

17 17 EngageNY.org 17

18

Close-out: Calculating Outcomes

Weighting Multiple SLOs

Sum the number of students.

50+39+18 = 107

Compute proportion of students covered by each SLO.

50/107 =.4673 39/107 =.3645 18/107 =.1682

Multiply the proportion by the HEDI points for three partial

HEDIs that will be added together.

.4673 * 14 = 6.5422 (SLO 1)

.3645 * 16 = 5.832 (SLO 2)

.1682 * 11 = 1.8502 (SLO 3)

Overall HEDI = sum of these partial HEDI values.

6.5422 + 5.832 + 1.8502 = 14.2244 Rounded = 14

(Effective)

Note:

SLO 1 = 14 points with 50 students

SLO 2 = 16 points with 39 students

SLO 3 = 11 points with 18 students

18 EngageNY.org 18

19

Close-out: Weighting Multiple SLOs

EngageNY.org 19

20

Close-out: Weighting Multiple SLOs

EngageNY.org 20

21

Close-out: Weighting Multiple SLOs

EngageNY.org 21

22

Close-out: Weighting Multiple SLOs

EngageNY.org 22

Close-Out: SLO Database

EngageNY.org 23

24

Reflecting on SLO Results to Inform

Instructional Decisions and Approaches

EngageNY.org 24

25

Reflection: Formal

Visit engageny.org for sample agenda items as

you plan for final conferences with educators.

24 EngageNY.org 25

26

Reflection: Organize and Review

0

1

2

3

4

5

6

Arts

Kinderg

arte

n

Grade 1 EL

A

Grade 1 M

ath

Grade 2 EL

A

Grade 2 M

ath

Highly Effective

Effective

Developing

Ineffective

25 EngageNY.org 26

27

Reflection: Formal

Remember to include SLO analysis with teachers

as a part of that final conference.

26 EngageNY.org 27

28

Reflection: Organize and Review

EngageNY.org 28

Standard:

Assessment Item:

29

Four phases of the SLO Process

1. Preparation

2. Development

3. Implementation

4. Results Analysis

28 EngageNY.org 29

30

Search: www.engageNY.org

29 EngageNY.org 30