Understanding How the Ranking is Calculated 2011 TOP TO BOTTOM RANKING

Understanding How the Ranking is Calculated

2011 TOP TO BOTTOM RANKING

The statewide top-to-bottom ranking takes into account both student achievement on state tests and graduation rates. Student achievement on state tests is included in the statewide top to bottom ranking in the following three ways:Achievement at the elementary, middle, and high school levels

Improvement in achievement over timeThe largest achievement gap between two subgroups calculated based on the top scoring 30% of students versus the bottom scoring 30% of students

TOP TO BOTTOM (TTB) RANKING

In addition to the achievement components, student graduation is included in the statewide top-to-bottom ranking for schools with a graduation rate in the two following ways:Graduation RateImprovement in graduation rate over time

TTB RANKING

Schools with 30 or more students tested over the last two years in at least two state-tested content areas:

MathematicsReadingScienceSocial StudiesWriting

WHO RECEIVES A RANKING?

For grade 3-8 reading and mathematics

HOW IS THE TOP TO BOTTOM RANKING CALCULATED

Two-Year Average

Standardized Student Scale

(Z) Score

Two-Year Average

Performance Level Change

Index

Two-Year Average Bottom 30% - Top 30%

Z-Score Gap

School Achievement

Z-Score

School Performance Level Change

Z-Score

School Achievement Gap Z-Score

School Content

Area Index

1/2

1/4

1/4

Content

Index Z-

score

A weighted composite of individual student performance level change is used to calculate improvement in grades 3-8 reading and mathematics

Rewards large improvements more heavily, rewards maintenance of proficiency if a student was already proficient

WEIGHTED PERFORMANCE LEVEL CHANGE

Previous Proficiency

Significant Decline

Decline MaintainImproveme

nt

Significant Improveme

nt

Not Previously Proficient

-2 -1 0 1 2

Previously Proficient -2 -1 1 1 2

For science, social studies, writing, and grade 11 reading and mathematics


Two-Year Average

Standardized Student Scale

(Z) Score

Four-Year Achievement Trend Slope

Two-Year Average Bottom 30% - Top 30%

Z-Score Gap

School Achievement

Z-Score

School Performance Achievement

TrendZ-Score

School Achievement Gap Z-Score

School Content

Area Index

1/2

1/4

1/4

Content

Index Z-

score

For graduation rate


Two-Year Average

Graduation Rate

Four-Year Graduation Rate

Trend Slope

School Graduation Rate

Z-Score

School Graduation Rate

TrendZ-Score

School Graduatio

n Rate Index

2/3

1/3

Grad Index

Z-score

Calculating a four-year slope (e.g., graduation rate)


• Plot the school’s graduation rate for the last four years

• Plot a linear regression line through the points

• Calculate the slope of the line (gives the school’s annual improvement rate)











Slope = 2.3%

Calculating an overall ranking for a school with a graduation rate


School Graduation

Rate Std Index

School Mathematics

Std Index

School Reading Std Index

School Science Std Index

School Social Studies Std

Index

School Writing Std Index

Overall Standardized School Index

18%

18%

18%

18%

18%

10%

Overall School Percentile Rank

Calculating an overall ranking for a school without a graduation rate


School Mathematics

Std Index

School Reading Std Index

School Science Std Index

School Social Studies Std

Index

School Writing Std Index

Overall School Standardized

Index

20%

20%

20%

20%

20%


Calculating an overall ranking for a school without a graduation rate and without a writing score


School Mathematics

Index

School Reading Index

School Science Index

School Social Studies Index

Overall School Standardized

Index

25%

25%

25%

25%


RESOURCES TO UNDERSTAND MY

RANKING

Complete list of all schools and their ranking Individual school look-up to see your school’s resultsOverview presentation with voice overFAQBusiness rules by which the rankings were calculatedComplete data file and validation file

You can access these resources at: http://www.michigan.gov/mde/0,4615,7-140-37818_56562---,00.html

You can also request individual assistance by calling the Evaluation, Research and Accountability unit at 517-373-1342, or emailing [email protected]

RESOURCES AVAILABLE

Quick Reference for Z-Scores

WHAT IS A Z-SCORE?

Z-SCORE “CHEAT SHEET”

Z-scores are a standardized measure that helps you compare individual student (or school) data to state average data.

Student z-score = (Student Scale Score) – (Statewide average of scale

scores)Standard Deviation of Scale Score

School z-score=(School Value) – (Statewide average of that value)

Standard deviation of that value

Z-SCORE “CHEAT SHEET”

Z-scores are centered around zeroPositive numbers mean the student or school is above the

state averageNegative numbers mean the student or school is below the

state average

0 1 2 3-1

-2

-3

State Average Better than state

average….…Worse than state

average

Z-SCORE EXAMPLES

Your school has a z-score of 1.5. You are better than the state average.

0 1 2 3-1

-2

-3



average

Z-score of 1.5

Z-SCORE EXAMPLES

Your school has a z-score of .2. You are better than the state average, but not by a lot.

0 1 2 3-1

-2

-3



average

Z-score of 1.5

Z-score of 0.2

Z-SCORE EXAMPLES

Your school has a z-score of -2.0. You are very far below state average.

0 1 2 3-1

-2

-3



average

Z-score of 1.5

Z-score of 0.2

Z-score of -2.0

TTB vs PLA

HOW IS THIS DIFFERENT FROM THE

PLA LIST?

This list represents a ranking of all schools in the state of Michigan, using our preferred methodology developed in collaboration with many stakeholders.

MDE also published, according to state statute, a list of Persistently Lowest Achieving schools. This is the PLA list.

The PLA list of schools was generated by a set of federally-approved and required rules that differ from our Top to Bottom ranking.

TTB VERSUS PLA

WHY ARE THE LISTS DIFFERENT?

Top to Bottom PLA

Subjects included MathReadingWritingScienceSocial Studies

MathReading

Graduation rate? Yes No

Components Achievement (1/2)Improvement (1/4)Achievement gap (1/4)

Proficiency (2/3)Improvement (1/3)

Proficiency? Uses standardized measure of student performance (z-score)

Uses proficiency levels

High achieving schools?

Calculation adjustments to avoid “ceiling effects”

No adjustment

Tiers? No tiers; all schools included

Tiers; Title I, AYP and school level considered

Documents

Understanding How the Ranking is Calculated 2011 TOP TO BOTTOM RANKING