Using State Data toUsing State Data to Achieve Performance GoalsAchieve Performance Goals

REGIONAL HIGH SCHOOL SUMMITSREGIONAL HIGH SCHOOL SUMMITS

MPR Associates, Inc.MPR Associates, Inc.www.mprinc.comwww.mprinc.com

March-May 2004March-May 2004

Archived Information

MPR Associates2

CLOSING THEACHIEVEMENTGAPEffective Performance Measurement Systems

Define valid and reliable measures of student performance

Use appropriate analytic methods

Promote school improvement

MPR Associates3

CLOSING THEACHIEVEMENTGAPEssential Elements of NCLB

Adequate Yearly Progress

Assess state, district and school achievement over time

Identify schools in need of improvement

High School Performance Measures Student achievement Graduation rates

MPR Associates4

CLOSING THEACHIEVEMENTGAPEssential Elements of NCLB

State Accountability System Single system Statistically valid and

reliable

Populations All Students Subgroups of students

Defining Defining TerminologyTerminology

MPR Associates6

CLOSING THEACHIEVEMENTGAPHigh School Graduation Rate

In 2000, the high school graduation rate was 86 %

How is graduation determined?

How is student mobility treated?

When does measurement occur?

MPR Associates7

CLOSING THEACHIEVEMENTGAPMeasurement Criteria

Statistically valid systems Single measurement

approach Accurate over time Reliable data

Measure Construction Fair Useful

Analytic Analytic ConsiderationsConsiderations

MPR Associates9

CLOSING THEACHIEVEMENTGAPUnpacking the Data

Aggregate statistics can conceal useful information.

Making the most of your data requires:

Identifying issues of concern

Disaggregating variables

Controlling for factors affecting outcomes

MPR Associates10

CLOSING THEACHIEVEMENTGAPExample: NCLB Graduation Rate

State and District Graduation Rate

State District

Grad. Rate 86 % 84 %

Race-ethnicity

White 89 90

Black 84 78

Hispanic 78 68

MPR Associates11

CLOSING THEACHIEVEMENTGAPExample: NCLB Graduation

Rate(continued)

State and District Graduation Rate

Urban

State DistrictDistricts

Grad. Rate 86 % 84 % 82 %

Race-ethnicity

White 89 90 86

Black 84 78 78

Hispanic 78 68 62

MPR Associates12

CLOSING THEACHIEVEMENTGAPExample: NCLB Graduation

Rate(continued)

District and School Graduation Rates

District School A School B

Grad. Rate 84 % 92 % 78 %

Race-ethnicity

White 90 93 80

Black 78 94 74

Hispanic 68 NA 68

MPR Associates13

CLOSING THEACHIEVEMENTGAPA General Model for Examining Student Outcomes

School

Inputs

School

Practices

Student

Outcomes

School

Inputs

School

Practices

Student

Outcomes

Good Evaluation Focuses on more than Student Outcomes:

Data on School Practices andInputs are Also Essential

MPR Associates14

CLOSING THEACHIEVEMENTGAPEssential Control Variables

School Practices Curricular offerings and rigor Class scheduling Professional development

School Inputs Student demographics Size and urbanicity Teacher experience

Examples:

MPR Associates15

CLOSING THEACHIEVEMENTGAPAdditional Data Sources…

Student Transcripts

Attendance

Subject area grades

Curricular rigor

Mobility & retention

…can provide a broader picture of student performance

Examples:

Using Results to Using Results to Promote Promote

ImprovementImprovement

MPR Associates17

CLOSING THEACHIEVEMENTGAPImproving Usability

User-tested reporting

Dedicated time for reflection and strategic planning

Building analytic capacity among teachers and administrators

Periodic feedback for overall design of state and local data systems

ConclusionConclusion

MPR Associates19

CLOSING THEACHIEVEMENTGAPEffective Performance Measurement Systems

Track: Produce valid and reliable data on school and student outcomes

Analyze: Provide policy relevant information across

a range of variables

Improve: Assist policymakers and educators in making better decisions