Pennsylvania Value-Added Assessment System (PVAAS): A Compass for Improvement Oxford Area School...

Pennsylvania Value-Added Pennsylvania Value-Added Assessment System (PVAAS):Assessment System (PVAAS):A Compass for ImprovementA Compass for Improvement

Oxford Area School DistrictOxford Area School DistrictFebruary 14, 2013February 14, 2013

PVAAS IS: Analysis of existing assessment data

• Longitudinal PSSA scores in available content areas

Math, Reading, Science, Writing• Provides reliable estimates

A measure of a school’s effectiveness

Critical Relationship: Growth Data vs. Achievement Data

PVAAS IS PVAAS IS NOTNOT

Another testAnother test Able to provide a measure of growth Able to provide a measure of growth

for an individual studentfor an individual student A comparison of single test scoresA comparison of single test scores

High Achievement

Average Achievement

Low Achievement

Current Data Collection Approaches

Achievement is based on each student’s ending point.

OASD/State 2012 Reading OASD/State 2012 Reading PSSA Disaggregated GroupsPSSA Disaggregated Groups

Key Concepts Key Concepts

Achievement Progress Measures students’

performance at a single point in time

Compares student performance to a standard

Critical to students’ post-secondary opportunities

Highly correlated with demographic factors, such as socioeconomic status

Measures students’ progress across time/years

Compares student performance to his/her own prior performance

Critical to ensuring students’ future academic success

Not correlated with demographic factors

Key Concepts Key Concepts

PVAAS reporting reflects the effectiveness of your district’s or school’s Standards-Aligned System

PVAAS reporting reflects the district’s or school’s system regarding curriculum, assessment, and instruction

Key Concepts Key Concepts

There is NO relationship between demographic variables such as socioeconomic status and growth.

• There are high achieving schools making high growth;• There are high achieving schools making low growth;• There are low achieving schools making high growth; • There are low achieving schools making low growth.

Growth reporting reflects what WE do with students in terms of academic growth in schools/districts.

-- VAAS can remove the effects of factors not under the control of the school. (McCaffrey, Lockwood, Koretz & Hamilton, 2003; Ross, Wang, Sanders, Wright & Stringfield, 1999a; Wright, Horn & Sanders, 1997).

PVAAS Adds Another Variable To Achievement…Progress

Below Growth

Standard

At or AboveGrowth

Standard

Progress is based Progress is based on each cohorton each cohort’’s starting points starting point..

0 = Growth Standard

TWO Types of PVAAS InformationTWO Types of PVAAS Information

Today

Looking Back/Evaluation…

Value-added Growth Reports For Groups of Students

Looking Forward/Planning…

PVAAS Projection Reports For Individual Students and Groups of Students

What questions does PVAAS What questions does PVAAS answer?answer?

1.1. Did each group of students make a year’s worth of Did each group of students make a year’s worth of growth in reading (grades 4-8 and 11), math (grades growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), and writing 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)?(grades 5, 8 and 11)?

1.1. Did each subgroup of students make a year’s worth Did each subgroup of students make a year’s worth of growth in reading (grades 4-8 and 11), math of growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), (grades 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)?and writing (grades 5, 8 and 11)?

1.1. Is each student on a trajectory to reach proficient or Is each student on a trajectory to reach proficient or advanced on a future PSSA reading, math, science, advanced on a future PSSA reading, math, science, and writing?and writing?

SAS PVAAS WebsiteSAS PVAAS Website

Professional Development Opportunities, New Features, Guide to District/School Reports, Guide to

Public Reporting, IU Point of Contact . . .

https://pvaas.sas.com

Overview of PVAAS Overview of PVAAS ReportingReporting

PVAAS ReportingPVAAS Reporting

Value-Added Reports and ProjectionsValue-Added Reports and Projections Reading, Math, Science and WritingReading, Math, Science and Writing District Level ReportingDistrict Level Reporting School Level ReportingSchool Level Reporting Grade Level Reporting (4-8, 11)Grade Level Reporting (4-8, 11) Subgroups Reporting (ex. IEP, ED, ELL)Subgroups Reporting (ex. IEP, ED, ELL) Performance Levels (Advanced, Proficient, Basic, Performance Levels (Advanced, Proficient, Basic,

Below Basic)Below Basic)

Student Level Reporting – Student Level Reporting – Only for projectionsOnly for projections• Reading, Math, Science, WritingReading, Math, Science, Writing

Did students make one Did students make one yearyear’’s academic growth s academic growth

last year?last year?

Scatter Plot Quadrants Scatter Plot Quadrants and Their Meaningsand Their Meanings

Quad 1 - Excelling

Higher Achievement,Higher Growth

Quad 4 - Improving

Lower Achievement, Higher Growth

Quad 2 - SlippingHigher

Achievement,Negative Growth

Quad 3 - Underperforming

Lower Achievement,Lower Growth

1616

School to CountySchool to CountyGrade 4 MathGrade 4 Math

School to CountySchool to CountyGrade 4 ReadingGrade 4 Reading

School to CountySchool to CountyGrade 5 MathGrade 5 Math

School to CountySchool to CountyGrade 5 ReadingGrade 5 Reading

School to CountySchool to CountyGrade 6 MathGrade 6 Math

School to CountySchool to CountyGrade 6 ReadingGrade 6 Reading

School to CountySchool to CountyGrade 7 MathGrade 7 Math

School to CountySchool to CountyGrade 7 ReadingGrade 7 Reading

School to CountySchool to CountyGrade 8 MathGrade 8 Math

School to CountySchool to CountyGrade 8 ReadingGrade 8 Reading

School to CountySchool to CountyGrade 11 MathGrade 11 Math

School to CountySchool to CountyGrade 11 ReadingGrade 11 Reading

Publicly Released Data: School SearchPublicly Released Data: School Search

Allows users to find and compare the Allows users to find and compare the achievement and gains of grade levels in all achievement and gains of grade levels in all schools in PA (grades 4-8 & 11)schools in PA (grades 4-8 & 11)• Will display the schoolWill display the school’’s quintile relative to all schools in s quintile relative to all schools in

PennsylvaniaPennsylvania• Can search for Can search for ““comparable schoolscomparable schools”” • Similar demographicsSimilar demographics

January 2011January 2011 2929

Average Growth IndexAverage Growth Index

Math (Grades 4-8) Math (Grades 4-8) • AGI 10.7 (19AGI 10.7 (19thth out of 553 districts) out of 553 districts)• *Significant evidence that the district *Significant evidence that the district

exceeded the standard for PA Academic exceeded the standard for PA Academic GrowthGrowth

• Range of growth 20.5 – (-55.9)Range of growth 20.5 – (-55.9)• Only 1/12 other Chester County school Only 1/12 other Chester County school

district ranked higher. district ranked higher.

Average Growth IndexAverage Growth Index

Reading (Grades 4-8) Reading (Grades 4-8) • AGI 5.6 (38AGI 5.6 (38thth out of 553 districts) out of 553 districts)• *Significant evidence that the district *Significant evidence that the district

exceeded the standard for PA Academic exceeded the standard for PA Academic GrowthGrowth

• Range of growth 15.4 – (-46.3)Range of growth 15.4 – (-46.3)• Only 3/12 other Chester County school Only 3/12 other Chester County school

districts ranked higher. districts ranked higher.

Gerald L. Zahorchak, D.Ed. Secretary of Education

Commonwealth of Pennsylvania

https://pvaas.sas.com

333 Market Street Harrisburg, PA 17126