47
PVAAS and PVAAS Teacher Specific Reporting Erin Van Guilder Antietam School District

PVAAS Overview and Teacher Specific Reporting

Embed Size (px)

Citation preview

Page 1: PVAAS Overview and Teacher Specific Reporting

PVAAS and PVAAS Teacher Specific Reporting

Erin Van GuilderAntietam School District

Page 2: PVAAS Overview and Teacher Specific Reporting

Goal of Session

By the end of the session, participants will be able to answer the following questions:

1. What is PVAAS and how is it a part of the Teacher Effectiveness Model?

2. How does PVAAS measure growth?3. What does PVAAS tell us about growth in our district and

school(s)?4. What is PVAAS Teacher Specific Reporting?5. How Specific Reporting is Determined for a Teacher?6. What and when is Roster Verification?

Page 3: PVAAS Overview and Teacher Specific Reporting
Page 4: PVAAS Overview and Teacher Specific Reporting

4

Page 5: PVAAS Overview and Teacher Specific Reporting

PVAAS Teacher Reporting Implementation Timeline

Page 6: PVAAS Overview and Teacher Specific Reporting

THE CONCEPT OF PVAAS GROWTH AND MEASURING GROWTH METHODOLOGY

Page 7: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013 7

PVAAS Analyses

PSSA Writing

Keystone Exams:

Algebra I, Biology,

Literature

PSSA Science

PSSA Reading

PSSA Math

2. LOOKING AHEADPlanning for

Students’ Needs:Student Projections

to Future Tests

1. LOOKING BACKEvaluating School

Effectiveness:Value Added &

Diagnostic Reports

PVAAS 2 Reporting Categories

Page 8: PVAAS Overview and Teacher Specific Reporting

8

LOOKING AHEADLOOKING

BACK

How much growth did groups of students make in the past school year?

Page 9: PVAAS Overview and Teacher Specific Reporting

PVAAS…a Growth and Projections Model

Page 10: PVAAS Overview and Teacher Specific Reporting

PVAAS Academic Growth does NOT…

Does NOT Does NOT

Page 11: PVAAS Overview and Teacher Specific Reporting

PVAAS Academic Growth is

• PVAAS Growth provides a measure of the growth of a teacher’s group of students

Page 12: PVAAS Overview and Teacher Specific Reporting

Where does the PVAAS Growth Measure come from?

Testing Subject-Grades

Methodologies

Measurement

Assessment in Consecutive Years

Math, 4-8Reading, 4-8

Growth Standards

Growth in Math and Reading

Assessments not in Consecutive Years

Writing, 5 & 8

Science- 4&8

Keystones- Algebra 1, Biology, Literature

Predictive Predicted scaled score based on each students’ academic assessment history across subjects

Page 13: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

13

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Page 14: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

14

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

Page 15: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

15

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

Page 16: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

16

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

Page 17: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

17

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

Page 18: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

18

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

Page 19: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Regardless of the entering achievement level of the group…

19

Page 20: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Regardless of the entering achievement level of the group…

• Students should not lose ground academically

20

Page 21: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Regardless of the entering achievement level of the group…

• Students should not lose ground academically

• A reasonable goal would be to at least maintain the achievement level of the group

21

Page 22: PVAAS Overview and Teacher Specific Reporting

F2F Overview 2013

Regardless of the entering achievement level of the group…

• Students should not lose ground academically

• A reasonable goal would be to at least maintain the achievement level of the group

• All groups of students can make growth

22

Page 23: PVAAS Overview and Teacher Specific Reporting

PVAAS Value-AddedGrowth Measures Reading and Math 4-8

The Growth Measure is NOT reported in years and cannot

be referenced in terms of number of year’s growth.

1000 1100 1200 1300 1400 1500 Scale Score Points

0 10 20 30 40 50 60 70 80 90 100NCE Units

Growth is measured in Normal Curve Equivalent (NCE) units as scale scores cannot be compared from grade to grade and year to year.

The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points.

Page 24: PVAAS Overview and Teacher Specific Reporting

PVAAS Value-Added Growth Measures - Science, Writing and Keystones

• Growth is measured in scale score points.

• The Growth Measure is NOT reported in years and cannot be referenced in terms of number of year’s growth.

• The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points.

Page 25: PVAAS Overview and Teacher Specific Reporting

TEACHER SPECIFIC REPORTING

Page 26: PVAAS Overview and Teacher Specific Reporting

What is PVAAS teacher-specific reporting?

• Estimates the effect of a teacher’s performance on the academic growth of a group of students.

• Taking into account both their endpoint and their entering achievement level.

• By concentrating on growth, PVAAS puts the emphasis on what educators can influence.

26

Page 27: PVAAS Overview and Teacher Specific Reporting

Purpose of PVAAS Teacher Specific Reporting

• To inform teaching practice in order to guide replication, changes,

or

• adjustments of teaching practices for continual professional growth.

Page 28: PVAAS Overview and Teacher Specific Reporting

Who does this affect?

A PA certified educator with full or partial responsibility for content

specific instruction of the assessed eligible content as measured by a PA

state assessment

Face to Face Online Instruction28

Page 29: PVAAS Overview and Teacher Specific Reporting

PVAAS Teacher Reporting: Teachers in Which Tested Grades/Subjects/Courses?

• PSSA: With/Without Accommodations (Not PASA)– Grades 4-8: Reading and Math– Grades 4 & 8: Science– Grades 5 & 8: Writing

• Future: Transition into ELA Assessment• Courses Culminating in Keystone Exams:

With/Without Accommodations– Algebra I– Literature– Biology

Approximately 30-40% of your teaching staff will be eligible

for a PVAAS teacher specific

score

29

Page 30: PVAAS Overview and Teacher Specific Reporting

What is content-specific instruction?

• Content Specific Instruction: When a teacher(s) has the responsibility to

• plan the instruction of the assessed eligible content,• provide the instruction of the assessed eligible content,• use the assessment information to evaluate the

effectiveness of the instruction of the assessed eligible content on a PA state assessment.

Defined on the Framework for Teaching by both Domains 1 and 3

Special education teachers, intervention specialists, reading/math specialists, ESL teachers, and gifted teachers are eligible for a

PVAAS score

30

Page 31: PVAAS Overview and Teacher Specific Reporting

HOW DOES TSR GET COMPUTED?

An Example

Page 32: PVAAS Overview and Teacher Specific Reporting

Teacher Specific Reporting Example: Mrs. Smith’s Class

Page 33: PVAAS Overview and Teacher Specific Reporting

Students not included in Teacher Specific Reporting

Page 34: PVAAS Overview and Teacher Specific Reporting

New Terms: % Instructional Responsibility

% Student + Teacher Enrollmen

t

Full or Partial %

of Instructio

n• This % is your total Instructional Responsibility

for a student. • This % reflects how much the student will be

weighted in the PVAAS analyses.• The % Instructional Responsibility is

calculated by multiplying the (% Student + Teacher Enrollment) by (Full or Partial % of Instruction).

% Instructional Responsibility

34

Page 35: PVAAS Overview and Teacher Specific Reporting

Calculating: % Student + Teacher Enrollment

% Student + Teacher Enrollmen

t

What proportion of the

grade/subject/course are the student and teacher concurrently

enrolled?

Day 1

Day 140Last Day

Before Testing Window

Grade/Subject/Course

Student Enrolled

Teacher Enrolled

% Student + Teacher Enrollment =

Concurrent Enrollment 35

Page 36: PVAAS Overview and Teacher Specific Reporting

Calculating: Full or Partial % of Instruction

Full or Partial % of Instruction

Full % of Instruction = 100%

Are you the only PA certified educator responsible for the content-specific instruction (Domains 1 and 3) of the

assessed eligible content in the grade/subject/course?

YES NO

Partial % of Instruction = <100%Proportion of responsibility for the content-specific instruction of the assessed eligible content

in the grade/subject/course (Domains 1 and 3)

36

Page 37: PVAAS Overview and Teacher Specific Reporting

Mrs. Smith’s % Instructional Responsibility The Total % Instructional Responsibility for Each Student

New # of Students in the TSR Group

Page 38: PVAAS Overview and Teacher Specific Reporting

Mrs. Smith’s Class

Actual # of Students

Instructional Responsibility of the actual # of students

Page 39: PVAAS Overview and Teacher Specific Reporting

TEACHER VERIFICATION

Page 40: PVAAS Overview and Teacher Specific Reporting

Teachers, school administrators and district administrators verifying data that is used to yield PVAAS teacher specific reporting– data that will ultimately be used as part of a teacher’s evaluation.

The PVAAS rosters are prepopulated from the

PIMS Course/HQT submitted by LEAs to PIMS (Student, Staff,

Course Templates)

What is this Verification process all about?

40

Page 41: PVAAS Overview and Teacher Specific Reporting

SY13-14 PVAAS Roster Verification Timeline

Page 42: PVAAS Overview and Teacher Specific Reporting

3 New Terms

42

Page 43: PVAAS Overview and Teacher Specific Reporting

Access to Teacher Specific Reporting

Page 44: PVAAS Overview and Teacher Specific Reporting

What does my District or School Admin see?

• The same PVAAS data and reporting for an individual teacher that a teacher can see

• No additional data or reporting on any individual teacher!

School Admin. can also:• See a District/School Teacher Summary for

quick access by school/ grade/ subject/ course

• Search to locate an individual teacher’s report

Page 45: PVAAS Overview and Teacher Specific Reporting

• Will PVAAS teacher‐specific reporting be reported publicly?– Act 82 states that “An employee's

individual rating form shall not be subject to disclosure

– Reference: Act of February 14, 2008 (P.L. 6, No.3), known as the "Right‐to‐Know Law." PDE will follow the law on non‐disclosure.

Page 46: PVAAS Overview and Teacher Specific Reporting

Support and Next Steps

Next Steps- Fall TrainingTypes of Reports for Teacher• Resources and Supports

Page 47: PVAAS Overview and Teacher Specific Reporting

LEA DATA TO PVAAS TEACHER SPECIFICREPORTING

ROSTER VERIFICATION: