TETN Accountability Update Session August 20, 2009

TETN Accountability Update Session

August 20, 2009

State Accountability Update

2009 Ratings Highlights

Compared to the 2008 TAKS results, the 2009 statewide performance on the TAKS was equal to or improved for all students and each student group in each subject area tested.

Compared to the class of 2007, Completion Rate I for the class of 2008 improved for all students and for each student group. (first gains demonstrated since the class of 2003.)

The state average grade 7-8 annual dropout rate improved from 0.4% to 0.3%.

3

4

2009 Ratings Highlights (cont.)

District Ratings by Rating Category(including Charter Operators)

ACCOUNTABILITY RATING2009

Count Percent

Exemplary 117 9.5%

Recognized 459 37.2%

Academically Acceptable 561 45.4%

Standard Procedures 510 41.3%

AEA Procedures 51 4.1%

Academically Unacceptable 87 7.0%



Not Rated: Other 11 0.9%

Total 1,235 100%

5

2009 Ratings Highlights (cont.)

ACCOUNTABILITY RATING2009

Count Percent

Exemplary 2,151 25.8%

Recognized 2,930 35.2%

Academically Acceptable 2,298 27.6%

Standard Procedures 1,895 22.8%


Academically Unacceptable 270 3.2%



Not Rated: Other 672 8.1%

Not Rated: Data Integrity Issues 1 0.0%

Total 8,322 100%

Campus Ratings by Rating Category(including Charter Campuses)

Movement

Under certain circumstances initial ratings can be changed. Reasons for a rating change include:

Special AnalysisDistricts with Academically Unacceptable campus(es)Districts with excessive underreported studentsHurricane Ike ProvisionGranted Appeals (n/a until October)

6

Movement (cont.)

Special Analysis 2 districts and 32 campuses affected Most moved to Not Rated: Other (1 district and 25

campuses)

Academically Unacceptable Campuses Only the district is evaluated 2 districts moved from Recognized to Academically

Acceptable due to having one or more Academically Unacceptable campuses.

7

Movement (cont.)

Excessive Underreported Students

Only the district is evaluated 7 districts moved from Recognized to Academically

Acceptable due to having more than 150 or more than 5.0% underreported students.

8

Movement (cont.)

Hurricane Ike Provision

49 districts and 562 campuses were eligible. 3 districts and 37 campuses used the provision. Of the 3 districts, 2 would have been Academically

Unacceptable without the provision. Of the 37 campuses, 14 would have been either

Academically Unacceptable or AEA: Academically Unacceptable without the provision.

9

Additional Features

There are three additional features in the system:

Required Improvement (RI) Texas Projection Measure (TPM) Exceptions Provision (EP)

Only one feature can be used per measure; however, different features can be used for different measures.

10

11

Additional Features (cont.)

Required Improvement (RI) - Campuses

Under standard procedures, 747 campuses used RI to achieve a higher rating.

601 campuses moved to Recognized (20.5% of all Recognized campuses)

146 campuses moved to Academically Acceptable (7.8% of all Academically Acceptable campuses)

A portion of these campuses may have used other features for other measures.

12


Required Improvement (RI) - Districts

Under standard procedures, 141 districts used RI to achieve a higher rating.

126 districts used RI to move to Recognized (27.5% of all Recognized districts )

15 districts used RI to move to Academically Acceptable

(2.9% of all Academically Acceptable districts)

A portion of these districts may have used other features for other measures.

13


Texas Projection Measure (TPM) - Campuses

Under standard procedures only, 2,543 campuses used TPM to achieve a higher rating.

355 used it to achieve Academically Acceptable

1,077 used it to achieve Recognized

1,111 used it to achieve Exemplary


14


Texas Projection Measure (TPM) - Districts

Under standard procedures, 329 districts used TPM to achieve a higher rating.

78 used it to achieve Academically Acceptable

178 used it to achieve Recognized

73 used it to achieve Exemplary


15


Exceptions Provision (EP) - Campuses

Of the 319 campuses that used the Exceptions Provision:

72 used one or more exceptions to achieve a rating of Academically Acceptable

96 used one or more exceptions to achieve a rating of Recognized

151 used one exception to achieve a rating of Exemplary


16


Exceptions Provision (EP) - Campuses

Of the 319 campuses using exceptions:

263 campuses used 1

37 campuses used 2

19 campuses used 3

0 campuses used 4

17


Exceptions Provision (EP) - Districts

Of the 17 districts that used the Exceptions Provision:

1 used one or more exceptions to achieve a rating of Academically Acceptable

8 used one or more exceptions to achieve a rating of Recognized

8 used one exception to achieve a rating of Exemplary


18


Exceptions Provision (EP) - Districts

Of the 17 districts using exceptions:

16 districts used 1

1 district used 2

0 districts used 3

0 districts used 4

Additional Features Summary

Campuses Districts

2008 2009 2008 2009

Any RI 521 747 106 141

Any TPM n/a 2,543 n/a 329

Any EP 832 319 90 17

19

RI is also available with the Completion Rate and Annual Dropout Rate indicators. In 2009, 7 districts and 24 campuses used RI with the Completion Rate and 0 districts and 0 campuses used RI with the Annual Dropout Rate indicators. These counts are not included in the table.

20

Rating Reasons

Of the 70 Academically Unacceptable districts:

48 (69%) were due to Completion Rate only; 14 were due to TAKS only; 5 were due to Annual Dropout Rate only; and, 3 were due to a combination of base indicators.

Of the 229 Academically Unacceptable campuses:

146 (64%) were due to TAKS only; 63 were due to Completion Rate only; 5 were due to Annual Dropout Rate only; and 15 were due to a combination of base indicators.

Rating Reasons (cont.)

Completion Rate – Exemplary and Recognized Ratings

Missed Exemplary due to Completion Rate only:

1 district

7 campuses

Missed Recognized due to Completion Rate only:

50 districts

71 campuses

See the Highlights document for more details on the ‘09 system:

http://ritter.tea.state.tx.us/perfreport/account/2009/highlights.pdf21

22

Appeals deadline (postmarked) – August 14, 2009

Appeals Panel meets – early October

Appeal decisions mailed to districts (and posted on secure web) – mid-October

Ratings change due to granted appeals will be published concurrent with Gold Performance Acknowledgment (GPA) release – late October.

Appeals Process and Dates

23

2008-09 AEIS Reports issued (TEASE) – early November

2009-10 list of Technical Assistance Team (TAT) campuses – early November (concurrent with AEIS TEASE release)

AEIS and TAT public releases – late November

2010-11 Public Education Grant (PEG) list (not applicable to charters or registered AECs) – mid-December

2008-09 School Report Cards – early December

2009 Remaining Calendar Items

24

Standard Accountability Decisions for 2010 and 2011

2010 2011*

Exemplary ≥ 90% ≥ 90%

Recognized ≥ 80% ≥ 80%

Academically Acceptable

Reading/ELA ≥ 70% ≥ 70%

Writing, Social Studies ≥ 70% ≥ 70%

Mathematics ≥ 60% ≥ 65%

Science ≥ 55% ≥ 60%

* Standards for 2011 will be reviewed in 2010 and are subject to change.

Numbers in bold indicate a change from the prior year.

TAKS Indicator

25

Standard Accountability Decisions for 2010 and 2011 (cont.)

TAKS (Accommodated) 2010 2011

Science (grades 5, 8, 10, & 11)Science (grade 5 Spanish)Social Studies (grades 8, 10, & 11)English Language Arts (grade 11)Mathematics (grade 11)

Use Use

Reading/ELA (grades 3 – 10)Reading (grades 3 – 6 Spanish)Mathematics (grades 3 – 10)Mathematics (grades 3 – 6 Spanish)Writing (grades 4 & 7)Writing (grade 4 Spanish)

Use Use

TAKS-Modified 2010 2011

All Subjects and Grades Report Use

Standards for 2011 will be reviewed in 2010 and are subject to change.

Numbers in bold indicate a change from the prior year.

Standard Accountability Decisions for 2010 and 2011 (cont.)

Completion Rate I, Annual Dropout Rate, and Underreported Students

2010 2011*

Completion Rate I

Exemplary

Recognized

Academically Acceptable

≥ 95.0%

≥ 85.0%

≥ 75.0%

≥ 95.0%

≥ 85.0%

≥ 75.0%

Gr. 7-8 Annual Dropout Rate (All categories)

≤ 1.8% ≤ 1.6%

Underreported Students (District only)150 and ≤ 4.0%

150 and ≤ 3.0%

27

AEA Decisions for 2010 and 2011

TAKS Progress Indicator

The TAKS Progress indicator includes all TAKS (Accommodated) results as described on slide 24.

The TAKS Progress indicator standard remains 50% for 2010.

The TAKS Progress indicator standard for 2011 will be reviewed with accountability advisory groups in spring 2010.

28

AEA Decisions for 2010 and 2011 (cont.)

Annual Dropout Rate (Grades 7-12) andCompletion Rate II Indicators

The Annual Dropout Rate indicator standard remains 20.0% for 2010.

The Completion Rate II indicator standard remains 60.0% for 2010.

In spring 2010, the accountability advisory groups will review various options and make recommendations to the commissioner about the leaver indicators evaluated under AEA procedures for 2011.

29

2010 AEA Campus Registration Process

The 2010 AEA campus registration process will be conducted online using the TEASE Accountability website.

The 2009-10 AEA campus registration process opens September 9, 2009.

An email notification will be sent to all superintendents stating that alternative education campuses (AECs) rated under 2009 AEA procedures will be re-registered automatically in 2010 subject to the 75% at-risk registration criterion.

30

2010 AEA Campus Registration Process (cont.)

AECs wishing to rescind AEA registration must complete an electronic 2009-10 AEA Campus Rescission Form.

AECs requesting AEA registration must complete an electronic 2009-10 AEA Campus Registration Form.

AECs for which 2009 AEA registration was rescinded due to not meeting the at-risk registration criterion must submit an electronic 2009-10 AEA Campus Registration Form if the AEC wishes to request AEA campus registration in 2010.

AEA rescission and registration forms submitted via TEASE Accountability must be printed and maintained locally as official documentation of AEA campus registration requests.

31

2010 AEA Campus Registration Process (cont.)

The 2009-10 AEA registration process closes September 23, 2009, at 1:00 p.m. C.D.T.

AEA rescissions and registrations will not be processed after this time.

When finalized, the list of 2010 Registered AECs will be available on the AEA website at: http://www.tea.state.tx.us/aea.

32

AEA At-Risk Registration Criterion

Each registered AEC must have a minimum percentage of at-risk students enrolled on the AEC verified through current-year PEIMS fall enrollment data in order to be evaluated under AEA procedures and receive an AEA rating. Two safeguards have been incorporated for those AECs that are below the at-risk requirement.

1. Prior-Year PEIMS At-Risk Data Safeguard: If a registered AEC does not meet the at-risk criterion in 2010, then it remains under AEA if the AEC had at least 75% at-risk enrollment in 2009.

2. New Campus Safeguard: If a new campus is registered for evaluation under AEA procedures, then the AEC is not required to meet the at-risk criterion in its first year of operation. This safeguard provides an accommodation for new campuses with no prior-year data.

33

AEA At-Risk Registration Criterion (cont.)

The AEA at-risk registration criterion was 65% in 2006, 70% in 2007, and 75% in 2008 and beyond.

AEA registration is rescinded for AECs that do not meet the at-risk registration criterion or utilize the safeguards. As a result, the AECs are evaluated under standard accountability procedures.

Below is a history of the number of campuses not meeting the at-risk registration criterion that were shifted to standard accountability procedures.

2006 – 17 AECs 2007 – 24 AECs 2008 – 17 AECs 2009 – 17 AECs

34

AEA At-Risk Registration Criterion (cont.)

The PEIMS Edit+ reports below may be helpful when analyzing at-risk student enrollment data. These reports may be run at the district and campus levels.

PRF5D003 – Student Roster. Lists all students enrolled by grade. The ‘AT RS’ column indicates whether a student is at-risk.

PRF5D018 – At-Risk Students by Sex, Ethnicity, and Grade. One-page report of at-risk students by sex, ethnicity, and grade.

PRF5D025 – At-Risk Roster by Grade. Lists at-risk students by grade. Other student demographics are included on this report.

35

Technical Assistance Team (TAT)

Districts with TAT-identified campuses will be notified in early November through TEASE at the same time the AEIS reports are posted to TEASE.

Campuses rated Academically Acceptable in 2009 are identified if 2008-09 performance does not meet 2010 accountability system criteria.

Required Improvement and the Exception Provision will be part of the 2010 TAT methodology.

However, the TPM feature will not be part of the 2010 TAT methodology. (The 2008 TPM equations used for 2009 accountability will not be applied to 2010 TAT Identification).

36

TAT (cont.)

The 2010 TAKS Preview indicator is evaluated for TAT. This indicator includes all TAKS (Accommodated) grades and subjects and applies the new 2010 student standards on the vertical scale. Campuses will be able to see their data for this indicator on their AEIS reports.

Because the 2010 standards for the completion and dropout rate indicators are the same as the 2009 standards, no additional campuses will be added to the TAT list due to these indicators.

2009 TAT requirements will be modified to begin transition to statutory changes reflected in HB3. Details to follow from the Division of Program Monitoring and Interventions.

37

The school-start window closes on September 25, 2009.

HB3 changes to statute regarding dropouts do not affect the processing of the class of 2009 leaver data.

Completion and Dropout Processing 2009

HB 3 Implementation

Transition Plans through 2012

July 30, 2010 2010 ratings are issued under current accountability system.

By December 1, 2010 Transition plan to the new assessment and accountability/accreditation system is submitted to the governor, lieutenant governor, other key legislative members and staff, and the Legislative Budget Board (LBB).

August 1, 2011 2011 ratings are the last ratings issued under the current accountability system.

38

HB 3 Implementation (cont.)

Transition Plans through 2012

2011-2012 Assignment of accreditation statuses and performance ratings are suspended for this school year.

New accreditation and academic accountability system is developed with input from the educator advisory groups on the timelines specified in the transition plan.

39


Transition Plans for 2013

August 8, 2013 District accreditation statuses and district and campus performance ratings are issued for the first time under new system. Ratings will be based on the percent proficient indicators. The percent college-ready indicators will be “report” only.

Distinction designations will be issued to districts and campuses with acceptable performance concurrent with the release of performance ratings.

Performance ratings and accreditation statuses issued in 2010-2011 and 2012-2013 school years will be considered consecutive.

40


Transition Plans for 2014

August 8, 2014 District accreditation statuses and district and campus performance ratings will be issued for second time. Ratings will be based on both percent proficient and percent college-ready indicators.

Distinction designations will be issued to districts and campuses with acceptable performance concurrent with the release of performance ratings.

41


Detailed analysis of HB3 and other education-related legislation that passed during the 2009 legislative session can be found in the TEA publication, “81st Texas Legislative Session: Briefing Book on Public Education Legislation”.

Go to the URL shown below and select, “Briefing Book – 81st Texas Legislature”

http://www.tea.state.tx.us/index4.aspx?id=5142

42


Exclusions to the NCES Dropout Definition

HB3 defined certain exclusions that the TEA must make when evaluating dropout and completion rates for accreditation and performance ratings. The exclusions can be grouped into five categories:

Previous dropouts; ADA ineligible dropouts; Court-ordered GEDs, not earned; Incarcerated in facilities not served by Texas public

schools; and Refugees and asylees.

43


Exclusions to the NCES Dropout Definition

HB3 explicitly requires use of the current NCES dropout definition until 2011-12. TEA is interpreting the 2011-12 effective date to mean the 2010-11 dropouts collected in the 2011-12 year.

The 2008-09 dropouts collected in the 2009-10 year (2010 ratings) will be processed using current definitions with no new exclusions applied.

The 2009-10 dropouts collected in the 2010-11 year (2011 ratings) will be processed using current definitions with no new exclusions applied.

44

45

Ethnicity and Race Data Collection and Reporting

PEIMS collects ethnicity and race using both old and new definitions.

TAKS answer documents collect both old and new definitions (pre-coded from PEIMS).

Reporting and Use – State accountability, federal accountability, AEIS (and related reports) use old definitions.

2009-10

46

TETN Accountability Update SessionsRemaining 2009 Date and Tentative Agenda Topics

November 19 Accountability Ratings UpdateGold Performance

AcknowledgmentsTAT ListAEIS ReportsSchool Report CardsPEG List2009-10 NCLB School Report Card

The above date is for 1 p.m. to 3 p.m.

47

TETN Accountability Update Sessions

2010 Dates and Tentative Agenda Topics

February 18 Update on Accountability Development

April 29 Accountability Decisions for 2010and Beyond

June 24 Accountability Manuals – State and AYP

August 19 Accountability Results for 2010

November 18 Accountability Ratings UpdateGold Performance AcknowledgmentsAEIS ReportsSchool Report CardsPEG List

The above dates are for 1 p.m. to 3 p.m.

48

Accountability Resources

Email the Division of Performance Reporting at [email protected].

Phone the Division of Performance Reporting at (512) 463-9704.

ESC Accountability Contacts.

Online: ACCT: http://www.tea.state.tx.us/perfreport/account/

AEA: http://www.tea.state.tx.us/aea/

AYP: http://www.tea.state.tx.us/ayp/

Documents

TETN Accountability Update Session August 20, 2009