42
Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Embed Size (px)

Citation preview

Page 1: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Assessment Update

Dr. Chun-Wu LiAssessment and Accountability

Services

Page 2: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Accountability

Page 3: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Accountability Release Dates

Tentative Accountability Release Dates

• Accountability LEA Preview: October 3, 2012• Webinar: October 8, 2012• Accountability Public Release: October 11,

2012

Page 4: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Percent Proficient Targets

School Level 2011ELA

2012ELA

2011Math

2012Math

Elementary and Middle 67.6% 78.4% 68.5% 79.0%

High 66.7% 77.8% 66.1% 77.4%

4

Page 5: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Impact of Safe Harbor

• Number of LEAs and schools that made their 2011 AYP through safe harbor

Type Made AYP

Made AYP Through Safe

HarborSchools 3,398 1,511 (44.5%)LEAs 212 102 (48%)

5

Page 6: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Continuous Enrollment Title 5 Regulations

• In January 2012, the SBE adopted regulations that define continuous enrollment for accountability purposes. These regulations do not, in any way, mandate local policies about enrolling or exiting students in the California Longitudinal Pupil Achievement Data System (CALPADS). • California Code of Regulations (CCR), Title 5 Section 1039.2, specifies that a student is considered continuously enrolled if the student was enrolled in the same school or LEA from Fall Census Day to the first day of testing without a gap of enrollment of 30 or more consecutive calendar days. This definition was first applied with the 2011 Base API.

6

Page 7: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Continuous EnrollmentImportant Dates

• Continuous enrollment is determined by using enrollment and exit code data from CALPADS. For the October 2012 accountability release, data was extracted from CALPADS on August 15, 2012.• The CDE will extract CALPADS enrollment and exit code data on two more occasions. The tentative schedule is:

– December 20, 2012 – February 26, 2013

• The CDE will use the extracted data, along with corrected demographic data, to update AYP and API Reports.

7

Page 8: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Reassignment of Test Scores

• SB 219 requires assessment and other accountability results of some students enrolled in an Alternative Education Program (AEP) to be assigned back to a school or LEA of residence in the calculation of the API.

• In January 2012, the SBE adopted CCR, Title 5, Section 1039.3, which specifies how students’ STAR and CAHSEE test scores will be reassigned.

• STAR and CAHSEE results are assigned to a non-AEP school and/or a non-AEP LEA of residence if both of the student: – Was referred after Fall Census Day to an AEP school (i.e.,

exited using student exit code T167 in the CALPADS) and – Took the STAR and/or CAHSEE at the AEP school.

8

Page 9: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Five-Year Cohort Graduation Rate• In January 2012, the SBE approved an amendment to California’s

Consolidated State Application Accountability Workbook to add the use of a five-year cohort graduation rate for 2013 AYP determinations.

• In February 2012, the SBE and CDE submitted the amendment to the U.S. Department of Education (ED) for approval

• The updated January 2013 AYP reports will include the 2012 five-year cohort graduation rates and growth targets for the 2013 AYP determinations.

• Meeting the four-year or five-year cohort graduation rate will qualify as meeting the graduation rate criteria for AYP

• The five-year cohort graduation rate will be used as an alternative method for meeting the graduation rate criteria if the eligibility criterion is met.

9

Page 10: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

New API Indicators

• The CDE will convene the Public Schools Accountability Act (PSAA) Advisory Committee to discuss incorporating the following indicators into the API:– High school graduation rates.– Middle school dropout rates (grade 8, and grade 9 for

schools where grade 9 is the highest grade offered).

10

Page 11: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Senate Bill 1458• Senate Bill 1458 was sent to the Governor’s desk on August

29, 2012. If signed, the bill would require:– Assessments constitute 60% of a high school API

beginning with the 2016 API calculations.– New variables be incorporated into the API one full

academic year after the state board approves the addition of a new variable.

11

Page 12: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Standardized Testing and Reporting(STAR)

Page 13: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

1313

Testing WindowsNovember Election and Proposition 30 School Year Calendars

• Test windows can be changed if orders are not in an Approved Status.• Once the orders have been placed, testing windows are fixed and cannot be changed.• Set up test administrations only after number of instructional days and school calendars are finalized.• Orders still must be placed and approved by December 1, 2012.

Page 14: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

1414

Demographic Data Corrections

STAR Module Available

October 1, 2012 – November 9, 2012

•Webcast September 27, 2012

•Fields That May Be Corrected

•Exception:– CALPADS “Continuously Enrolled”

Page 15: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

1515

STAR In-Transition Activities

Alignment to Common Core State Standards

• Planning to provide CCSS-aligned results on STAR Student Reports

• Planning to align CST released test questions (RTQs) with California’s Common Core State Standards (CCSS)

Page 16: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

1616

STAR In-Transition Activities (cont.)

Expedited Return of Individual Student Results• After QC of test results, CST and CMA student scores electronically delivered within 10–12 working days of the receipt of test materials.

• Preliminary scores in an electronic format.

• Include scale scores and performance levels.

• Student record labels, individual student reports, and district data CD will be sent out with paper reports in July-August.

• Writing results for grades four and seven .– Will be reported separately.– Will not be a part of the scale score.

Page 17: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

1717

STAR In-Transition Activities (cont.)

Paperless Aggregate Reporting Data Manager for California STAR

•This tool is a browser-based graphical user interface for analysis.

•Interactive tool presents results in views of lists, tables, and charts.

•Develop ad hoc reports and download data for import into other programs.

•Focus Group/Pilot Testing in October 2012.

Page 18: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

California High SchoolExit Examination

(CAHSEE)

Page 19: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

19

Options for Meeting the CAHSEE Requirement

• Take the test with or without accommodations and pass both English–language arts (ELA) and mathematics portions. (California Education Code [EC] Section 60851[a]).

• Take the test (ELA and/or mathematics portion) using a modification and score at least 350 and obtain a local waiver (EC Section 60851[c]).

• Utilize the exemption (EC Section 60852.3)

• On behalf of a student with disabilities (SWD), the local educational agency (LEA) or special education local plan area (SELPA) may submit a streamlined waiver request (EC 56101).

Page 20: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

2020

CAHSEE Exemption• The exemption was enacted through the 2009–10 Budget

Act and is established in EC Section 60852.3.• Eligible SWDs are exempt from meeting the CAHSEE

requirement as a condition of high school graduation.• At its July meeting, the State Board of Education (SBE)

adopted permanent regulations extending the implementation date for alternative means to January 1, 2013. This extension also will, in effect, extend the exemption.

• Assembly Bill (AB) 1705 (Amended by Stats. 2012, Ch. 192, Effective January 1, 2013.) amends California Education Code (EC) sections 60852.1 and 60852.2. On January 1, 2013, the implementation date of the alternative means will be postponed until July 1, 2015.

• AB 1705 also authorizes the SBE, through regulation, to extend this date up to one year.

Page 21: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

21

Streamlined Waiver

Eligibility requirements:• Student has an operative IEP or Section 504 plan that indicates that he or

she is an eligible SWD, has an anticipated graduation date, and is scheduled to receive a high school diploma on or after July 1, 2012;

• Has attempted to pass both portions of the CAHSEE (ELA and mathematics) at least once and has not passed;

• Has satisfied or will satisfy all other state and local requirements for a high school diploma; and

• Has attained a performance level scale score of 300 (basic) or above on the California Standards Test (CST) for ELA in grade ten or CST for Algebra I without the use of a modification or a scale score of 350 (proficient) or above on the California Modified Assessment (CMA) for ELA in grade ten or CMA for Algebra I.

• Pursuant to EC Section 60851(b), all SWDs shall take the CAHSEE in grade ten for the purpose of fulfilling the accountability requirements of the federal Elementary and Secondary Education Act.

Page 22: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

California English Language Development Test

(CELDT)

Page 23: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

23

CELDT Administration• Educational Data Systems will continue as the

2012–15 CELDT primary contractor.

• Subcontractors– Educational Testing Service (ETS) – Sacramento County Office of Education (SCOE)– MetriTech

Page 24: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

CELDT Administration (cont.)

Separation of K–1 Test

• Educators’ meeting: October 11, 2012• Item writing activities: January–April 2013• Content and bias and sensitivity reviews: May

2013• Item pilots: May–June 2013• Field test: 2014–15• Projected separation: 2015–16

24

Page 25: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

2525

Transitional Kindergarten (TK)

• TK students whose primary language is other than English must be administered the CELDT.• 2012–13 Edition:

– Mark the “K” bubble for grade.– Include date of birth.

• 2013–14 Edition:– “TK” bubble for grade may be added to the answer book.

25

CELDT Administration (cont.)

Page 26: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

• Scoring rubrics revised– Revisions to Oral Vocabulary, 4-Picture Narrative, Sentences,

and Short Composition• Increased precision in scoring.• Improved alignment with common student responses .• More consistent gradations between score points.• http://celdt.org/resources/archives/

• Released Test Questions (RTQs)– Updated RTQs to be posted at http://

www.cde.ca.gov/ta/tg/el/resources.asp– Will include the revisions to the scoring rubrics.

26

CELDT Administration (cont.)

Page 27: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

CELDT Reporting

• New report: CELDT Test Results by Prior Overall Performance Level

– Current CELDT overall performance and most recent previous CELDT overall performance.

– State, county, district, and school levels.

• DataQuest Web pagehttp://dq.cde.ca.gov/dataquest/

27

Page 28: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

CELDT Reporting (cont.)

28

CELDT Results by Prior Overall Performance Level

(Sacramento County)

Page 29: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

CELDT Reporting (cont.)

29

CELDT Results by Prior Overall Performance Level

(Sacramento County)

Page 30: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

30

CELDT Reporting (cont.)CELDT Results by Prior Overall

Performance Level(Sacramento County)

Page 31: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Title III Accountability

31

Page 32: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

32

AMAOs 1 and 2 ResultsPercent of LEAs/Consortia Meeting AMAOs

Source: June 2012 update

Page 33: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Release of AMAOs 1 and 2 Results Analysis of AMAO 1 Results

Student level AMAO 1 performance improved over 7% from prior year

33Source: September 2012 update

Page 34: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Release of AMAOs 1 and 2 Results Analysis of AMAO 2 Results

Percent students meeting AMAO 2

34Source: March 7, 2012 update

Page 35: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

California Longitudinal Pupil Achievement Data System

(CALPADS)

Page 36: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

CALPADS Assessment DataData Loads 2008/09 2009/10 2010/11 2011/12

STAR √ √ √ In Progress

CELDT √ √ √ √

CAHSEE √ √ √ √

Page 37: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Accountability Reports

• Academic Performance Index

• Adequate Yearly Progress

Individual-Level Results

• Assessment History

Page 38: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Current Use of CALPADS Data• Enrollment Counts• English Learner Counts• Graduation and Dropout Counts• Teacher Counts• Title I & Homeless Student Counts• Suspensions and Expulsions• Courses Offered, credits and grades earned• Some Funding Calculations• Federal and State Reporting

Page 39: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Increasing Reliance for Accountability

• In coming years, the CDE will use additional CALPADS data for API and AYP reporting:– Race and Ethnicity– English Learner Status– Socioeconomically Disadvantaged – Special Education– Gender

Page 40: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

Assessment and Accountability Related Items

Page 41: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services

SBAC Pilot Test

• Pilot Test in early 2013. • More than 10,000 items and performance

tasks. • Open to all schools in the Consortium• Two million students. • 22% of students from each Governing State

41

Page 42: Assessment Update Dr. Chun-Wu Li Assessment and Accountability Services