Assessment and Accountability Update

Assessment and Accountability Update

Kentucky Association of School AdministratorsJuly 18, 2013

Kentucky Department of EducationOffice of Assessment and Accountability (OAA)

KDE:OAA:7/15/13 Questions: [email protected] or 502-564-43941

Ken Draut, Associate Commissioner Rhonda Sims, Director ([email protected])

Timeline for Reporting

Accountability - Year Two

School Report Card - Year Two

Program Review Data Release

Science/Social Studies Standards Update

Additional Information

2 KDE:OAA:7/15/13 Questions: [email protected] or 502-564-4394

Timeline for 2013 ReportingAll dates are tentative.


• Individual student data released first in PearsonAccess.• August 2 K-PREP individual test scores (NAPD) (all

subjects grades 3-8, writing at grades 10-11)• August 16 Individual student reports with student growth

percentileNote: EOC individual scores already reported.

• Schools and districts will have opportunity to review student data for accountability and demographics before public reporting. •August 14-27 Data review and cleanup in SDRR•September 12 DAC training and Quality Control day for system

issues

Week of September 23-27 Public release of accountability reports via the School Report Card

Review of Accountability System and School Report Card



Accountability-Year Two SRC Review











10

Needs Improvement (Below 70th Percentile)Proficient (At or Above 70th Percentile)Distinguished (Above 90th Percentile)Progressing

meet Annual Measurable Objective (AMO) goal (1.0 gain in Overall Score below Proficient or .5 gain Proficient and above);

graduation rate goal (AFGR); and participation rate (95%)

High-Progress top 10% of improvement; and meet AMO; graduation rate goal (AFGR); and participation

rate (95%)


NEW 2013

NEW 2013

Priority (No new Priority Schools added in 2012-13)Focus

Lowest 10% in Overall Gap group or meets third standard deviation model for a single gap group

High Performing School Top 90% of schools; and meets AMO, graduation rate goal

rate* and participation rate goalSchools of Distinction

Top 95% of schools; and meets AMO, graduation rate goal and participation rate goal; and has graduation rate above 60% for 2 years


Percentiles for Elementary, Middle and High Overall Score were set and locked in 2011-12. The locked percentile serves as the overall score target for 2013 reporting.

70th 90th 95th Elementary Overall Score 62.5 69.8 72.5Middle Overall Score 58.7 64.9 68.2High School Overall Score * 58.0 64.4 67.7District Overall Score 58.4 63.3 65.2

*At high school, the removal of constructed response in EOC testing means new percentiles will need to be calculated.


Cohort model graduation data will be used in the 2012-13 calculation for Graduation Rate component (20% of high school Next-Generation Learners).

Averaged Freshman Graduation Rate (AFGR) will be used one last time in 2012-13 for graduation rate goals.


Add Trend Data for ProfilesUpdate Graduation Data to show both Cohort and

AFGR Add Trend Data for NAPD TablesAdd Non-Duplicated Gap Group to list of individual

group scoresAdd Level Based (elementary, middle and high) data

for disaggregated pagesAdd Norm-Referenced Test (NRT) disaggregated

dataAdd Advanced Placement data if availableClarify language and footnotes


Tentative Release Date: October 2013

Provided through Open House on KDE website

Based on Program Review scores that schools and districts entered in the ASSIST system

Scores generated using the Program Review scoring guides/rubrics



Program Review (PR) Scoring Guide

Program Review CalculationsEach of the 3 Program Review areas (Arts & Humanities, Writing, and Practical Living) is comprised of 4 standards (Curriculum/Instruction, Formative/Summative Assessment, Professional Development, and Administrative Support).

Step 1: Average the characteristic scores for a score for each standard. Scores range from 0-3 for each standard 0 – No Implementation, 1– Needs Improvement, 2 –Proficient, and 3 Distinguished

Step 2: Add the 4 standard scores to get a single number for each Program Review area.

Scores range 0-12 for each Program Review area The cut score 8 is Proficient and 10.8 is Distinguished

Step 3: Add the three Program Review area scores for a total Program Review score.

Scores range between 0-36

Step 4: Divide the total number by 24 (proficient (8) x 3 areas = 24). This number yields the percent of the 23 points earned (number of

points possible in Unbridled Learning accountability model for PR when Learners and PR are combined).


Program Review Data Release

CalculationExample

19

Accountability Formula for Combining Next Generation Learners and Program Reviews

Component OverallWeighted Percent

Weighted Score

Next Gen Learners Overall Score

57.9 X 77% = 44.6

Program Reviews 75.0 X 23% = 17.3

Combined Overall

Score* 61.9

*Combined Overall Score used to calculate new 70th and 90th percentile cut for summer 2014 targets


Senate Bill 1 (2009) required new standards that: Focus on the “critical knowledge, skills and capacities

needed for success in the global economy.” “Consider international benchmarks” and “consider

standards that have been adopted by national content advisory groups and professional education consortia.”

Are aligned across all levels – elementary, middle, high and postsecondary.



Develop Adopt Implement Assess

Summer 2011 – Framework releasedSeptember 2011 –Kentucky accepted as a lead stateMay 2012 –First public draftJanuary 2013 – Second Public DraftApril 2013 –Final release of standards

April 2013 – First Review by KBE of 704 KAR 3:303, Kentucky Core Academic Standards .June 2013 –The KBE adopted Kentucky Core Academic Standards for Science

September 2013 –Launch Science Networks

2014-15 or 2015-16 School Year – Assess KCAS for Science


Kentucky Core Academic StandardsNext Generation Social Studies Standards-Timeline

Social Studies Standards being created in summer 2013

Kentucky Board of Education (KBE) First Read – October 2013

KBE Second Read – December 2013Implemented in 2014-15Use to assess social studies in 2015 or 2016


Additional Information

EOC Online TestingACT Online Testing System crashed April 29.1500 students tests were interrupted (1% of total test-

takers)100% finished after moving to paper format.Accountability decisions will be made jointly with affected

districts.Financial penalties imposed on ACT.Fall 2013 Stress Test with 20,000 students required to

demonstrate to KY the ACT system will work.


Two Consortia (federally-funded)PARCCSmarter Balance

Kentucky is a “participating” member of PARCC; this means Kentucky monitors the work of PARCC but is not pledged to give the tests.

Decisions to use the PARCC tests delayed until after the first operational test administered in order to fully evaluate the product and the costs.


Documents

Assessment and Accountability Update