1Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

Assessment andAccountability

Update

2

1. Assessment and Accountability Reporting Schedule

2. School Report Card Update• Key Accountability Pages • Clarifications and Issues

3. New for 2013 Testing

Topics for Discussion

Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

Assessment and Accountability Reporting

Schedule October 16 – Quality Control at district/school level ends.

Great Work, DACs and BACs!!

October 17-29 – KDE makes changes, loads to School Report Card (SRC) and performs final quality control.

October 30 – Schools and media receive access to SRC and final data. (Date embargoed until public release.)

November 2 – Public release of data occurs.

November 2-14 – After public release, clean-up and appeal process required by state regulation is available.

3Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

4Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

5Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

6

School Address, Phone and Fax

Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

7Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

8Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

9Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

10Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

11Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

12Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

SCHOOL CONFIGURATION AND REPORTING92% of all schools in Kentucky follow standard

configurations of K-5/K-6, 6-8 and 9-12.The new Unbridled Learning model calls for

three levels of schools: Elementary, Middle, and High.

In order to make comparisons at the three levels, non-traditional configurations are placed into one of the three standard levels.

Non-traditional configurations are not penalized and do not have lower scores. Scores for these schools range from low to high.

13Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

REDISTRIBUTION OF WEIGHTSin REPORTINGIf data cannot be

calculated for any category of next-generation learners, the weights shall be redistributed using an equal proportion to categories that shall be reported for the school or district.

14Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

High School Achievement (20% of Next Generation Learners)

Example

Tests Standard Weights

Redistributed Weights

Reading (English II)

20% 25%

Mathematics (Algebra II)

20% No test data

Science (Biology)

20% 25%

Social Studies(U.S. Hist.)

20% 25%

Writing (ODW/ LangMech)

20% 25%

Year 2 Reporting Annual Measurable Objective is the gain or improvement expected on the

Overall Score in 2013. 70th percentile and above gain of .5

69th percentile and below gain of 1

Relationship between Overall Score and Percentile Rank is locked annually

until complete Unbridled Learning is implemented, then it is locked for five

years.

15Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

Overall Score=Percentile Rank Example of Lock (Simulation Data)

2012 2013

Overall Score 58.7

= 70th Percentile Rank for

Proficient Schools

Overall Score 58.7 becomes

the locked target.

School reaches

58.7. It is Proficient.

ACHIEVEMENTBased on formula using student performance

levels—Novice (0), Apprentice (.5), Proficient (1)

and Distinguished (1) (NAPD)—with a bonus

awarded if Distinguished is greater than Novice

The new testing system:links to the CPE definition of college readiness from

Grades 3 to 12. revises Kentucky’s Novice, Apprentice, Proficient, and

Distinguished (NAPD) performance levels to align with

college readiness.

16Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

ACHIEVEMENT

The standard setting process for End-of-Course (EOC)

tests used the superscore generated from all parts of

the EOC tests combined. The Multiple Choice/Multiple

Choice/Constructed Response results were reported

on a new scale of 225-295 to set cuts for NAPD.

Language mechanics is 4% of writing. At high school,

the PLAN language usage score is used. NAPD cuts

are aligned to the quartiles (1-24, 25-49, 50-74, 75-99)

of the national percentile rank.

17Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

GAPGap data reports the percent of non-

duplicated gap students scoring proficient or distinguished in each content area.

If a student is a member of one of the individual student groups (African American, Hispanic, Native American, students with disability (IEP), free/reduced price lunch and Limited English Proficient), then the student is included the non-duplicated gap group. 

The student only counts once toward the non-duplicated gap group

score in each content area.  Minimum for reporting is 10.  Non-duplicated gap students are identified in the student listing

spreadsheets.

18Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

GROWTHData cleanup issue: Non-matched students.Non-match students are eliminated from the

calculation.Approximately 90-95% of students matched

from one year to the next.Most schools had very small numbers of

unmatched students. Some schools had a higher number.

KDE will work with schools with classification impacts to clean-up data after the public release.

19Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

COLLEGE/CAREER READINESS (CCR)All G-Code students need opportunities to show

readiness. All G-Code students that have an 100 day

enrollment (full academic year) are included in CCR accountability reporting. College Ready: If student does not take the ACT in March or at a

national administration, use COMPASS or KYOTE.

Career Ready: Students must be on a Career and Technical Education Preparatory track to take KOSSA and earn credit for Industry Certifications with CCR calculation. 

ASVAB or WorkKeys results only add to CCR calculation for Career and Technical Education students.

20Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

GRADUATION RATEYear 1 of Unbridled Learning reporting (2012), uses

Averaged Freshman Graduation Rate (AFGR) for state reporting and information for federal reporting requirements.

In 2013, KDE will produce AFGR and Cohort Rate.

AFGR must be used one final time for federal reporting requirement to compare 2012 to 2013.

Cohort rate also reported for 2012-13; timing on use for accountability to be determined.

21Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

FEDERALLY-REQUIRED LABELS (PRIORITY AND

FOCUS)Priority schools are those previously identified as

Persistently Low Achieving.

There are three ways to be a Focus school. Non-duplicated gap is in the lowest 10 percent of the student group

gap scores by level . The list will identify the lowest 10 percent of the Title I schools and the lowest 10 percent of all schools, regardless of Title I status; or

All schools with individual gap groups underperforming in the third standard deviation below the mean (called Third Standard Deviation Model); or

Any high school having a graduation rate below 60 percent for two years in a row will be a Focus school.

22

Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

NEW FOR 2013 TESTINGData quality and test security remain important

themes in 2013.

As recommended by security audit, a Student Honor Code has been added to the Student Response Booklet on the back cover. Scripts will direct the Code be read aloud before testing begins.

23Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

K-PREP Student Honor CodeI understand the answers on this test must be my own work. Receiving test questions or answers from others is cheating. Giving test questions or answers to others is cheating.  If I cheat, my school may discipline me and my test may not be scored. _________________________Student Signature 

NEW FOR 2013 TESTINGBuffer time allowed in 2012 will continue in 2013.

Includes Parts B and C of Reading, Mathematics, Science and Social Studies

Part A (NRT) in Reading, Mathematics, Science and Social Studies and Writing On-Demand will not have an increase in time.

Inclusion Regulation (703 KAR 5:070) has been withdrawn. No new accommodations changes will impact 2013 testing. Reader/read aloud will be permitted on Reading test (grades 3-8)

and EOC English II this academic year.

24Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

Resources and QuestionsFollow up questions may be addressed to

rhonda.sims or dacinfo@education.ky.gov or 502-564-4394.

Resources for release of final data DAC and Special DAC E-Mails Training webcast (Friday, October 26) see DAC E-Mail for links

SRC workbook to assist data analysisCut scores Performance Level Descriptors for 3-8 and Writing high schoolData Goal Calculator

25Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12