53
Testing and Accountability in North Carolina Charter Schools Curtis Sonneman Accountability Services, NCDPI December 16, 2013

Testing and Accountability in North Carolina Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16, 2013

  • Upload
    more

  • View
    66

  • Download
    0

Embed Size (px)

DESCRIPTION

Testing and Accountability in North Carolina Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16, 2013. Overview. North Carolina Testing Program Test Program Overview Test Coordinator Responsibilities Uses of Testing Program Data READY Accountability Model - PowerPoint PPT Presentation

Citation preview

Page 1: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Testing and Accountability

in North Carolina Charter Schools

Curtis SonnemanAccountability Services, NCDPI

December 16, 2013

Page 2: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

2

Overview• North Carolina Testing Program

– Test Program Overview– Test Coordinator Responsibilities

• Uses of Testing Program Data– READY Accountability Model– Federal Annual Measurable Objectives (AMO)

and State Targets– School Performance Grades

Page 3: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

What is North Carolina’s Testing

Program?

Page 4: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

4

Classroom Assessments:Formative and Diagnostic Information

Balanced Assessment System

Formative Assessment(Classroom)

Benchmark Assessment(Classroom, School, District)

Summative Assessment(Classroom, Statewide)

Page 5: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

K - 2

34567

8

9

10

11

Diagnostic and Formative Assessments

Student Teacher

School Accountability Assessments

State LEA School

K-5 Diagnostics

ACT Explore

ACT Plan

The ACT

12

Measures of Student Learningto be included in Student Growth component

in teacher evaluation

Teacher School

EOG (Math, ELA)

End of Grade (Math, English Language Arts, Science)

EOG (Math, ELA)

EOG (Math, ELA, Science)

EOG (Math, ELA)

EOG (Math, ELA)

Stat

e &

Loca

l In

stru

ction

al Im

prov

emen

t Too

lsFo

rmati

ve &

Ben

chm

ark

Asse

ssm

ents

and

Dat

a An

alys

is fo

r Ins

truc

tion

High School NC Final Exams in core academic non-tested subjects 3 End of

Course (EOC)Biology, Math I and

Eng II

Elementary and Middle School NC Final Exams in currently non-tested subjects

Lower Elementary Measures of Student Learning

The ACT

ACT WorkKeys

Page 6: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Current Testing Program

Assessments Administered in North Carolina

• End of Grade (Grades 3-8)• ELA/Reading• Mathematics• Science (Grades 5 & 8)• Alternate Assessments

• End of Course• Math I• English II• Biology• Alternate Assessments

• Field Tests

• LEP/ESL Assessments• W-APT• ACCESS for ELLs

• ACT Suite of Assessments– Dependent Upon State

Funding• ACT Explore - Grade 8• ACT Plan - Grade 10• The ACT - Grade 11• ACT WorkKeys - Grade

12 (CTE Concentrators)• NAEP Testing

Page 7: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

State Assessments 2013-14

• Aligned to the new standards in 2012-13• Inclusion of item types other than Multiple

Choice• Math/Math I—Gridded Response (All)• Science/Biology and English II—Technology

Enhanced (Online Only)• English II—Constructed Response (All)

• Moving towards full online administration in 2014-15

Page 8: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

How do we deliver the assessments?

Page 9: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

• Online Administration– All End of Course Assessments (Math I, English II, & Biology)– End of Grade 5 & 8 Science– NCEXTEND2 Alternate Assessments (Final Year 2013-14)

• NCEXTEND2 ELA/Reading and Math 3-8• NCEXTEND2 Science 5 & 8• NCEXTEND2 Math I, English II & Biology

• Paper/Pencil Administration– ELA/Reading and Math 3-8– All online assessments will be available in this format

• NCDPI recommends online administration, but paper/pencil will be available

Assessment Delivery Format

Page 10: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

• 2013-14 Online Assessment System– NCTest will continue to be the online assessment delivery

system– Requires a locked down browser or app

• 2014-15 Online Assessment System (Transitional Year)– Home Base will be new system for delivering summative

assessments online (this will include delivery of Smarter Balanced Assessments)

• Test Nav– NCTest may continue to provide online assessment delivery

as transition to Test Nav moves forward

Online Assessment Delivery Plan

Page 11: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

18

Some Additional Tests

• CTE Post-Assessments– Used for CTE certifications– Used for Educator Effectiveness

• NC Final Exams (aka Common Exams 12-13)– Used for Educator Effectiveness

Page 12: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

• 5-day window for semester-long courses– Includes EOC, NC Final Exams, CTE post

assessments, teacher made finals.

• 10-day window for year-long courses– Includes EOG, EOC, NC Final Exams, CTE post

assessments, teacher made finals.

Testing Window-GA Legislation

Page 13: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

What aboutNC Final Exams?

Page 14: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

NC Final Exams

Library of NC Final Exams

When: End of Year or Semester; Same window as EOG/EOC

Used For: • Providing an EVAAS score• Only for those teachers whose

subjects are currently non-tested• For professional growth, and as a

required component of employment decisions*

Logistics: • Once a year• 1 or 2 class periods• Replaces teacher- made final

exam

* Note: Not part of School Accountability Model (“A-F”)

Educator EffectivenessTests to measure student growth as a part of educator evaluation

Page 15: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

NC Final Exams

Charter Requirement• Must participate in the NC Final Exams administration

if--

• Received Race To the Top funds

• Have beginning teachers who are seeking continuing licensure (Year 1)

• Must have 3 years of growth data

Charters may elect to participate in NC Final Exams

Page 16: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

23

Test Coordinator Responsibilities

Page 17: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

24

Testing and Accountability Responsibilities• Principals/Directors/Board Members are

ultimately responsible for Testing and Accountability Duties

• North Carolina Testing Code of Ethics• Responsible for Test Security

– Materials must be stored in a secure locked facility (plan your facilities accordingly)• Accessible by 1-2 staff (Test Coordinator and Principal)• Room, closet, or locked cabinet that cannot be

removed

Page 18: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

25

School Test Coordinators• Each charter school must have an assigned

Testing Coordinator– Must be employee of charter school

• Recommend a certified staff , but not regular classroom teacher if at all possible (not enough time to do both)

– Must be available to attend all trainings (off-site)– Have no other responsibilities during test

administration days– Available for training and updates during summer

months (accountability reporting ends June 30)

Page 19: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

26

Test Coordinator Responsibilities• Ensure test security with leadership

– Test materials– Testing violations– Distribution of test materials– Ensure test materials are on copied or

reproduced in any way– Order/Request test materials

• Attend and conduct training– NC Train the Trainer Model

• NCDPI Regional Staff Train School Test Coordinators• School Test Coordinators Train School Staff

Page 20: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

27

Test Coordinator Responsibilities• Create school testing plan• Schedule test administrations• Develop local policies and procedures to

ensure proper test administration• Submit materials for scanning/scoring• With assistance from RAC determine testing

irregularities• Check online systems for updates

Page 21: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

28

Test Coordinator Responsibilities• Maintain confidentiality of student test

scores and teacher information– Will have access to all test results and

accountability for the school• Submit data requested by RAC or NCDPI• Ensure data accuracy

Page 22: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

29

School Test Coordinator Skills• Strong Computer Skills

– Microsoft Excel– Microsoft Word– Internet savvy– Able to learn new programs easily

• Secure File Transfer System• NCEducation online system• HomeBase

• Able to send/receive information via email/phone and respond in a timely manner

• Strong organizational skills

Page 23: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

30

School Test Coordinator Skills• Available to attend regularly scheduled

meetings (generally 1 time each month)• Strong interpersonal relationship skills

– Training staff– Work closely with school leadership and NCDPI

staff– Work closely with other staff to obtain data– Meet/talk with parents/staff to answer questions

• Good listening skills• Not afraid to ask questions or address issues

Page 24: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Testing Questions

Page 25: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

How are schools held accountable?

Page 26: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

33

Accountability• Accountability of Test Scores

– All public schools must participate in the North Carolina Testing Program• Schools are expected to test all eligible students

– 95% Tested Rule

» Failure to meet results in non-compliance notification

» Additional requirements for not testing 95% of students for federal reporting

Page 27: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

34

Accountability• Accountability of Test Scores (cont.)

– Data Collections• Economically Disadvantaged Students (EDS)

– Whether or not you have a school lunch program• Power School• Limited English Proficient—Consolidated

Federal Data Collection• CECAS• Test Administration Data

– Data Validation

Page 28: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

35

Accountability• Accountability Model

– READY Accountability Model 2012-2013• Yearly Performance—Status• Performance over time—Progress (targets)• Student Growth—EVAAS Growth Model

Page 29: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

36

Elementary and Middle School Accountability

End of Grade 3-8 Math

End of Grade 3-8 ELA

End of Grade 5 & 8 Science

Δ End of Grade 3-8 Math

Δ End of Grade 3-8 ELA

Δ End of Grade 5 & 8 Science

EVAAS Growth

School-wide

StatusIndicators“this year”

ProgressIndicators“trend over time for groups of students”

Growth Indicators“combined individual student’s growth”

Page 30: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

37

High School Accountability

37

End of Course

ACT

Graduation Rates

Math Course Rigor

ACT WorkKeys

Graduation Project

Δ End of Course

Δ ACT

Δ Graduation Rates

Δ Math Course Rigor

Δ ACT WorkKeys

EVAAS Growth

School-wide

StatusIndicators“this year”

ProgressIndicators“trend over time for groups of students”

Growth Indicators“combined individual student’s growth”

Page 31: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

READY Accountability Model Reporting and School Performance Grades Indicators

End-of-Grade and End-of-CoursePerformance Composite READY Broken out by assessment SPG

• Percent of proficient tests in a school− All EOG/EOC tests, subjects, and grade

levels (Including alternate assessments)

The ACT• The ACT Composite Score of 17 as

meeting standard− 17 is UNC System minimum for admission

Math Course Rigor• Percent of graduates who earn credit in

Alg. II, Int. Math III, or Math III− Excludes the 1% and OCS populations

ACT WorkKeys

• Percent of graduates who are CTE concentrators and who achieve a Silver certificate, or better, on the ACT WorkKeys assessment

Graduation Rate

• Percent of students that graduate within 4 years (4-year cohort graduation rate) READY and SPG

• Percent of students that graduate within 5 years (5-year cohort graduation rate) READY

Page 32: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

2012-2013 Ready Accountability Model Reporting

Accountability Indicators Indicator will display data if school has 5 or more

assessments/studentsFederal Targets

English language arts/reading, math, graduation rate, and attendance

State Targets Science, The ACT, and ACT WorkKeys

EVAAS Growth (School-wide Accountability Growth) Reported as Exceeds, Meets, or Does Not Meet on

website Linked to EVAAS public reporting website

Graduation Project Reported as Yes, No or N/A

Ability to drill down into data for analysis

Page 33: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

How will the School Performance Grades

be calculated?

Page 34: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Performance Grades

• First passed by the General Assembly in 2012

• Assigns a letter grade A-F for each public school in North Carolina

• Includes consequences for “F” schools

Page 35: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Performance Grades Legislation

Implemented: 2013-14 school year

Reported: August 2014

Components: Performance (School Achievement Score) and Growth

Page 36: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Performance Grades

School Achievement

Score

Growth

School Performance

Grade

Page 37: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Performance Grades Break Out

Elem/Middle

EOG Mathematics

EOG ELA/Reading

EOG Science

Math I (when applicable)

English II (when applicable)

Biology (when applicable)

High Schools

Math I

English II

Biology

The ACT

Math Course Rigor

ACT WorkKeys

Graduation Rate

Page 38: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Achievement Scores

Components of the School Achievement Scores (80%)

Test Scores: Percent of students who score at or above Level 3 End-of-Grade Tests End-of-Course Tests

Graduation Rate: Percent of students who graduate in four years

Math Course Rigor: Percent of graduates who successfully complete Math III (Algebra II, Integrated Math III, Math III)

The ACT: Percent of 11th grade students who score 17 or above (the UNC System’s minimum composite score requirement)

ACT WorkKeys: Percent of CTE concentrator graduates who achieve a Silver Certificate or above

Page 39: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

READY Accountability Model Reporting and School Performance Grades Indicators

End-of-Grade and End-of-CoursePerformance Composite READY Broken out by assessment SPG

• Percent of proficient tests in a school− All EOG/EOC tests, subjects, and grade

levels (Including alternate assessments)

The ACT• The ACT Composite Score of 17 as

meeting standard− 17 is UNC System minimum for admission

Math Course Rigor• Percent of graduates who earn credit in

Alg. II, Int. Math III, or Math III− Excludes the 1% and OCS populations

ACT WorkKeys

• Percent of graduates who are CTE concentrators and who achieve a Silver certificate, or better, on the ACT WorkKeys assessment

Graduation Rate

• Percent of students that graduate within 4 years (4-year cohort graduation rate) READY and SPG

• Percent of students that graduate within 5 years (5-year cohort graduation rate) READY

Page 40: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Growth

EVAAS School-wide Accountability Growth (20%)IncludesEnd-of-Grade Tests End-of-Course Tests

Reported for each school asExceeds Expected GrowthMeets Expected GrowthDoes Not Meet Expected Growth

Not included in School Performance Grades for schools that have a School Achievement Score at or above 80 % and Meets Expected Growth

Page 41: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Growth

Meets growth: No additional calculation; growth not included in School Performance Grade

Did not meet or exceeded growth: Include growth in calculation of School Performance Grade

School Achievement

Score at or above 80 %

Include growth in calculation of School Performance Grade

School Achievement

Score 79 % or below

Page 42: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Growth Conversion

80 85 9050 60 70

0 +2 +4 +6 +8-10 -8 -6 -4 -2

Index range constrained at -10 to +10 Index value converted to 50-100 point scale

Did Not Meet Growth

Exceeded Growth

Met Growth

100

+10

Page 43: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Elementary Achievement Calculations

5&8 Science% Proficient

3-8 Math% Proficient

3-8 Reading % Proficient

Biology % Proficient

English II % Proficient

Math I % Proficient

# of Available Indicators

+ + + + += Points

60.1%(98/163)

83.6% (336/402)

73.1%(294/402)

0%(0/0)

0%(0/0)

93.8%(30/32)

4

+ + + + += 77.7

73.1 + 83.6 + 60.1 + 93.8 = 310.6 and 310.6 ÷ 4 = 77.65 ≈ 77.7

Page 44: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Elementary Grade Calculation

(62.2)+(18.3)= 80.5

80.5pts=letter grade of “B”

Achievement Score under 80 ORAchievement Score at least 80 AND “Did Not Meet Growth” or “Exceeded Growth

Achievement Score =

School Performance Grade Points

90-100pts=A80-89pts=B70-79pts=C60-69pts=D

Under 60pts=F= 80.5

+ X 0.2X 0.8 GrowthPoints( )( )

+ X 0.2X 0.8 (( ) )91.377.7

Page 45: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

High School Achievement Calculation

Biology% Proficient

English II% Proficient

Math I% Proficient

The ACT % Met 17

ACT WorkKeys% Silver

MCR% Math III

# of Available Indicators

+ + + + += Points

82.8%(77/93)

89.7% (78/87)

85.7%(90/105)

69.1%(56/81)

85.7%(42/49)

63.4%(52/82)

7

+ + + + += 82.2

85.7 + 89.7 + 82.8 + 63.4 + 69.1 + 85.7 + 98.8 = 575.2 and 575.2 ÷ 7 = 82.17 ≈ 82.2

98.8%(80/81)+

Grade Rate % 4yr

+

Page 46: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

High School Grade Calculation

Achievement Score 80 or above AND “Met Growth”

Achievement Score =

School Performance Grade Points

90-100pts=A80-89pts=B70-79pts=C60-69pts=D

Under 60pts=F82.2 = 82.2

82.2pts=letter grade of “B”

Page 47: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

High School Grade Calculation

(65.8)+(13.1)= 78.9

78.9pts=letter grade of “C”

Achievement Score under 80 ORAchievement Score at least 80 AND “Did Not Meet Growth” or “Exceeded Growth

Achievement Score =

School Performance Grade Points

90-100pts=A80-89pts=B70-79pts=C60-69pts=D

Under 60pts=F= 78.9

+ X 0.2X 0.8 GrowthPoints( )( )

+ X 0.2X 0.8 (( ) )65.682.2

Page 48: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Growth will be reported for each school: exceeded, met, or did not meet expected growth

A separate achievement score for math and reading will be reported for schools serving grades K-8

The report card for schools serving 3rd graders will contain information on the number and percentage of third graders who are retained or promoted based on reading performance

Additional Reporting

Page 49: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

What is new in testing in 2014-15

and beyond?

Page 50: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

57

Testing• Read to Achieve (Beginning 2013-14)

– End-of-grade test form administered at beginning of 3rd grade (BOG3)

– End-of-grade retesting for end of 3rd grade ELA/Reading administrations or alternative assessment

• ACT– HB 587: requires an alternative for ACT in Spring 2014

and for ACT Plan in Fall 2014

Page 51: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Draft – March 2012. Check http://www.ncpublicschools.org/ready/resources/ for Updates to this Presentation

Testing• Online Assessments for 2014-15

• EOCs

• Science- Grades 5 and 8

• NCEXTEND2: Not available in 2014-15• Will no longer provide based on ESEA Waiver

requirement

Page 52: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

School Accountability Assessments:Timeline

Test 2012-2013 2013-2014 2014-15 on New

Stat

e Developed

Math 3-8ELA 3-8

English IIMath I

BiologyScience 5 & 8

ACT ACT

SMARTER

Balance

d

Math 3-8*ELA 3-8*

11th Grade Math*

11th Grade ELA*

In Development

SBE Decision

SBE Decision

SBE Decision

*2014-15 implementation of SMARTER assessments contingent upon board approval of assessments to replace the State-developed ELA and Math assessments.

Page 53: Testing and Accountability   in North Carolina  Charter Schools C urtis Sonneman Accountability Services, NCDPI December 16,  2013

Questions?

Every Student READY