Statewide Assessment Transition Update

Vince Dean, Ph.D.Director, Office of Standards & Assessment

DAS Advisory Committee 11-7-13

1

Career and College Ready

2

Career- and College-Ready (CCR) means that a high school graduate has the core foundational knowledge and skills necessary to succeed in workforce training, certification programs, and entry-level, credit-bearing academic college courses that provide preparation for careers leading to a self-sustaining wage, pathways to advancement, and competitiveness in the global economy

3

• Use technology and tools strategically in learning and communicating 

• Use argument and reasoning to do research, construct arguments, and critique the reasoning of others

• Communicate and collaborate effectively with a variety of audiences

• Solve problems, construct explanations and design solutions

Career and College Ready

4

What the Suite of Summative and Interim Assessments will Look Like

Subject

Grade

K 1 2 3 4 5 6 7 8 9 10 11 12

Mathematics i i i s s s s s s S S S c

Reading i i i s s s s s s S S S c

Writing i i i s s s s s s S S S c

Science * * * i mi i i mi c c c Mc c

Social Studies * * * i i mi i i mi c c Mc c

Other (e.g., Art, Music, P.E.) * * * * * * * * * * * * *i Interim assessments

c Interim course content assessments based on Michigan Merit Curriculum

m MEAP end of year assessment

M MME end of year assessment

s Smarter Balanced (based on grade level common core). Includes interim grade level, and summative assessments.

S Smarter Balanced (based on high school common core). Includes interim course content, and summative assessments.

* Model interim/course content assessments

Legislative Action on Common Core & Smarter Balanced Suspension

• October 1 MDE budget prohibition against any implementation of Common Core or Smarter Balanced

• ‘Affirmative Action’ – Defined by Michigan House of Representatives as a

resolution– Voted on 9/26/13; 85-21 in support of CCSS and Smarter

Balanced through HCR 11 if certain conditions met• Guarantee local control; data security; report on

assessment options

5

Legislative Action on Common Core & Smarter Balanced Suspension

• Senate took action on October 24th – Held hearing with limited testimony and public

comment on October 2nd –May develop a new resolution, modify the House

resolution, or resolve through a revision to the MDE budget

–Modified House resolution• Preference for CAT• Administered twice per year• Real-time results

6

Legislative Action on Common Core & Smarter Balanced Suspension

• Example Repercussions– Implementation purgatory; CCSS were still our state standards– Michigan in violation of our NCLB flexibility waiver– Approximately 97% of schools and districts fail AYP– Revert to original method of calculating Bottom 5 percent, causing

turmoil with schools coming on and going off the list – Participation in Smarter Balanced and DLM field testing during this

school year– K-2 Pilot Test

7

Assessment Transition Planning

• Leaving Consortia • Collective state capacity• Item types• Scoring and reporting• Computer Adaptive Testing• Individual student growth data • PD materials• Fall 14/Moving to spring

8

Assessment Transition PlanningSummative and Interim

Different purposes Multiple measures to support reform efforts

and accountabilityFall to Spring

All summative will eventually be spring Thinking about a year’s growth

Spring 2015: Goal for as many operational components as possible

9

Assessment Transition Planning Pilot/Field testing opportunities are the key in every

scenario Every fall and spring there will be opportunities for

schools to participate in an online pilot or field test event

Enough students must participate in order to: Calibrate items Compare mode effects Test systems Support the move to spring Field viable assessments if no consortia opportunities

10

Interim Assessment Pilot Testing

Smarter Balanced Field Testing• Currently at approximately 92% of what we need in terms of

Michigan students participating to provide a demographically representative sample

• Voluntary sign-up through November 8th

• Low numbers for grades 8 and 11; everything else looking very good

• Targeted recruitment coming next• First 2/3 of window; fixed-form to calibrate items• Last 1/3 of window; shakedown cruise of CAT algorithm and

scoring solutions– Same approximate test length, item type and DOK distribution

12

Interim Assessment PilotingWhere are we now:•Currently pilot testing Science & Social Studies around the state. Window opened 10/28 will close Dec 6; piloting 2,800 items•Beginning recruitment for Spring Pilot of K2, due to legislative delay

– While the delay hurts our overall timeline by half a year, it may help with participation as schools will not be competing with MEAP

– Approximately 500 TE items– K: 135 schools, 17k students– 1: 153 schools, 19k students– 2: 172 schools, 21k students

•Begin item writing and development of approximately 850-1,000 high school mathematics items. •Mathematics design challenge

13

Interim Assessment PilotingWhat’s next:•Spring 2014 K2 Pilot: Looking at a 6-week window– Suggestions for best window between February and May?

•Schedule work sessions to think about high school ELA interim content and design– Suggestions for a 12th grade ELA interim assessment?

•Fall 14 large-scale field-test of Science and Social Studies interim system– This will model the operational test design as closely as possible. The goal

would be to move to an operational status for Spring 15– Waiver status issue

14

MI-Access FI Social Studies• New EGLCEs and EHSCEs posted to MI-Access webpage• Assessment will consist of two kinds of items:

– stand-alone and passage-based;• Currently recruiting for a spring (April/May) pilot test for

students in grades 5, 8, and 11• Pilot will include chance for teachers and students to provide

feedback on the online assessment experience and assessment features (such as different types of audio presentations)

• Operational in Spring 2015• Interested in pilot? email John Jaquith at

JaquithJ@michigan.gov

15

Dynamic Learning Maps• One ISD center based program participating in the fall Pilot• Michigan districts have been encouraged to participate in three

different field test opportunities in the winter and spring (Deadline for districts to sign up is 11/18: go to https://kansasedu.qualtrics.com/SE/?SID=SV_1BVeB6p9r9zXYYR)– make sure Michigan students and teachers are well represented;– students/teachers will become more familiar with DLM and

computer-based testing;– opportunity to give feedback after each field test;– allows DLM’s system to be improve movement through learning

map (which set of items/testlets to administer to student);

16

WIDA Assessments• 3 available assessments:

– W-APT: replaces ELPA Initial Screening– ACCESS for ELLs: replaces Spring ELPA (test window Feb. 10 – Mar. 28)– Alternate ACCESS for ELLs: for ELs who are also SWDs (test window Feb. 10 – Mar. 28)

• PD for the ACCESS starting in December• 3 districts field testing online Reading items in spring• Biggest transition challenges:

– Communication with districts who don’t have ISD/RESA support or large EL populations– Greater amount of time to screen students than with ELPA– Difficulty in achieving inter-rater reliability on scoring W-APT Speaking and Writing items

• QuestionsHow can we better assist schools with low to medium sized populations in this

transition year? How can we, on a large-scale, better prepare test administrators to score Speaking

and Writing items using the WIDA rubrics?

17

Kindergarten Entry Assessment The KEA pilot began September 3, 2013 ended on November 1,

2013. Jeff Beal - currently assisting teachers in making sure that they

finalize all of their checkpoints and entered information for every student.

Administrators and teachers are now able to create reports through TS GOLD.

TS GOLD is sending a survey to all participants this week. 76 districts throughout Michigan 88 schools 173 teachers 4107 students

18

Contact Information Smarter Balanced – Vince Dean; deanv@michigan.gov DLM & MI-Access Social Studies– Linda Howley;

howleyl@michigan.gov & John Jaquith; jaquithj@michigan.gov

Interim Assessments – Andy Middlestead; middlesteada@michigan.gov

WIDA – Jen Paul; paulj@michigan.gov KEA – Jeff Beal; bealj1@michigan.gov Online Assessment Readiness – Matt Ayotte;

ayottem@michigan.gov

19