MEAP / MMEMEAP / MMENew Cut ScoresNew Cut Scores

Gill ElementaryGill Elementary

February 2012February 2012

Meaning of a Cut ScoreMeaning of a Cut Score

A “cut score” is the lowest score a student A “cut score” is the lowest score a student can achieve on a test (or multiple tests) to be can achieve on a test (or multiple tests) to be considered “proficient” or “passing” at their considered “proficient” or “passing” at their respective grade levelrespective grade level

A cut score on a test is the score that A cut score on a test is the score that separates test takers into various categories, separates test takers into various categories, such as advanced proficient, proficient, such as advanced proficient, proficient, partially proficient and not proficientpartially proficient and not proficient

The New MEAP/MME Cut ScoresThe New MEAP/MME Cut Scores

New cut scores approved by State Board New cut scores approved by State Board of Education in Sept. 2011of Education in Sept. 2011

New cut scores in effect for 2011-12 testsNew cut scores in effect for 2011-12 tests What is different?What is different?

1.1. They did not use standard setting panels, They did not use standard setting panels, which is how nearly all other previous cut which is how nearly all other previous cut scores were set.scores were set.

2.2. The new method was purely statistical, The new method was purely statistical, they linked 11they linked 11thth grade MME scores to grade MME scores to college grades and then linked grades 3-9 college grades and then linked grades 3-9 MEAP to those MME scores.MEAP to those MME scores.

Cut Score StudyCut Score Study

MDE conducted a special study using:MDE conducted a special study using:– Michigan students’ 2008-09 MME scores, Michigan students’ 2008-09 MME scores,

and and – First semester freshman grades in Fall First semester freshman grades in Fall

2010 in selected non-remedial courses at 2010 in selected non-remedial courses at Michigan post-secondary public Michigan post-secondary public institutionsinstitutions

Twenty-two 4-year colleges Twenty-two 4-year colleges Fifteen 2-year institutionsFifteen 2-year institutions

– Then the 2008-09 MME scores were linked Then the 2008-09 MME scores were linked to the 2010-11 MME scores.to the 2010-11 MME scores.

5

• The grades being predicted are often being given by graduate teaching assistants whose knowledge about grading may vary.

• The “social science” courses are a variety of the courses.

• There are large differences in the grading practices and student populations among colleges (and community colleges).

• 75% of the variation in college grades cannot be predicted by ACT scores.

Considerations with Prediction Data

““AdvancedAdvanced”” is now defined as having a is now defined as having a 2 in 32 in 3 or or greatergreater chance of earning an A or B in college (or being chance of earning an A or B in college (or being proficient on the next grade level test).proficient on the next grade level test).

““ProficientProficient”” is now defined as having a is now defined as having a 1 in 21 in 2 to 2 in 3 to 2 in 3 chance of earning an A or B in college (or being proficient chance of earning an A or B in college (or being proficient on the next grade level test).on the next grade level test).

““Partially ProficientPartially Proficient”” is now defined as having a is now defined as having a 1 in 31 in 3 to 1 in 2to 1 in 2 chance of earning an A or B in college (or being chance of earning an A or B in college (or being proficient on the next grade level test).proficient on the next grade level test).

““Not ProficientNot Proficient”” is now defined as having is now defined as having less than aless than a 1 in 31 in 3 chance of earning an A or B in college (or being chance of earning an A or B in college (or being proficient on the next grade level test).proficient on the next grade level test).

Cut Score VideoCut Score Video

http://www.mistreamnet.com/vidflv.php?who=resa121611http://www.mistreamnet.com/vidflv.php?who=resa121611

Impact of Cut Score Impact of Cut Score ChangesChanges

In the short term…In the short term… Fewer students will be deemed Fewer students will be deemed

“proficient” on state tests“proficient” on state tests This may result in some criticism of This may result in some criticism of

schools’ past efforts or previous schools’ past efforts or previous standardsstandards

New scores will more closely align New scores will more closely align with our local assessmentswith our local assessments

Impact of Cut Score ChangesImpact of Cut Score Changes

In the long term…In the long term…

Higher standards will likely result in Higher standards will likely result in improved achievement over timeimproved achievement over time

Michigan schools and students will be Michigan schools and students will be better prepared for transition to common better prepared for transition to common state standards and assessments, state standards and assessments, scheduled for implementation in 2014-15scheduled for implementation in 2014-15

Scale Score DistributionScale Score Distribution

Drops in proficiency may be Drops in proficiency may be attributed to how many students fall attributed to how many students fall in the “just made it” category. in the “just made it” category.

Those students who were proficient Those students who were proficient in previous years are now in previous years are now designated partially proficient.designated partially proficient.

State=62

State=36

3rd Grade MEAP 2005-06 - 2011-12 Old & New Cut Scores

95 95 94 94 9490

94 94 95 95 96 97 98 96

78 76 75 75 7771 71

53 5448

5652 53

46

0

10

20

30

40

50

60

70

80

90

100

05-06 06-07 07-08 08-09 09-10 10-11 11-12 05-06 06-07 07-08 08-09 09-10 10-11 11-12

Reading Math

Subject and Year

Per

cen

t P

rofi

cien

t

Farmington 3rd Old Farmington 3rd New

State=68

State=40

State=45

4th Grade MEAP 2005-06 - 2011-12 Old & New Cut Scores

93 93 92 92 89 90 92 91 93 93 93 95 95 94

71

59 59 58

79 77 75 75 76 75 77

5450 50

58 57 58

50

6155

0

10

20

30

40

50

60

70

80

90

100

05-06

06-07

07-08

08-09

09-10

10-11

11-12

05-06

06-07

07-08

08-09

09-10

10-11

11-12

05-06

06-07

07-08

08-09

09-10

10-11

11-12

Reading Math Writing

Subject and Year

Per

cen

t P

rofi

cien

t

Farmington 4th Old Farmington 4th New

The writing test changed, cut scores did not.

33rdrd Grade Math Old to New Cut Grade Math Old to New Cut ScoresScores

44thth Grade Math Old to New Cut Grade Math Old to New Cut ScoresScores

33rdrd Grade Reading Old to New Cut Scores Grade Reading Old to New Cut Scores

44thth Grade Reading Old to New Cut Scores Grade Reading Old to New Cut Scores

44thth Grade Writing – New Test Was Grade Writing – New Test Was Based on New Cut ScoresBased on New Cut Scores

55thth Grade Science Grade Science Old to New Cut Old to New Cut ScoresScores

Michigan AYP Targets for 2011-12 – Michigan AYP Targets for 2011-12 – Percent Proficient (Including Percent Proficient (Including

Subgroups)Subgroups)

GradeGrade ReadingReading MathematicsMathematics

3rd3rd 86%86% 83%83%

4th4th 85%85% 82%82%

5th5th 84%84% 81%81%

6th6th 83%83% 80%80%

7th7th 82%82% 78%78%

8th8th 82%82% 77%77%

11th11th 86%86% 78%78%

Projected Targets for Adequate Projected Targets for Adequate Yearly Progress (AYP)Yearly Progress (AYP)

Are the Annual Measurable Outcomes Are the Annual Measurable Outcomes ambitious ambitious enough?enough?

New cut scores - standard for New cut scores - standard for proficiency is much higher.proficiency is much higher.

Almost no school in Michigan is above Almost no school in Michigan is above 85% on the new cut scores.85% on the new cut scores.

((“Maybe not even one school“Maybe not even one school..” ” )) 85% is an interim goal; 100% is still the 85% is an interim goal; 100% is still the

ultimate goal.ultimate goal.Dr. Venessa Keesler, Office of Psychometrics, Dr. Venessa Keesler, Office of Psychometrics,

Accountability, Research and EvaluationAccountability, Research and Evaluation

What is the Future of Statewide Testing What is the Future of Statewide Testing in Michigan?in Michigan?

Michigan adopted the Common Core State Michigan adopted the Common Core State Standards in June 2010Standards in June 2010

These standards are shared with 43 statesThese standards are shared with 43 states The new end of year assessment will The new end of year assessment will

replace the MEAP/MME in the Spring of replace the MEAP/MME in the Spring of 20152015

There will be more changes both in the There will be more changes both in the administration (on-line) and reporting administration (on-line) and reporting (comparison (comparison acrossacross states) in the future states) in the future

Efforts to Meet New StandardsEfforts to Meet New Standards

Use of National Assessments Use of National Assessments aligned to standards for aligned to standards for monitoring progress and growthmonitoring progress and growth

Use Iowa Assessments along with Use Iowa Assessments along with ACT Explore and Plan as ACT Explore and Plan as predictors for College Readiness predictors for College Readiness to adjust instructionto adjust instruction

Efforts to Meet New Standards Efforts to Meet New Standards (continued)(continued)

Identification of students and Identification of students and areas for needed supportareas for needed support

Use of interventions for identified Use of interventions for identified studentsstudents

Professional development for staff Professional development for staff focusing on strategies identified in focusing on strategies identified in the school improvement processthe school improvement process

School Goals Summary on the Wiki School Goals Summary on the Wiki https://gillschool.wiki.farmington.k12.mi.us/https://gillschool.wiki.farmington.k12.mi.us/