Accountability ProgramsMICHIGAN SCHOOL TESTING CONFERENCEFEBRUARY 19, 2014
Outline
• Scorecard Summary and Overview
• 1% & 2% Cap Information for MI-Access and MEAP-Access, Respectively
• Full Academic Year and Feeder File Information
Getting to Know Scorecards
Accountability Scorecard Overview• Individual proficiency, graduation/attendance cells use three colors:
• Differentiated proficiency targets by content area (all five) for each school and district
• Attendance for schools that do not graduate students – whole school only. Target is 90% or improvement target
• Graduation cohort uses 4, 5, 6 year rate with 80% target or improvement target
2 1 0Target was Met Safe Harbor Target not Met
Details…• Individual participation, educator evaluations,
compliance factors use two colors:
• No points are earned for participation – red cells (<95%) directly affect the overall scorecard color as “audits”
• Educator Evaluations and Compliance Factors are worth an additional 5% each of proficiency points
Attain 85% or greater of possible points
Attain at least 70% but less than 85% of possible points
Attain at least 60% but less than 70% of possible points
Attain at least 50% but less than 60% of possible points
Attain less than 50% of possible points
Scorecard Color Ranges
Danger Zone – Audit Checks Ahead• Red cells present on the Scorecards will lower
the overall Scorecard color
• Red overall grad/attend/ed evals/compliance factors = overall scorecard no higher than yellow
• At least two content areas with less than 95% participation rate = red overall scorecard
Scorecards and Top-to-Bottom
• Each system can affect the other:
• Top to Bottom Scorecard– Priority = Red Scorecard
• Scorecard -> Top to Bottom– Red Scorecard will take away Reward label– Red Scorecard two consecutive years or three out
of last five years for participation = Priority label– Green Scorecard with at least 85% proficiency in
each subject and showing continuous improvement = Reward label
– Green Bottom 30% cells in all subjects and 75th percentile or higher on TTB = no Focus label
2012-13 School Scorecard Results
• Overall Color Counts for Building-Level:
Green = 93
Lime = 0
Yellow = 2598
Orange = 184
Red = 481
2012-13 Subgroup Results Analysis - Math
Subgroup Total Met Met %
Safe Harbor
Safe Harbor %
Total Met
Total Met %
Am. Indian/AK Nat.
27 22 81.5 1 3.7 23 85.2
Asian 173 170 98.3 0 0 170 98.3
Black/Af. Am.
893 519 58.1 32 3.6 551 61.7
Hispanic 327 268 82 5 1.5 273 83.5
Two or More 53 45 84.9 0 0 45 84.9
White 2561 2510
98 1 0 2511 98
SE 1333 443 33.2 107 8 550 41.3
ED 2683 2154
80.3 50 1.9 2204 82.1
EL 243 125 51.4 6 2.5 131 53.9
Bottom 30 2950 109 3.7 30 1 139 4.7
All Subgroups
11243 6365
56.6 232 2.1 6597 58.7
2012-13 Subgroup Results Analysis - Reading
Subgroup Total Met Met %
Safe Harbor
Safe Harbor %
Total Met
Total Met %
Am. Indian/AK Nat.
27 25 92.6 1 3.7 26 96.3
Asian 173 168 97.1 0 0 168 97.1
Black/Af. Am.
893 809 90.6 10 1.1 918 91.7
Hispanic 327 315 96.3 0 0 315 96.3
Two or More 54 53 98.1 0 0 53 98.1
White 2560 2513
98.2 2 0.1 2515 98.2
SE 1344 229 17 237 17.6 466 34.7
ED 2685 2532
94.3 18 0.7 2550 95
EL 243 157 64.6 22 9.1 179 73.7
Bottom 30 2951 564 19.1 254 8.6 818 27.7
All Subgroups
11257 7365
65.4 544 4.8 7909 70.3
Proficiency
• Students that are Full Academic Year (FAY) and “feed” to your school and district count toward proficiency.
• Scorecard proficiency includes proficient students (PL 1 & 2), provisionally proficient students (within 2 std. devs. of the std. error, and growth proficient students (PL change of I or SI)
Averaging & Safe Harbor
• Multiple years of data are averaged to help meet targets: 1, 2, or 3 years proficiency and participation data are considered
• Safe Harbor is currently met when meeting the state’s rate of improvement at the 80th percentile
– 350 buildings made Safe Harbor in at least one content area and subgroup
Participation
• All students included in the fall 2013 MSDS General Collection and Student Record Maintenance (SRM) files with an “as of date” on or before October 25, 2013 will count toward participation rates for the school/district.
Changes to Scorecard
• MDE and stakeholders are currently reviewing changes/proposals to scorecard policy revisions.
• Changes will be in ESEA Flex update to the USED late winter.
1% and 2% CapsMI-ACCESS & MEAP-ACCESS FOR SCORECARD USE
1% Cap and MI-Access• MEAP-Access has a 2% district cap for proficiency.
• MI-Access (all levels combined - FI, SI, P) has a separate 1% cap for proficiency with an additional 1% allowed if you have the 1% cap exception and appeal during the preliminary report cards window that it be applied.
• The % cap is calculated by the district’s total headcount enrollment in applicable tested grades, for each subject (each subject has a “separate” cap).
• Proficient tests scores above the cap are considered “not proficient” instead of being truly proficient as they otherwise would be.
• 1% Cap also DOES NOT impact Top-to-Bottom Ranking.
• All assessments contribute to the participation requirement– the cap DOES NOT impact participation.
2% Cap and MEAP-Access• MEAP-Access has a 2% district cap for
proficiency.
• The % cap is calculated by the district’s total headcount enrollment in applicable tested grades, for each subject (each subject has a “separate” cap).
• Proficient tests scores above the cap are considered “not proficient” instead of being truly proficient as they otherwise would be.
• All assessments contribute to the participation requirement– the cap DOES NOT impact participation.
2% Cap and MEAP-Access
• 2% Cap for MEAP-Access also DOES NOT impact Top-to-Bottom Ranking.
• 2% Cap for MEAP-Access is automatic and does not require a waiver application to use the full 2% like the 1% MI-Access cap.
• This should be the last year for the 2% cap since MEAP-Access will no longer be an assessment option.
1% Cap Exception Approved Districts
• List of Currently Approved Districts:– www.michigan.gov/baa-accountability– Under “Resources for Educators” section– Approved apps are good for 3 years– Districts must still appeal during summer preliminary
scorecard window for cap exception to be applied
• Within the next week, MDE will begin accepting 1% cap exception applications on the Secure Site. – Process used to be a paper application– Now fully electronic at:
https://baa.state.mi.us/BAASecure/
Full Academic Year and Feeder Schools
Feeder File Available Soon
• Within the next week, the “Student Feeder File” downloadable student data files on the Secure Site.– Available under the “Student Test Scores” section
where users download their other data files.
• Feeder files provide fall assessment information alongside fall MSDS collection data.
FAY & Feeder
• Full Academic Year (FAY) students are those that were present in the…– For Fall 2013 Assessment results:
• Fall 2012, Spring 2013, EOY 2013 Collections
• Feeder schools are the schools where the student was for those collections.
Feeder Student Files
• Provide FAY information for Fall 2013 students enrolled in your school.
• Provide Feeder School information for the Fall 2013 FAY students.
• Provide assessment results, like the other student data files.
Feeder Student Files
• Allow schools/districts to see FAY-Feeder student proficiency.– “True” Proficiency
• PLs 1 & 2
– Growth Proficiency • Improved and Signif. Improved Students• Math and Reading ONLY
– Provisional Proficiency • Students who scored within 2 standard errors of the
cut score for the grade level and content.
Contact Information
• Matt Gleason & Alex Schwarz
• 877-560-8378
Recommended
