View
215
Download
0
Tags:
Embed Size (px)
Citation preview
Testing Students with DisabilitiesTesting Students with Disabilities
Special Education Special Education AdministratorsAdministrators
Spring ConferenceSpring ConferenceMarch 24, 2011March 24, 2011
Top 10 Testing Quotes from 2010Top 10 Testing Quotes from 2010
10.10. “Johnny broke his wrist last night. Can he use “Johnny broke his wrist last night. Can he use dictation for the writing test?”dictation for the writing test?”
9.9. “We didn’t like the way the man was signing on the “We didn’t like the way the man was signing on the DVD, so we just turned it off and signed it ourselves.”DVD, so we just turned it off and signed it ourselves.”
8. 8. “The CD-ROMs didn’t read all of the answer choices, “The CD-ROMs didn’t read all of the answer choices, so the TA read them to the student.”so the TA read them to the student.”
7.7. “I thought cueing meant that I could rephrase the “I thought cueing meant that I could rephrase the questions.”questions.”
6.6. “ We ran out of CD-ROMs, so we just read all of the “ We ran out of CD-ROMs, so we just read all of the questions and all of the answers to the student.”questions and all of the answers to the student.”
Top 10 Testing Quotes (cont.)Top 10 Testing Quotes (cont.)
5.5. “She refused to spell every third word in her writing “She refused to spell every third word in her writing composition.”composition.”
4.4. “The teacher let them use the computer for the writing “The teacher let them use the computer for the writing test and forgot to disable spell-check.”test and forgot to disable spell-check.”
3.3. “ We didn’t order test booklets for the students using “ We didn’t order test booklets for the students using CD-ROMs.”CD-ROMs.”
2.2. ““They were not supposed to get an oral They were not supposed to get an oral administration, but the teacher read it to them administration, but the teacher read it to them anyway.”anyway.”
11.. “He was supposed to get an oral administration, “He was supposed to get an oral administration, but we forgot!”but we forgot!”
Test Security ViolationsTest Security Violations
60 to 70 percent of all test security 60 to 70 percent of all test security violations relate to testing students violations relate to testing students with disabilities.with disabilities.
Accommodations ManualAccommodations Manual
The five-step process :The five-step process :
STEP 1: Expect students with disabilities to achieve STEP 1: Expect students with disabilities to achieve grade-level academic content standardsgrade-level academic content standards
STEP 2: Learn about accommodations for instruction STEP 2: Learn about accommodations for instruction and assessmentand assessment
STEP 3: Select accommodations for instruction and STEP 3: Select accommodations for instruction and assessment for individual studentsassessment for individual students
STEP 4: Administer accommodations for instruction STEP 4: Administer accommodations for instruction and assessmentand assessment
STEP 5: Evaluate and improve use of accommodationsSTEP 5: Evaluate and improve use of accommodations
Accommodations ManualAccommodations Manual
http://ed.sc.gov/agency/Accountability/Assessment/old/assessment/programs/amc/documents/AccomManualJan11.pdf
Accommodations Selection Process Accommodations Selection Process (AccSelPro)(AccSelPro)
A research-based Web A research-based Web tool designed by the tool designed by the SCDE through the AVAAD Enhanced SCDE through the AVAAD Enhanced Assessment Grant to assist IEP and 504 plan Assessment Grant to assist IEP and 504 plan teams with making appropriate decisions teams with making appropriate decisions regarding individual student regarding individual student accommodations.accommodations.
www.accselpro.org
Test Administration ManualsTest Administration Manuals
Appendix C: Appendix C: Testing Students with DisabilitiesTesting Students with Disabilities
Appendix D: Appendix D: ESOL/LEP StudentsESOL/LEP Students
http://ed.sc.gov/agency/Accountability/Assessment/
Customized MaterialsCustomized Materials
Order customized materials including oral Order customized materials including oral administration CDs and any scripts for a administration CDs and any scripts for a specific student through pre-code.specific student through pre-code.
Order oral administration scripts per test Order oral administration scripts per test administrator through on-line enrollment.administrator through on-line enrollment.
Alternate Assessments on Alternate Assessments on Alternate Achievement Alternate Achievement Standards (AA-AAS)Standards (AA-AAS)
1% Assessments –1% Assessments –
No more than one percent of all No more than one percent of all students assessed can be counted as students assessed can be counted as proficient for AYP on AA-AASproficient for AYP on AA-AAS..
SC-Alt is the state assessment on SC-Alt is the state assessment on alternate achievement standards.alternate achievement standards.
Alternate Assessment on Alternate Assessment on Modified Achievement Modified Achievement Standards (AA-MAS)Standards (AA-MAS)
2% Assessments-2% Assessments-
No more than two percent of all No more than two percent of all students assessed can be counted students assessed can be counted as proficient as proficient for AYP on AA-MAS.for AYP on AA-MAS.
Use of Accommodations and Use of Accommodations and Performance of Students with Performance of Students with
Disabilities on PASS 2010Disabilities on PASS 2010
Participation of Students with Participation of Students with Disabilities in Statewide TestingDisabilities in Statewide Testing
43,257 students with disabilities (SWD) were 43,257 students with disabilities (SWD) were tested in grades 3-8 in 2010 (includes PASS tested in grades 3-8 in 2010 (includes PASS and SC-Alt students)and SC-Alt students)
SWD made up 13.4% of all students tested in SWD made up 13.4% of all students tested in grades 3-8grades 3-8
6.0% of SWD were tested with SC-Alt6.0% of SWD were tested with SC-Alt
The number of students tested with SC-Alt The number of students tested with SC-Alt was 0.8% of all students tested with PASS and was 0.8% of all students tested with PASS and SC-Alt (SWD and Non-SWD)SC-Alt (SWD and Non-SWD)
Standard AccommodationsStandard AccommodationsAll Content Areas Grades 3-8 with Exceptions NotedAll Content Areas Grades 3-8 with Exceptions Noted
SettingSetting TimingTiming SchedulingScheduling Oral or Signed AdministrationOral or Signed Administration
(except ELA grades 3-4)(except ELA grades 3-4) Use of calculator with Math Use of calculator with Math
(except grades 3-4)(except grades 3-4) Response OptionsResponse Options Supplementary Materials or DevicesSupplementary Materials or Devices
Non-Standard AccommodationsNon-Standard Accommodations
Oral Administration of ELAOral Administration of ELA Grades 3-4Grades 3-4
Writing Extended Response –Non-standard Writing Extended Response –Non-standard ProceduresProcedures
Use of spell check, grammar check, Use of spell check, grammar check,
word prediction software word prediction software
Use of calculator in mathUse of calculator in math Grades 3-4Grades 3-4
Use of Accommodations with PASS 2010Use of Accommodations with PASS 2010
Content Content AreaArea
Percent of SWD Students Using:Percent of SWD Students Using:
Any Any Accom.Accom.
Oral/Oral/
Signed Signed AdminAdmin
CalculatorCalculatorNon-Non-Standard Standard AccomAccom
ELAELA 61.961.9 24.924.9 1.41.4
WritingWriting 61.661.6 40.840.8 0.10.1
MathMath 63.963.9 49.549.5 14.414.4 0.10.1
ScienceScience 62.062.0 49.549.5
Social Social StudiesStudies
61.661.6 49.449.4
Six-year Trends for Oral Administration Six-year Trends for Oral Administration of ELA and Calculator Use with of ELA and Calculator Use with
PACT/PASSPACT/PASS
Oral AdministrationOral Administration
20.0% in 2005 26.3% 20.0% in 2005 26.3% in 2006in 2006
26.2% in 200726.2% in 2007
26.6% in 200826.6% in 2008
30.7% in 200930.7% in 2009
24.9% in 201024.9% in 2010
Calculator Use Calculator Use
8.6% in 20058.6% in 2005
11.7% in 200611.7% in 2006
14.3% in 200714.3% in 2007
15.7% in 200815.7% in 2008
15.0% in 2009 15.0% in 2009 14.4% in 201014.4% in 2010
Use of Oral Administration with ELAUse of Oral Administration with ELA
24.9% of all SWD students received oral 24.9% of all SWD students received oral administrations for PASS ELA in 2010.administrations for PASS ELA in 2010.
Oral administrations were predominantly in Oral administrations were predominantly in grades 5-8 where they are standard grades 5-8 where they are standard accommodations.accommodations.
The overall rate of oral administrations for The overall rate of oral administrations for grades 5-8 was 37.2%.grades 5-8 was 37.2%.
Percent of SWD ReceivingPercent of SWD ReceivingOral Administration of ELA by GradeOral Administration of ELA by Grade
2008-20102008-2010
20
30.130.2
26.223.2
31.3
37.734.8
24.9
36.8
30.3
22.2
40.637.138.7
32.7
43.6
0
10
20
30
40
50
60
70
80
Gr 3 Gr 4 Gr 5 Gr 6 Gr 7 Gr 8
Per
cent
of
Stud
ents
200820092010
Rates of Oral AdministrationRates of Oral Administrationby Disability Groupsby Disability Groups
By disability group percentage, students By disability group percentage, students with mild and moderate cognitive disability with mild and moderate cognitive disability had the largest oral administration rateshad the largest oral administration rates
(53 – 65%).(53 – 65%).
Used by 29% of students with learning Used by 29% of students with learning disabilities, and being the largest disability disabilities, and being the largest disability group, made up approximately 70% of all group, made up approximately 70% of all students receiving oral administrations.students receiving oral administrations.
ELA Performance of SWD TestedELA Performance of SWD Tested
With and Without Oral Administration (OA)With and Without Oral Administration (OA)
60.4
12.6
2719.9
2.9
77.3
0
10
20
30
40
50
60
70
80
90
100
Not Met Met Exemplary
Per
cent
of
Stud
ents
Without OAWith OA
Use of Calculators with PASSUse of Calculators with PASS
14.4% of all SWD used a calculator with 14.4% of all SWD used a calculator with PASS mathematicsPASS mathematics
Calculator administrations were Calculator administrations were predominantly in grades 5-8 where they are predominantly in grades 5-8 where they are standard accommodationsstandard accommodations
The overall rate ofThe overall rate of calculatorcalculator administrations for grades 5-8 was 22.5%administrations for grades 5-8 was 22.5%
Percent of SWDPercent of SWDUsing Calculator AdministrationsUsing Calculator Administrations
by Grade 2008-2010by Grade 2008-2010
3.8
30.7
26.4
95.9
21.3
30.528.6
4.7
19.8
8.1
2.5
32.2
20.3
10.6
0.3 0.4
28.3
0
10
20
30
40
50
60
70
80
Gr 3 Gr 4 Gr 5 Gr 6 Gr 7 Gr 8
Per
cent
of
Stud
ents
200820092010
Rates of Calculator Use by Disability Rates of Calculator Use by Disability GroupsGroups
By disability group percentage, students By disability group percentage, students with mild and moderate cognitive disability with mild and moderate cognitive disability and students with traumatic brain injury and students with traumatic brain injury had the largest calculator use rateshad the largest calculator use rates(19 – 25%).(19 – 25%).
Used by 16% of students with learning Used by 16% of students with learning disabilities, and being the largest disability disabilities, and being the largest disability group, made up approximately 68% of all group, made up approximately 68% of all students receiving calculator students receiving calculator administrations.administrations.
Math Performance of SWDMath Performance of SWD
Tested With and Without CalculatorsTested With and Without Calculators
65.3
9.1
25.5
10.9
0.7
88.5
0
10
20
30
40
50
60
70
80
90
100
Not Met Met Exemplary
Per
cent
of
Stud
ents
Without With
South CarolinaSouth CarolinaAccountability WorkbookAccountability Workbook
Link for information on AYP inclusion:Link for information on AYP inclusion:
See Critical Element 5.3See Critical Element 5.3
http://ed.sc.gov/agency/Accountability/Federal-and-State-Accountability/old/fp/title_i/documents/SCAccountabilityPlanJune92010.pdf
Including Students with Disabilities Including Students with Disabilities in NAEPin NAEP
To Help Ensure Validity of ResultsTo Help Ensure Validity of Results
OverviewOverview
National Assessment of Educational Progress National Assessment of Educational Progress Only ongoing nationwide assessment Only ongoing nationwide assessment Representative sample across statesRepresentative sample across states State- and national-level resultsState- and national-level results
State grades 4 and 8State grades 4 and 8 National-grades 4, 8, and 12National-grades 4, 8, and 12
Valid cross-state comparisonsValid cross-state comparisons
Overview (continued)Overview (continued)
Designed primarily to provide data to Designed primarily to provide data to state- and national-level policy makersstate- and national-level policy makers
With passage of ESEA/NCLB, state’s With passage of ESEA/NCLB, state’s participation became requiredparticipation became required
The National Center for Education The National Center for Education Statistics (NCES) in the U.S. Department Statistics (NCES) in the U.S. Department of Education is responsible for NAEP of Education is responsible for NAEP implementationimplementation
NAEP policy is set by the National NAEP policy is set by the National Assessment Governing Board (NAGB)Assessment Governing Board (NAGB)
New NAEP Inclusion PolicyNew NAEP Inclusion Policy
New policy becomes effective with NAEP New policy becomes effective with NAEP 20132013
Focus on states’ inclusion of students with Focus on states’ inclusion of students with disabilities (SD) and English language disabilities (SD) and English language learners (ELLs) learners (ELLs)
As a percentage of total population, total As a percentage of total population, total excluded (SD/ELL) should not be more than excluded (SD/ELL) should not be more than 5%. 5%.
As a percentage of the identified group, As a percentage of the identified group, excluded should not exceed 15%.excluded should not exceed 15%.
Recent Exclusion Rates: NAEP 2009Recent Exclusion Rates: NAEP 2009
ExcludedExcluded
Subject Subject GradeGrade % of Total% of Total% of SD % of SD GroupGroup
MathematicsMathematics 44 2.02.0 12.212.2
MathematicsMathematics 88 4.44.4 31.931.9
ReadingReading 44 5.35.3 31.131.1
ReadingReading 88 6.46.4 42.442.4
Inclusion Rates: State vs. NationalInclusion Rates: State vs. National
0102030405060708090
100
Math Reading Math Reading
4 8
Per
cent
Incl
uded
South Carolina
National Public
(2009 NAEP Data)
Increasing InclusionIncreasing Inclusion
NAEP participation is now addressed in the NAEP participation is now addressed in the online IEP tool.online IEP tool.
– –Other key points– Other key points– NAEP provides most accommodations NAEP provides most accommodations
typically offered on state tests.typically offered on state tests. Federal law requires that schools notify Federal law requires that schools notify
parents of their child’s selection.parents of their child’s selection. No student-level scores reported. Results No student-level scores reported. Results
only reported for the nation, states, and only reported for the nation, states, and groups within states.groups within states.
Contact InformationContact Information
Suzanne SwaffieldAccommodations
and SC-Alt
Douglas AlexanderSC-Alt
Chris Webster NAEP