Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
D-225
• • • •••
D Nebraska Drough the School-based Teacher-led Assessment and Reporting System(STARS), Nebraska administers exams in grades 4 and 8 in reading andmathematics. Nebraska alternates reading and mathematics exams by the
year: the state tested reading in 2001 and 2003 and mathematics in 2000 and 2002.The scores available for this report do not include any breakdowns by race/ethnicityor poverty status. Nebraska uses one achievement level for reporting purposes:meeting the standard. Because Nebraska alternates reading and mathematics tests,trend graphs for Nebraska are not included in this report. School-level assessmentscores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 127 schools in grade 4 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading performance standard (meeting) isbelow the NAEP basic level. The state’s primary grade 8 reading performancestandard (meeting) is close to the NAEP basic level.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps in reading ingrades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Read Volume 2.book Page 225 Wednesday, March 12, 2008 5:19 PM
Achievement
D-226 National Assessment of Educational Progress
• • • •••
NEBRASKA
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.46 0.042 0.42 0.023
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••
••••••••••••••••••
•••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advancedmeeting
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
Read Volume 2.book Page 226 Wednesday, March 12, 2008 5:19 PM
NEBRASKA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-227
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — 20.6 20.1 — 16.6 17.7
English language learner — 3.0 3.2 — 2.9 2.1Student with disability — 16.2 15.6 — 12.9 14.7Both — 1.4 1.3 — 0.8 0.9
Excluded — 5.4 5.0 — 6.9 5.0English language learner — 0.9 0.8 — 2.0 1.0Student with disability — 3.8 3.4 — 4.4 3.5Both — 0.6 0.7 — 0.5 0.5
Accommodated — 6.3 5.8 — 2.3 4.5English language learner — 0.4 0.3 — 0.1 0.2Student with disability — 5.8 5.2 — 2.2 4.2Both — 0.1 0.3 — 0.1 0.1
Read Volume 2.book Page 227 Wednesday, March 12, 2008 5:19 PM
Read Volume 2.book Page 228 Wednesday, March 12, 2008 5:19 PM
D-229
• • • •••
D Nevada Devada administers the Iowa Tests of Basic Skills (ITBS) in grades 4 and 7 inreading and mathematics. Scores are available for Hispanic, Black, andeconomically disadvantaged students. Nevada uses four achievement levels
for reporting purposes: Level 1 (below the standard), Level 2 (approaching the standard),Level 3 (meeting the standard), and Level 4 (exceeding the standard). Before 2003, whenthe ITBS was implemented, students took the TerraNova, and scores were reportedby percentile rank only. Because of this switch in tests, direct comparisons cannot bemade between ITBS scores from 2003 and TerraNova scores from previous years.Therefore, trend graphs are not included in this report. School-level assessmentscores based on 10 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 4 and 63 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading performance standard ((3) meeting)is close to the NAEP basic level. The state’s primary grade 7 reading performancestandard ((3) meeting) is between the NAEP basic and proficient levels.
• Trends. No comparisons were possible for grades 4 and 7.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White gap in reading in grades 4 and 7 in2003. The Hispanic-White gap in grade 4 in percent meeting the state’s standard inreading in 2003 was smaller when measured by NAEP compared to the stateassessment. There were no significant differences between NAEP and the stateassessment in measurement of the Hispanic-White gap in grade 7 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the poverty gap in reading in grade 4 in 2003. Overall, the povertygap in grade 7 in percent meeting the state’s standard in reading in 2003 wassmaller when measured by NAEP compared to the state assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
N
Read Volume 2.book Page 229 Wednesday, March 12, 2008 5:19 PM
Achievement
D-230 National Assessment of Educational Progress
• • • •••
NEVADA
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8 (state 7th grade standards)
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorApproaching:2 0.80 0.032 0.78 0.029Meeting:3 0.86 0.021 0.78 0.016Exceeding:4 0.83 0.024 0.77 0.024
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••
•••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
exceeding
meeting
approaching
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••
•••••••••••••
••••••••••••••••••••
•••••••••
••••••••••••••••••
••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
approaching
meeting
exceeding
Read Volume 2.book Page 230 Wednesday, March 12, 2008 5:19 PM
NEVADA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-231
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 19.6 26.9 25.7 15.3 20.0 17.6
English language learner 9.8 14.7 12.7 5.4 7.1 5.4Student with disability 9.2 9.3 9.8 9.2 10.6 10.3Both 0.7 2.9 3.2 0.7 2.4 1.9
Excluded 11.0 10.3 8.3 5.8 6.0 3.5English language learner 5.5 5.0 3.5 2.0 2.0 1.3Student with disability 4.9 3.4 3.3 3.4 2.8 1.6Both 0.6 1.8 1.5 0.5 1.3 0.6
Accommodated 1.1 3.0 4.6 1.8 2.0 5.4English language learner 0.4 0.9 1.1 0.4 0.0 0.5Student with disability 0.6 1.8 3.1 1.4 1.8 4.2Both 0.1 0.4 0.4 0.0 0.1 0.7
Read Volume 2.book Page 231 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-232 National Assessment of Educational Progress
• • • •••
NEVADA
Figure 2. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 3.3
Lower half -0.5
Upper half 6.2
Lower quarter -3.4
Middle half 0.0
Upper quarter 8.1
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 232 Wednesday, March 12, 2008 5:19 PM
NEVADA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-233
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
NOTE: State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.5
Lower half 0.2
Upper half -0.8
Lower quarter -0.5
Middle half -1.1
Upper quarter -3.4
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 233 Wednesday, March 12, 2008 5:19 PM
Hispanic-White Gap
D-234 National Assessment of Educational Progress
• • • •••
NEVADA
Figure 5. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 7.5*
Lower half 8.8*
Upper half 7.1
Lower quarter 8.0*
Middle half 8.9*
Upper quarter 3.2
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 234 Wednesday, March 12, 2008 5:19 PM
NEVADA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-235
• • • •••
Figure 6. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
NOTE: State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 1.9
Lower half -0.6
Upper half 4.5
Lower quarter -2.8
Middle half 1.3
Upper quarter 4.6
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 235 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-236 National Assessment of Educational Progress
• • • •••
NEVADA
Figure 7. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 2.8
Lower half 4.1
Upper half 1.6
Lower quarter 5.6
Middle half 3.3
Upper quarter -1.3
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 236 Wednesday, March 12, 2008 5:19 PM
NEVADA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-237
• • • •••
Figure 8. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 5.3*
Lower half 1.3
Upper half 9.7*
Lower quarter -1.1
Middle half 5.0*
Upper quarter 11.0*
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 237 Wednesday, March 12, 2008 5:19 PM
Read Volume 2.book Page 238 Wednesday, March 12, 2008 5:19 PM
D-239
• • • •••
D New Hampshire Dhrough the New Hampshire Educational Improvement and AssessmentProgram (NHEIAP), the state administers exams in grades 3, 6, and 10 inEnglish language arts and mathematics. Scores are available for economically
disadvantaged students; however, note that the percentage of Black studentsrepresented is below two-thirds of the population in Grade 4 (59%). New Hampshireuses four achievement levels for reporting purposes: novice, basic, proficient, andadvanced. State assessment data and comparisons based upon those data are notdisplayed for grade 8 because New Hampshire does not test grade 8. School-levelassessment scores based on 10 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 3 and 0 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 3 reading performance standard (basic) is closeto the NAEP basic level. There are insufficient data for comparing state standardsto NAEP for grade 8.
• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent basic between 1998 and 2003. No comparisons werepossible for grade 8.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in reading in grades 3and 8 in 2003. Overall, there were no significant differences between NAEP andthe state assessment in measurement of the poverty gap in reading in grade 3 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the poverty gap in reading in grade 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Read Volume 2.book Page 239 Wednesday, March 12, 2008 5:19 PM
Achievement
D-240 National Assessment of Educational Progress
• • • •••
NEW HAMPSHIRE
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4 (state 3rd grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
— Not available.† Not applicable.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 3 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.61 0.029 — †Proficient 0.49 0.035 — †Advanced 0.21 0.108 — †
• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••
•••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
advanced
proficient
basic
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••••
••••••••••••••••••••••••
••••••••••
•••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
Read Volume 2.book Page 240 Wednesday, March 12, 2008 5:19 PM
NEW HAMPSHIRE D
Comparison between NAEP and State Reading Assessment Results: 2003 D-241
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes ingrade 4 percent meeting reading standards: 1998, 2002, and 2003
Grade 4 (state grade 3)
* NAEP and state assessment 1998-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting grade 3 reading standards as reported by state:1998, 2002, and 2003
— Not available.
SOURCE: NH Dept. of Education retrieved from http://www.ed.state.nh.us/Assessment/HistoricalDataGR03.xls.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 14.2 — 19.0 — — 19.0
English language learner 0.9 — 2.1 — — 1.2Student with disability 13.2 — 16.1 — — 17.3Both 0.1 — 0.7 — — 0.6
Excluded 3.3 — 3.9 — — 3.2English language learner 0.3 — 0.6 — — 0.4Student with disability 2.9 — 3.1 — — 2.8Both 0.1 — 0.2 — — 0.1
Accommodated 5.0 — 10.3 — — 9.4English language learner 0.0 — 0.4 — — 0.2Student with disability 5.0 — 9.5 — — 8.7Both 0.0 — 0.4 — — 0.4
Level 1998 2002 2003Grade 3 34.0 — 37.0
72 72 72
36 38
39
8
9
10
72
75 77
3637
38
8
8
7
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
**
basic
proficient
advanced
Read Volume 2.book Page 241 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-242 National Assessment of Educational Progress
• • • •••
NEW HAMPSHIRE
Figure 3. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 3.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.0
Lower half -9.4
Upper half -0.8
Lower quarter -10.9
Middle half -4.5
Upper quarter -1.4
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 242 Wednesday, March 12, 2008 5:19 PM
D-243
• • • •••
D New Jersey Dhe state administers the New Jersey Assessment of Skills and Knowledge (NJASK) in grade 4 in English language arts and mathematics and the GradeEight Proficiency Assessment (GEPA) in English language arts and
mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students. New Jersey uses three achievement levels for reportingpurposes: partially proficient, proficient, and advanced proficient. Before 2003, when theNJ ASK was implemented, grade 4 students took the Elementary School ProficiencyAssessment (ESPA). Trend graphs are not included because New Jersey did notparticipate in State NAEP prior to 2003. School-level assessment scores based on 10or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 4 and 107 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading performance standard (proficient) isbelow the NAEP basic level. The state’s primary grade 8 reading performancestandard (proficient) is between the NAEP basic and proficient levels.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White, Hispanic-White, and poverty gapsin reading in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Read Volume 2.book Page 243 Wednesday, March 12, 2008 5:19 PM
Achievement
D-244 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.84 0.012 0.85 0.018Advanced 0.57 0.063 0.59 0.020
••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••
••••••••••
••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
advanced
proficient
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••
••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
proficient
advanced
Read Volume 2.book Page 244 Wednesday, March 12, 2008 5:19 PM
NEW JERSEY D
Comparison between NAEP and State Reading Assessment Results: 2003 D-245
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — — 16.6 — — 17.5
English language learner — — 3.5 — — 2.1Student with disability — — 12.5 — — 15.1Both — — 0.6 — — 0.3
Excluded — — 4.9 — — 2.9English language learner — — 1.6 — — 0.7Student with disability — — 3.0 — — 2.1Both — — 0.4 — — 0.1
Accommodated — — 9.7 — — 11.8English language learner — — 1.2 — — 1.0Student with disability — — 8.2 — — 10.6Both — — 0.2 — — 0.2
Read Volume 2.book Page 245 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-246 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 2. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.6
Lower half -4.6
Upper half -2.0
Lower quarter -1.9
Middle half -5.1
Upper quarter 0.3
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 246 Wednesday, March 12, 2008 5:19 PM
NEW JERSEY D
Comparison between NAEP and State Reading Assessment Results: 2003 D-247
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 4.5
Lower half 5.2
Upper half 4.5
Lower quarter 3.3
Middle half 7.5
Upper quarter 0.7
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 247 Wednesday, March 12, 2008 5:19 PM
Hispanic-White Gap
D-248 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 4. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.7
Lower half -6.2
Upper half 0.3
Lower quarter -7.8
Middle half -2.5
Upper quarter 0.2
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 248 Wednesday, March 12, 2008 5:19 PM
NEW JERSEY D
Comparison between NAEP and State Reading Assessment Results: 2003 D-249
• • • •••
Figure 5. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.5
Lower half 2.3
Upper half -5.2
Lower quarter 5.0
Middle half -2.6
Upper quarter -3.6
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 249 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-250 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 6. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.3
Lower half -3.8
Upper half -3.9
Lower quarter 0.2
Middle half -3.9
Upper quarter -2.6
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 250 Wednesday, March 12, 2008 5:19 PM
NEW JERSEY D
Comparison between NAEP and State Reading Assessment Results: 2003 D-251
• • • •••
Figure 7. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 2.2
Lower half 1.3
Upper half 4.8
Lower quarter -1.2
Middle half 5.0
Upper quarter 2.8
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 251 Wednesday, March 12, 2008 5:19 PM
Read Volume 2.book Page 252 Wednesday, March 12, 2008 5:19 PM
D-253
• • • •••
D New Mexico Dew Mexico administers the TerraNova in grades 3-9 in English language artsand mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Black students to provide a
reliable comparison. New Mexico uses four quartiles for reporting purposes. Becausethere are no data available for 1998 and 2002, trend graphs are not included in thisreport. School-level assessment scores based on 4 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 89 schools in grade 4 and 68 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading performance standard (top half) isclose to the NAEP basic level. The state’s primary grade 8 reading performancestandard (top half) is between the NAEP basic and proficient levels.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White gap in reading in grades 4 and 8 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the Hispanic-White and poverty gaps in reading in grades 4 and 8in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
N
Read Volume 2.book Page 253 Wednesday, March 12, 2008 5:19 PM
Achievement
D-254 National Assessment of Educational Progress
• • • •••
NEW MEXICO
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorTop 75% 0.67 0.035 0.57 0.023Top half 0.80 0.027 0.65 0.032Top 25% 0.79 0.021 0.67 0.038
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••
•••••••••••••••••••••••••••••
••••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
top 25%
top half
top 75%
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••
••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
top 75%
top half
top 25%
Read Volume 2.book Page 254 Wednesday, March 12, 2008 5:19 PM
NEW MEXICO D
Comparison between NAEP and State Reading Assessment Results: 2003 D-255
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 27.8 37.2 40.7 22.3 30.8 31.2
English language learner 13.5 21.9 22.3 7.0 12.4 12.0Student with disability 12.1 9.7 11.2 13.3 11.0 12.4Both 2.2 5.6 7.2 1.9 7.4 6.8
Excluded 9.4 10.1 7.6 8.3 8.3 8.0English language learner 2.2 3.5 3.1 3.0 1.7 3.3Student with disability 5.7 3.6 2.4 4.4 3.3 2.8Both 1.5 2.9 2.0 0.9 3.2 1.9
Accommodated 2.3 4.4 10.1 3.2 5.5 8.9English language learner 0.6 1.2 3.3 0.3 0.3 1.0Student with disability 1.6 2.7 4.4 2.5 3.8 5.1Both 0.1 0.6 2.3 0.4 1.4 2.8
Read Volume 2.book Page 255 Wednesday, March 12, 2008 5:19 PM
Hispanic-White Gap
D-256 National Assessment of Educational Progress
• • • •••
NEW MEXICO
Figure 2. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.3
Lower half -2.0
Upper half 1.1
Lower quarter -1.8
Middle half -2.0
Upper quarter 1.7
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 256 Wednesday, March 12, 2008 5:19 PM
NEW MEXICO D
Comparison between NAEP and State Reading Assessment Results: 2003 D-257
• • • •••
Figure 3. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.1
Lower half -3.0
Upper half -3.8
Lower quarter 1.2
Middle half -5.3
Upper quarter -2.3
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 257 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-258 National Assessment of Educational Progress
• • • •••
NEW MEXICO
Figure 4. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 0.1
Lower half 0.2
Upper half 0.7
Lower quarter -0.9
Middle half 0.5
Upper quarter -0.4
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 258 Wednesday, March 12, 2008 5:19 PM
NEW MEXICO D
Comparison between NAEP and State Reading Assessment Results: 2003 D-259
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.3
Lower half -0.5
Upper half -2.8
Lower quarter 2.4
Middle half -3.0
Upper quarter 0.9
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 259 Wednesday, March 12, 2008 5:19 PM
Read Volume 2.book Page 260 Wednesday, March 12, 2008 5:19 PM
D-261
• • • •••
D New York Dew York administers exams in grades 4 and 8 in English language arts andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students; however, note that the percentage of disadvantaged
students represented is below two-thirds of the population in Grade 4 (63%). NewYork uses four achievement levels for reporting purposes: Step 1, Level 2 (needs help),Level 3 (meets expectations), and Level 4 (exceeds expectations). The total populationassessment scores based on 4 or fewer students are suppressed; disaggregated datasuppression rules vary from school to school.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 141 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading performance standard (meeting) isclose to the NAEP basic level. The state’s primary grade 8 reading performancestandard (meeting) is between the NAEP basic and proficient levels.
• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent meeting between 2002 and 2003.
• Gaps. Overall, the Black-White gap in grades 4 and 8 in percent meeting thestate’s standard in reading in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White andpoverty gaps in reading in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
N
Read Volume 2.book Page 261 Wednesday, March 12, 2008 5:19 PM
Achievement
D-262 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeed Help 0.66 0.023 0.69 0.025Meeting 0.83 0.003 0.80 0.015Exceeding 0.74 0.021 0.53 0.047
••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••
••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
exceeding
meeting
need help
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
••••••••••••••••••••••••••
••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
need help
meeting
exceeding
Read Volume 2.book Page 262 Wednesday, March 12, 2008 5:19 PM
NEW YORK D
Comparison between NAEP and State Reading Assessment Results: 2003 D-263
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting reading standards, by grade: 1998, 2002, and 2003
Grade 4 Grade 8
* NAEP and state assessment 2002-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting grades 4 and 8 reading standards as reported bystate: 1998, 2002, and 2003
— Not available.
SOURCE: New York State Department of Education retrieved fromhttp://www.emsc.nysed.gov/repcrd2003/statewide/total-public-overview.htm.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 14.3 17.6 19.2 15.5 20.0 18.6
English language learner 4.8 3.9 5.4 5.2 4.8 3.8Student with disability 9.1 11.8 12.3 9.8 13.7 13.2Both 0.3 1.9 1.5 0.5 1.6 1.5
Excluded 7.4 8.2 8.0 7.6 9.4 6.6English language learner 3.5 2.0 2.9 3.6 1.8 1.6Student with disability 3.7 4.9 4.5 3.5 6.6 4.5Both 0.2 1.3 0.6 0.4 1.0 0.6
Accommodated 4.2 6.1 8.4 3.9 7.1 9.4English language learner 0.0 0.8 1.2 0.0 1.2 1.2Student with disability 4.2 4.9 6.5 3.9 5.5 7.4Both 0.0 0.3 0.8 0.0 0.4 0.7
Level 1998 2002 2003Grade 4 — 62.0 64.0Grade 8 — 44.0 45.0
92 93
62 62
21 19
9294
6264
2121
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP needhelp
meeting
exceeding
94 92
4345
9
12
94 92
43
47
98
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*
needhelp
meeting
exceeding
Read Volume 2.book Page 263 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-264 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -10.3*
Lower half -10.4*
Upper half -9.3*
Lower quarter -7.6
Middle half -12.8*
Upper quarter -4.9
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 264 Wednesday, March 12, 2008 5:19 PM
NEW YORK D
Comparison between NAEP and State Reading Assessment Results: 2003 D-265
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 4 reading standards: 2002 and 2003
State NAEP
Gap improvement
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.4
Lower half -0.9
Upper half -5.4
Lower quarter 7.0
Middle half -4.1
Upper quarter -0.6
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 265 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-266 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 5. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -9.9*
Lower half -9.8*
Upper half -8.5*
Lower quarter -6.6
Middle half -8.2*
Upper quarter -13.5*
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 266 Wednesday, March 12, 2008 5:19 PM
NEW YORK D
Comparison between NAEP and State Reading Assessment Results: 2003 D-267
• • • •••
Figure 6. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 8 reading standards: 2002 and 2003
State NAEP
Gap improvement
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.5
Lower half -3.5
Upper half 0.7
Lower quarter -4.7
Middle half -1.0
Upper quarter -12.9
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 267 Wednesday, March 12, 2008 5:19 PM
Hispanic-White Gap
D-268 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 7. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.1
Lower half -6.2
Upper half -5.1
Lower quarter -5.4
Middle half -8.7
Upper quarter -2.2
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 268 Wednesday, March 12, 2008 5:19 PM
NEW YORK D
Comparison between NAEP and State Reading Assessment Results: 2003 D-269
• • • •••
Figure 8. Comparison of NAEP and state assessment Hispanic-White gapchanges in percent meeting grade 4 reading standards: 2002 and 2003
State NAEP
Gap improvement
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.3
Lower half -6.0
Upper half -6.0
Lower quarter -1.3
Middle half -11.1
Upper quarter -5.7
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 269 Wednesday, March 12, 2008 5:19 PM
Hispanic-White Gap
D-270 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 9. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.0
Lower half -7.6*
Upper half 0.2
Lower quarter -5.8
Middle half -5.7
Upper quarter -2.2
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 270 Wednesday, March 12, 2008 5:19 PM
NEW YORK D
Comparison between NAEP and State Reading Assessment Results: 2003 D-271
• • • •••
Figure 10. Comparison of NAEP and state assessment Hispanic-White gapchanges in percent meeting grade 8 reading standards: 2002 and 2003
State NAEP
Gap improvement
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.5
Lower half -6.4
Upper half -2.0
Lower quarter -7.9
Middle half -5.5
Upper quarter -7.1
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 271 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-272 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 11. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.6
Lower half -2.1
Upper half -3.2
Lower quarter -2.9
Middle half -4.0
Upper quarter -0.9
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 272 Wednesday, March 12, 2008 5:19 PM
NEW YORK D
Comparison between NAEP and State Reading Assessment Results: 2003 D-273
• • • •••
Figure 12. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 4 reading standards: 2002 and 2003
State NAEP
Gap improvement
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.8
Lower half 3.1
Upper half -6.6
Lower quarter 5.6
Middle half 0.2
Upper quarter -5.3
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 273 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-274 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 13. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.5
Lower half -4.8
Upper half -1.7
Lower quarter -5.6
Middle half -5.2
Upper quarter 2.4
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 274 Wednesday, March 12, 2008 5:19 PM
NEW YORK D
Comparison between NAEP and State Reading Assessment Results: 2003 D-275
• • • •••
Figure 14. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 8 reading standards: 2002 and 2003
State NAEP
Gap improvement
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.1
Lower half -2.9
Upper half 2.2
Lower quarter -8.6
Middle half -0.2
Upper quarter 2.7
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 275 Wednesday, March 12, 2008 5:19 PM
Read Volume 2.book Page 276 Wednesday, March 12, 2008 5:19 PM
D-277
• • • •••
D North Carolina Dn accordance with the ABCs of Public Education, North Carolina administersEnd-of-Grade (EOG) exams in grades 3-8 in reading and mathematics. Scoresare available for Hispanic, Black, and economically disadvantaged students, but
there are too few Hispanic students to provide a reliable comparison. North Carolinauses four achievement levels for reporting purposes: Level I (insufficient mastery), LevelII (inconsistent mastery), Level III (consistent mastery), and Level IV (superior). School-level assessment scores based on 4 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 147 schools in grade 4 and 129 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading performance standard (consistentmastery) is below the NAEP basic level. This is also true for grade 8.
• Trends. Between 1998 and 2003, the NAEP grade 4 gains in percent displayingconsistent mastery are less than the state assessment gains. Between 1998 and2003, the state reported gains in grade 8 in percent displaying consistent mastery,which NAEP did not.
• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White and poverty gaps in reading ingrades 4 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in reading in grades 4and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
I
Read Volume 2.book Page 277 Wednesday, March 12, 2008 5:19 PM
Achievement
D-278 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorInconsistent Mastery 0.46 0.034 0.50 0.051Consistent Mastery 0.80 0.006 0.71 0.041Superior 0.86 0.017 0.81 0.013
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
superior
consistent mastery
inconsistent mastery
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• •0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
inconsistent mastery
consistent mastery
superior
Read Volume 2.book Page 278 Wednesday, March 12, 2008 5:19 PM
NORTH CAROLINA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-279
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting reading standards, by grade: 1998, 2002, and 2003
Grade 4 Grade 8
* NAEP and state assessment 1998-2002 or 2002-2003 changes are significantly different (p<.05).** NAEP and state assessment 1998-2003 changes are significantly different (p<.05).SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting grades 4 and 8 reading standards as reported bystate: 1998, 2002, and 2003
— Not available.
SOURCE: North Carolina Department of Public Instruction site at http://www.ncreportcards.org/src/stateDetails.jsp?Page=1&pYear=2002-2003.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 15.4 19.4 20.1 13.8 18.1 17.8
English language learner 1.7 2.7 3.4 1.2 1.9 1.6Student with disability 13.5 14.7 14.4 12.5 14.9 14.3Both 0.1 2.0 2.3 0.1 1.3 1.9
Excluded 6.8 11.9 7.2 5.6 9.2 6.9English language learner 0.7 1.6 1.0 0.7 1.1 0.6Student with disability 6.1 8.7 5.1 4.8 7.1 5.3Both 0.0 1.6 1.1 0.1 1.0 1.0
Accommodated 5.6 4.1 8.3 4.8 6.3 8.0English language learner 0.1 0.5 0.9 0.2 0.2 0.6Student with disability 5.4 3.5 6.7 4.6 5.9 6.9Both 0.1 0.2 0.7 0.0 0.1 0.5
Level 1998 2002 2003Grade 4 — 77.1 81.1Grade 8 — 85.1 85.7
93
98 97
70
77
78
28
32
34
9395 94
70 76
81
28 31
41
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
inconsistent mastery
consistent mastery
superior
* **
* **
* **
97 98
98
79 80 79
35 36 33
9798
96
79
85 86
35
4145
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
inconsistent mastery
consistent mastery
superior * **
* **
***
*
Read Volume 2.book Page 279 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-280 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.0
Lower half -4.9
Upper half -0.4
Lower quarter -6.9
Middle half -2.4
Upper quarter 0.8
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 280 Wednesday, March 12, 2008 5:19 PM
NORTH CAROLINA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-281
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 4 reading standards: 2002 and 2003
State NAEP
Gap improvement
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.7
Lower half -6.6
Upper half -2.2
Lower quarter -6.0
Middle half -6.1
Upper quarter 0.8
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 281 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-282 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 5. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.2
Lower half -1.6
Upper half 0.8
Lower quarter -2.1
Middle half -1.2
Upper quarter 2.6
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
BlackWhite
0
Lowestachievers
Highestachievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 282 Wednesday, March 12, 2008 5:19 PM
NORTH CAROLINA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-283
• • • •••
Figure 6. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 8 reading standards: 2002 and 2003
State NAEP
Gap improvement
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.9
Lower half -4.1
Upper half 0.0
Lower quarter -3.2
Middle half -3.8
Upper quarter 1.9
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 283 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-284 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 7. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.9
Lower half -4.7
Upper half 1.0
Lower quarter -6.2
Middle half -2.2
Upper quarter 2.9
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 284 Wednesday, March 12, 2008 5:19 PM
NORTH CAROLINA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-285
• • • •••
Figure 8. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 4 reading standards: 2002 and 2003
State NAEP
Gap improvement
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.5
Lower half -6.4
Upper half -0.3
Lower quarter -6.9
Middle half -4.7
Upper quarter 1.7
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 285 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-286 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 9. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 1.9
Lower half 0.7
Upper half 3.1
Lower quarter 0.4
Middle half 1.6
Upper quarter 4.4
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 286 Wednesday, March 12, 2008 5:19 PM
NORTH CAROLINA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-287
• • • •••
Figure 10. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 8 reading standards: 2002 and 2003
State NAEP
Gap improvement
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.0
Lower half -3.8
Upper half -2.4
Lower quarter -7.5
Middle half -0.5
Upper quarter -2.4
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 287 Wednesday, March 12, 2008 5:19 PM
Read Volume 2.book Page 288 Wednesday, March 12, 2008 5:19 PM
D-289
• • • •••
D North Dakota Dhrough the North Dakota State Assessment (NDSA) Program, the stateadministers the CAT (California Achievement Test)/TerraNova, SecondEdition, in grades 4 and 8 in reading and mathematics. The scores available
for this report do not include any breakdowns by race/ethnicity or poverty status.North Dakota uses only one achievement level: meeting the standard. Because thereare no data available for 1998 and 2002, trend graphs are not included in this report.Suppression information is not available.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 176 schools in grade 4 and 31 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading performance standard (meeting) isbelow the NAEP basic level. The state’s primary grade 8 reading performancestandard (meeting) is between the NAEP basic and proficient levels.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps in reading ingrades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Read Volume 2.book Page 289 Wednesday, March 12, 2008 5:19 PM
Achievement
D-290 National Assessment of Educational Progress
• • • •••
NORTH DAKOTA
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.65 0.023 0.72 0.087
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••
•••••••••••
••••••••••••••••••••••••••••••
••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
meeting
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••
••••••••••••••
•••••••••••••••
•••••••••••••••••
••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
Read Volume 2.book Page 290 Wednesday, March 12, 2008 5:19 PM
NORTH DAKOTA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-291
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
— Not available.
# Estimate rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — 18.2 16.8 — 14.9 15.7
English language learner — 1.7 2.2 — 1.2 1.0Student with disability — 15.8 12.9 — 12.7 14.1Both — 0.6 1.7 — 1.0 0.6
Excluded — 5.4 3.7 — 4.2 4.5English language learner — 0.3 0.1 — # 0.1Student with disability — 4.7 3.0 — 3.7 4.0Both — 0.4 0.7 — 0.4 0.3
Accommodated — 3.3 4.0 — 2.4 3.6English language learner — 0.2 0.1 — 0.1 0.1Student with disability — 3.1 3.8 — 2.2 3.4Both — # 0.2 — 0.1 0.1
Read Volume 2.book Page 291 Wednesday, March 12, 2008 5:19 PM
Read Volume 2.book Page 292 Wednesday, March 12, 2008 5:19 PM
D-293
• • • •••
D Ohio Dhio administers proficiency tests in grades 4, 6, and 9 in reading andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Hispanic students to provide a
reliable comparison. Ohio uses four achievement levels for reporting purposes: belowbasic, basic, proficient, and advanced. However, we only have data for the proficientlevel in 2002; therefore, we report the trends using this performance level only. Stateassessment data and comparisons based upon those data are not displayed for grade 9because there are not enough schools that have grades 8 and 9 to allow a reliablecomparison with NAEP. Scores based on 10 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 163 schools in grade 4 and 0 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 reading standard (proficient) is below theNAEP basic level. There is not enough data to compare state standards to NAEPfor grade 8.
• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent proficient between 2002 and 2003. No comparisonswere possible for grade 8.
• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in grade 4 in 2003. The changein the Black-White gap in grade 4 between 2002 and 2003 was more positive(greater reduction) when measured by the state assessment than when compared toNAEP. In 2003, there were insufficient data for comparing the NAEP and stateassessment measurement of the Black-White gap in grade 8, for the Hispanic-White gap in grades 4 and 8, and the poverty gap in grade 8. Overall, there were nosignificant differences between NAEP and the state assessment in measurement ofthe poverty gap in reading in grade 4 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
O
Read Volume 2.book Page 293 Wednesday, March 12, 2008 5:19 PM
Achievement
D-294 National Assessment of Educational Progress
• • • •••
OHIO
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
— Not available.
† Not applicable.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.64 0.040 — †Proficient 0.74 0.026 — †Advanced 0.42 0.052 — †
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••
••••••••••••••••
•••••••••••••
••••••••••••
•••••••••••••
••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
advanced
proficient
basic
• •••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••
••••••••••••••••••••••••••
••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
Read Volume 2.book Page 294 Wednesday, March 12, 2008 5:19 PM
OHIO D
Comparison between NAEP and State Reading Assessment Results: 2003 D-295
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
— Not available.
# Estimate rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes ingrade 4 percent meeting reading standards: 1998, 2002, and 2003
Grade 4
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting grade 4 reading standards as reported by state:1998, 2002, and 2003
— Not available.
SOURCE: Ohio Department of Education retrieved fromhttp://www.ode.state.oh.us/GD/Templates/Pages/ODE/ODEDetail.aspx?page=3&TopicRelationID=400&Content=15350.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — 13.9 13.2 — 12.4 13.0
English language learner — 1.0 0.8 — 0.5 0.7Student with disability — 12.6 11.6 — 11.2 11.8Both — 0.3 0.7 — 0.7 0.4
Excluded — 8.4 6.1 — 7.1 5.7English language learner — 0.4 0.4 — 0.3 0.3Student with disability — 7.8 5.4 — 6.3 5.2Both — 0.2 0.4 — 0.5 0.2
Accommodated — 1.5 4.7 — 1.4 4.3English language learner — 0.0 # — # 0.1Student with disability — 1.5 4.4 — 1.4 4.1Both — 0.0 0.2 — 0.0 0.1
Level 1998 2002 2003Grade 4 — 64.0 68.0
6867
68 68
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
proficient
Read Volume 2.book Page 295 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-296 National Assessment of Educational Progress
• • • •••
OHIO
Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.3
Lower half -5.1
Upper half -5.3
Lower quarter 1.5
Middle half -10.9*
Upper quarter -4.0
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 296 Wednesday, March 12, 2008 5:19 PM
OHIO D
Comparison between NAEP and State Reading Assessment Results: 2003 D-297
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 4 reading standards: 2002 and 2003
State NAEP
Gap improvement
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -14.4*
Lower half -11.7
Upper half -16.9*
Lower quarter -6.0
Middle half -20.9*
Upper quarter -15.1*
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
2003
2002
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Read Volume 2.book Page 297 Wednesday, March 12, 2008 5:19 PM
Poverty Gap
D-298 National Assessment of Educational Progress
• • • •••
OHIO
Figure 5. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.4
Lower half -7.1*
Upper half -1.4
Lower quarter -6.0
Middle half -6.0*
Upper quarter 0.5
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Disadvantaged
Not disadvantaged
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 298 Wednesday, March 12, 2008 5:19 PM
D-299
• • • •••
D Oklahoma Dhrough the Oklahoma State Testing Program (OSTP), the state administersOklahoma Core Curriculum Tests (OCCT) in grades 5 and 8 in reading andmathematics. Scores are available for Hispanic and Black students, but there
are too few Hispanic students in grades 5 and 8 and too few Black students in grade 8to provide reliable comparisons between these subgroups with White students.Oklahoma uses four achievement levels for reporting purposes: unsatisfactory, limitedknowledge, satisfactory, and advanced. Because there are no data available for 1998 and2002, trend graphs are not included in this report. School-level assessment scoresbased on 5 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 131 schools in grade 5 and 123 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 reading performance standard (satisfactory)is below the NAEP basic level. This is also true for grade 8.
• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White gap in reading in grade 5 in 2003.There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White gap in reading in grade 8 in 2003. There wereinsufficient data for comparing the NAEP and state assessment measurement of theHispanic-White and poverty gaps in reading in grades 5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Read Volume 2.book Page 299 Wednesday, March 12, 2008 5:19 PM
Achievement
D-300 National Assessment of Educational Progress
• • • •••
OKLAHOMA
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorLittle Knowledge 0.30 0.058 0.46 0.088Satisfactory 0.58 0.023 0.66 0.014Advanced 0.30 0.045 0.41 0.051
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••
••••••••••••••••••
•••••••••••••••••••••••
•••••••••
•••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
advanced
satisfactory
limited knowledge
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
limited knowledge
satisfactory
advanced
Read Volume 2.book Page 300 Wednesday, March 12, 2008 5:19 PM
OKLAHOMA D
Comparison between NAEP and State Reading Assessment Results: 2003 D-301
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 15.2 20.8 21.5 13.4 17.4 18.0
English language learner 1.8 3.7 5.0 2.2 2.3 3.4Student with disability 13.4 15.7 15.2 10.8 13.7 13.2Both 0.0 1.4 1.3 0.4 1.4 1.4
Excluded 9.2 5.5 5.6 9.1 4.1 4.1English language learner 0.4 0.9 0.6 1.1 0.5 0.5Student with disability 8.8 4.2 4.5 7.6 3.4 3.2Both 0.0 0.3 0.5 0.4 0.2 0.4
Accommodated 1.3 5.1 4.8 0.8 3.7 4.5English language learner 0.0 0.4 0.2 0.0 0.0 0.3Student with disability 1.3 4.5 4.3 0.8 3.6 3.9Both 0.0 0.2 0.3 0.0 0.1 0.3
Read Volume 2.book Page 301 Wednesday, March 12, 2008 5:19 PM
Black-White Gap
D-302 National Assessment of Educational Progress
• • • •••
OKLAHOMA
Figure 2. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 7.5
Lower half 8.8
Upper half 5.2
Lower quarter 11.9*
Middle half 5.5
Upper quarter 6.7
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Black
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 302 Wednesday, March 12, 2008 5:19 PM
D-303
• • • •••
D Oregon Dhe state administers the Oregon Statewide Assessment in grades 3, 5, and 8 inreading and mathematics. Scores are available for Hispanic and Blackstudents in grade 8, but there are too few Black students to provide a reliable
comparison. Oregon uses five achievement levels for reporting purposes: very low, low,nearly meets the standard, meets the standard, and exceeds the standard. However, due todata unavailability, this report is based on only the top two standards. Suppressioninformation is not available.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 5 and 107 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 reading performance standard (meets thestandard) is below the NAEP basic level for grade 4. The state’s primary grade 8reading performance standard (meets the standard) is between the NAEP basic andproficient levels.
• Trends. Between 1998 and 2003, the NAEP grade 4 gains in percent meeting areless than the state assessment gains. Between 1998 and 2003, the state reportedgains in grade 8 in percent meeting, which NAEP did not.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in reading in grades 5 and 8 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Hispanic-White gap in reading in grade 5 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the Hispanic-White gap in reading in grade 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Read Volume 2.book Page 303 Wednesday, March 12, 2008 5:19 PM
Achievement
D-304 National Assessment of Educational Progress
• • • •••
OREGON
Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.54 0.047 0.60 0.052Exceeding 0.61 0.060 0.56 0.049
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
•••••••••••••
•••••••••••••
••••••••••••••
•••••••••••••••••••••
•••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basicNAEP proficient
NAEP advanced
exceeding
meeting
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••
••••••••••••••••••
••••••••••••••••••••
••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Reading Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
exceeding
Read Volume 2.book Page 304 Wednesday, March 12, 2008 5:19 PM
OREGON D
Comparison between NAEP and State Reading Assessment Results: 2003 D-305
• • • •••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting reading standards, by grade: 1998, 2002, and 2003
Grade 4 (state grade 5) Grade 8
* NAEP and state assessment 1998-2002 or 2002-2003 changes are significantly different (p<.05).
** NAEP and state assessment 1998-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting grades 5 and 8 reading standards as reported bystate: 1998, 2002, and 2003
SOURCE: Oregon Department of Education retrieved from http://www.ode.state.or.us/search/results/?id=126.
Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 19.7 24.5 26.0 14.2 17.8 19.8
English language learner 5.9 9.0 9.7 2.6 5.1 5.4Student with disability 13.2 12.7 13.4 11.3 10.4 12.3Both 0.6 2.9 3.0 0.2 2.3 2.0
Excluded 5.6 7.8 8.8 3.8 5.2 5.5English language learner 1.4 2.6 2.3 0.9 1.3 1.6Student with disability 4.1 3.6 4.9 2.9 2.9 2.9Both 0.2 1.6 1.5 0.0 1.0 1.0
Accommodated 4.2 4.1 5.1 3.5 2.6 3.6English language learner 0.7 1.1 1.5 0.5 0.3 0.5Student with disability 3.1 2.6 3.1 2.8 1.9 2.8Both 0.3 0.4 0.5 0.1 0.4 0.3
Level 1998 2002 2003Grade 5 66.0 79.0 76.0Grade 8 55.0 64.0 61.0
6571
67
1822 21
65
78 78
18
25 26
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
meeting
exceeding**
***
53 5449
28 2926
54
66
59
28
35
28
1998 2002 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
meeting
exceeding
**
**
*
Read Volume 2.book Page 305 Wednesday, March 12, 2008 5:19 PM
Hispanic-White Gap
D-306 National Assessment of Educational Progress
• • • •••
OREGON
Figure 3. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 6.0
Lower half 7.1
Upper half 6.1
Lower quarter 4.5
Middle half 4.5
Upper quarter 9.4
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Hispanic
White
0
Lowest
achievers
Highest
achievers
Median
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
State
NAEP
Lowest
achievers
Median Highest
achievers
Read Volume 2.book Page 306 Wednesday, March 12, 2008 5:19 PM