82
D-225 D Nebraska D rough the School-based Teacher-led Assessment and Reporting System (STARS), Nebraska administers exams in grades 4 and 8 in reading and mathematics. Nebraska alternates reading and mathematics exams by the year: the state tested reading in 2001 and 2003 and mathematics in 2000 and 2002. The scores available for this report do not include any breakdowns by race/ethnicity or poverty status. Nebraska uses one achievement level for reporting purposes: meeting the standard. Because Nebraska alternates reading and mathematics tests, trend graphs for Nebraska are not included in this report. School-level assessment scores based on 9 or fewer students are suppressed. Summary of Comparisons The results of comparisons between NAEP and state assessment results, which for 2003 are based on 127 schools in grade 4 and 105 schools in grade 8, are shown graphically on the following pages. A brief summary of the results follows: 1 Standards. The state’s primary grade 4 reading performance standard (meeting) is below the NAEP basic level. The state’s primary grade 8 reading performance standard (meeting) is close to the NAEP basic level. Trends. No comparisons were possible for grades 4 and 8. Gaps. There were insufficient data for comparing the NAEP and state assessment measurement of the Black-White, Hispanic-White, and poverty gaps in reading in grades 4 and 8 in 2003. 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must be considered in the context of the available data. NAEP and state assessments may employ different test items, testing accommodations, and scoring methods; and they may involve different students in each school, at different times of the year, with different motivational characteristics. At the present time, in spite of controlling for effects of school sampling, differences in standards, and NAEP exclusion rates, we cannot identify specific reasons for differences between NAEP and state assessment results. T

Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-225

• • • •••

D Nebraska Drough the School-based Teacher-led Assessment and Reporting System(STARS), Nebraska administers exams in grades 4 and 8 in reading andmathematics. Nebraska alternates reading and mathematics exams by the

year: the state tested reading in 2001 and 2003 and mathematics in 2000 and 2002.The scores available for this report do not include any breakdowns by race/ethnicityor poverty status. Nebraska uses one achievement level for reporting purposes:meeting the standard. Because Nebraska alternates reading and mathematics tests,trend graphs for Nebraska are not included in this report. School-level assessmentscores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 127 schools in grade 4 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading performance standard (meeting) isbelow the NAEP basic level. The state’s primary grade 8 reading performancestandard (meeting) is close to the NAEP basic level.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps in reading ingrades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Read Volume 2.book Page 225 Wednesday, March 12, 2008 5:19 PM

Page 2: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-226 National Assessment of Educational Progress

• • • •••

NEBRASKA

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.46 0.042 0.42 0.023

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••

••••••••••••••••••

•••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advancedmeeting

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

Read Volume 2.book Page 226 Wednesday, March 12, 2008 5:19 PM

Page 3: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEBRASKA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-227

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — 20.6 20.1 — 16.6 17.7

English language learner — 3.0 3.2 — 2.9 2.1Student with disability — 16.2 15.6 — 12.9 14.7Both — 1.4 1.3 — 0.8 0.9

Excluded — 5.4 5.0 — 6.9 5.0English language learner — 0.9 0.8 — 2.0 1.0Student with disability — 3.8 3.4 — 4.4 3.5Both — 0.6 0.7 — 0.5 0.5

Accommodated — 6.3 5.8 — 2.3 4.5English language learner — 0.4 0.3 — 0.1 0.2Student with disability — 5.8 5.2 — 2.2 4.2Both — 0.1 0.3 — 0.1 0.1

Read Volume 2.book Page 227 Wednesday, March 12, 2008 5:19 PM

Page 4: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Read Volume 2.book Page 228 Wednesday, March 12, 2008 5:19 PM

Page 5: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-229

• • • •••

D Nevada Devada administers the Iowa Tests of Basic Skills (ITBS) in grades 4 and 7 inreading and mathematics. Scores are available for Hispanic, Black, andeconomically disadvantaged students. Nevada uses four achievement levels

for reporting purposes: Level 1 (below the standard), Level 2 (approaching the standard),Level 3 (meeting the standard), and Level 4 (exceeding the standard). Before 2003, whenthe ITBS was implemented, students took the TerraNova, and scores were reportedby percentile rank only. Because of this switch in tests, direct comparisons cannot bemade between ITBS scores from 2003 and TerraNova scores from previous years.Therefore, trend graphs are not included in this report. School-level assessmentscores based on 10 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 4 and 63 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading performance standard ((3) meeting)is close to the NAEP basic level. The state’s primary grade 7 reading performancestandard ((3) meeting) is between the NAEP basic and proficient levels.

• Trends. No comparisons were possible for grades 4 and 7.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White gap in reading in grades 4 and 7 in2003. The Hispanic-White gap in grade 4 in percent meeting the state’s standard inreading in 2003 was smaller when measured by NAEP compared to the stateassessment. There were no significant differences between NAEP and the stateassessment in measurement of the Hispanic-White gap in grade 7 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the poverty gap in reading in grade 4 in 2003. Overall, the povertygap in grade 7 in percent meeting the state’s standard in reading in 2003 wassmaller when measured by NAEP compared to the state assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

N

Read Volume 2.book Page 229 Wednesday, March 12, 2008 5:19 PM

Page 6: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-230 National Assessment of Educational Progress

• • • •••

NEVADA

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8 (state 7th grade standards)

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorApproaching:2 0.80 0.032 0.78 0.029Meeting:3 0.86 0.021 0.78 0.016Exceeding:4 0.83 0.024 0.77 0.024

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••

•••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

exceeding

meeting

approaching

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••

•••••••••••••

••••••••••••••••••••

•••••••••

••••••••••••••••••

••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

approaching

meeting

exceeding

Read Volume 2.book Page 230 Wednesday, March 12, 2008 5:19 PM

Page 7: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEVADA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-231

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 19.6 26.9 25.7 15.3 20.0 17.6

English language learner 9.8 14.7 12.7 5.4 7.1 5.4Student with disability 9.2 9.3 9.8 9.2 10.6 10.3Both 0.7 2.9 3.2 0.7 2.4 1.9

Excluded 11.0 10.3 8.3 5.8 6.0 3.5English language learner 5.5 5.0 3.5 2.0 2.0 1.3Student with disability 4.9 3.4 3.3 3.4 2.8 1.6Both 0.6 1.8 1.5 0.5 1.3 0.6

Accommodated 1.1 3.0 4.6 1.8 2.0 5.4English language learner 0.4 0.9 1.1 0.4 0.0 0.5Student with disability 0.6 1.8 3.1 1.4 1.8 4.2Both 0.1 0.4 0.4 0.0 0.1 0.7

Read Volume 2.book Page 231 Wednesday, March 12, 2008 5:19 PM

Page 8: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-232 National Assessment of Educational Progress

• • • •••

NEVADA

Figure 2. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 3.3

Lower half -0.5

Upper half 6.2

Lower quarter -3.4

Middle half 0.0

Upper quarter 8.1

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 232 Wednesday, March 12, 2008 5:19 PM

Page 9: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEVADA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-233

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

NOTE: State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.5

Lower half 0.2

Upper half -0.8

Lower quarter -0.5

Middle half -1.1

Upper quarter -3.4

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 233 Wednesday, March 12, 2008 5:19 PM

Page 10: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Hispanic-White Gap

D-234 National Assessment of Educational Progress

• • • •••

NEVADA

Figure 5. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 7.5*

Lower half 8.8*

Upper half 7.1

Lower quarter 8.0*

Middle half 8.9*

Upper quarter 3.2

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 234 Wednesday, March 12, 2008 5:19 PM

Page 11: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEVADA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-235

• • • •••

Figure 6. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

NOTE: State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 1.9

Lower half -0.6

Upper half 4.5

Lower quarter -2.8

Middle half 1.3

Upper quarter 4.6

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 235 Wednesday, March 12, 2008 5:19 PM

Page 12: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-236 National Assessment of Educational Progress

• • • •••

NEVADA

Figure 7. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 2.8

Lower half 4.1

Upper half 1.6

Lower quarter 5.6

Middle half 3.3

Upper quarter -1.3

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 236 Wednesday, March 12, 2008 5:19 PM

Page 13: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEVADA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-237

• • • •••

Figure 8. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 5.3*

Lower half 1.3

Upper half 9.7*

Lower quarter -1.1

Middle half 5.0*

Upper quarter 11.0*

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 237 Wednesday, March 12, 2008 5:19 PM

Page 14: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Read Volume 2.book Page 238 Wednesday, March 12, 2008 5:19 PM

Page 15: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-239

• • • •••

D New Hampshire Dhrough the New Hampshire Educational Improvement and AssessmentProgram (NHEIAP), the state administers exams in grades 3, 6, and 10 inEnglish language arts and mathematics. Scores are available for economically

disadvantaged students; however, note that the percentage of Black studentsrepresented is below two-thirds of the population in Grade 4 (59%). New Hampshireuses four achievement levels for reporting purposes: novice, basic, proficient, andadvanced. State assessment data and comparisons based upon those data are notdisplayed for grade 8 because New Hampshire does not test grade 8. School-levelassessment scores based on 10 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 3 and 0 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 3 reading performance standard (basic) is closeto the NAEP basic level. There are insufficient data for comparing state standardsto NAEP for grade 8.

• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent basic between 1998 and 2003. No comparisons werepossible for grade 8.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in reading in grades 3and 8 in 2003. Overall, there were no significant differences between NAEP andthe state assessment in measurement of the poverty gap in reading in grade 3 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the poverty gap in reading in grade 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Read Volume 2.book Page 239 Wednesday, March 12, 2008 5:19 PM

Page 16: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-240 National Assessment of Educational Progress

• • • •••

NEW HAMPSHIRE

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4 (state 3rd grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

— Not available.† Not applicable.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 3 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.61 0.029 — †Proficient 0.49 0.035 — †Advanced 0.21 0.108 — †

• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••

•••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

advanced

proficient

basic

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••••

••••••••••••••••••••••••

••••••••••

•••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

Read Volume 2.book Page 240 Wednesday, March 12, 2008 5:19 PM

Page 17: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW HAMPSHIRE D

Comparison between NAEP and State Reading Assessment Results: 2003 D-241

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes ingrade 4 percent meeting reading standards: 1998, 2002, and 2003

Grade 4 (state grade 3)

* NAEP and state assessment 1998-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting grade 3 reading standards as reported by state:1998, 2002, and 2003

— Not available.

SOURCE: NH Dept. of Education retrieved from http://www.ed.state.nh.us/Assessment/HistoricalDataGR03.xls.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 14.2 — 19.0 — — 19.0

English language learner 0.9 — 2.1 — — 1.2Student with disability 13.2 — 16.1 — — 17.3Both 0.1 — 0.7 — — 0.6

Excluded 3.3 — 3.9 — — 3.2English language learner 0.3 — 0.6 — — 0.4Student with disability 2.9 — 3.1 — — 2.8Both 0.1 — 0.2 — — 0.1

Accommodated 5.0 — 10.3 — — 9.4English language learner 0.0 — 0.4 — — 0.2Student with disability 5.0 — 9.5 — — 8.7Both 0.0 — 0.4 — — 0.4

Level 1998 2002 2003Grade 3 34.0 — 37.0

72 72 72

36 38

39

8

9

10

72

75 77

3637

38

8

8

7

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

**

basic

proficient

advanced

Read Volume 2.book Page 241 Wednesday, March 12, 2008 5:19 PM

Page 18: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-242 National Assessment of Educational Progress

• • • •••

NEW HAMPSHIRE

Figure 3. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 3.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.0

Lower half -9.4

Upper half -0.8

Lower quarter -10.9

Middle half -4.5

Upper quarter -1.4

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 242 Wednesday, March 12, 2008 5:19 PM

Page 19: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-243

• • • •••

D New Jersey Dhe state administers the New Jersey Assessment of Skills and Knowledge (NJASK) in grade 4 in English language arts and mathematics and the GradeEight Proficiency Assessment (GEPA) in English language arts and

mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students. New Jersey uses three achievement levels for reportingpurposes: partially proficient, proficient, and advanced proficient. Before 2003, when theNJ ASK was implemented, grade 4 students took the Elementary School ProficiencyAssessment (ESPA). Trend graphs are not included because New Jersey did notparticipate in State NAEP prior to 2003. School-level assessment scores based on 10or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 4 and 107 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading performance standard (proficient) isbelow the NAEP basic level. The state’s primary grade 8 reading performancestandard (proficient) is between the NAEP basic and proficient levels.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White, Hispanic-White, and poverty gapsin reading in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Read Volume 2.book Page 243 Wednesday, March 12, 2008 5:19 PM

Page 20: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-244 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.84 0.012 0.85 0.018Advanced 0.57 0.063 0.59 0.020

••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••

••••••••••

••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

advanced

proficient

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••

••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

proficient

advanced

Read Volume 2.book Page 244 Wednesday, March 12, 2008 5:19 PM

Page 21: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW JERSEY D

Comparison between NAEP and State Reading Assessment Results: 2003 D-245

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — — 16.6 — — 17.5

English language learner — — 3.5 — — 2.1Student with disability — — 12.5 — — 15.1Both — — 0.6 — — 0.3

Excluded — — 4.9 — — 2.9English language learner — — 1.6 — — 0.7Student with disability — — 3.0 — — 2.1Both — — 0.4 — — 0.1

Accommodated — — 9.7 — — 11.8English language learner — — 1.2 — — 1.0Student with disability — — 8.2 — — 10.6Both — — 0.2 — — 0.2

Read Volume 2.book Page 245 Wednesday, March 12, 2008 5:19 PM

Page 22: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-246 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 2. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.6

Lower half -4.6

Upper half -2.0

Lower quarter -1.9

Middle half -5.1

Upper quarter 0.3

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 246 Wednesday, March 12, 2008 5:19 PM

Page 23: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW JERSEY D

Comparison between NAEP and State Reading Assessment Results: 2003 D-247

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 4.5

Lower half 5.2

Upper half 4.5

Lower quarter 3.3

Middle half 7.5

Upper quarter 0.7

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 247 Wednesday, March 12, 2008 5:19 PM

Page 24: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Hispanic-White Gap

D-248 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 4. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.7

Lower half -6.2

Upper half 0.3

Lower quarter -7.8

Middle half -2.5

Upper quarter 0.2

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 248 Wednesday, March 12, 2008 5:19 PM

Page 25: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW JERSEY D

Comparison between NAEP and State Reading Assessment Results: 2003 D-249

• • • •••

Figure 5. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.5

Lower half 2.3

Upper half -5.2

Lower quarter 5.0

Middle half -2.6

Upper quarter -3.6

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 249 Wednesday, March 12, 2008 5:19 PM

Page 26: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-250 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 6. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.3

Lower half -3.8

Upper half -3.9

Lower quarter 0.2

Middle half -3.9

Upper quarter -2.6

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 250 Wednesday, March 12, 2008 5:19 PM

Page 27: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW JERSEY D

Comparison between NAEP and State Reading Assessment Results: 2003 D-251

• • • •••

Figure 7. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 2.2

Lower half 1.3

Upper half 4.8

Lower quarter -1.2

Middle half 5.0

Upper quarter 2.8

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 251 Wednesday, March 12, 2008 5:19 PM

Page 28: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Read Volume 2.book Page 252 Wednesday, March 12, 2008 5:19 PM

Page 29: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-253

• • • •••

D New Mexico Dew Mexico administers the TerraNova in grades 3-9 in English language artsand mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Black students to provide a

reliable comparison. New Mexico uses four quartiles for reporting purposes. Becausethere are no data available for 1998 and 2002, trend graphs are not included in thisreport. School-level assessment scores based on 4 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 89 schools in grade 4 and 68 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading performance standard (top half) isclose to the NAEP basic level. The state’s primary grade 8 reading performancestandard (top half) is between the NAEP basic and proficient levels.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White gap in reading in grades 4 and 8 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the Hispanic-White and poverty gaps in reading in grades 4 and 8in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

N

Read Volume 2.book Page 253 Wednesday, March 12, 2008 5:19 PM

Page 30: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-254 National Assessment of Educational Progress

• • • •••

NEW MEXICO

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorTop 75% 0.67 0.035 0.57 0.023Top half 0.80 0.027 0.65 0.032Top 25% 0.79 0.021 0.67 0.038

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••

•••••••••••••••••••••••••••••

••••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

top 25%

top half

top 75%

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••

••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

top 75%

top half

top 25%

Read Volume 2.book Page 254 Wednesday, March 12, 2008 5:19 PM

Page 31: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW MEXICO D

Comparison between NAEP and State Reading Assessment Results: 2003 D-255

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 27.8 37.2 40.7 22.3 30.8 31.2

English language learner 13.5 21.9 22.3 7.0 12.4 12.0Student with disability 12.1 9.7 11.2 13.3 11.0 12.4Both 2.2 5.6 7.2 1.9 7.4 6.8

Excluded 9.4 10.1 7.6 8.3 8.3 8.0English language learner 2.2 3.5 3.1 3.0 1.7 3.3Student with disability 5.7 3.6 2.4 4.4 3.3 2.8Both 1.5 2.9 2.0 0.9 3.2 1.9

Accommodated 2.3 4.4 10.1 3.2 5.5 8.9English language learner 0.6 1.2 3.3 0.3 0.3 1.0Student with disability 1.6 2.7 4.4 2.5 3.8 5.1Both 0.1 0.6 2.3 0.4 1.4 2.8

Read Volume 2.book Page 255 Wednesday, March 12, 2008 5:19 PM

Page 32: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Hispanic-White Gap

D-256 National Assessment of Educational Progress

• • • •••

NEW MEXICO

Figure 2. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.3

Lower half -2.0

Upper half 1.1

Lower quarter -1.8

Middle half -2.0

Upper quarter 1.7

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 256 Wednesday, March 12, 2008 5:19 PM

Page 33: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW MEXICO D

Comparison between NAEP and State Reading Assessment Results: 2003 D-257

• • • •••

Figure 3. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.1

Lower half -3.0

Upper half -3.8

Lower quarter 1.2

Middle half -5.3

Upper quarter -2.3

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 257 Wednesday, March 12, 2008 5:19 PM

Page 34: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-258 National Assessment of Educational Progress

• • • •••

NEW MEXICO

Figure 4. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 0.1

Lower half 0.2

Upper half 0.7

Lower quarter -0.9

Middle half 0.5

Upper quarter -0.4

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 258 Wednesday, March 12, 2008 5:19 PM

Page 35: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW MEXICO D

Comparison between NAEP and State Reading Assessment Results: 2003 D-259

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.3

Lower half -0.5

Upper half -2.8

Lower quarter 2.4

Middle half -3.0

Upper quarter 0.9

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 259 Wednesday, March 12, 2008 5:19 PM

Page 36: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Read Volume 2.book Page 260 Wednesday, March 12, 2008 5:19 PM

Page 37: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-261

• • • •••

D New York Dew York administers exams in grades 4 and 8 in English language arts andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students; however, note that the percentage of disadvantaged

students represented is below two-thirds of the population in Grade 4 (63%). NewYork uses four achievement levels for reporting purposes: Step 1, Level 2 (needs help),Level 3 (meets expectations), and Level 4 (exceeds expectations). The total populationassessment scores based on 4 or fewer students are suppressed; disaggregated datasuppression rules vary from school to school.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 141 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading performance standard (meeting) isclose to the NAEP basic level. The state’s primary grade 8 reading performancestandard (meeting) is between the NAEP basic and proficient levels.

• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent meeting between 2002 and 2003.

• Gaps. Overall, the Black-White gap in grades 4 and 8 in percent meeting thestate’s standard in reading in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White andpoverty gaps in reading in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

N

Read Volume 2.book Page 261 Wednesday, March 12, 2008 5:19 PM

Page 38: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-262 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeed Help 0.66 0.023 0.69 0.025Meeting 0.83 0.003 0.80 0.015Exceeding 0.74 0.021 0.53 0.047

••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••

••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

exceeding

meeting

need help

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

••••••••••••••••••••••••••

••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

need help

meeting

exceeding

Read Volume 2.book Page 262 Wednesday, March 12, 2008 5:19 PM

Page 39: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW YORK D

Comparison between NAEP and State Reading Assessment Results: 2003 D-263

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting reading standards, by grade: 1998, 2002, and 2003

Grade 4 Grade 8

* NAEP and state assessment 2002-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting grades 4 and 8 reading standards as reported bystate: 1998, 2002, and 2003

— Not available.

SOURCE: New York State Department of Education retrieved fromhttp://www.emsc.nysed.gov/repcrd2003/statewide/total-public-overview.htm.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 14.3 17.6 19.2 15.5 20.0 18.6

English language learner 4.8 3.9 5.4 5.2 4.8 3.8Student with disability 9.1 11.8 12.3 9.8 13.7 13.2Both 0.3 1.9 1.5 0.5 1.6 1.5

Excluded 7.4 8.2 8.0 7.6 9.4 6.6English language learner 3.5 2.0 2.9 3.6 1.8 1.6Student with disability 3.7 4.9 4.5 3.5 6.6 4.5Both 0.2 1.3 0.6 0.4 1.0 0.6

Accommodated 4.2 6.1 8.4 3.9 7.1 9.4English language learner 0.0 0.8 1.2 0.0 1.2 1.2Student with disability 4.2 4.9 6.5 3.9 5.5 7.4Both 0.0 0.3 0.8 0.0 0.4 0.7

Level 1998 2002 2003Grade 4 — 62.0 64.0Grade 8 — 44.0 45.0

92 93

62 62

21 19

9294

6264

2121

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP needhelp

meeting

exceeding

94 92

4345

9

12

94 92

43

47

98

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*

needhelp

meeting

exceeding

Read Volume 2.book Page 263 Wednesday, March 12, 2008 5:19 PM

Page 40: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-264 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -10.3*

Lower half -10.4*

Upper half -9.3*

Lower quarter -7.6

Middle half -12.8*

Upper quarter -4.9

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 264 Wednesday, March 12, 2008 5:19 PM

Page 41: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW YORK D

Comparison between NAEP and State Reading Assessment Results: 2003 D-265

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 4 reading standards: 2002 and 2003

State NAEP

Gap improvement

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.4

Lower half -0.9

Upper half -5.4

Lower quarter 7.0

Middle half -4.1

Upper quarter -0.6

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 265 Wednesday, March 12, 2008 5:19 PM

Page 42: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-266 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 5. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -9.9*

Lower half -9.8*

Upper half -8.5*

Lower quarter -6.6

Middle half -8.2*

Upper quarter -13.5*

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 266 Wednesday, March 12, 2008 5:19 PM

Page 43: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW YORK D

Comparison between NAEP and State Reading Assessment Results: 2003 D-267

• • • •••

Figure 6. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 8 reading standards: 2002 and 2003

State NAEP

Gap improvement

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.5

Lower half -3.5

Upper half 0.7

Lower quarter -4.7

Middle half -1.0

Upper quarter -12.9

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 267 Wednesday, March 12, 2008 5:19 PM

Page 44: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Hispanic-White Gap

D-268 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 7. Comparison of NAEP and state assessment Hispanic-White gaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.1

Lower half -6.2

Upper half -5.1

Lower quarter -5.4

Middle half -8.7

Upper quarter -2.2

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 268 Wednesday, March 12, 2008 5:19 PM

Page 45: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW YORK D

Comparison between NAEP and State Reading Assessment Results: 2003 D-269

• • • •••

Figure 8. Comparison of NAEP and state assessment Hispanic-White gapchanges in percent meeting grade 4 reading standards: 2002 and 2003

State NAEP

Gap improvement

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.3

Lower half -6.0

Upper half -6.0

Lower quarter -1.3

Middle half -11.1

Upper quarter -5.7

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 269 Wednesday, March 12, 2008 5:19 PM

Page 46: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Hispanic-White Gap

D-270 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 9. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.0

Lower half -7.6*

Upper half 0.2

Lower quarter -5.8

Middle half -5.7

Upper quarter -2.2

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 270 Wednesday, March 12, 2008 5:19 PM

Page 47: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW YORK D

Comparison between NAEP and State Reading Assessment Results: 2003 D-271

• • • •••

Figure 10. Comparison of NAEP and state assessment Hispanic-White gapchanges in percent meeting grade 8 reading standards: 2002 and 2003

State NAEP

Gap improvement

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.5

Lower half -6.4

Upper half -2.0

Lower quarter -7.9

Middle half -5.5

Upper quarter -7.1

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 271 Wednesday, March 12, 2008 5:19 PM

Page 48: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-272 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 11. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.6

Lower half -2.1

Upper half -3.2

Lower quarter -2.9

Middle half -4.0

Upper quarter -0.9

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 272 Wednesday, March 12, 2008 5:19 PM

Page 49: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW YORK D

Comparison between NAEP and State Reading Assessment Results: 2003 D-273

• • • •••

Figure 12. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 4 reading standards: 2002 and 2003

State NAEP

Gap improvement

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.8

Lower half 3.1

Upper half -6.6

Lower quarter 5.6

Middle half 0.2

Upper quarter -5.3

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 273 Wednesday, March 12, 2008 5:19 PM

Page 50: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-274 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 13. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.5

Lower half -4.8

Upper half -1.7

Lower quarter -5.6

Middle half -5.2

Upper quarter 2.4

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 274 Wednesday, March 12, 2008 5:19 PM

Page 51: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NEW YORK D

Comparison between NAEP and State Reading Assessment Results: 2003 D-275

• • • •••

Figure 14. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 8 reading standards: 2002 and 2003

State NAEP

Gap improvement

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.1

Lower half -2.9

Upper half 2.2

Lower quarter -8.6

Middle half -0.2

Upper quarter 2.7

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 275 Wednesday, March 12, 2008 5:19 PM

Page 52: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Read Volume 2.book Page 276 Wednesday, March 12, 2008 5:19 PM

Page 53: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-277

• • • •••

D North Carolina Dn accordance with the ABCs of Public Education, North Carolina administersEnd-of-Grade (EOG) exams in grades 3-8 in reading and mathematics. Scoresare available for Hispanic, Black, and economically disadvantaged students, but

there are too few Hispanic students to provide a reliable comparison. North Carolinauses four achievement levels for reporting purposes: Level I (insufficient mastery), LevelII (inconsistent mastery), Level III (consistent mastery), and Level IV (superior). School-level assessment scores based on 4 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 147 schools in grade 4 and 129 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading performance standard (consistentmastery) is below the NAEP basic level. This is also true for grade 8.

• Trends. Between 1998 and 2003, the NAEP grade 4 gains in percent displayingconsistent mastery are less than the state assessment gains. Between 1998 and2003, the state reported gains in grade 8 in percent displaying consistent mastery,which NAEP did not.

• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White and poverty gaps in reading ingrades 4 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in reading in grades 4and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

I

Read Volume 2.book Page 277 Wednesday, March 12, 2008 5:19 PM

Page 54: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-278 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorInconsistent Mastery 0.46 0.034 0.50 0.051Consistent Mastery 0.80 0.006 0.71 0.041Superior 0.86 0.017 0.81 0.013

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

superior

consistent mastery

inconsistent mastery

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• •0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

inconsistent mastery

consistent mastery

superior

Read Volume 2.book Page 278 Wednesday, March 12, 2008 5:19 PM

Page 55: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NORTH CAROLINA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-279

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting reading standards, by grade: 1998, 2002, and 2003

Grade 4 Grade 8

* NAEP and state assessment 1998-2002 or 2002-2003 changes are significantly different (p<.05).** NAEP and state assessment 1998-2003 changes are significantly different (p<.05).SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting grades 4 and 8 reading standards as reported bystate: 1998, 2002, and 2003

— Not available.

SOURCE: North Carolina Department of Public Instruction site at http://www.ncreportcards.org/src/stateDetails.jsp?Page=1&pYear=2002-2003.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 15.4 19.4 20.1 13.8 18.1 17.8

English language learner 1.7 2.7 3.4 1.2 1.9 1.6Student with disability 13.5 14.7 14.4 12.5 14.9 14.3Both 0.1 2.0 2.3 0.1 1.3 1.9

Excluded 6.8 11.9 7.2 5.6 9.2 6.9English language learner 0.7 1.6 1.0 0.7 1.1 0.6Student with disability 6.1 8.7 5.1 4.8 7.1 5.3Both 0.0 1.6 1.1 0.1 1.0 1.0

Accommodated 5.6 4.1 8.3 4.8 6.3 8.0English language learner 0.1 0.5 0.9 0.2 0.2 0.6Student with disability 5.4 3.5 6.7 4.6 5.9 6.9Both 0.1 0.2 0.7 0.0 0.1 0.5

Level 1998 2002 2003Grade 4 — 77.1 81.1Grade 8 — 85.1 85.7

93

98 97

70

77

78

28

32

34

9395 94

70 76

81

28 31

41

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

inconsistent mastery

consistent mastery

superior

* **

* **

* **

97 98

98

79 80 79

35 36 33

9798

96

79

85 86

35

4145

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

inconsistent mastery

consistent mastery

superior * **

* **

***

*

Read Volume 2.book Page 279 Wednesday, March 12, 2008 5:19 PM

Page 56: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-280 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.0

Lower half -4.9

Upper half -0.4

Lower quarter -6.9

Middle half -2.4

Upper quarter 0.8

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 280 Wednesday, March 12, 2008 5:19 PM

Page 57: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NORTH CAROLINA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-281

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 4 reading standards: 2002 and 2003

State NAEP

Gap improvement

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.7

Lower half -6.6

Upper half -2.2

Lower quarter -6.0

Middle half -6.1

Upper quarter 0.8

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 281 Wednesday, March 12, 2008 5:19 PM

Page 58: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-282 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 5. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.2

Lower half -1.6

Upper half 0.8

Lower quarter -2.1

Middle half -1.2

Upper quarter 2.6

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

BlackWhite

0

Lowestachievers

Highestachievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 282 Wednesday, March 12, 2008 5:19 PM

Page 59: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NORTH CAROLINA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-283

• • • •••

Figure 6. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 8 reading standards: 2002 and 2003

State NAEP

Gap improvement

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.9

Lower half -4.1

Upper half 0.0

Lower quarter -3.2

Middle half -3.8

Upper quarter 1.9

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 283 Wednesday, March 12, 2008 5:19 PM

Page 60: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-284 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 7. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.9

Lower half -4.7

Upper half 1.0

Lower quarter -6.2

Middle half -2.2

Upper quarter 2.9

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 284 Wednesday, March 12, 2008 5:19 PM

Page 61: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NORTH CAROLINA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-285

• • • •••

Figure 8. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 4 reading standards: 2002 and 2003

State NAEP

Gap improvement

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.5

Lower half -6.4

Upper half -0.3

Lower quarter -6.9

Middle half -4.7

Upper quarter 1.7

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 285 Wednesday, March 12, 2008 5:19 PM

Page 62: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-286 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 9. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 1.9

Lower half 0.7

Upper half 3.1

Lower quarter 0.4

Middle half 1.6

Upper quarter 4.4

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 286 Wednesday, March 12, 2008 5:19 PM

Page 63: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NORTH CAROLINA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-287

• • • •••

Figure 10. Comparison of NAEP and state assessment poverty achievement gapchanges in percent meeting grade 8 reading standards: 2002 and 2003

State NAEP

Gap improvement

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.0

Lower half -3.8

Upper half -2.4

Lower quarter -7.5

Middle half -0.5

Upper quarter -2.4

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 287 Wednesday, March 12, 2008 5:19 PM

Page 64: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Read Volume 2.book Page 288 Wednesday, March 12, 2008 5:19 PM

Page 65: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-289

• • • •••

D North Dakota Dhrough the North Dakota State Assessment (NDSA) Program, the stateadministers the CAT (California Achievement Test)/TerraNova, SecondEdition, in grades 4 and 8 in reading and mathematics. The scores available

for this report do not include any breakdowns by race/ethnicity or poverty status.North Dakota uses only one achievement level: meeting the standard. Because thereare no data available for 1998 and 2002, trend graphs are not included in this report.Suppression information is not available.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 176 schools in grade 4 and 31 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading performance standard (meeting) isbelow the NAEP basic level. The state’s primary grade 8 reading performancestandard (meeting) is between the NAEP basic and proficient levels.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps in reading ingrades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Read Volume 2.book Page 289 Wednesday, March 12, 2008 5:19 PM

Page 66: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-290 National Assessment of Educational Progress

• • • •••

NORTH DAKOTA

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.65 0.023 0.72 0.087

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••

•••••••••••

••••••••••••••••••••••••••••••

••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

meeting

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••

••••••••••••••

•••••••••••••••

•••••••••••••••••

••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

Read Volume 2.book Page 290 Wednesday, March 12, 2008 5:19 PM

Page 67: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

NORTH DAKOTA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-291

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

— Not available.

# Estimate rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — 18.2 16.8 — 14.9 15.7

English language learner — 1.7 2.2 — 1.2 1.0Student with disability — 15.8 12.9 — 12.7 14.1Both — 0.6 1.7 — 1.0 0.6

Excluded — 5.4 3.7 — 4.2 4.5English language learner — 0.3 0.1 — # 0.1Student with disability — 4.7 3.0 — 3.7 4.0Both — 0.4 0.7 — 0.4 0.3

Accommodated — 3.3 4.0 — 2.4 3.6English language learner — 0.2 0.1 — 0.1 0.1Student with disability — 3.1 3.8 — 2.2 3.4Both — # 0.2 — 0.1 0.1

Read Volume 2.book Page 291 Wednesday, March 12, 2008 5:19 PM

Page 68: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Read Volume 2.book Page 292 Wednesday, March 12, 2008 5:19 PM

Page 69: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-293

• • • •••

D Ohio Dhio administers proficiency tests in grades 4, 6, and 9 in reading andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Hispanic students to provide a

reliable comparison. Ohio uses four achievement levels for reporting purposes: belowbasic, basic, proficient, and advanced. However, we only have data for the proficientlevel in 2002; therefore, we report the trends using this performance level only. Stateassessment data and comparisons based upon those data are not displayed for grade 9because there are not enough schools that have grades 8 and 9 to allow a reliablecomparison with NAEP. Scores based on 10 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 163 schools in grade 4 and 0 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 reading standard (proficient) is below theNAEP basic level. There is not enough data to compare state standards to NAEPfor grade 8.

• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent proficient between 2002 and 2003. No comparisonswere possible for grade 8.

• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in grade 4 in 2003. The changein the Black-White gap in grade 4 between 2002 and 2003 was more positive(greater reduction) when measured by the state assessment than when compared toNAEP. In 2003, there were insufficient data for comparing the NAEP and stateassessment measurement of the Black-White gap in grade 8, for the Hispanic-White gap in grades 4 and 8, and the poverty gap in grade 8. Overall, there were nosignificant differences between NAEP and the state assessment in measurement ofthe poverty gap in reading in grade 4 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

O

Read Volume 2.book Page 293 Wednesday, March 12, 2008 5:19 PM

Page 70: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-294 National Assessment of Educational Progress

• • • •••

OHIO

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

— Not available.

† Not applicable.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.64 0.040 — †Proficient 0.74 0.026 — †Advanced 0.42 0.052 — †

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••

••••••••••••••••

•••••••••••••

••••••••••••

•••••••••••••

••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

advanced

proficient

basic

• •••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••

••••••••••••••••••••••••••

••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

Read Volume 2.book Page 294 Wednesday, March 12, 2008 5:19 PM

Page 71: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

OHIO D

Comparison between NAEP and State Reading Assessment Results: 2003 D-295

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

— Not available.

# Estimate rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes ingrade 4 percent meeting reading standards: 1998, 2002, and 2003

Grade 4

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting grade 4 reading standards as reported by state:1998, 2002, and 2003

— Not available.

SOURCE: Ohio Department of Education retrieved fromhttp://www.ode.state.oh.us/GD/Templates/Pages/ODE/ODEDetail.aspx?page=3&TopicRelationID=400&Content=15350.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified — 13.9 13.2 — 12.4 13.0

English language learner — 1.0 0.8 — 0.5 0.7Student with disability — 12.6 11.6 — 11.2 11.8Both — 0.3 0.7 — 0.7 0.4

Excluded — 8.4 6.1 — 7.1 5.7English language learner — 0.4 0.4 — 0.3 0.3Student with disability — 7.8 5.4 — 6.3 5.2Both — 0.2 0.4 — 0.5 0.2

Accommodated — 1.5 4.7 — 1.4 4.3English language learner — 0.0 # — # 0.1Student with disability — 1.5 4.4 — 1.4 4.1Both — 0.0 0.2 — 0.0 0.1

Level 1998 2002 2003Grade 4 — 64.0 68.0

6867

68 68

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

proficient

Read Volume 2.book Page 295 Wednesday, March 12, 2008 5:19 PM

Page 72: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-296 National Assessment of Educational Progress

• • • •••

OHIO

Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.3

Lower half -5.1

Upper half -5.3

Lower quarter 1.5

Middle half -10.9*

Upper quarter -4.0

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 296 Wednesday, March 12, 2008 5:19 PM

Page 73: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

OHIO D

Comparison between NAEP and State Reading Assessment Results: 2003 D-297

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White gap changes inpercent meeting grade 4 reading standards: 2002 and 2003

State NAEP

Gap improvement

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2002 and 2003 Reading Assessments: Full populationestimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -14.4*

Lower half -11.7

Upper half -16.9*

Lower quarter -6.0

Middle half -20.9*

Upper quarter -15.1*

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

2003

2002

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Read Volume 2.book Page 297 Wednesday, March 12, 2008 5:19 PM

Page 74: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Poverty Gap

D-298 National Assessment of Educational Progress

• • • •••

OHIO

Figure 5. Comparison of NAEP and state assessment poverty achievement gapsin percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.4

Lower half -7.1*

Upper half -1.4

Lower quarter -6.0

Middle half -6.0*

Upper quarter 0.5

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Disadvantaged

Not disadvantaged

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 298 Wednesday, March 12, 2008 5:19 PM

Page 75: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-299

• • • •••

D Oklahoma Dhrough the Oklahoma State Testing Program (OSTP), the state administersOklahoma Core Curriculum Tests (OCCT) in grades 5 and 8 in reading andmathematics. Scores are available for Hispanic and Black students, but there

are too few Hispanic students in grades 5 and 8 and too few Black students in grade 8to provide reliable comparisons between these subgroups with White students.Oklahoma uses four achievement levels for reporting purposes: unsatisfactory, limitedknowledge, satisfactory, and advanced. Because there are no data available for 1998 and2002, trend graphs are not included in this report. School-level assessment scoresbased on 5 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 131 schools in grade 5 and 123 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 reading performance standard (satisfactory)is below the NAEP basic level. This is also true for grade 8.

• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White gap in reading in grade 5 in 2003.There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White gap in reading in grade 8 in 2003. There wereinsufficient data for comparing the NAEP and state assessment measurement of theHispanic-White and poverty gaps in reading in grades 5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Read Volume 2.book Page 299 Wednesday, March 12, 2008 5:19 PM

Page 76: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-300 National Assessment of Educational Progress

• • • •••

OKLAHOMA

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorLittle Knowledge 0.30 0.058 0.46 0.088Satisfactory 0.58 0.023 0.66 0.014Advanced 0.30 0.045 0.41 0.051

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••

••••••••••••••••••

•••••••••••••••••••••••

•••••••••

•••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

advanced

satisfactory

limited knowledge

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

limited knowledge

satisfactory

advanced

Read Volume 2.book Page 300 Wednesday, March 12, 2008 5:19 PM

Page 77: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

OKLAHOMA D

Comparison between NAEP and State Reading Assessment Results: 2003 D-301

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 15.2 20.8 21.5 13.4 17.4 18.0

English language learner 1.8 3.7 5.0 2.2 2.3 3.4Student with disability 13.4 15.7 15.2 10.8 13.7 13.2Both 0.0 1.4 1.3 0.4 1.4 1.4

Excluded 9.2 5.5 5.6 9.1 4.1 4.1English language learner 0.4 0.9 0.6 1.1 0.5 0.5Student with disability 8.8 4.2 4.5 7.6 3.4 3.2Both 0.0 0.3 0.5 0.4 0.2 0.4

Accommodated 1.3 5.1 4.8 0.8 3.7 4.5English language learner 0.0 0.4 0.2 0.0 0.0 0.3Student with disability 1.3 4.5 4.3 0.8 3.6 3.9Both 0.0 0.2 0.3 0.0 0.1 0.3

Read Volume 2.book Page 301 Wednesday, March 12, 2008 5:19 PM

Page 78: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Black-White Gap

D-302 National Assessment of Educational Progress

• • • •••

OKLAHOMA

Figure 2. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 reading standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 7.5

Lower half 8.8

Upper half 5.2

Lower quarter 11.9*

Middle half 5.5

Upper quarter 6.7

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Black

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 302 Wednesday, March 12, 2008 5:19 PM

Page 79: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

D-303

• • • •••

D Oregon Dhe state administers the Oregon Statewide Assessment in grades 3, 5, and 8 inreading and mathematics. Scores are available for Hispanic and Blackstudents in grade 8, but there are too few Black students to provide a reliable

comparison. Oregon uses five achievement levels for reporting purposes: very low, low,nearly meets the standard, meets the standard, and exceeds the standard. However, due todata unavailability, this report is based on only the top two standards. Suppressioninformation is not available.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 5 and 107 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 reading performance standard (meets thestandard) is below the NAEP basic level for grade 4. The state’s primary grade 8reading performance standard (meets the standard) is between the NAEP basic andproficient levels.

• Trends. Between 1998 and 2003, the NAEP grade 4 gains in percent meeting areless than the state assessment gains. Between 1998 and 2003, the state reportedgains in grade 8 in percent meeting, which NAEP did not.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in reading in grades 5 and 8 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Hispanic-White gap in reading in grade 5 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the Hispanic-White gap in reading in grade 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Read Volume 2.book Page 303 Wednesday, March 12, 2008 5:19 PM

Page 80: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Achievement

D-304 National Assessment of Educational Progress

• • • •••

OREGON

Figure 1. Distribution of grades 4 and 8 NAEP reading achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s reading standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.54 0.047 0.60 0.052Exceeding 0.61 0.060 0.56 0.049

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

•••••••••••••

•••••••••••••

••••••••••••••

•••••••••••••••••••••

•••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basicNAEP proficient

NAEP advanced

exceeding

meeting

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••

••••••••••••••••••

••••••••••••••••••••

••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Reading Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

exceeding

Read Volume 2.book Page 304 Wednesday, March 12, 2008 5:19 PM

Page 81: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

OREGON D

Comparison between NAEP and State Reading Assessment Results: 2003 D-305

• • • •••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP readingassessments, by grade: 1998, 2002, and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting reading standards, by grade: 1998, 2002, and 2003

Grade 4 (state grade 5) Grade 8

* NAEP and state assessment 1998-2002 or 2002-2003 changes are significantly different (p<.05).

** NAEP and state assessment 1998-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 1998, 2002, and 2003 Reading Assessment: Full pop-ulation estimates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting grades 5 and 8 reading standards as reported bystate: 1998, 2002, and 2003

SOURCE: Oregon Department of Education retrieved from http://www.ode.state.or.us/search/results/?id=126.

Grade 4 Grade 8Students 1998 2002 2003 1998 2002 2003Identified 19.7 24.5 26.0 14.2 17.8 19.8

English language learner 5.9 9.0 9.7 2.6 5.1 5.4Student with disability 13.2 12.7 13.4 11.3 10.4 12.3Both 0.6 2.9 3.0 0.2 2.3 2.0

Excluded 5.6 7.8 8.8 3.8 5.2 5.5English language learner 1.4 2.6 2.3 0.9 1.3 1.6Student with disability 4.1 3.6 4.9 2.9 2.9 2.9Both 0.2 1.6 1.5 0.0 1.0 1.0

Accommodated 4.2 4.1 5.1 3.5 2.6 3.6English language learner 0.7 1.1 1.5 0.5 0.3 0.5Student with disability 3.1 2.6 3.1 2.8 1.9 2.8Both 0.3 0.4 0.5 0.1 0.4 0.3

Level 1998 2002 2003Grade 5 66.0 79.0 76.0Grade 8 55.0 64.0 61.0

6571

67

1822 21

65

78 78

18

25 26

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

meeting

exceeding**

***

53 5449

28 2926

54

66

59

28

35

28

1998 2002 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

meeting

exceeding

**

**

*

Read Volume 2.book Page 305 Wednesday, March 12, 2008 5:19 PM

Page 82: Comparison Between NAEP and State Reading Assessment … · 1. All statements of differences are based on statistical tests at the 5% significance level. However, these results must

Hispanic-White Gap

D-306 National Assessment of Educational Progress

• • • •••

OREGON

Figure 3. Comparison of NAEP and state assessment Hispanic-White gaps inpercent meeting grade 8 reading standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Reading Assessment: Full population estimates.The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 6.0

Lower half 7.1

Upper half 6.1

Lower quarter 4.5

Middle half 4.5

Upper quarter 9.4

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Hispanic

White

0

Lowest

achievers

Highest

achievers

Median

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

State

NAEP

Lowest

achievers

Median Highest

achievers

Read Volume 2.book Page 306 Wednesday, March 12, 2008 5:19 PM