348
U.S. Department of Education NCES 2008-475 Comparison Between NAEP and State Mathematics Assessment Results: 2003 Volume 2 Research and Development Report

Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

U.S. Department of Education

NCES 2008-475

Comparison Between NAEP and State MathematicsAssessment Results: 2003

Volume 2

Research and Development Report

Cover_front_v2.fm Page 1 Saturday, March 22, 2008 3:30 PM

Page 2: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Cover_front_v2.fm Page 2 Saturday, March 22, 2008 3:30 PM

Page 3: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

U.S. Department of Education

NCES 2008-475

Comparison Between NAEP and State MathematicsAssessment Results: 2003

Volume 2

Research and Development Report

January 2008

Don McLaughlinVictor Bandeira de MelloCharles BlankenshipKassandra ChaneyPhil EsraHiro HikawaDaniela RojasPaul WilliamMichael Wolman

American Institutes for Research

Taslima Rahman

Project Officer

National Center for Education Statistics

Cover_front_v2.fm Page 3 Saturday, March 22, 2008 3:30 PM

Page 4: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

U.S. Department of Education

Margaret Spellings

Secretary

Institute of Education Sciences

Grover J. Whitehurst

Director

National Center for Education Statistics

Mark Schneider

Commissioner

The National Center for Education Statistics (NCES) is the primary federal entity for collecting, analyzing, andreporting data related to education in the United States and other nations. It fulfills a congressional mandate tocollect, collate, analyze, and report full and complete statistics on the condition of education in the United States;conduct and publish reports and specialized analyses of the meaning and significance of such statistics; assist stateand local education agencies in improving their statistical systems; and review and report on education activities inforeign countries.

NCES activities are designed to address high-priority education data needs; provide consistent, reliable, complete,and accurate indicators of education status and trends; and report timely, useful, and high-quality data to the U.S.Department of Education, the Congress, the states, other education policymakers, practitioners, data users, and thegeneral public. Unless specifically noted, all information contained herein is in the public domain.

We strive to make our products available in a variety of formats and in language that is appropriate to a variety ofaudiences. You, as our customer, are the best judge of our success in communicating information effectively. If youhave any comments or suggestions about this or any other NCES product or report, we would like to hear from you.Please direct your comments to

National Center for Education StatisticsInstitute of Education SciencesU.S. Department of Education1990 K Street NWWashington, DC 20006-5651¬

January 2008

The NCES World Wide Web Home Page address is http://nces.ed.gov.The NCES World Wide Web Electronic Catalog is http://nces.ed.gov/pubsearch.

Suggested Citation

McLaughlin, D.H., Bandeira de Mello, V., Blankenship, C., Chaney, K., Esra, P., Hikawa, H., Rojas, D., William, P., and Wolman, M. (2008).

Comparison Between NAEP and State Mathematics Assessment Results: 2003

(NCES 2008-475). National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. Washington, DC.

For ordering information on this report, write to

U.S. Department of EducationED PubsP.O. Box 1398Jessup, MD 20794-1398

or call toll free 1-877-4ED-Pubs or order online at http://www.edpubs.org.

Content Contact

Taslima Rahman(202) [email protected]

Cover_front_v2.fm Page 4 Saturday, March 22, 2008 3:30 PM

Page 5: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

iii

• • • •••

Contents

Page

Explanat ion of State Prof i les . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -1

Alabama . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -11

Alaska . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -19

Ar izona . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -23

Arkansas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -29

Cal i forn ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -37

Colorado . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -45

Connect i cut . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -49

Delaware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -59

Dist r i c t of Co lumbia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -67

F lor ida . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -73

Georg ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -83

Hawai i . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -91

Idaho . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -97

I l l ino is . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -103

Indiana . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -113

Iowa . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -121

Kansas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -125

Kentucky . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -131

Louis iana . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -137

Chapter_D0.fm Page iii Thursday, March 13, 2008 1:19 PM

Page 6: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

iv

National Assessment of Educational Progress

• • • •••

Page

Maine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -145

Mary land . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -149

Massachusetts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -153

Mich igan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -159

Minnesota . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -163

Miss i ss ipp i . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -167

Missour i . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -175

Montana . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -183

Nebraska . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -187

Nevada . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -191

New Hampshi re . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -199

New Jersey . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -203

New Mexico . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -213

New York . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -221

North Caro l ina . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -231

North Dakota . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -239

Ohio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -243

Oklahoma . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -249

Oregon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -255

Pennsy lvania . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -259

Rhode I s land . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -267

South Caro l ina . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -273

South Dakota . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -281

Tennessee . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -287

Texas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -295

Chapter_D0.fm Page iv Thursday, March 13, 2008 1:19 PM

Page 7: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CONTENTS

Comparison between NAEP and State Mathematics Assessment Results: 2003

v

• • • •••

Page

Utah . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -303

Vermont . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -307

Vi rg in ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -313

Washington . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -319

West V i rg in ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -323

Wiscons in . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -327

Wyoming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -333

Chapter_D0.fm Page v Thursday, March 13, 2008 1:19 PM

Page 8: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D0.fm Page vi Thursday, March 13, 2008 1:19 PM

Page 9: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-1

• • • •••

D

Explanation of State Profiles

D

he relations between the National Assessment of Educational Progress(NAEP) results and individual state assessment results vary from state to state.Individual state profiles in this section display the comparisons for each state.

Each state profile has up to 13 elements, depending on the availability of school-levelstate assessment information in the national longitudinal school-level stateassessment score database (NLSLSASD). They include:

• a summary description of the state assessment data;

• an overview of the results displayed in the profile;

• a display of the state’s achievement standard thresholds on the NAEPachievement distribution in the state;

• the correlations between NAEP and state assessment school achievement;

• the percentages of students with disabilities or English language learners;

• a comparison of NAEP and state assessment achievement changes;

• state-reported percentages of students meeting standards; and

• comparisons of NAEP and state assessment achievement gaps.

These are described below, in the context of the example profile displayed on thefollowing pages.

T

Chapter_D1.fm Page 1 Thursday, March 13, 2008 1:20 PM

Page 10: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-2

National Assessment of Educational Progress

• • • •••

E lement 1Br ief descr ipt ion of the s tate assessment data

The description is based primarily on information provided on the state educationagency website, as it applies to the data used in this comparison report (school-levelscores on reading and mathematics assessments). The information included in thedescriptions includes test(s) used, grades tested, subgroup data availability,availability of data across years, and data suppression information, as well as anyinformation which would be required for understanding the results presented in theprofile.

E lement 2Br ief textua l summary of s tat i s t i ca l ly s ign i f i cant d i f ferences between NAEP and s tate assessment scores .

The summary provides a brief overview of the results being displayed in the profile. Itincludes the number of schools in each grade which are being used for thecomparison, a textual explanation of the standards comparison graphs (element 3), abrief explanation of the changes in achievement (element 6), and a summary ofsignificant results for each gap type (Black-White, Hispanic-White, and poverty–elements 8-13).

1

The summary serves to highlight the information presented in thegraphs and tables.

1. The poverty gap in achievement refers to the difference in achievement between economicallydisadvantaged students and other students, where disadvantaged students are defined as those eligiblefor free/reduced price lunch.

Chapter_D1.fm Page 2 Thursday, March 13, 2008 1:20 PM

Page 11: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

EXPLANATION OF STATE PROFILES

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-3

• • • •••

Figure D-1.Elements 1 and 2 of the state profile

D-1

••••••

D State X Dhrough the Comprehensive Assessment System, X administers exams ingrades 4 and 7 in English language arts and grades 4 and 8 in mathematics.Scores are available for Hispanic and Black students, but there are too few

Black students in grade 8 to provide a reliable comparison. State X uses fourachievement levels for reporting purposes: warning, needs improvement, proficient, andadvanced. Assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 189 schools in grade 4 and 145 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. This is also true for grade 8.

• Trends. Between 2000 and 2003, NAEP reported a gain in grade 4 in percentproficient, which the state did not. Between 2000 and 2003, the NAEP grade 8gains in percent proficient are greater than the state assessment gains.

• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEPand state assessment measurement of the Black-White gap in mathematics ingrade 8 in 2003. Overall, there were no significant differences between NAEPand the state assessment in measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. There were insufficient data forcomparing the NAEP and state assessment measurement of the poverty gap inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However,these results must be considered in the context of the available data. NAEP and state assessmentsmay employ different test items, testing accommodations, and scoring methods; they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differencesin standards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T1

2

Chapter_D1.fm Page 3 Thursday, March 13, 2008 1:20 PM

Page 12: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-4

National Assessment of Educational Progress

• • • •••

E lement 3Pos i t ion of s tandards in the ach ievement d is t r ibut ion

The position of the state’s achievement standard thresholds on the NAEPachievement distribution in the state are based on mapping the percentagesachieving state standards reported for schools participating in NAEP with thedistribution of NAEP grade 4 or grade 8 performance in those schools.

2

In some cases,the state’s standard is for an adjacent grade. In those cases, the assumption is madethat the percentage of students meeting the state’s standard for one grade would beapproximately the same as the percentage meeting a standard the state might set forthe next grade. The distributions are displayed for all states with availablepercentages achieving standards in NAEP schools.

Because Alabama, Tennessee, and Utah data files available for this report do notinclude percentages of students meeting standards, the state profiles for these states,unlike the other states, are based on the median percentile rank in each school, notthe percentages meeting state standards. Therefore, no state standard thresholds areplaced on the NAEP scale.

E lement 4Corre lat ions of NAEP and s tate assessment school ach ievement

Based on schools participating in NAEP, this table displays correlations ofpercentages reported as meeting state standards with NAEP percentages ofachievement meeting the estimated state standard in the same schools. For thisdisplay, NAEP has been rescored to estimate the percentages of students above thestate’s cutpoints indicated in element 3.

In states with multiple standards, one standard was identified for this report as theprimary standard. In nearly every case, this is the standard that is used for reportingadequate yearly progress to the federal government. For Alabama, Tennessee, andUtah, the correlations are for median percentile ranks.

2. The figure plots the relative frequency of the NAEP plausible values in the state. Since the numericalvalues on the vertical axis (i.e., the relative frequencies, or more accurately, approximate probabilitydensities) are solely a function of the fineness of the categorization of the continuous scale on thehorizontal axis, it is neither meaningful nor appropriate to display numerical values for the verticalaxis.

Chapter_D1.fm Page 4 Thursday, March 13, 2008 1:20 PM

Page 13: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

EXPLANATION OF STATE PROFILES

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-5

• • • •••

Figure D-2.Elements 3 and 4 of the state profile

D-2 National Assessment of Educational Progress

••••••

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores:2003

grade 4

grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeeds Improvement 0.78 0.015 0.88 0.015Proficient 0.82 0.008 0.87 0.012Advanced 0.74 0.033 0.87 0.023

• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

needs improvement

•• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

needs improvement

proficient

advanced

3

4

Chapter_D1.fm Page 5 Thursday, March 13, 2008 1:20 PM

Page 14: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-6

National Assessment of Educational Progress

• • • •••

E lement 5Percentages of s tudents with d isab i l i t ies or Engl i sh language learners

Because measurement of trends in achievement can be affected by changes in thepercentages of students with disabilities (SD) or English language learners (ELLs),through their exclusion from testing or access to testing accommodations, informationabout these percentages are presented for NAEP assessments in 2000 and 2003. Thepercentages are presented separately for (1) English language learners (but not with adisability), (2) students with disabilities (who are not English language learners), and(3) English language learners who also have a disability. The percentages of studentsidentified with disabilities or as English language learners who participated in NAEPwithout accommodations are not included in the table.

The percentages of students excluded from NAEP participation are based on the totalstudent population. For example, if 10 percent of students have a disability and 40percent of those with a disability are excluded, that means that 4 percent of the totalstudent population is excluded. The use of full population estimates in this report isintended to minimize the effects of NAEP exclusions on the results of changes inachievement. Similarly, the percentages of students accommodated by NAEP are basedon the total student population. In the example above, if 50 percent of the includedSD/ELL students were accommodated, that would mean that accommodations wereprovided for 50 percent of the included 6 percent, or 3 percent of the total population.

E lement 6Compar ison of NAEP and s tate assessment changes in ach ievement , based on NAEP schools

Achievement changes are presented as percentages meeting the states’ standards inNAEP schools for state assessment results (lighter line) and for NAEP results (darkerline). The standards are equated in the first year of analysis, forcing the percentages tomatch in the first year by definition. Differences between NAEP and state assessmentachievement changes are revealed at the second point in time. Asterisks on the chartsindicate statistically significant differences (

p

<.05) between NAEP and stateassessment gains.

Comparisons of achievement changes are available only for states in which comparablestate scores are reported across years. Many states changed tests or changed standardsbetween 2000 and 2003 and, although data were available for the different tests, it isimpossible to construct meaningful comparisons of NAEP and state assessment gains.

E lement 7State reported percentages meet ing s tandard

The changes in achievement presented in element 6 are based on the NAEP sample ofschools, weighted to represent the state. In most states, these results can be comparedto reports issued by state education agencies on their websites.

3

These are shown in

3. The state-reported percentages were retrieved from state education agencies’ websites in July 2004.

Chapter_D1.fm Page 6 Thursday, March 13, 2008 1:20 PM

Page 15: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

EXPLANATION OF STATE PROFILES

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-7

• • • •••

element 7. Ideally, the percentages in the table of state-reported achievement shouldmatch the state assessment percentages based on the NAEP sample of schools.However, in some cases state assessment scores were not available for all NAEPschools. This occurs, for example, when state assessment scores are for an adjacentgrade and some NAEP schools do not include the grade tested, or when they have notbeen reported by the state.

Figure D-3.Elements 5, 6, and 7 of the state profile

STATE X D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-3

••••••

Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP mathematicsassessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting mathematics standards, by grade: 2000 and 2003

grade 4 grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p <.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting mathematics standards as reported by state: 2003

SOURCE: State education agency website.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.4 21.9 19.4 18.4

English language learner 5.1 3.8 3.0 2.0Student with disability 13.7 17.0 15.6 15.2Both 0.6 1.0 0.9 1.2

Excluded 2.7 2.9 2.7 3.1English language learner 2.0 0.8 0.9 0.8Student with disability 0.7 1.8 1.2 1.8Both 0.0 0.3 0.6 0.5

Accommodated 10.1 15.0 8.8 10.8English language learner 1.5 1.1 1.1 0.4Student with disability 8.2 13.3 7.5 10.0Both 0.5 0.6 0.2 0.5

Level 2000 2003Grade 4 40.0 40.0Grade 8 34.0 37.0

82

89

41

51

12

19

82

84

41

38

12

11

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

needsimprovement

proficient

advanced

*

*

*

6167

34

41

10

15

61

68

3438

1013

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

needsimprovement

proficient

advanced

*

5

6

7

Chapter_D1.fm Page 7 Thursday, March 13, 2008 1:20 PM

Page 16: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-8

National Assessment of Educational Progress

• • • •••

E lement 8Compar ison of NAEP and s tate assessment of the B lack–White grade 4 ach ievement gap

Three graphs and a table on the third page of the profile pertain to measurement ofan achievement gap in grade 4 in 2003. The graphs show comparisons of the gap asmeasured in NAEP schools (a) by state assessment and (b) by NAEP. In states inwhich at least 10 percent of public school membership is Black, the first achievementgap presented is the Black-White gap.

4

The two graphs at the top of the page are population profiles of the achievement ofBlack and White students as indicated by state assessment results (lighter lines) andNAEP results (darker lines). Both graphs represent percentages meeting the primarystate standard in the same sample of schools.

5

Interpretation of the population profiles is as follows: imagine the students in asubpopulation (e.g., White students) lined up along the horizontal axis, sorted fromthose in the lowest scoring segments of the subpopulation at the left to the highestscoring segments of the subpopulation at the right. The graph shows the percentageof students in each student’s school achieving the standard. For example, at themedian (50th percentile) of the White student population, White students are inschools in which about 62 percent of the White students are achieving the standard(the dashed line on the following graph), as measured by both NAEP and the stateassessment. By comparison, at the median (50th percentile) of the Black studentpopulation in the state, Black students are in schools in which about 33 percent ofthe Black students are achieving the standard (the solid line on the same graph).

The population gap profile in the lower left portion of the page displays the differencebetween the Black and White population profiles (i.e., the White profile is subtractedfrom the Black profile). The lighter line refers to state assessment of the gap; thedarker line refers to NAEP assessment of the gap. The space between those two linesrepresents the difference between NAEP and state assessment of the gap. In thisgraph, it appears that both assessments, but especially NAEP, find the gap to besomewhat larger in comparing the lower halves of the subpopulations than incomparing the upper halves.

The table at the lower right summarizes the average differences in gaps and indicateswhether the NAEP-State gap difference is significantly different from zero.

6

Positivenumbers indicate that the state assessment found the gap to be larger, negativenumbers the opposite. For example, in comparing the lower quarters of thesubpopulations, NAEP found the gap to be 1.4 percent larger (i.e., the gap between

4. At least 10 NAEP schools with sufficient numbers of minority students were required for constructinga comparison.

5. For Alabama, Tennessee, and Utah, states for which state reports of percentages meeting standardswere unavailable, comparisons are based on median percentile scores.

6. The significance was determined by a Student’s

t

. However, it is important to examine the values of aStudent’s

t

before reaching conclusions about gap differences, because in the cases of small samples,large variations in percentages meeting standards can occur by chance.

Chapter_D1.fm Page 8 Thursday, March 13, 2008 1:20 PM

Page 17: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

EXPLANATION OF STATE PROFILES

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-9

• • • •••

the percentages of Black and White students meeting the standard was 1.4 percentgreater when the NAEP measurements were compared than when the stateassessment scores were compared.) However, Student’s

t

-test indicates that thesedifferences may well be random. In the top quarter, NAEP found the gap to be 12.4percent larger with Student’s

t

indicating that these differences are

statisticallysignificant

for this gap comparison.

Figure D-4.Element 8 of the state profile

D-4 National Assessment of Educational Progress

••••••

Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p <.05)

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.5*

Lower half -3.3

Upper half -7.8

Lower quarter -1.4

Middle half -4.3

Upper quarter -12.4*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

8

Chapter_D1.fm Page 9 Thursday, March 13, 2008 1:20 PM

Page 18: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-10

National Assessment of Educational Progress

• • • •••

E lements 9 -13Other gap prof i les

Gap profiles in the same form as element 8 are also included for grade 8 and for theHispanic-White gap and the poverty gap where more than 10 percent of the studentsare in the subpopulation and sufficient data are available. All gap profiles are basedon percentages of students in schools meeting achievement standards, and for smallschools these percentages are subject to large random variations. Therefore, resultsfrom schools where very small numbers of minority students are enrolled andparticipate in the assessment are suppressed and are not represented in the populationprofiles. The

suppression threshold

for state assessment scores varies from state to state;however, in analyzing NAEP data, we omitted school-level percentages based on oneor two students.

Chapter_D1.fm Page 10 Thursday, March 13, 2008 1:20 PM

Page 19: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-11

• • • •••

D

Alabama

D

labama administers the Stanford Achievement Test, Tenth Edition (SAT-10)in grades 3-8 in reading and mathematics. Scores are available for Black andeconomically disadvantaged students. Alabama does not use multiple

achievement levels for reporting purposes on the SAT-9/SAT-10; instead, it reportsexam results in percentiles. Before 2003, when the SAT-10 was implemented,students took the SAT-9. School-level assessment scores based on 10 or fewerstudents are suppressed.

Summary of Compar i sons

The results of comparisons between NAEP and state assessment results, which for2003 are based on 106 schools in grade 4 and 100 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:

1

Standards.

There are not enough data to compare state standards to NAEP forgrade 4 or grade 8.

Trends.

There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in average percentile rank between 2000 and 2003.

Gaps.

Overall, the Black-White and poverty gaps in grades 4 and 8 in mathematicsin 2003 were greater when measured by NAEP compared to the state assessment.There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Hispanic-White gap in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

A

Chapter_D2.fm Page 11 Thursday, March 13, 2008 1:21 PM

Page 20: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-12

National Assessment of Educational Progress

• • • •••

A

LABAMA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

NOTE: State does not use multiple achievement levels for reporting; it reports exam results in percentiles.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard error

Percentile Rank 0.80 0.010 0.84 0.016

••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••

••••••••••••••••••••••••••••

••••••••••••

•••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 12 Thursday, March 13, 2008 1:21 PM

Page 21: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ALABAMA

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-13

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Students 2000 2003 2000 2003

Identified

12.8 11.6 14.1 13.6English language learner 0.2 0.4 0.5 0.9Student with disability 12.6 10.6 13.3 12.2Both # 0.5 0.4 0.5

Excluded

3.2 1.6 6.4 2.2English language learner # 0.1 0.1 0.3Student with disability 3.2 1.5 6.0 1.8Both # # 0.3 0.1

Accommodated

2.9 2.4 0.6 2.6English language learner # # # #Student with disability 2.9 2.2 0.5 2.4Both # 0.1 0.1 0.1

4237

5753

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

Percentile rank41 39

5551

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

Percentile rank

Chapter_D2.fm Page 13 Thursday, March 13, 2008 1:21 PM

Page 22: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-14

National Assessment of Educational Progress

• • • •••

A

LABAMA

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (

p

<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

difference

Overall -7.5*

Lower half -7.1*

Upper half -8.6*

Lower quarter -6.6*

Middle half -5.7*

Upper quarter -10.6*

Lowest

achievers

Median Highest

achieversa c h i e v e r s

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 14 Thursday, March 13, 2008 1:21 PM

Page 23: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ALABAMA

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-15

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (

p<.

05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

difference

Overall -8.1*

Lower half -7.6*

Upper half -7.3*

Lower quarter -5.5*

Middle half -10.8*

Upper quarter -10.1*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 15 Thursday, March 13, 2008 1:21 PM

Page 24: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-16

National Assessment of Educational Progress

• • • •••

A

LABAMA

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (

p

<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

difference

Overall -4.2*

Lower half -3.0

Upper half -6.1*

Lower quarter -0.5

Middle half -2.9

Upper quarter -5.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 16 Thursday, March 13, 2008 1:21 PM

Page 25: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ALABAMA

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-17

• • • •••

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (

p

<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

difference

Overall -3.6

Lower half -7.3*

Upper half -0.2

Lower quarter -5.1

Middle half -5.3*

Upper quarter 1.1

Lowest

achievers

Median Highest

achievers

HH0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 17 Thursday, March 13, 2008 1:21 PM

Page 26: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 18 Thursday, March 13, 2008 1:21 PM

Page 27: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-19

• • • •••

D

Alaska

D

laska administers the Alaska Benchmark Examinations and the CaliforniaAchievement Tests, Sixth Edition Survey (CAT/6). The Benchmark examstest students in grade 8 in reading and mathematics; the CAT/6 tests students

in grade 4 in reading and mathematics. Scores are available for Black students ingrade 4, but there are too few students in this subgroup to provide a reliablecomparison. Alaska uses four achievement levels for reporting purposes on theBenchmark exams:

not proficient

,

below proficient

,

proficient

, and

advanced

. However,2003 data were available for only one level:

proficient

. The CAT/6 results are reportedon only two levels:

not proficient

and

proficient

. Trend graphs are not included becauseAlaska did not participate in State NAEP prior to 2003. School-level assessmentscores based on 5 or fewer students are suppressed.

Summary of Compar i sons

The results of comparisons between NAEP and state assessment results, which for2003 are based on 110 schools in grade 4 and 57 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:

1

Standards.

The state’s primary grade 4 mathematics performance standard(

proficient

) is between the NAEP basic and proficient levels. This is also true forgrade 8.

Trends.

No comparisons were possible for grades 4 and 8.•

Gaps.

There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

A

Chapter_D2.fm Page 19 Thursday, March 13, 2008 1:21 PM

Page 28: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-20

National Assessment of Educational Progress

• • • •••

A

LASKA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard error

Proficient 0.78 0.023 0.86 0.028

••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

•••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

•••••••••••••••••

•••••••••••••••••

••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

proficient

Chapter_D2.fm Page 20 Thursday, March 13, 2008 1:21 PM

Page 29: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ALASKA

D

Comparison between NAEP and State Mathematics Assessment Results: 2003

D-21

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003

Identified

30.5

23.4

English language learner

14.1

8.6

Student with disability

12.8

12.1

Both

3.6

2.6

Excluded

1.0

1.0

English language learner

0.1

0.2

Student with disability

0.8

0.8

Both

0.1

#

Accommodated

9.9

7.9

English language learner

0.9

0.2

Student with disability

7.0

6.9

Both

2.0

0.8

Chapter_D2.fm Page 21 Thursday, March 13, 2008 1:21 PM

Page 30: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 22 Thursday, March 13, 2008 1:21 PM

Page 31: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-23

• • • •••

D

Arizona

D

he state administers Arizona’s Instrument to Measure Standards (AIMS) ingrades 3, 5, and 8 in reading and mathematics. Scores are available forHispanic and Black students, but there are too few Black students to provide a

reliable comparison. Arizona uses four achievement levels for reporting purposes:

fallsfar below the standard

,

approaches the standard

,

meets the standard

, and

exceeds thestandard

. School-level assessment scores based on 10 or fewer students are suppressed.

Summary of Compar i sons

The results of comparisons between NAEP and state assessment results, which for2003 are based on 99 schools in grade 5 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:

1

• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (meeting) is close to the NAEPproficient level.

• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent meeting aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in percent meeting between2000 and 2003.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in mathematics in grades 5 and8 in 2003. Overall, the Hispanic-White gap in grades 5 and 8 in percent meetingthe state’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 23 Thursday, March 13, 2008 1:21 PM

Page 32: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-24 National Assessment of Educational Progress

• • • •••

ARIZONA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorApproaching 0.68 0.019 0.74 0.016Meeting 0.77 0.012 0.69 0.014Exceeding 0.78 0.018 0.58 0.063

•••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

approaching

meeting

exceeding

•• •••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••

•••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122222333

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

approaching

meeting

exceeding

Chapter_D2.fm Page 24 Thursday, March 13, 2008 1:21 PM

Page 33: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ARIZONA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-25

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 (state assessment grade 5) Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Arizona Department of Education retrieved from http://www.ade.state.az.us/profile/publicview/.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 24.9 27.4 18.8 23.9

English language learner 14.3 15.2 8.2 12.8Student with disability 9.1 7.9 9.0 8.2Both 1.6 4.3 1.7 3.0

Excluded 4.3 4.6 3.0 3.6English language learner 1.7 1.1 1.0 1.1Student with disability 1.8 2.2 1.6 1.6Both 0.8 1.3 0.4 0.9

Accommodated 8.9 4.5 4.5 5.6English language learner 4.8 1.3 2.0 1.4Student with disability 3.6 2.6 2.1 3.4Both 0.5 0.7 0.3 0.8

Level 2000 2003Grade 5 35.0 49.0Grade 8 18.0 21.0

79

88

41

55

17

28

79

89

41 50

17

37

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*

*

approaching

meeting

exceeding

54 56

18 18

6 5

5461

18 21

6 7

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

approaching

meeting

exceeding

*

Chapter_D2.fm Page 25 Thursday, March 13, 2008 1:21 PM

Page 34: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-26 National Assessment of Educational Progress

• • • •••

ARIZONA

Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -12.1*

Lower half -10.8*

Upper half -14.2*

Lower quarter -7.1*

Middle half -15.1*

Upper quarter -11.0*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 26 Thursday, March 13, 2008 1:21 PM

Page 35: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ARIZONA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-27

• • • •••

Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.4*

Lower half -0.8

Upper half -7.6

Lower quarter -0.2

Middle half -2.5

Upper quarter -14.0*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 27 Thursday, March 13, 2008 1:21 PM

Page 36: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 28 Thursday, March 13, 2008 1:21 PM

Page 37: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-29

• • • •••

D Arkansas Dhrough the Arkansas Comprehensive Testing, Assessment and AccountabilityProgram (ACTAAP), the state administers Benchmark Exams in grades 4 and8 in reading and mathematics. Scores are available for Black and

economically disadvantaged students in grades 4 and 8 and for Hispanic students ingrade 4, but there are too few Hispanic students to provide a reliable comparison.Arkansas uses four achievement levels for reporting purposes: below basic, basic,proficient, and advanced. However, due to data unavailability, the trend graphs arepresented using only the proficient level. School-level assessment scores based on 9or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 117 schools in grade 4 and 101 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is close to the NAEPproficient level.

• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are less than the state assessment gains.

• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 29 Thursday, March 13, 2008 1:21 PM

Page 38: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-30 National Assessment of Educational Progress

• • • •••

ARKANSAS

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.80 0.011 0.79 0.015Proficient 0.81 0.009 0.77 0.025Advanced 0.81 0.019 0.55 0.069

•••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

Chapter_D2.fm Page 30 Thursday, March 13, 2008 1:21 PM

Page 39: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ARKANSAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-31

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Arkansas School Information Site retrieved from http://www.as-is.org/reportcard/.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 13.6 16.7 13.6 16.7

English language learner 1.3 2.8 0.6 2.2Student with disability 12.2 13.0 13.0 13.8Both 0.2 0.9 # 0.7

Excluded 4.0 2.2 2.2 1.9English language learner 0.1 0.8 0.4 0.5Student with disability 3.7 1.2 1.8 1.3Both 0.2 0.2 # 0.1

Accommodated 4.1 7.9 3.7 7.8English language learner 0.2 0.3 # 0.6Student with disability 3.9 7.5 3.7 7.0Both # 0.1 0.0 0.2

Level 2000 2003Grade 4 37.0 60.0Grade 8 14.0 22.0

36

53

36

60

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

proficient

*

1318

13

22

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*proficient

Chapter_D2.fm Page 31 Thursday, March 13, 2008 1:21 PM

Page 40: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-32 National Assessment of Educational Progress

• • • •••

ARKANSAS

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.5*

Lower half -8.7*

Upper half -8.4*

Lower quarter -6.5

Middle half -10.1*

Upper quarter -8.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 32 Thursday, March 13, 2008 1:21 PM

Page 41: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ARKANSAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-33

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 0.9

Lower half 0.3

Upper half 0.8

Lower quarter 1.6

Middle half 0.3

Upper quarter -1.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 33 Thursday, March 13, 2008 1:21 PM

Page 42: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-34 National Assessment of Educational Progress

• • • •••

ARKANSAS

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 0.5

Lower half 0.1

Upper half 0.3

Lower quarter 4.8

Middle half -1.2

Upper quarter -1.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 34 Thursday, March 13, 2008 1:21 PM

Page 43: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ARKANSAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-35

• • • •••

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 4.1

Lower half 2.9

Upper half 5.9

Lower quarter 3.3

Middle half 3.2

Upper quarter 5.9

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 35 Thursday, March 13, 2008 1:21 PM

Page 44: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 36 Thursday, March 13, 2008 1:21 PM

Page 45: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-37

• • • •••

D California Dhrough the Standardized Testing and Reporting (STAR) Program, the stateadministers two exams: the California Standards Tests (CST) and theCalifornia Achievement Tests, Sixth Edition Survey (CAT/6). The CST tests

students in grades 2-11 in English language arts and grades 2-7 in mathematics; theCAT/6 tests students in grades 2-11 in both reading and mathematics. Scores areavailable for Hispanic, Black, and economically disadvantaged students, but there aretoo few Black students to provide a reliable comparison. California uses fiveachievement levels for reporting purposes on the CST: far below basic, below basic,basic, proficient, and advanced. The CAT/6 results are reported as the percent at orabove the 25th, 50th, and 75th percentiles. Before 2003, when the CAT/6 wasimplemented, the Stanford Achievement Test, Ninth Edition (SAT-9) wasCalifornia’s norm-referenced test. Therefore, the scores from 2003 and from 2000 arenot comparable and since CST data are not available for 2000, the report does notinclude trend graphs. School-level assessment scores based on 10 or fewer studentsare suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 216 schools in grade 4 and 180 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics standard, proficient, is betweenthe NAEP basic and proficient levels. This is also true for grade 7.

• Trends. No comparisons were possible for grades 4 and 7.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White gap in grades 4 and 7 in 2003. Overall, theHispanic-White and poverty gaps in grade 4 in percent proficient in 2003 weregreater when measured by NAEP compared to the state assessment. Overall, therewere no significant differences between NAEP and the state assessment inmeasurement of the Hispanic-White and poverty gaps in grade 7 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 37 Thursday, March 13, 2008 1:21 PM

Page 46: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-38 National Assessment of Educational Progress

• • • •••

CALIFORNIA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8 (state 7th grade standards)

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorBelow Basic 0.56 0.039 0.63 0.028Basic 0.77 0.014 0.82 0.010Proficient 0.84 0.009 0.88 0.011Advanced 0.82 0.013 0.81 0.018

• ••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

•••••••••••••••••••••••••

••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

below basic

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••

••••••••••••••••••••••

•••••••••••••••••••••

••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

below basic

Chapter_D2.fm Page 38 Thursday, March 13, 2008 1:21 PM

Page 47: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CALIFORNIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-39

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 33.0 38.4 26.6 27.3

English language learner 24.8 28.5 16.4 16.5Student with disability 6.5 5.6 8.0 7.0Both 1.8 4.3 2.2 3.8

Excluded 5.6 3.4 4.2 2.6English language learner 2.3 1.5 1.3 1.2Student with disability 2.5 1.0 2.3 0.7Both 0.7 0.9 0.5 0.7

Accommodated 8.3 4.2 5.3 2.6English language learner 7.0 2.1 2.8 0.3Student with disability 1.0 1.2 1.7 1.5Both 0.2 0.9 0.9 0.8

Chapter_D2.fm Page 39 Thursday, March 13, 2008 1:21 PM

Page 48: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-40 National Assessment of Educational Progress

• • • •••

CALIFORNIA

Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -11.1*

Lower half -14.7*

Upper half -7.6*

Lower quarter -13.0*

Middle half -10.5*

Upper quarter -8.8*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 40 Thursday, March 13, 2008 1:21 PM

Page 49: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CALIFORNIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-41

• • • •••

Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.6

Lower half -5.9*

Upper half -3.4

Lower quarter -5.1

Middle half -6.1

Upper quarter -1.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 41 Thursday, March 13, 2008 1:21 PM

Page 50: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-42 National Assessment of Educational Progress

• • • •••

CALIFORNIA

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.7*

Lower half -9.5*

Upper half -4.2

Lower quarter -8.7

Middle half -8.3*

Upper quarter -3.6

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 42 Thursday, March 13, 2008 1:21 PM

Page 51: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CALIFORNIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-43

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.1

Lower half -2.8

Upper half -1.8

Lower quarter 1.5

Middle half -3.4

Upper quarter -1.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

High

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 43 Thursday, March 13, 2008 1:21 PM

Page 52: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 44 Thursday, March 13, 2008 1:21 PM

Page 53: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-45

• • • •••

D Colorado Dhrough the Colorado Student Assessment Program (CSAP), the stateadministers exams in grades 4 and 8 in reading and grades 5 and 8 inmathematics. The scores available for this report do not include any

breakdowns by race/ethnicity or poverty status. Colorado uses four achievementlevels for reporting purposes: unsatisfactory, partially proficient, proficient, and advanced.Colorado did not participate in State NAEP prior to 2003; therefore, trend graphs arenot included. School-level assessment scores based on 15 or fewer students aresuppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 5 and 104 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard (partiallyproficient) is below the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (partially proficient) is between the NAEP basic and proficientlevels.

• Trends. No comparisons were possible for grades 5 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 45 Thursday, March 13, 2008 1:21 PM

Page 54: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-46 National Assessment of Educational Progress

• • • •••

COLORADO

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorPartially Proficient 0.79 0.013 0.87 0.017Proficient 0.83 0.013 0.89 0.010Advanced 0.74 0.016 0.80 0.017

•••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

partially proficient

proficient

advanced

•••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••

•••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

partially proficient

proficient

advanced

Chapter_D2.fm Page 46 Thursday, March 13, 2008 1:21 PM

Page 55: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

COLORADO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-47

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 19.7 — 15.4

English language learner — 7.6 — 3.7Student with disability — 10.4 — 10.7Both — 1.7 — 1.0

Excluded — 2.3 — 1.9English language learner — 0.7 — 0.6Student with disability — 1.5 — 1.1Both — 0.1 — 0.2

Accommodated — 10.8 — 8.1English language learner — 3.6 — 1.3Student with disability — 6.4 — 6.4Both — 0.9 — 0.5

Chapter_D2.fm Page 47 Thursday, March 13, 2008 1:21 PM

Page 56: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 48 Thursday, March 13, 2008 1:21 PM

Page 57: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-49

• • • •••

D Connecticut Dhe state administers the Connecticut Mastery Test (CMT) in grades 4 and 8in reading and mathematics. Scores are available for Hispanic, Black, andeconomically disadvantaged students. The CMT was administered from 1998-

2002 using four achievement levels for reporting purposes: below basic, basic, proficient,and goal. Results for 2003 have been reported with one additional level: advanced.Because the data included for 2000 have only percent at or above goal, the trendgraph does not include any other levels. School-level assessment scores based on 19or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 108 schools in grade 4 and 102 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard (goal) isbetween the NAEP basic and proficient levels. This is also true for grade 8.

• Trends. Between 2000 and 2003, NAEP reported a gain in grades 4 and 8 inpercent achieving performance standard (goal), which the state did not.

• Gaps. Overall, the Black-White and poverty gaps in grade 4 in percent meeting thestate’s standard in mathematics in 2003 were greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the Black-White andpoverty gaps in mathematics in grade 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of theHispanic-White gap in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 49 Thursday, March 13, 2008 1:21 PM

Page 58: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-50 National Assessment of Educational Progress

• • • •••

CONNECTICUT

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.79 0.022 0.79 0.029Proficient 0.87 0.006 0.87 0.012Goal 0.89 0.004 0.89 0.007Advanced 0.74 0.008 0.86 0.005

•••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

goal

advanced

basic

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••

•••••••••••••••

••••••••••••••••••••••••••••••••••

••••••••••••••

••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

goal

advanced

Chapter_D2.fm Page 50 Thursday, March 13, 2008 1:21 PM

Page 59: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CONNECTICUT D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-51

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Connecticut State Department of Education retrieved from http://www.sde.ct.gov/sde/site/default.asp.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 14.4 16.1 15.8 17.1

English language learner 2.9 3.3 2.1 2.7Student with disability 11.0 11.9 13.3 13.6Both 0.4 0.9 0.4 0.9

Excluded 4.7 4.0 6.0 3.8English language learner 1.2 0.7 1.2 0.5Student with disability 3.3 2.8 4.4 3.0Both 0.2 0.5 0.4 0.3

Accommodated 4.2 7.5 3.8 7.8English language learner 0.5 1.3 0.6 1.0Student with disability 3.7 5.9 3.2 6.6Both # 0.3 # 0.2

Level 2000 2003Grade 4 60.2 60.4Grade 8 54.8 56.1

64

72

64

59

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

goal

*

57 56

57 60

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

goal*

Chapter_D2.fm Page 51 Thursday, March 13, 2008 1:21 PM

Page 60: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-52 National Assessment of Educational Progress

• • • •••

CONNECTICUT

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -9.5*

Lower half -5.2

Upper half -13.0*

Lower quarter -4.0

Middle half -11.5*

Upper quarter -14.7*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-80

-60

-40

-20

0

20

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-80

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 52 Thursday, March 13, 2008 1:21 PM

Page 61: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CONNECTICUT D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-53

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 0.2

Lower half -1.6

Upper half 2.7

Lower quarter -6.1

Middle half 1.9

Upper quarter 1.6

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

High

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 53 Thursday, March 13, 2008 1:21 PM

Page 62: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-54 National Assessment of Educational Progress

• • • •••

CONNECTICUT

Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.4

Lower half -4.7

Upper half -6.7

Lower quarter -2.6

Middle half -6.6

Upper quarter -6.8

Lowest

achievers

Median Highest

achieversHghet achievers0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 54 Thursday, March 13, 2008 1:21 PM

Page 63: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CONNECTICUT D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-55

• • • •••

Figure 6. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 1.6

Lower half -0.7

Upper half 4.1

Lower quarter -2.3

Middle half 2.9

Upper quarter 6.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 55 Thursday, March 13, 2008 1:21 PM

Page 64: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-56 National Assessment of Educational Progress

• • • •••

CONNECTICUT

Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.5*

Lower half -4.2

Upper half -6.4*

Lower quarter -1.4

Middle half -8.1*

Upper quarter -3.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 56 Thursday, March 13, 2008 1:21 PM

Page 65: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

CONNECTICUT D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-57

• • • •••

Figure 8. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 0.6

Lower half 1.5

Upper half 1.0

Lower quarter -1.9

Middle half 3.0

Upper quarter -1.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 57 Thursday, March 13, 2008 1:21 PM

Page 66: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 58 Thursday, March 13, 2008 1:21 PM

Page 67: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-59

• • • •••

D Delaware Dhrough the Delaware Student Testing Program (DSTP), the state administersexams in grades 3, 5, and 8 in reading and mathematics. Scores are availablefor Hispanic, Black, and economically disadvantaged students, but there are

too few Hispanic students to provide a reliable comparison. Delaware uses fiveachievement levels for reporting purposes: well below the standard, below the standard,meets the standard, exceeds the standard, and distinguished performance. Scores from 2000are not available for this report, so no direct comparisons could be made with scoresfrom 2003; therefore, trend graphs are not included. School-level assessment scoresbased on 14 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 50 schools in grade 5 and 32 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (meeting) is between the NAEP basic and proficient levels.

• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White and poverty gaps in mathematics ingrades 5 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 59 Thursday, March 13, 2008 1:21 PM

Page 68: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-60 National Assessment of Educational Progress

• • • •••

DELAWARE

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorBelow 0.54 0.072 0.73 0.028Meeting 0.58 0.035 0.79 0.041Exceeding 0.60 0.047 0.81 0.038Distinguished 0.55 0.062 0.79 0.046

••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

meeting

exceeding

distinguished

below

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••

•••••••••••

•••••••••••••

••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

exceeding

distinguished

below

Chapter_D2.fm Page 60 Thursday, March 13, 2008 1:21 PM

Page 69: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

DELAWARE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-61

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 18.0 — 17.9

English language learner — 2.2 — 1.4Student with disability — 15.0 — 15.4Both — 0.8 — 1.0

Excluded — 6.9 — 9.1English language learner — 0.8 — 0.7Student with disability — 5.8 — 8.0Both — 0.3 — 0.4

Accommodated — 7.4 — 5.6English language learner — 0.7 — 0.2Student with disability — 6.5 — 5.1Both — 0.3 — 0.4

Chapter_D2.fm Page 61 Thursday, March 13, 2008 1:21 PM

Page 70: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-62 National Assessment of Educational Progress

• • • •••

DELAWARE

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.4

Lower half -5.8*

Upper half 2.9

Lower quarter -7.2*

Middle half -2.2

Upper quarter 5.6*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 62 Thursday, March 13, 2008 1:21 PM

Page 71: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

DELAWARE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-63

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.3

Lower half -3.4

Upper half -1.0

Lower quarter -4.3*

Middle half -3.2

Upper quarter -0.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 63 Thursday, March 13, 2008 1:21 PM

Page 72: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-64 National Assessment of Educational Progress

• • • •••

DELAWARE

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 0.5

Lower half -2.7

Upper half 2.5

Lower quarter -1.3

Middle half -2.0

Upper quarter 9.2*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 64 Thursday, March 13, 2008 1:21 PM

Page 73: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

DELAWARE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-65

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 1.3

Lower half -3.0

Upper half 4.8*

Lower quarter -5.1

Middle half 1.9

Upper quarter 9.2*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 65 Thursday, March 13, 2008 1:21 PM

Page 74: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 66 Thursday, March 13, 2008 1:21 PM

Page 75: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-67

• • • •••

D District of Columbia Dhe District of Columbia administers the Stanford Achievement Test, NinthEdition (SAT-9) in reading and mathematics in grades 3-11. Scores areavailable for economically disadvantaged students. DC uses four performance

levels: below basic, basic, proficient, and advanced. Direct comparisons cannot be madebetween the data from 2000 and the data from 2003 because scores from 2000 are fordifferent grades than are those from 2003; therefore, trend graphs are not included.School-level assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 99 schools in grade 4 and 26 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, the poverty gap in grade 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the poverty gap inmathematics in grade 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 67 Thursday, March 13, 2008 1:21 PM

Page 76: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-68 National Assessment of Educational Progress

• • • •••

DISTRICT OF COLUMBIA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.69 0.017 0.90 0.014Proficient 0.69 0.003 0.97 0.008

•••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

•• ••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••

••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

Chapter_D2.fm Page 68 Thursday, March 13, 2008 1:21 PM

Page 77: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

DISTRICT OF COLUMBIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-69

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.3 18.4 15.2 19.8

English language learner 6.0 5.0 4.0 4.0Student with disability 13.2 11.7 10.9 14.6Both 0.2 1.6 0.3 1.1

Excluded 5.1 4.4 6.3 6.0English language learner 1.9 0.7 1.7 0.9Student with disability 3.3 3.1 4.4 4.6Both # 0.7 0.2 0.5

Accommodated 7.0 9.8 5.9 9.0English language learner 2.3 2.6 1.5 1.4Student with disability 4.6 6.6 4.2 7.2Both 0.1 0.7 0.2 0.4

Chapter_D2.fm Page 69 Thursday, March 13, 2008 1:21 PM

Page 78: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-70 National Assessment of Educational Progress

• • • •••

DISTRICT OF COLUMBIA

Figure 2. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -15.8*

Lower half -7.9*

Upper half -26.4*

Lower quarter -0.4

Middle half -12.9*

Upper quarter -35.4*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 70 Thursday, March 13, 2008 1:21 PM

Page 79: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

DISTRICT OF COLUMBIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-71

• • • •••

Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.3

Lower half -0.3

Upper half -3.1

Lower quarter 0.2

Middle half -1.6

Upper quarter -7.4*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 71 Thursday, March 13, 2008 1:21 PM

Page 80: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 72 Thursday, March 13, 2008 1:21 PM

Page 81: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-73

• • • •••

D Florida Dhe state administers the Florida Comprehensive Assessment Test (FCAT) ingrades 3-10 in reading and mathematics. Scores are available for Hispanic,Black, and economically disadvantaged students. Florida uses five

achievement levels for reporting purposes: Level 1 (little success), Level 2 (limitedsuccess), Level 3 (partial success), Level 4 (some success), and Level 5 (success). Scoresfrom 2000 are not available for this report, so no direct comparisons could be madewith scores from 2003; therefore, trend graphs are not included. School-levelassessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 103 schools in grade 4 and 96 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard ((3)partial success) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, the Black-White gap in grades 4 and 8 in percent meeting the state’s

standard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White gap inmathematics in grade 4 in 2003. Overall, the Hispanic-White gap in grade 8 inpercent meeting the state’s standard in mathematics in 2003 was greater whenmeasured by NAEP compared to the state assessment. Overall, there were nosignificant differences between NAEP and the state assessment in measurement ofthe poverty gap in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 73 Thursday, March 13, 2008 1:21 PM

Page 82: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-74 National Assessment of Educational Progress

• • • •••

FLORIDA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard error(2) Limited Success 0.80 0.009 0.82 0.011(3) Partial Success 0.89 0.012 0.86 0.018(4) Some Success 0.86 0.022 0.78 0.020(5) Success 0.73 0.037 0.76 0.041

•••••••••••••••••••••••••••••••••••

•••••••••••••••••••••

•••••••••••••••••••••••••••••

•••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

partial success

some success

success

limited success

•••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

•••••••••••••••••••

••••••••••••••••••••

••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

partial success

some success

success

limited success

Chapter_D2.fm Page 74 Thursday, March 13, 2008 1:21 PM

Page 83: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

FLORIDA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-75

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 26.3 — 19.2

English language learner — 7.9 — 5.2Student with disability — 15.3 — 12.2Both — 3.1 — 1.7

Excluded — 3.3 — 3.0English language learner — 1.2 — 1.1Student with disability — 1.5 — 1.5Both — 0.7 — 0.4

Accommodated — 14.7 — 11.3English language learner — 2.2 — 2.0Student with disability — 10.6 — 8.6Both — 1.9 — 0.7

Chapter_D2.fm Page 75 Thursday, March 13, 2008 1:21 PM

Page 84: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-76 National Assessment of Educational Progress

• • • •••

FLORIDA

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.2*

Lower half -8.5*

Upper half -7.5*

Lower quarter -9.8*

Middle half -6.9*

Upper quarter -4.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 76 Thursday, March 13, 2008 1:21 PM

Page 85: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

FLORIDA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-77

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.8*

Lower half -8.4*

Upper half -5.3

Lower quarter -5.4

Middle half -11.2*

Upper quarter -0.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 77 Thursday, March 13, 2008 1:21 PM

Page 86: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-78 National Assessment of Educational Progress

• • • •••

FLORIDA

Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.8

Lower half -5.1

Upper half -3.1

Lower quarter -2.7

Middle half -6.6

Upper quarter 1.6

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 78 Thursday, March 13, 2008 1:21 PM

Page 87: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

FLORIDA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-79

• • • •••

Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.3*

Lower half -11.2*

Upper half -2.2

Lower quarter -11.5*

Middle half -5.8

Upper quarter 2.9

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 79 Thursday, March 13, 2008 1:21 PM

Page 88: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-80 National Assessment of Educational Progress

• • • •••

FLORIDA

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.4

Lower half -6.1*

Upper half -0.7

Lower quarter -5.9*

Middle half -3.4

Upper quarter 1.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 80 Thursday, March 13, 2008 1:21 PM

Page 89: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

FLORIDA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-81

• • • •••

Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.7

Lower half -4.1

Upper half 1.1

Lower quarter -3.6

Middle half -4.9

Upper quarter 6.6

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 81 Thursday, March 13, 2008 1:21 PM

Page 90: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 82 Thursday, March 13, 2008 1:21 PM

Page 91: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-83

• • • •••

D Georgia Deorgia administers the Criterion-Referenced Competency Test (CRCT) ingrades 1-8 in reading and mathematics. Scores are available for Hispanic,Black, and economically disadvantaged students, but there are too few

Hispanic students to provide a reliable comparison. Georgia uses three performancelevels for reporting purposes: does not meet, meets, and exceeds the standard. School-level assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 147 schools in grade 4 and 113 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is below the NAEP basic level. This is also true for grade 8.

• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent meeting between 2000 and 2003. Between 2000 and2003, the NAEP grade 8 gains in percent meeting are less than the state assessmentgains.

• Gaps. Overall, the Black-White gap in grades 4 and 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003. Overall, there were no significant differences between NAEP andthe state assessment in measurement of the poverty gap in mathematics in grade 4in 2003. Overall, the poverty gap in grade 8 in percent meeting the state’s standardin mathematics in 2003 was greater when measured by NAEP compared to thestate assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

G

Chapter_D2.fm Page 83 Thursday, March 13, 2008 1:21 PM

Page 92: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-84 National Assessment of Educational Progress

• • • •••

GEORGIA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.83 0.017 0.80 0.012Exceeding 0.85 0.008 0.78 0.018

••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

meeting

exceeding

• •••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

•••••••••••••••••••••••

•••••••••••

••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

exceeding

Chapter_D2.fm Page 84 Thursday, March 13, 2008 1:21 PM

Page 93: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

GEORGIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-85

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Georgia Department of Education site retrieved from http://public.doe.k12.ga.us/.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 10.9 15.7 10.6 12.8

English language learner 1.5 3.3 1.4 1.6Student with disability 9.4 11.4 9.0 10.4Both # 1.0 0.3 0.8

Excluded 3.0 2.1 4.8 2.0English language learner 0.5 0.5 1.2 0.3Student with disability 2.5 1.5 3.4 1.4Both # 0.1 0.3 0.3

Accommodated 3.9 7.3 2.6 6.0English language learner 0.2 0.8 # 0.3Student with disability 3.7 6.2 2.6 5.4Both # 0.3 # 0.3

Level 2000 2003Grade 4 62.0 74.0Grade 8 54.0 67.0

62

77

10

18

6274

10

19

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

meeting

exceeding

5560

1214

55

66

1215

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*meeting

exceeding

Chapter_D2.fm Page 85 Thursday, March 13, 2008 1:21 PM

Page 94: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-86 National Assessment of Educational Progress

• • • •••

GEORGIA

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.4*

Lower half -9.7*

Upper half -7.3*

Lower quarter -10.4

Middle half -9.3*

Upper quarter -7.2*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 86 Thursday, March 13, 2008 1:21 PM

Page 95: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

GEORGIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-87

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -13.1*

Lower half -17.4*

Upper half -9.3*

Lower quarter -19.8*

Middle half -14.3*

Upper quarter -4.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 87 Thursday, March 13, 2008 1:21 PM

Page 96: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-88 National Assessment of Educational Progress

• • • •••

GEORGIA

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.9

Lower half -4.0

Upper half -3.8

Lower quarter -3.6

Middle half -4.2

Upper quarter -2.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 88 Thursday, March 13, 2008 1:21 PM

Page 97: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

GEORGIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-89

• • • •••

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -7.5*

Lower half -10.6*

Upper half -4.7

Lower quarter -11.1*

Middle half -9.2*

Upper quarter -1.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 89 Thursday, March 13, 2008 1:21 PM

Page 98: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 90 Thursday, March 13, 2008 1:21 PM

Page 99: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-91

• • • •••

D Hawaii Dhe state administers the Hawaii Content and Performance Standards II(HCPS-II) exam and the Stanford Achievement Test, Ninth Edition (SAT-9). Both exams test students in grades 3, 5, and 8 in reading and mathematics.

Scores are available for Hispanic students for grade 8 and for economicallydisadvantaged students for grades 5 and 8, but there are too few Hispanic students toprovide a reliable comparison. Hawaii uses four achievement levels for reportingpurposes on the HCPS-II: well below, approaches, meets, and exceeds the standard. Theachievement levels used for reporting purposes on the SAT-9 are percent at or abovestanines 4, 5, and 7. SAT-9 results are used for trend graphs because the SAT-9 keptthe same performance levels every year, while the HCPS-II set new standards in2003. School-level assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 5 and 54 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP proficient level. This is also true for grade 8.

• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent at or abovestanine 5 are greater than the state assessment gains. Between 2000 and 2003, thestate assessment declines in grade 8 in percent stanine 5 are greater than NAEP’s.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 5 and 8 in 2003. Overall, the poverty gap in grades 5 and 8 in mathematicsin 2003 was greater when measured by NAEP compared to the state assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 91 Thursday, March 13, 2008 1:21 PM

Page 100: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-92 National Assessment of Educational Progress

• • • •••

HAWAII

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorApproaching 0.67 0.019 0.79 0.037Meeting 0.78 0.010 0.83 0.017Exceeding 0.45 0.083 0.31 0.120

•••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

approaching

meeting

exceeding

•••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••

••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

approaching

meeting

exceeding

Chapter_D2.fm Page 92 Thursday, March 13, 2008 1:21 PM

Page 101: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

HAWAII D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-93

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 (state assessment grade 5) Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.4 16.6 20.3 20.3

English language learner 6.1 5.3 5.0 4.8Student with disability 11.9 9.9 14.4 14.2Both 1.4 1.3 0.9 1.3

Excluded 8.6 3.1 5.3 3.7English language learner 2.5 1.3 1.2 1.0Student with disability 5.3 1.3 3.8 2.2Both 0.8 0.4 0.3 0.5

Accommodated 2.7 8.2 2.0 8.8English language learner 0.2 1.7 0.3 1.3Student with disability 2.2 5.9 1.7 7.2Both 0.3 0.6 # 0.3

81

92

65

79

31

45

81 80

65 67

3133

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP *

*stanine 4

stanine 5

stanine 7

8083

61

65

19 20

80

72

61

54

19 20

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*

*stanine 5

stanine 7

stanine 4

Chapter_D2.fm Page 93 Thursday, March 13, 2008 1:21 PM

Page 102: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-94 National Assessment of Educational Progress

• • • •••

HAWAII

Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.7*

Lower half -5.1*

Upper half -5.9*

Lower quarter -3.3

Middle half -6.9*

Upper quarter -5.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 94 Thursday, March 13, 2008 1:21 PM

Page 103: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

HAWAII D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-95

• • • •••

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.6*

Lower half -4.5*

Upper half -5.0*

Lower quarter -2.9

Middle half -5.3*

Upper quarter -5.7*

Lowest

achievers

Median Highest

achievers Highest achievers

Highest achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 95 Thursday, March 13, 2008 1:21 PM

Page 104: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 96 Thursday, March 13, 2008 1:21 PM

Page 105: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-97

• • • •••

D Idaho Dhe state administers the Idaho Standards Achievement Tests (ISAT) in grades2-9 in reading and mathematics. Scores are available for Hispanic students.Idaho uses four achievement levels for reporting purposes: below basic,

proficient, and advanced. Scores from 2000 are not available for this report, so nodirect comparisons could be made with scores from 2003; therefore, trend graphs arenot included. School-level assessment scores based on 9 or fewer students aresuppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 114 schools in grade 4 and 86 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP basic level. The state’s primary grade 8mathematics performance standard (proficient) is between the NAEP basic andproficient levels.

• Trends. No trend comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White and poverty gaps in mathematics in grades 4 and8 in 2003. Overall, the Hispanic-White gap in grades 4 and 8 in percent meetingthe state’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 97 Thursday, March 13, 2008 1:21 PM

Page 106: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-98 National Assessment of Educational Progress

• • • •••

IDAHO

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.46 0.047 0.69 0.026Proficient 0.67 0.039 0.70 0.026Advanced 0.55 0.044 0.61 0.027

••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advancedbasic

proficient

advanced

• •••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••

•••••••••••••••••••••••

•••••••••••••••

••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

Chapter_D2.fm Page 98 Thursday, March 13, 2008 1:21 PM

Page 107: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

IDAHO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-99

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.7 17.6 13.9 14.6

English language learner 4.1 5.9 3.3 4.5Student with disability 10.6 10.4 9.6 8.9Both 1.1 1.3 0.9 1.2

Excluded 2.3 1.6 2.0 0.7English language learner 1.2 0.6 0.4 0.2Student with disability 0.6 0.8 1.4 0.4Both 0.4 0.2 0.1 0.2

Accommodated 6.6 7.4 3.7 4.5English language learner 0.6 0.6 0.4 0.6Student with disability 5.7 5.8 2.7 3.5Both 0.3 0.9 0.6 0.4

Chapter_D2.fm Page 99 Thursday, March 13, 2008 1:21 PM

Page 108: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-100 National Assessment of Educational Progress

• • • •••

IDAHO

Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -10.4*

Lower half -12.1*

Upper half -8.3

Lower quarter -11.8*

Middle half -11.4*

Upper quarter -7.1

Lowest

achievers

Median Highest

achievers Highest achieversHighest achievers0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 100 Thursday, March 13, 2008 1:21 PM

Page 109: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

IDAHO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-101

• • • •••

Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.4*

Lower half -6.9*

Upper half -5.0

Lower quarter -9.2*

Middle half -5.9

Upper quarter -5.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achieversHghet achievers0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 101 Thursday, March 13, 2008 1:21 PM

Page 110: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 102 Thursday, March 13, 2008 1:21 PM

Page 111: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-103

• • • •••

D Illinois Dhe state administers the Illinois Standards Achievement Test (ISAT) ingrades 3, 5, and 8 in reading and mathematics. Scores are available forHispanic, Black, and economically disadvantaged students. Illinois uses four

achievement levels for reporting purposes: academic warning, below the standard, meetsthe standard, and exceeds the standard. However, due to data unavailability, the trendgraphs only include the top two levels. School-level assessment scores based on 10 orfewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 161 schools in grade 5 and 169 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP basic level. The state’s primary grade 8 performancestandard is between the NAEP basic and proficient levels.

• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent meeting between 2000 and 2003. For grade 8, theNAEP gains in percent meeting are less than the state assessment gains.

• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grades 5 and8 in 2003. The Hispanic-White gap in grade 5 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were no significant differences between NAEP andthe state assessment in measurement of the Hispanic-White gap in mathematics ingrade 8 in 2003. There were no significant differences between NAEP and the stateassessment in measurement of the poverty gap in mathematics in grade 5 in 2003.The poverty gap in grade 8 in percent meeting the state’s standard in mathematicsin 2003 was greater when measured by NAEP compared to the state assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 103 Thursday, March 13, 2008 1:21 PM

Page 112: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-104 National Assessment of Educational Progress

• • • •••

ILLINOIS

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorBelow the Standard 0.58 0.040 0.70 0.045Meeting 0.84 0.011 0.92 0.009Exceeding 0.82 0.021 0.82 0.018

••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

•••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

below the standard

meeting

exceeding

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••

•••••••••••••••••••••••••

•••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

exceeding

below the standard

Chapter_D2.fm Page 104 Thursday, March 13, 2008 1:21 PM

Page 113: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ILLINOIS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-105

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 (state assessment grade 5) Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Illinois State Board of Education retrieved from http://www.isbe.net./news/2003/isat_charts.pdf.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 17.0 22.6 15.4 18.0

English language learner 6.0 7.2 4.3 2.8Student with disability 9.9 13.6 10.6 14.0Both 1.0 1.8 0.5 1.2

Excluded 3.1 4.3 4.8 4.4English language learner 1.2 1.6 1.5 0.8Student with disability 1.5 2.0 3.0 3.2Both 0.5 0.7 0.3 0.5

Accommodated 8.6 10.9 3.5 9.3English language learner 2.8 2.2 0.4 1.1Student with disability 5.3 8.0 3.1 7.8Both 0.5 0.7 # 0.5

Level 2000 2003Grade 5 57.3 68.3Grade 8 46.8 53.1

53

65

511

53

68

510

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

meeting

exceeding

meeting

exceeding

4649

1114

46

54

1116

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*

Chapter_D2.fm Page 105 Thursday, March 13, 2008 1:21 PM

Page 114: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-106 National Assessment of Educational Progress

• • • •••

ILLINOIS

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.5

Lower half -1.9

Upper half -2.6

Lower quarter -1.8

Middle half -4.2

Upper quarter 0.7

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100Pe

rcen

t m

eetin

g st

ate'

s pr

imar

y st

anda

rds

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 106 Thursday, March 13, 2008 1:21 PM

Page 115: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ILLINOIS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-107

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.3

Lower half -0.4

Upper half -1.8

Lower quarter 0.5

Middle half -3.7

Upper quarter 1.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

Highest achieversHighest achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 107 Thursday, March 13, 2008 1:21 PM

Page 116: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-108 National Assessment of Educational Progress

• • • •••

ILLINOIS

Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -7.1*

Lower half -5.1

Upper half -8.3*

Lower quarter -5.6

Middle half -5.7

Upper quarter -8.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100Pe

rcen

t m

eetin

g st

ate'

s pr

imar

y st

anda

rds

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 108 Thursday, March 13, 2008 1:21 PM

Page 117: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ILLINOIS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-109

• • • •••

Figure 6. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.9

Lower half -4.1

Upper half -5.3

Lower quarter -2.8

Middle half -3.5

Upper quarter -7.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 109 Thursday, March 13, 2008 1:21 PM

Page 118: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-110 National Assessment of Educational Progress

• • • •••

ILLINOIS

Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.7

Lower half -3.8

Upper half -3.5

Lower quarter -5.4

Middle half -4.8

Upper quarter -0.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100Pe

rcen

t m

eetin

g st

ate'

s pr

imar

y st

anda

rds

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 110 Thursday, March 13, 2008 1:21 PM

Page 119: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

ILLINOIS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-111

• • • •••

Figure 8. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.6*

Lower half -4.1

Upper half -6.7

Lower quarter -1.1

Middle half -7.2*

Upper quarter -6.2

Lowest

achievers

Median Highest

achieversHghet achievers0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 111 Thursday, March 13, 2008 1:21 PM

Page 120: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 112 Thursday, March 13, 2008 1:21 PM

Page 121: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-113

• • • •••

D Indiana Dhe state administers the Indiana Statewide Testing for Education Progress-Plus(ISTEP+) assessment in grades 3 and 8 in English language arts andmathematics. Scores are available for Black and economically disadvantaged

students in grades 3 and 8 and for Hispanic students in grade 8, but there are too fewHispanic students to provide a reliable comparison. Indiana uses three achievementlevels for reporting purposes: not pass, pass, and pass+. The ISTEP+ is given in thefall, so 2002-03 data correspond to the exams administered in the fall of 2002. Sincethe new ISTEP+ is based upon new content and is scored on a new scale, trendgraphs are not included in this report. School-level assessment scores based on 9 orfewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 110 schools in grade 3 and 99 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 3 mathematics performance standard (pass) isbetween the NAEP basic and proficient levels. This is also true for grade 8.

• Trends. No comparisons were possible for grades 3 and 8.• Gaps. Overall, the Black-White and poverty gaps in grade 3 in percent meeting the

state’s standard in mathematics in 2003 were greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the Black-White andpoverty gaps in mathematics in grade 8 in 2003. There were insufficient data forcomparing the NAEP and state assessment measurement of the Hispanic-Whitegap in mathematics in grades 3 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 113 Thursday, March 13, 2008 1:21 PM

Page 122: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-114 National Assessment of Educational Progress

• • • •••

INDIANA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state assessment grade 3)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 3 Grade 8Standard Correlation Standard error Correlation Standard errorPass 0.44 0.013 0.83 0.022Pass Plus 0.22 0.030 0.71 0.046

••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

pass

pass plus

• •••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

pass

pass plus

Chapter_D2.fm Page 114 Thursday, March 13, 2008 1:21 PM

Page 123: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

INDIANA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-115

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.4 16.5 12.3 15.2

English language learner 1.2 2.1 1.2 1.7Student with disability 10.0 13.7 11.1 12.7Both 0.2 0.7 0.1 0.9

Excluded 2.5 2.1 3.2 2.3English language learner 0.5 0.1 0.4 0.1Student with disability 1.8 1.7 2.8 2.0Both 0.2 0.3 # 0.3

Accommodated 6.0 6.7 3.2 6.7English language learner 0.6 0.6 # 0.4Student with disability 5.3 5.8 3.2 5.9Both 0.1 0.3 # 0.4

Chapter_D2.fm Page 115 Thursday, March 13, 2008 1:21 PM

Page 124: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-116 National Assessment of Educational Progress

• • • •••

INDIANA

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 3.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -22.7*

Lower half -14.9*

Upper half -30.2*

Lower quarter -9.5

Middle half -21.7*

Upper quarter -32.5*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 116 Thursday, March 13, 2008 1:21 PM

Page 125: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

INDIANA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-117

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.6

Lower half -2.2

Upper half 0.2

Lower quarter -5.4

Middle half -0.3

Upper quarter 1.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 117 Thursday, March 13, 2008 1:21 PM

Page 126: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-118 National Assessment of Educational Progress

• • • •••

INDIANA

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 3.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -11.5*

Lower half -13.0*

Upper half -9.9*

Lower quarter -10.7*

Middle half -14.3*

Upper quarter -7.5*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 118 Thursday, March 13, 2008 1:21 PM

Page 127: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

INDIANA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-119

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

# Rounds to zero.

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 4.2

Lower half 0.3

Upper half 8.5*

Lower quarter #

Middle half 5.3

Upper quarter 8.0*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 119 Thursday, March 13, 2008 1:21 PM

Page 128: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 120 Thursday, March 13, 2008 1:21 PM

Page 129: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-121

• • • •••

D Iowa Dowa administers the Iowa Tests of Basic Skills (ITBS) in grades 4 and 8 inreading and mathematics. Scores are available for Hispanic and Black studentsin grade 8, but there are too few students in these subgroups to provide a reliable

comparison. Iowa uses three achievement levels for reporting purposes (low,intermediate, and high), although the data available only included percent proficient.Iowa has defined proficient as the intermediate and high levels combined. Iowa’sscores are available for biennium periods only. For example, this year’s scores representthe biennium period 2001-02 to 2002-03. This is also the first year for which scoresare available for this report; for these reasons, trend graphs are not included. SinceIowa does not have NAEP grade 8 data for 2000, those cells in the inclusion andaccommodation table are empty. School-level assessment scores based on 10 or fewerstudents are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 133 schools in grade 4 and 114 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

I

Chapter_D2.fm Page 121 Thursday, March 13, 2008 1:21 PM

Page 130: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-122 National Assessment of Educational Progress

• • • •••

IOWA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.77 0.016 0.77 0.047

•••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••

••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

proficient

Chapter_D2.fm Page 122 Thursday, March 13, 2008 1:21 PM

Page 131: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

IOWA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-123

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 14.6 17.9 — 17.5

English language learner 2.0 2.6 — 1.8Student with disability 12.5 14.1 — 15.1Both 0.1 1.2 — 0.6

Excluded 2.3 3.0 — 2.4English language learner 0.9 0.6 — 0.2Student with disability 1.4 2.1 — 2.2Both # 0.4 — #

Accommodated 7.0 10.6 — 9.5English language learner 0.2 0.5 — 0.7Student with disability 6.8 9.6 — 8.6Both # 0.5 — 0.3

Chapter_D2.fm Page 123 Thursday, March 13, 2008 1:21 PM

Page 132: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 124 Thursday, March 13, 2008 1:21 PM

Page 133: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-125

• • • •••

D Kansas Dansas administers exams in grades 5 and 8 in reading and in grades 4 and 7 inmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Hispanic students in grades 4

and 7 and too few Black students in grade 7 to provide reliable comparisons betweenthese subgroups and White students. Kansas uses five achievement levels forreporting purposes: unsatisfactory, basic, proficient, advanced, and exemplary. School-level assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 130 schools in grade 4 and 120 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 7.

• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent proficient between 2000 and 2003.

• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Black-White gap in mathematics in grade 7 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Hispanic-White gap in mathematics in grades 4 and 7 in 2003.Overall, there were no significant differences between NAEP and the stateassessment in measurement of the poverty gap in mathematics in grades 4 and 7 in2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

K

Chapter_D2.fm Page 125 Thursday, March 13, 2008 1:21 PM

Page 134: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-126 National Assessment of Educational Progress

• • • •••

KANSAS

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8 (state 7th grade standards)

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorBasic 0.65 0.011 0.71 0.009Proficient 0.66 0.021 0.72 0.014Advanced 0.63 0.024 0.68 0.020Exemplary 0.56 0.022 0.64 0.049

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••

••••••••••

•••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

exemplary

basic

•••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

proficient

advanced

exemplary

basic

Chapter_D2.fm Page 126 Thursday, March 13, 2008 1:21 PM

Page 135: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

KANSAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-127

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8 (state assessment grade 5)

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Kansas State Department of Education retrieved fromhttp://www3.ksde.org/ayp/2003_Kansas_State_Assessment_Highlights.htm

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.7 15.8 13.7 15.9

English language learner 4.1 2.3 1.4 2.8Student with disability 10.6 12.7 12.3 12.3Both 1.1 0.7 # 0.8

Excluded 3.0 1.7 3.3 2.9English language learner # 0.4 0.2 0.6Student with disability 2.6 1.2 3.2 2.0Both 0.4 0.1 # 0.4

Accommodated 4.2 10.9 2.6 9.4English language learner 0.7 1.0 # 1.4Student with disability 3.5 9.5 2.6 7.7Both # 0.4 # 0.3

Level 2000 2003Grade 4 62.4 73.6Grade 7 54.6 60.0

8591

59

71

37

49

1221

85

92

59

74

37

52

12

22

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

basic

proficient

advanced

exemplary

78 79

55 56

33 34

1316

78 81

55

59

3338

1317

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

basic

proficient

advanced

exemplary

Chapter_D2.fm Page 127 Thursday, March 13, 2008 1:21 PM

Page 136: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-128 National Assessment of Educational Progress

• • • •••

KANSAS

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -11.2*

Lower half -12.9*

Upper half -8.6

Lower quarter -14.7*

Middle half -8.9

Upper quarter -4.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 128 Thursday, March 13, 2008 1:21 PM

Page 137: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

KANSAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-129

• • • •••

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -7.7

Lower half -7.6

Upper half -8.2

Lower quarter -6.9

Middle half -7.6

Upper quarter -10.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

High

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 129 Thursday, March 13, 2008 1:21 PM

Page 138: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-130 National Assessment of Educational Progress

• • • •••

KANSAS

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 1.5

Lower half 0.2

Upper half 3.5

Lower quarter 2.2

Middle half -0.5

Upper quarter 6.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 130 Thursday, March 13, 2008 1:21 PM

Page 139: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-131

• • • •••

D Kentucky Dhrough the Commonwealth Accountability Testing System (CATS), theCommonwealth administers Kentucky Core Content Tests (KCCT) in grades4 and 7 in reading and grades 5 and 8 in mathematics. Scores are available for

Black and economically disadvantaged students, but there are too few Black studentsin grade 8 to provide a reliable comparison. Kentucky uses four achievement levelsfor reporting purposes: novice, apprentice, proficient, and distinguished. School-levelassessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 117 schools in grade 5 and 112 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent proficient between 2000 and 2003.

• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grade 5 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White gap in mathematics in grade 8 in 2003. Therewere insufficient data for comparing the NAEP and state assessment measurementof the Hispanic-White gap in mathematics in grades 5 and 8 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the poverty gap in mathematics in grades 5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 131 Thursday, March 13, 2008 1:21 PM

Page 140: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-132 National Assessment of Educational Progress

• • • •••

KENTUCKY

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorApprentice 0.52 0.049 0.66 0.035Proficient 0.53 0.019 0.72 0.026Distinguished 0.58 0.021 0.65 0.048

•••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••

••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

apprentice

proficient

distinguished

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

apprentice

proficient

distinguished

Chapter_D2.fm Page 132 Thursday, March 13, 2008 1:21 PM

Page 141: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

KENTUCKY D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-133

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 (state assessment grade 5) Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Kentucky Department of Education retrieved fromhttp://www.ksde.org/ayp/2003_Kansas_State_Assessment_Highlights.htm.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.5 14.4 13.6 13.6

English language learner 0.5 1.0 1.1 0.9Student with disability 11.0 12.7 12.3 12.2Both 0.1 0.7 0.2 0.4

Excluded 2.6 3.2 4.5 4.4English language learner # 0.3 0.5 0.4Student with disability 2.5 2.7 3.8 3.9Both 0.1 0.2 0.2 0.1

Accommodated 5.1 6.7 4.4 5.0English language learner # # 0.1 0.1Student with disability 5.1 6.3 4.3 4.8Both # 0.3 # 0.1

Level 2000 2003Grade 5 31.3 38.1Grade 8 25.2 30.9

61

74

31

41

5 6

61 68

31 38

58

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*

apprentice

proficient

distinguished

6569

2630

6 7

65

73

26

32

6 8

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

apprentice

proficient

distinguished

*

Chapter_D2.fm Page 133 Thursday, March 13, 2008 1:21 PM

Page 142: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-134 National Assessment of Educational Progress

• • • •••

KENTUCKY

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.3

Lower half -0.4

Upper half -3.9

Lower quarter -0.6

Middle half -1.9

Upper quarter 1.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 134 Thursday, March 13, 2008 1:21 PM

Page 143: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

KENTUCKY D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-135

• • • •••

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

# Rounds to zero.

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.3

Lower half -1.5

Upper half -2.9

Lower quarter 0.5

Middle half -4.2

Upper quarter #

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 135 Thursday, March 13, 2008 1:21 PM

Page 144: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-136 National Assessment of Educational Progress

• • • •••

KENTUCKY

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.2

Lower half -0.7

Upper half 1.1

Lower quarter -1.1

Middle half -1.1

Upper quarter 2.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 136 Thursday, March 13, 2008 1:21 PM

Page 145: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-137

• • • •••

D Louisiana Dhe state administers the Louisiana Educational Assessment Program for the21st Century (LEAP 21) in grades 4 and 8 in English language arts andmathematics. Scores are available for Black and economically disadvantaged

students. Louisiana uses five achievement levels for reporting purposes: unsatisfactory,approaching basic, basic, mastery, and advanced. School-level assessment scores basedon 10 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 4 and 94 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(mastery) is between the NAEP proficient and advanced levels. This is also true forgrade 8.

• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent mastery aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in percent mastery between2000 and 2003.

• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 137 Thursday, March 13, 2008 1:21 PM

Page 146: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-138 National Assessment of Educational Progress

• • • •••

LOUISIANA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorApproaching Basic 0.73 0.028 0.84 0.015Basic 0.77 0.020 0.88 0.010Mastery 0.79 0.020 0.82 0.024Advanced 0.68 0.049 0.65 0.082

•• •••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

mastery

advanced

approaching basic

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••

•••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

mastery

advanced

approaching basic

Chapter_D2.fm Page 138 Thursday, March 13, 2008 1:21 PM

Page 147: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

LOUISIANA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-139

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Louisiana Department of Education retrieved from http://www.doe.state.la.us/lde/uploads/3779.pdf.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.8 21.6 13.1 16.4

English language learner 0.4 0.7 0.7 0.6Student with disability 15.1 20.0 12.4 15.1Both 0.3 1.0 # 0.6

Excluded 2.6 2.8 2.6 4.6English language learner 0.1 # 0.1 0.2Student with disability 2.4 2.8 2.5 4.1Both 0.1 # # 0.3

Accommodated 11.1 16.0 6.2 9.6English language learner 0.2 0.5 0.3 0.1Student with disability 10.8 14.7 5.9 9.2Both 0.1 0.8 # 0.2

Level 2000 2003Grade 4 12.0 16.0

Grade 8 8.0 8.0

73

82

50

62

11

19

1

4

73 81

50 58

11 16

13

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

approachingbasic

basic

mastery

advanced

*

*

*

69

75

48

55

7

11

3

4

69 74

4752

7 93 3

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

approachingbasic

basic

mastery

advanced

Chapter_D2.fm Page 139 Thursday, March 13, 2008 1:21 PM

Page 148: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-140 National Assessment of Educational Progress

• • • •••

LOUISIANA

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.7*

Lower half -1.4

Upper half -7.7*

Lower quarter -2.5

Middle half -2.9

Upper quarter -9.9*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 140 Thursday, March 13, 2008 1:21 PM

Page 149: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

LOUISIANA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-141

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.1

Lower half 1.1

Upper half -5.1*

Lower quarter 2.5

Middle half -1.6

Upper quarter -4.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 141 Thursday, March 13, 2008 1:21 PM

Page 150: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-142 National Assessment of Educational Progress

• • • •••

LOUISIANA

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.2

Lower half -0.2

Upper half -5.4

Lower quarter -2.1

Middle half -2.6

Upper quarter -6.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 142 Thursday, March 13, 2008 1:21 PM

Page 151: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

LOUISIANA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-143

• • • •••

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.7

Lower half 1.4

Upper half -3.0

Lower quarter 2.0

Middle half -2.0

Upper quarter -3.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 143 Thursday, March 13, 2008 1:21 PM

Page 152: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 144 Thursday, March 13, 2008 1:21 PM

Page 153: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-145

• • • •••

D Maine Dhrough Maine’s Comprehensive Assessment System (Meccas), the stateadministers the Maine Educational Assessment (MEA) in grades 4 and 8 inreading and mathematics. The scores available for this report do not include

any breakdowns by race/ethnicity or poverty status. Maine uses four achievementlevels for reporting purposes: does not meet the standard, partially meets the standard,meets the standard, and exceeds the standard. School-level assessment scores based on 4or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP proficient and advanced levels. This is also true forgrade 8.

• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent meeting aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in percent meeting between2000 and 2003.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 145 Thursday, March 13, 2008 1:21 PM

Page 154: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-146 National Assessment of Educational Progress

• • • •••

MAINE

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPartially Meeting 0.51 0.046 0.61 0.010Meeting 0.56 0.052 0.69 0.036Exceeding 0.52 0.032 0.15 0.133

••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••

•••••••••••

••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••

••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

partially meeting

meeting

exceeding

Chapter_D2.fm Page 146 Thursday, March 13, 2008 1:21 PM

Page 155: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MAINE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-147

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Maine Department of Education retrieved from http://www.state.me.us/education/mea/edmea.htm.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.2 18.4 14.7 16.8

English language learner 1.1 0.7 0.3 0.5Student with disability 15.1 17.0 14.2 15.7Both 0.1 0.6 0.2 0.6

Excluded 4.5 3.4 2.7 3.8English language learner 0.3 0.1 0.1 0.1Student with disability 4.3 2.9 2.5 3.5Both # 0.4 0.1 0.3

Accommodated 6.7 10.5 4.6 7.5English language learner # 0.1 0.2 0.1Student with disability 6.7 10.4 4.4 7.2Both # 0.1 # 0.2

Level 2000 2003Grade 4 23.0 28.0Grade 8 21.0 18.0

71

82

23

35

2 3

71

72

23 29

2 3

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

partiallymeeting

meeting

exceeding

*

*

60 60

21

19

1

1

60

68

21

17

10

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

partiallymeeting

meeting

exceeding

*

Chapter_D2.fm Page 147 Thursday, March 13, 2008 1:21 PM

Page 156: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 148 Thursday, March 13, 2008 1:21 PM

Page 157: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-149

• • • •••

D Maryland Dhe state administers the Maryland School Assessment (MSA) in grades 3, 5,and 8 in reading and mathematics. The scores available for this report do notinclude any breakdowns by race/ethnicity or poverty status. Maryland uses

three achievement levels for reporting purposes: basic, proficient, and advanced. Before2003, when the MSA was implemented, students took the Maryland SchoolPerformance Assessment Program (MSPAP) exams. For this reason, scores from 2003and those from 2000 are not comparable; therefore, this report does not include trendgraphs. School-level assessment scores based on 4 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 106 schools in grade 5 and 96 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 5 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 149 Thursday, March 13, 2008 1:21 PM

Page 158: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-150 National Assessment of Educational Progress

• • • •••

MARYLAND

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.83 0.003 0.88 0.016Advanced 0.75 0.022 0.82 0.027

•••••••••••••••••••••••••••••••••••••

•••••••••••

••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••

••••••••••••••

•••••••••••••••••••

•••••••••••••••••

••••••••••••••••••••••

••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

proficient

advanced

Chapter_D2.fm Page 150 Thursday, March 13, 2008 1:21 PM

Page 159: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MARYLAND D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-151

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.5 15.7 13.3 15.7

English language learner 1.5 2.9 1.4 2.2Student with disability 10.7 11.7 11.2 12.9Both 0.3 1.1 0.7 0.7

Excluded 2.5 3.8 2.7 4.1English language learner 0.8 0.9 0.8 0.7Student with disability 1.6 2.3 1.6 3.1Both 0.1 0.6 0.3 0.3

Accommodated 5.5 6.2 3.7 4.8English language learner 0.1 0.4 0.2 0.2Student with disability 5.5 5.4 3.4 4.5Both # 0.4 0.2 0.1

Chapter_D2.fm Page 151 Thursday, March 13, 2008 1:21 PM

Page 160: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 152 Thursday, March 13, 2008 1:21 PM

Page 161: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-153

• • • •••

D Massachusetts Dhrough the Massachusetts Comprehensive Assessment System (MCAS), theCommonwealth administers exams in grades 4 and 7 in English language artsand grades 4 and 8 in mathematics. Scores are available for Hispanic and

Black students, but there are too few Black students in grade 8 to provide a reliablecomparison. Massachusetts uses four achievement levels for reporting purposes:warning (failing), needs improvement, proficient, and advanced. School-level assessmentscores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 161 schools in grade 4 and 128 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. This is also true for grade 8.

• Trends. Between 2000 and 2003, NAEP reported a gain in grade 4 in percentproficient, which the state did not. Between 2000 and 2003, the NAEP grade 8gains in percent proficient are greater than the state assessment gains.

• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Black-White gap in mathematics in grade 8 in2003. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Hispanic-White gap in mathematics in grades 4and 8 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the poverty gap in mathematics in grades 4 and 8 in2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 153 Thursday, March 13, 2008 1:21 PM

Page 162: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-154 National Assessment of Educational Progress

• • • •••

MASSACHUSETTS

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeeds Improvement 0.78 0.015 0.88 0.015Proficient 0.82 0.008 0.87 0.012Advanced 0.74 0.033 0.87 0.023

• ••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

needs improvement

•• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

•••••••••

••••••••••••

•••••••••••••••••••••••••••

••••••••••

••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

needs improvement

proficient

advanced

Chapter_D2.fm Page 154 Thursday, March 13, 2008 1:21 PM

Page 163: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MASSACHUSETTS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-155

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Massachusetts Dept. of Education from http://www.doe.mass.edu/mcas/2003/results/summary.pdf.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.4 21.9 19.4 18.4

English language learner 5.1 3.8 3.0 2.0Student with disability 13.7 17.0 15.6 15.2Both 0.6 1.0 0.9 1.2

Excluded 2.7 2.9 2.7 3.1English language learner 2.0 0.8 0.9 0.8Student with disability 0.7 1.8 1.2 1.8Both # 0.3 0.6 0.5

Accommodated 10.1 15.0 8.8 10.8English language learner 1.5 1.1 1.1 0.4Student with disability 8.2 13.3 7.5 10.0Both 0.5 0.6 0.2 0.5

Level 2000 2003Grade 4 40.0 40.0Grade 8 34.0 37.0

82

89

41

51

12

19

82

84

41

38

12

11

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

needsimprovement

proficient

advanced

*

*

*

6167

34

41

10

15

61

68

3438

1013

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

needsimprovement

proficient

advanced

*

Chapter_D2.fm Page 155 Thursday, March 13, 2008 1:21 PM

Page 164: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-156 National Assessment of Educational Progress

• • • •••

MASSACHUSETTS

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.5*

Lower half -3.3

Upper half -7.8

Lower quarter -1.4

Middle half -4.3

Upper quarter -12.4*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 156 Thursday, March 13, 2008 1:21 PM

Page 165: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MASSACHUSETTS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-157

• • • •••

Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.7

Lower half -1.6

Upper half -12.0*

Lower quarter 0.4

Middle half -6.6*

Upper quarter -12.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 157 Thursday, March 13, 2008 1:21 PM

Page 166: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White

D-158 National Assessment of Educational Progress

• • • •••

MASSACHUSETTS

Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.3

Lower half -1.3

Upper half -7.4

Lower quarter -0.1

Middle half -3.3

Upper quarter -8.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 158 Thursday, March 13, 2008 1:21 PM

Page 167: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-159

• • • •••

D Michigan Dhrough the Michigan Educational Assessment Program (MEAP), the stateadministers exams in grades 4 and 7 in reading and grades 4 and 8 inmathematics. The scores available for this report do not include any

breakdowns by race/ethnicity or poverty status. Michigan uses four achievementlevels for reporting purposes: Level 4 (apprentice), Level 3 (basic performance), Level 2(met expectations), and Level 1 (exceeded expectations). Because the MEAP examschanged in 2003, direct comparisons cannot be made between scores from 2003 andthose from 2000; therefore, trend graphs are not included. School-level assessmentscores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 133 schools in grade 4 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 159 Thursday, March 13, 2008 1:21 PM

Page 168: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-160 National Assessment of Educational Progress

• • • •••

MICHIGAN

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.54 0.027 0.87 0.005Meeting 0.74 0.011 0.87 0.009Exceeding 0.80 0.018 0.84 0.018

•••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

meeting

exceeding

•• ••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

•••••••••••••

••••••••••••••

•••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

meeting

exceeding

Chapter_D2.fm Page 160 Thursday, March 13, 2008 1:21 PM

Page 169: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MICHIGAN D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-161

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.1 15.0 10.7 14.7

English language learner 1.0 4.3 0.3 2.1Student with disability 10.0 9.7 10.3 12.1Both 0.1 1.0 # 0.4

Excluded 3.3 4.1 3.9 4.7English language learner 0.7 0.6 0.3 0.5Student with disability 2.5 3.2 3.5 3.9Both 0.1 0.2 # 0.2

Accommodated 4.4 5.7 2.2 6.1English language learner # 0.6 # 1.0Student with disability 4.4 4.6 2.2 5.2Both # 0.5 # 0.0

Chapter_D2.fm Page 161 Thursday, March 13, 2008 1:21 PM

Page 170: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 162 Thursday, March 13, 2008 1:21 PM

Page 171: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-163

• • • •••

D Minnesota Dhe state administers the Minnesota Comprehensive Assessments (MCA) ingrades 3 and 5 in reading and mathematics. Scores are available for Black andeconomically disadvantaged students in grade 5, but there are too few Black

students to provide a reliable comparison. Minnesota uses five achievement levels forreporting purposes: Level 1 (gaps in knowledge), Level 2a (partial knowledge), Level 2b(satisfactory), Level 3 (proficient), and Level 4 (superior). Grade 8 trends are notincluded in this report because the state does not test this grade. School-levelassessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 100 schools in grade 5 (no grade 8 schools), are shown graphicallyon the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. There are not enoughdata to compare state standards to NAEP for grade 8.

• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent proficient between 2000 and 2003. No comparisonswere possible for grade 8.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 5 and 8 in 2003. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the poverty gap in mathematicsin grade 5 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the poverty gap in mathematics in grade 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 163 Thursday, March 13, 2008 1:21 PM

Page 172: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-164 National Assessment of Educational Progress

• • • •••

MINNESOTA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

— Not available. † Not applicable.SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard error(2a) Partial Knowledge 0.71 0.048 — †(2b) Satisfactory 0.79 0.017 — †(3) Proficient 0.77 0.016 — †(4) Superior 0.62 0.017 — †

•••••••••••••••••••••••••••••••••••••••••••

••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

satisfactory

proficient

superior

partial knowledge

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••

••••••••••••••••••••••••

••••••••••••

•••••••••••••••••

•••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 164 Thursday, March 13, 2008 1:21 PM

Page 173: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MINNESOTA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-165

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting grade 4 mathematics standards: 2000 and 2003

Grade 4 (state assessment grade 5)

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: MInnesota Department of Education retrieved from http://education.state.mn.us/CLASS/mcaGraphs.do?

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.4 18.3 15.1 16.3

English language learner 4.4 4.6 2.9 3.3Student with disability 11.4 12.6 11.8 12.6Both 0.6 1.1 0.3 0.4

Excluded 2.2 2.7 1.6 2.3English language learner 0.3 0.4 0.5 0.5Student with disability 1.5 2.1 1.0 1.8Both 0.4 0.1 0.2 0.1

Accommodated 7.4 7.1 2.6 6.2English language learner 2.3 1.2 0.2 0.9Student with disability 4.8 5.4 2.3 5.1Both 0.2 0.6 # 0.2

Level 2000 2003Grade 5 45.6 57.0

8793

64

72

48

57

13

19

87

94

64

78

48

58

1319

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

partialknowledge

satisfactory

proficient

superior

*

Chapter_D2.fm Page 165 Thursday, March 13, 2008 1:21 PM

Page 174: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-166 National Assessment of Educational Progress

• • • •••

MINNESOTA

Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.9

Lower half -2.0

Upper half -3.0

Lower quarter -1.0

Middle half -3.9

Upper quarter -1.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 166 Thursday, March 13, 2008 1:21 PM

Page 175: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-167

• • • •••

D Mississippi Dhrough the Mississippi Grade Level Testing Program, the state administersMississippi Curriculum Tests (MCT) in grades 2-8 in reading andmathematics. Scores are available for Black and economically disadvantaged

students. Mississippi uses four achievement levels for reporting purposes: minimal,basic, proficient, and advanced. However, this year data were not available for theadvanced level. Scores from 2000 are not available for this report, so no directcomparisons could be made with scores from 2003; therefore, trend graphs are notincluded. School-level assessment scores based on 10 or fewer students aresuppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 4 and 102 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is below the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (proficient) is close to the NAEP basic level.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White gap in mathematics in grade 4 in2003. Overall, the Black-White gap in grade 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003. Overall, there were no significant differences between NAEP andthe state assessment in measurement of the poverty gap in mathematics in grades 4and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 167 Thursday, March 13, 2008 1:21 PM

Page 176: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-168 National Assessment of Educational Progress

• • • •••

MISSISSIPPI

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.66 0.040 0.77 0.026Proficient 0.79 0.016 0.82 0.012

•••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

Chapter_D2.fm Page 168 Thursday, March 13, 2008 1:21 PM

Page 177: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MISSISSIPPI D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-169

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 5.9 10.1 10.5 9.4

English language learner # 0.3 0.1 0.7Student with disability 5.9 9.2 10.4 8.6Both # 0.6 0.1 #

Excluded 2.7 5.4 5.5 4.9English language learner # 0.3 0.1 0.3Student with disability 2.7 4.7 5.3 4.6Both # 0.5 0.1 #

Accommodated 2.1 1.2 1.3 1.6English language learner # # # #Student with disability 2.1 1.2 1.3 1.6Both # # # #

Chapter_D2.fm Page 169 Thursday, March 13, 2008 1:21 PM

Page 178: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-170 National Assessment of Educational Progress

• • • •••

MISSISSIPPI

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.1

Lower half -0.3

Upper half -1.5

Lower quarter -2.0

Middle half #

Upper quarter -3.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

H

H0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 170 Thursday, March 13, 2008 1:21 PM

Page 179: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MISSISSIPPI D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-171

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -6.9*

Lower half -8.1*

Upper half -6.7*

Lower quarter -6.6

Middle half -8.2*

Upper quarter -4.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 171 Thursday, March 13, 2008 1:21 PM

Page 180: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-172 National Assessment of Educational Progress

• • • •••

MISSISSIPPI

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.7

Lower half -1.1

Upper half -5.7

Lower quarter 0.1

Middle half -4.4

Upper quarter -4.9

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 172 Thursday, March 13, 2008 1:21 PM

Page 181: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MISSISSIPPI D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-173

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.5

Lower half -5.2

Upper half -4.0

Lower quarter -3.4

Middle half -5.3

Upper quarter -5.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 173 Thursday, March 13, 2008 1:21 PM

Page 182: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 174 Thursday, March 13, 2008 1:21 PM

Page 183: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-175

• • • •••

D Missouri Dhrough the Missouri Assessment Program (MAP), the state administers examsin grades 3 and 7 in communication arts (which includes reading) and grades4 and 8 in mathematics. Scores are available for Black and economically

disadvantaged students. Missouri uses five achievement levels for reporting purposes:step 1, progressing, nearing proficiency, proficient, and advanced. The total populationassessment scores based on 4 or fewer students are suppressed; the disaggregatedpopulation assessment scores based on 29 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 126 schools in grade 4 and 114 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is between the NAEPproficient and advanced levels.

• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are greater than the state assessment gains.

• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 175 Thursday, March 13, 2008 1:21 PM

Page 184: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-176 National Assessment of Educational Progress

• • • •••

MISSOURI

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProgressing 0.40 0.080 0.79 0.017Nearing Proficient 0.68 0.034 0.73 0.039Proficient 0.69 0.016 0.62 0.033Advanced 0.45 0.027 0.44 0.079

••••••••••••••••••••••••••••••••••••••••••••

••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

nearing proficiency

proficient

advanced

progressing

• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

•••••••••

•••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

nearing proficient

proficient

advanced

progressing

Chapter_D2.fm Page 176 Thursday, March 13, 2008 1:21 PM

Page 185: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MISSOURI D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-177

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Missouri Dept. of Education site at http://www.dese.state.mo.us/divimprove/assess/stateresults.html.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.4 16.8 14.7 16.0

English language learner 1.2 1.5 0.3 0.7Student with disability 14.1 14.5 14.4 14.9Both 0.1 0.8 # 0.4

Excluded 2.6 3.5 2.9 3.8English language learner 0.6 0.3 0.3 0.2Student with disability 2.0 3.0 2.7 3.4Both 0.1 0.3 # 0.2

Accommodated 7.6 9.6 6.7 9.0English language learner 0.2 0.9 # 0.4Student with disability 7.5 8.4 6.7 8.4Both # 0.4 # 0.1

Level 2000 2003Grade 4 36.7 37.2Grade 8 14.0 13.9

97 99

79

86

37

46

8

11

97

98

79

80

37

37

8

6

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

*

*

*

proficient

advanced

nearingproficient

progressing

75 81

4148

13

18

1

2

75

83

41

48

1313

11

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

progressing

nearingproficient

proficient

advanced

*

Chapter_D2.fm Page 177 Thursday, March 13, 2008 1:21 PM

Page 186: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-178 National Assessment of Educational Progress

• • • •••

MISSOURI

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -13.3*

Lower half -7.2*

Upper half -18.8*

Lower quarter -3.6

Middle half -14.5*

Upper quarter -21.2*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 178 Thursday, March 13, 2008 1:21 PM

Page 187: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MISSOURI D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-179

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.8

Lower half 0.5

Upper half -3.6

Lower quarter 1.0

Middle half -0.9

Upper quarter -3.9

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 179 Thursday, March 13, 2008 1:21 PM

Page 188: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-180 National Assessment of Educational Progress

• • • •••

MISSOURI

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.7

Lower half 3.0

Upper half -10.3

Lower quarter 5.4

Middle half -3.8

Upper quarter -13.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 180 Thursday, March 13, 2008 1:21 PM

Page 189: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MISSOURI D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-181

• • • •••

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.6

Lower half 0.9

Upper half -1.9

Lower quarter 1.8

Middle half -2.1

Upper quarter -2.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 181 Thursday, March 13, 2008 1:21 PM

Page 190: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 182 Thursday, March 13, 2008 1:21 PM

Page 191: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-183

• • • •••

D Montana Dhrough the Montana Comprehensive Assessment System (MontCAS), thestate administers Iowa Tests of Basic Skills (ITBS) in grades 4 and 8 in readingand mathematics. The scores available for this report do not include any

demographic breakdowns by race/ethnicity or poverty status. Montana uses fourachievement levels for reporting purposes: novice, nearing proficiency, proficient, andadvanced. Scores from 2000 are not available for this report, so no direct comparisonscould be made with scores from 2003; therefore, trend graphs are not included.School-level assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 142 schools in grade 4 and 101 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 183 Thursday, March 13, 2008 1:21 PM

Page 192: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-184 National Assessment of Educational Progress

• • • •••

MONTANA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNearing Proficient 0.69 0.021 0.73 0.019Proficient 0.72 0.020 0.72 0.033Advanced 0.44 0.058 0.43 0.039

••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advancednearing proficient

proficient

advanced

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

•••••••••••••••••

••••••••••

••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

nearing proficiency

proficient

advanced

Chapter_D2.fm Page 184 Thursday, March 13, 2008 1:21 PM

Page 193: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

MONTANA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-185

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.3 15.9 11.7 13.6

English language learner 0.4 2.1 0.2 1.5Student with disability 11.9 12.0 11.3 11.1Both # 1.8 0.2 1.1

Excluded 1.8 1.8 2.3 1.7English language learner 0.2 # # #Student with disability 1.6 1.7 2.1 1.6Both # 0.2 0.2 0.1

Accommodated 5.6 7.5 3.3 6.4English language learner # 0.4 # 0.5Student with disability 5.6 6.5 3.3 5.4Both # 0.6 # 0.5

Chapter_D2.fm Page 185 Thursday, March 13, 2008 1:21 PM

Page 194: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 186 Thursday, March 13, 2008 1:21 PM

Page 195: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-187

• • • •••

D Nebraska Dhrough the School-based Teacher-led Assessment and Reporting System(STARS), Nebraska administers exams in grades 4 and 8 in reading andmathematics. Nebraska alternates reading and mathematics exams by the

year: the state tested reading in 2001 and 2003 and mathematics in 2000 and 2002.Nebraska uses one achievement level for reporting purposes: meeting the standard.Because Nebraska alternates reading and mathematics tests, there are nomathematics data available for 2003. School-level assessment scores based on 9 orfewer students are suppressed.

Summary of Compar i sonsBecause 2003 state mathematics assessment data do not exist for Nebraska, nocomparisons to NAEP were possible.

T

Chapter_D2.fm Page 187 Thursday, March 13, 2008 1:21 PM

Page 196: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-188 National Assessment of Educational Progress

• • • •••

NEBRASKA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

•••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••

•••••••••••

•••••••••••••

••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

••••••••••••••••••••

••••••••••

••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 188 Thursday, March 13, 2008 1:21 PM

Page 197: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEBRASKA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-189

• • • •••

Table 1. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 18.0 20.2 13.2 16.3

English language learner 3.0 4.0 1.8 2.1Student with disability 14.9 15.1 11.1 13.5Both 0.2 1.1 0.2 0.6

Excluded 3.4 3.0 3.6 3.5English language learner 1.2 0.6 0.4 0.8Student with disability 2.3 1.9 2.9 2.6Both # 0.5 0.2 0.1

Accommodated 4.3 8.7 2.2 5.3English language learner 0.4 0.9 0.3 0.2Student with disability 3.9 7.4 1.9 4.8Both # 0.4 # 0.3

Chapter_D2.fm Page 189 Thursday, March 13, 2008 1:21 PM

Page 198: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 190 Thursday, March 13, 2008 1:21 PM

Page 199: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-191

• • • •••

D Nevada Devada administers the Iowa Tests of Basic Skills (ITBS) in grades 4 and 7 inreading and mathematics. Scores are available for Hispanic, Black, andeconomically disadvantaged students, but there are too few Black students to

provide a reliable comparison. Nevada uses four achievement levels for reportingpurposes: Level 1 (below the standard), Level 2 (approaching the standard), Level 3(meeting the standard), and Level 4 (exceeding the standard). Before 2003, when theITBS was implemented, students took the TerraNova, and scores were reported bypercentile rank only. Because of this switch in tests, direct comparisons cannot bemade between ITBS scores from 2003 and TerraNova scores from 2000. Therefore,trend graphs are not included in this report. School-level assessment scores based on10 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 4 and 63 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. This is also true forgrade 7.

• Trends. No comparisons were possible for grades 4 and 7.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White gap in mathematics in grades 4 and 7 in 2003.Overall, the Hispanic-White gap in grades 4 and 7 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, the poverty gap in grade 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the poverty gap inmathematics in grade 7 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

N

Chapter_D2.fm Page 191 Thursday, March 13, 2008 1:21 PM

Page 200: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-192 National Assessment of Educational Progress

• • • •••

NEVADA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

grade 8 (state 7th grade standards)

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorApproaching:2 0.78 0.014 0.77 0.019Meeting:3 0.81 0.034 0.82 0.011Exceeding:4 0.78 0.015 0.77 0.020

••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

approaching

meeting

exceeding

••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

••••••••••••••••••••

••••••••••••••••

••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

approaching

meeting

exceeding

Chapter_D2.fm Page 192 Thursday, March 13, 2008 1:21 PM

Page 201: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEVADA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-193

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.8 26.4 15.9 18.0

English language learner 9.8 13.5 4.4 5.8Student with disability 8.8 9.6 10.9 10.5Both 1.2 3.3 0.6 1.7

Excluded 6.8 4.3 3.6 2.4English language learner 3.4 1.7 1.0 0.5Student with disability 2.6 1.8 2.3 1.4Both 0.8 0.8 0.3 0.5

Accommodated 5.0 7.8 4.7 6.3English language learner 1.1 2.4 0.3 1.0Student with disability 3.7 4.2 4.3 4.7Both 0.2 1.2 0.1 0.6

Chapter_D2.fm Page 193 Thursday, March 13, 2008 1:21 PM

Page 202: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-194 National Assessment of Educational Progress

• • • •••

NEVADA

Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -7.2*

Lower half -11.4*

Upper half -3.3

Lower quarter -9.4*

Middle half -9.9*

Upper quarter 0.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 194 Thursday, March 13, 2008 1:21 PM

Page 203: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEVADA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-195

• • • •••

Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.1*

Lower half -7.6*

Upper half -2.3

Lower quarter -7.3*

Middle half -7.2*

Upper quarter 1.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 195 Thursday, March 13, 2008 1:21 PM

Page 204: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-196 National Assessment of Educational Progress

• • • •••

NEVADA

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -7.1*

Lower half -9.7*

Upper half -4.6

Lower quarter -9.7*

Middle half -6.9*

Upper quarter -5.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 196 Thursday, March 13, 2008 1:21 PM

Page 205: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEVADA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-197

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

# Rounds to zero.

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall #

Lower half -3.2*

Upper half 3.4*

Lower quarter -4.7*

Middle half -1.1

Upper quarter 5.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 197 Thursday, March 13, 2008 1:21 PM

Page 206: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 198 Thursday, March 13, 2008 1:21 PM

Page 207: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-199

• • • •••

D New Hampshire Dhrough the New Hampshire Educational Improvement and AssessmentProgram (NHEIAP), the state administers exams in grades 3, 6, and 10 inEnglish language arts and mathematics. Scores are available for economically

disadvantaged students. New Hampshire uses four achievement levels for reportingpurposes: novice, basic, proficient, and advanced. Scores from 2000 are not available forthis report, so no direct comparisons could be made with scores from 2003; therefore,trend graphs are not included. State assessment data and comparisons based uponthose data are not displayed for grade 8 because New Hampshire does not test grade8. School-level assessment scores based on 10 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 108 schools in grade 3 (no grade 8 schools), are shown graphicallyon the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 3 mathematics performance standard (basic) isbetween the NAEP basic and proficient levels.

• Trends. No comparisons were possible for grade 3.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White and Hispanic-White gaps in grade 3 mathematicsin 2003. Overall, the poverty gap in grade 3 in percent meeting the state’s standardin mathematics in 2003 was greater when measured by NAEP compared to thestate assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 199 Thursday, March 13, 2008 1:21 PM

Page 208: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-200 National Assessment of Educational Progress

• • • •••

NEW HAMPSHIRE

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 3th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

— Not available.† Not applicable.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 3 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.46 0.017 — †Proficient 0.45 0.023 — †Advanced 0.32 0.054 — †

••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

basic

••• •••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 200 Thursday, March 13, 2008 1:21 PM

Page 209: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW HAMPSHIRE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-201

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 19.9 — 19.7

English language learner — 1.8 — 1.1Student with disability — 17.3 — 18.3Both — 0.8 — 0.3

Excluded — 3.0 — 3.5English language learner — 0.5 — 0.3Student with disability — 2.4 — 3.2Both — 0.2 — #

Accommodated — 12.0 — 9.8English language learner — 0.6 — 0.4Student with disability — 11.1 — 9.2Both — 0.4 — 0.3

Chapter_D2.fm Page 201 Thursday, March 13, 2008 1:21 PM

Page 210: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-202 National Assessment of Educational Progress

• • • •••

NEW HAMPSHIRE

Figure 2. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 3.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -10.8*

Lower half -17.1*

Upper half -4.8

Lower quarter -18.0*

Middle half -14.1*

Upper quarter -0.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 202 Thursday, March 13, 2008 1:21 PM

Page 211: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-203

• • • •••

D New Jersey Dhe state administers the New Jersey Assessment of Skills and Knowledge (NJASK) in grade 4 in English language arts and mathematics and the GradeEight Proficiency Assessment (GEPA) in English language arts and

mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students. New Jersey uses three achievement levels for reportingpurposes: partially proficient, proficient, and advanced. Before 2003, when the NJ ASKwas implemented, grade 4 students took the Elementary School ProficiencyAssessment (ESPA). Trend graphs are not included because New Jersey did notparticipate in State NAEP prior to 2003. School-level assessment scores based on 10or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 4 and 107 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, the Black-White and Hispanic-White gaps in grade 4 in percent

meeting the state’s standard in mathematics in 2003 were greater when measuredby NAEP compared to the state assessment. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the Black-White and Hispanic-White gaps in mathematics in grade 8 in 2003. Overall, therewere no significant differences between NAEP and the state assessment inmeasurement of the poverty gap in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 203 Thursday, March 13, 2008 1:21 PM

Page 212: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-204 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.84 0.009 0.90 0.007Advanced 0.78 0.020 0.85 0.014

••••••••••••••••••••••••••••••••••••••

•••••••••••••••

•••••••••••••••••

••••••••••••••••

••••••••••

••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••

••••••••••••••

•••••••••••••••••••••

••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

proficient

advanced

Chapter_D2.fm Page 204 Thursday, March 13, 2008 1:21 PM

Page 213: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW JERSEY D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-205

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 18.2 — 18.1

English language learner — 3.8 — 2.7Student with disability — 13.7 — 14.6Both — 0.7 — 0.7

Excluded — 2.3 — 2.3English language learner — 0.7 — 1.2Student with disability — 1.3 — 0.9Both — 0.3 — 0.2

Accommodated — 14.5 — 13.7English language learner — 2.5 — 1.3Student with disability — 11.6 — 11.9Both — 0.4 — 0.5

Chapter_D2.fm Page 205 Thursday, March 13, 2008 1:21 PM

Page 214: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-206 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.5*

Lower half -7.7

Upper half -10.4*

Lower quarter -4.9

Middle half -12.1*

Upper quarter -6.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 206 Thursday, March 13, 2008 1:21 PM

Page 215: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW JERSEY D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-207

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.7

Lower half -1.5

Upper half -3.1

Lower quarter -3.1

Middle half -1.4

Upper quarter -1.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 207 Thursday, March 13, 2008 1:21 PM

Page 216: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-208 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -14.7*

Lower half -13.6*

Upper half -16.1*

Lower quarter -10.3

Middle half -17.6*

Upper quarter -14.4*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 208 Thursday, March 13, 2008 1:21 PM

Page 217: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW JERSEY D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-209

• • • •••

Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.0

Lower half -3.8

Upper half 0.3

Lower quarter -1.2

Middle half -2.7

Upper quarter 2.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 209 Thursday, March 13, 2008 1:21 PM

Page 218: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-210 National Assessment of Educational Progress

• • • •••

NEW JERSEY

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.7

Lower half -4.3

Upper half -7.3

Lower quarter 3.8

Middle half -8.2

Upper quarter -8.8*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 210 Thursday, March 13, 2008 1:21 PM

Page 219: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW JERSEY D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-211

• • • •••

Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

# Rounds to zero.

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.1

Lower half -4.2

Upper half #

Lower quarter -3.2

Middle half -3.5

Upper quarter 1.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 211 Thursday, March 13, 2008 1:21 PM

Page 220: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 212 Thursday, March 13, 2008 1:21 PM

Page 221: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-213

• • • •••

D New Mexico Dew Mexico administers the TerraNova in grades 3-9 in English language artsand mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Black students to provide a

reliable comparison. New Mexico uses quartiles for reporting purposes. Scores from2000 are not available for this report, so no direct comparisons could be made withscores from 2003; therefore, trend graphs are not included. School-level assessmentscores based on 4 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 89 schools in grade 4 and 68 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard (top half)is between the NAEP basic and proficient levels. This is also true for grade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White gap in mathematics in grades 4 and 8 in 2003.Overall, the Hispanic-White gap in grades 4 and 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the poverty gap in mathematicsin grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

N

Chapter_D2.fm Page 213 Thursday, March 13, 2008 1:21 PM

Page 222: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-214 National Assessment of Educational Progress

• • • •••

NEW MEXICO

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorTop 75% 0.76 0.024 0.77 0.039Top half 0.77 0.014 0.81 0.016Top 25% 0.70 0.029 0.83 0.023

••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••

•••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

top 75%

top half

top 25%

•••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••

••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

top 75%

top half

top 25%

Chapter_D2.fm Page 214 Thursday, March 13, 2008 1:21 PM

Page 223: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW MEXICO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-215

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 31.3 39.7 25.0 32.3

English language learner 16.5 22.4 7.9 12.6Student with disability 11.1 10.8 13.6 12.3Both 3.7 6.5 3.5 7.3

Excluded 5.7 3.5 7.3 2.5English language learner 0.8 1.4 0.6 0.5Student with disability 3.4 1.1 4.9 1.1Both 1.5 1.0 1.8 0.9

Accommodated 9.8 14.5 4.0 14.3English language learner 4.5 6.0 1.3 4.2Student with disability 4.0 5.6 2.1 6.9Both 1.3 2.9 0.5 3.3

Chapter_D2.fm Page 215 Thursday, March 13, 2008 1:21 PM

Page 224: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-216 National Assessment of Educational Progress

• • • •••

NEW MEXICO

Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.5*

Lower half -7.7

Upper half -7.8

Lower quarter -8.0

Middle half -7.5

Upper quarter -10.9*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 216 Thursday, March 13, 2008 1:21 PM

Page 225: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW MEXICO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-217

• • • •••

Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -7.2*

Lower half -7.5*

Upper half -6.3

Lower quarter -5.7

Middle half -9.8*

Upper quarter -5.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 217 Thursday, March 13, 2008 1:21 PM

Page 226: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-218 National Assessment of Educational Progress

• • • •••

NEW MEXICO

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.9

Lower half -7.9

Upper half 1.8

Lower quarter -11.9

Middle half -1.0

Upper quarter 2.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 218 Thursday, March 13, 2008 1:21 PM

Page 227: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW MEXICO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-219

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.7

Lower half -1.8

Upper half -0.5

Lower quarter 2.4

Middle half -5.3

Upper quarter 3.9

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 219 Thursday, March 13, 2008 1:21 PM

Page 228: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 220 Thursday, March 13, 2008 1:21 PM

Page 229: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-221

• • • •••

D New York Dew York administers exams in grades 4 and 8 in English language arts andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students. New York uses four achievement levels for reporting

purposes: Step 1, Level 2 (needs help), Level 3 (meets expectations), and Level 4 (exceedsexpectations). The total population assessment scores based on 4 or fewer students aresuppressed; disaggregated data suppression rules vary from school to school.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 141 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is close to the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (meeting) is between the NAEP basic and proficient levels.

• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent meeting between 2000 and 2003. Between 2000 and2003, the NAEP grade 8 gains in percent meeting are less than the state assessmentgains.

• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grade 4 in2003. Overall, the Black-White gap in grade 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White andpoverty gaps in mathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

N

Chapter_D2.fm Page 221 Thursday, March 13, 2008 1:21 PM

Page 230: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-222 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeed Help 0.70 0.016 0.80 0.011Meeting 0.86 0.011 0.85 0.009Exceeding 0.74 0.016 0.76 0.025

• •••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••

•••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

need help

meeting

exceeding

••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

••••••••••••••

••••••••••••••••••••••••

•••••••••••••••••••••••••••

••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

need help

meeting

exceeding

Chapter_D2.fm Page 222 Thursday, March 13, 2008 1:21 PM

Page 231: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW YORK D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-223

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: New York State Department of Education retrieved fromhttp://www.emsc.nysed.gov/repcrd2003/statewide/total-public-overview.htm

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.0 19.1 16.2 20.0

English language learner 5.4 5.8 4.7 4.2Student with disability 9.5 11.3 10.5 14.0Both 1.1 2.0 1.1 1.8

Excluded 4.6 5.5 4.0 5.4English language learner 2.4 2.7 1.2 1.4Student with disability 1.5 2.0 1.8 3.4Both 0.6 0.8 1.0 0.6

Accommodated 9.5 11.2 7.3 11.6English language learner 1.5 1.7 1.0 1.8Student with disability 7.5 8.5 6.2 8.8Both 0.5 1.1 0.1 1.0

Level 2000 2003Grade 4 65.0 79.0Grade 8 40.0 51.0

93

96

68

76

20

28

9395

68

79

20

31

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

need help

meeting

exceeding

78 80

41

48

69

78

85

41

54

610

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

need help

meeting

exceeding

*

*

Chapter_D2.fm Page 223 Thursday, March 13, 2008 1:21 PM

Page 232: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-224 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.1

Lower half -3.8

Upper half -3.5

Lower quarter -5.5

Middle half -5.6

Upper quarter -3.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 224 Thursday, March 13, 2008 1:21 PM

Page 233: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW YORK D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-225

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -9.8*

Lower half -11.2*

Upper half -8.2*

Lower quarter -13.1*

Middle half -7.9*

Upper quarter -10.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 225 Thursday, March 13, 2008 1:21 PM

Page 234: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-226 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.0

Lower half -5.6

Upper half -3.8

Lower quarter -7.8

Middle half -6.0

Upper quarter -3.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 226 Thursday, March 13, 2008 1:21 PM

Page 235: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW YORK D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-227

• • • •••

Figure 6. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.9

Lower half -8.1*

Upper half -4.4

Lower quarter -8.9*

Middle half -4.7

Upper quarter -4.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 227 Thursday, March 13, 2008 1:21 PM

Page 236: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-228 National Assessment of Educational Progress

• • • •••

NEW YORK

Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.3

Lower half -1.1

Upper half -1.0

Lower quarter -1.4

Middle half -3.1

Upper quarter 0.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 228 Thursday, March 13, 2008 1:21 PM

Page 237: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NEW YORK D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-229

• • • •••

Figure 8. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.6

Lower half -2.9

Upper half 1.1

Lower quarter -3.9

Middle half -2.0

Upper quarter 0.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 229 Thursday, March 13, 2008 1:21 PM

Page 238: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 230 Thursday, March 13, 2008 1:21 PM

Page 239: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-231

• • • •••

D North Carolina Dn accordance with the ABCs of Public Education, North Carolina administersEnd-of-Grade (EOG) exams in grades 3-8 in reading and mathematics. Scoresare available for Hispanic, Black, and economically disadvantaged students, but

there are too few Hispanic students to provide a reliable comparison. North Carolinauses four achievement levels for reporting purposes: Level I (insufficient mastery), LevelII (inconsistent mastery), Level III (consistent mastery), and Level IV (superior). School-level assessment scores based on 4 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 151 schools in grade 4 and 129 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(consistent mastery) is below the NAEP basic level. This is also true for grade 8.

• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent consistent mastery between 2000 and 2003.

• Gaps. Overall, there were no significant differences between NAEP and stateassessment in measurement of Black-White and poverty gaps in mathematics ingrades 4 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

I

Chapter_D2.fm Page 231 Thursday, March 13, 2008 1:21 PM

Page 240: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-232 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorInconsistent Mastery 0.24 0.075 0.59 0.054Consistent Mastery 0.63 0.044 0.71 0.016Superior 0.85 0.023 0.79 0.014

••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advancedinconsistent mastery

consistent mastery

superior

••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••

••••••••••••••••

•••••••••••••••••••

•••••••••••••••••

•••••••••••

•••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

inconsistent mastery

consistent mastery

superior

Chapter_D2.fm Page 232 Thursday, March 13, 2008 1:21 PM

Page 241: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NORTH CAROLINA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-233

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

— Not available.SOURCE: North Carolina Department of Public Instruction site at http://www.ncreportcards.org/src/stateDetails.jsp?Page=1&pYear=2002-2003

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.3 20.6 15.7 18.4

English language learner 2.3 3.3 1.5 2.8Student with disability 13.8 15.3 13.8 14.3Both 0.3 2.0 0.4 1.3

Excluded 5.1 4.1 5.0 3.8English language learner 0.7 0.5 0.7 0.6Student with disability 4.1 3.2 3.9 2.7Both 0.3 0.4 0.4 0.5

Accommodated 7.9 11.7 6.9 11.7English language learner 0.8 1.3 0.3 1.2Student with disability 7.1 9.2 6.6 9.8Both # 1.1 # 0.6

Level 2000 2003Grade 4 — 92.1Grade 8 — 82.4

98

100

85

93

40

57

9898

85 92

40

59

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

consistentmastery

superior

inconsistentmastery

*

96

97

81

84

44

50

96

94

81

82

4448

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

inconsistentmastery

consistentmastery

superior

*

Chapter_D2.fm Page 233 Thursday, March 13, 2008 1:21 PM

Page 242: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-234 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.8

Lower half -7.0

Upper half -2.9*

Lower quarter -6.2

Middle half -5.6*

Upper quarter -0.9

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 234 Thursday, March 13, 2008 1:21 PM

Page 243: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NORTH CAROLINA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-235

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.5

Lower half -7.9*

Upper half -1.1

Lower quarter -11.2*

Middle half -3.5

Upper quarter 1.2

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 235 Thursday, March 13, 2008 1:21 PM

Page 244: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-236 National Assessment of Educational Progress

• • • •••

NORTH CAROLINA

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.1

Lower half -5.0

Upper half 1.3

Lower quarter -7.7

Middle half -1.5

Upper quarter 2.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 236 Thursday, March 13, 2008 1:21 PM

Page 245: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NORTH CAROLINA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-237

• • • •••

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.1

Lower half -2.8

Upper half 0.7

Lower quarter -3.7

Middle half -1.5

Upper quarter 1.3

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

Highest achievers

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 237 Thursday, March 13, 2008 1:21 PM

Page 246: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 238 Thursday, March 13, 2008 1:21 PM

Page 247: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-239

• • • •••

D North Dakota Dhrough the North Dakota State Assessment (NDSA) Program, the stateadministers the CAT (California Achievement Test)/TerraNova, SecondEdition, in grades 4 and 8 in reading and mathematics. The scores available

for this report do not include any breakdowns by race/ethnicity or poverty status.North Dakota uses only one achievement level: meeting the standard. Scores from2000 are not available for this report, so no direct comparisons could be made withscores from 2003; therefore, trend graphs are not included. Suppression informationis not available.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 176 schools in grade 4 and 31 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 239 Thursday, March 13, 2008 1:21 PM

Page 248: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-240 National Assessment of Educational Progress

• • • •••

NORTH DAKOTA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.64 0.022 0.75 0.048

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

meeting

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

Chapter_D2.fm Page 240 Thursday, March 13, 2008 1:21 PM

Page 249: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

NORTH DAKOTA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-241

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.1 17.5 11.1 15.5

English language learner 1.3 2.3 0.4 1.3Student with disability 10.6 13.7 10.2 13.4Both 0.1 1.5 0.6 0.8

Excluded 1.4 1.7 1.6 1.5English language learner 0.1 0.1 # #Student with disability 1.3 1.4 1.4 1.3Both # 0.3 0.2 0.2

Accommodated 4.0 7.4 2.0 6.8English language learner 0.1 0.1 # 0.2Student with disability 3.8 6.7 2.0 6.1Both 0.1 0.5 # 0.5

Chapter_D2.fm Page 241 Thursday, March 13, 2008 1:21 PM

Page 250: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 242 Thursday, March 13, 2008 1:21 PM

Page 251: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-243

• • • •••

D Ohio Dhio administers proficiency tests in grades 4, 6, and 9 in reading andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Hispanic students to provide a

reliable comparison. Ohio uses four achievement levels for reporting purposes: belowbasic, basic, proficient, and advanced. However, we only have data for the proficientlevel in 2000; therefore, we report the changes using this performance level only.State assessment data and comparisons based upon those data are not displayed forgrade 9 because there are not enough schools that have grades 8 and 9 to allow areliable comparison with NAEP. School-level assessment scores based on 10 or fewerstudents are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 163 schools in grade 4 (no grade 8 schools), are shown graphicallyon the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. There are not enoughdata to compare state standards to NAEP for grade 8.

• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent proficient areless than the state assessment gains. No comparisons were possible for grade 8.

• Gaps. Overall, the Black-White and poverty gaps in grade 4 in percent meeting thestate’s standard in mathematics in 2003 were greater when measured by NAEPcompared to the state assessment. There were insufficient data for comparing theNAEP and state assessment measurement of the Black-White and poverty gaps inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

O

Chapter_D2.fm Page 243 Thursday, March 13, 2008 1:21 PM

Page 252: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-244 National Assessment of Educational Progress

• • • •••

OHIO

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

— Not available.† Not applicable.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.80 0.012 — †Proficient 0.81 0.011 — †Advanced 0.66 0.019 — †

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 244 Thursday, March 13, 2008 1:21 PM

Page 253: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

OHIO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-245

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting grade 4 mathematics standards: 2000 and 2003

Grade 4

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

— Not available.

SOURCE: Ohio Department of Education retrieved fromhttp://www.ode.state.oh.us/GD/Templates/Pages/ODE/ODEDetail.aspx?page=3&TopicRelationID=400&Content=15350.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.0 13.1 11.4 13.4

English language learner 0.4 0.7 0.8 0.6Student with disability 11.6 11.5 9.8 12.4Both # 0.8 0.8 0.4

Excluded 4.7 4.4 4.4 5.1English language learner 0.2 0.2 0.3 0.2Student with disability 4.5 3.9 3.3 4.8Both # 0.4 0.8 0.1

Accommodated 5.4 6.7 2.9 5.3English language learner # 0.1 0.1 0.2Student with disability 5.4 6.2 2.8 5.0Both # 0.4 # 0.1

Level 2000 2003Grade 4 — 58.0

43

5342

59

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

proficient

*

Chapter_D2.fm Page 245 Thursday, March 13, 2008 1:21 PM

Page 254: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-246 National Assessment of Educational Progress

• • • •••

OHIO

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.3*

Lower half -4.6

Upper half -12.0*

Lower quarter -0.9

Middle half -8.4*

Upper quarter -15.1*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 246 Thursday, March 13, 2008 1:21 PM

Page 255: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

OHIO D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-247

• • • •••

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.2*

Lower half -8.3*

Upper half -8.2*

Lower quarter -8.3*

Middle half -8.3*

Upper quarter -8.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 247 Thursday, March 13, 2008 1:21 PM

Page 256: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 248 Thursday, March 13, 2008 1:21 PM

Page 257: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-249

• • • •••

D Oklahoma Dhrough the Oklahoma State Testing Program (OSTP), the state administersOklahoma Core Curriculum Tests (OCCT) in grades 5 and 8 in reading andmathematics. Scores are available for Hispanic and Black students, but there

are too few Hispanic students to provide a reliable comparison. Oklahoma uses fourachievement levels for reporting purposes: unsatisfactory, limited knowledge, satisfactory,and advanced. School-level assessment scores based on 5 or fewer students aresuppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 132 schools in grade 5 and 123 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(satisfactory) is close to the NAEP basic level. The state’s primary grade 8mathematics performance standard (satisfactory) is below the NAEP basic level.

• Trends. Between 2000 and 2003, the state reported declines in grade 4 in percentsatisfactory, which NAEP did not. There were no significant differences betweengrade 8 NAEP and state assessment gains in percent satisfactory between 2000 and2003.

• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grades 5 and8 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the Hispanic-White and poverty gaps in mathematicsin grades 5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 249 Thursday, March 13, 2008 1:21 PM

Page 258: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-250 National Assessment of Educational Progress

• • • •••

OKLAHOMA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorLittle Knowledge 0.36 0.073 0.51 0.038Satisfactory 0.58 0.016 0.71 0.021Advanced 0.42 0.033 0.64 0.026

•••••••••••••••••••••••••••••••••••••••••••

••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

satisfactory

advanced

limited knowledge

••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

limited knowledge

satisfactory

advanced

Chapter_D2.fm Page 250 Thursday, March 13, 2008 1:21 PM

Page 259: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

OKLAHOMA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-251

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 (state assessment grade 5) Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Oklahoma State Department of Education site at http://www.sde.state.ok.us/home/defaultns.html.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 20.3 21.8 14.6 19.0

English language learner 4.4 5.0 1.6 3.1Student with disability 14.9 15.2 12.8 13.9Both 1.1 1.6 0.2 2.0

Excluded 5.0 3.6 3.9 2.3English language learner 0.6 0.5 0.3 0.3Student with disability 4.2 2.7 3.5 1.8Both 0.2 0.5 0.1 0.3

Accommodated 4.7 8.0 2.8 6.7English language learner 0.7 0.5 0.1 0.5Student with disability 3.5 6.9 2.7 5.5Both 0.6 0.6 # 0.6

Level 2000 2003Grade 5 85.0 72.0Grade 8 71.0 73.0

93 96

8690

1015

9398

86

69

1014

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

limitedknowledge

satisfactory

advanced

* 88 89

71

74

13 15

88

95

71

71

1316

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

limitedknowledge

satisfactory

advanced

*

Chapter_D2.fm Page 251 Thursday, March 13, 2008 1:21 PM

Page 260: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-252 National Assessment of Educational Progress

• • • •••

OKLAHOMA

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.5

Lower half -0.1

Upper half -11.9*

Lower quarter 4.7

Middle half -5.6

Upper quarter -12.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 252 Thursday, March 13, 2008 1:21 PM

Page 261: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

OKLAHOMA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-253

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.7

Lower half -2.8

Upper half 1.3

Lower quarter 0.9

Middle half -3.0

Upper quarter 0.9

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 253 Thursday, March 13, 2008 1:21 PM

Page 262: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 254 Thursday, March 13, 2008 1:21 PM

Page 263: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-255

• • • •••

D Oregon Dhe state administers the Oregon Statewide Assessment in grades 3, 5, and 8 inreading and mathematics. Scores are available for Hispanic and Blackstudents in grade 8, but there are too few Black students to provide a reliable

comparison. Oregon uses five achievement levels for reporting purposes: very low, low,nearly meets the standard, meets the standard, and exceeds the standard. However, due todata unavailability, this report is based on only the top two standards. Suppressioninformation is not available.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 5 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP basic level for grade 4. The state’s primary grade 8mathematics performance standard (meeting) is between the NAEP basic andproficient levels.

• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent meeting between 2000 and 2003.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in mathematics in grades 5 and8 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the Hispanic-White gap in mathematics in grade 5 in2003. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Hispanic-White gap in mathematics in grade 8in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 255 Thursday, March 13, 2008 1:21 PM

Page 264: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-256 National Assessment of Educational Progress

• • • •••

OREGON

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.51 0.031 0.77 0.022Exceeding 0.67 0.029 0.80 0.015

•••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

meeting

exceeding

••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••

•••••••••••

•••••••••••

•••••••••••••

•••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

meeting

exceeding

Chapter_D2.fm Page 256 Thursday, March 13, 2008 1:21 PM

Page 265: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

OREGON D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-257

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 (state assessment grade 5) Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Oregon Department of Education site at http://www.ode.state.or.us/search/results/?id=126.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 18.3 26.7 16.9 19.5

English language learner 4.6 9.4 4.3 5.1Student with disability 12.8 14.8 11.7 12.8Both 0.9 2.4 0.8 1.6

Excluded 2.7 4.1 2.5 3.2English language learner 0.7 0.6 0.5 0.5Student with disability 1.5 2.7 1.7 2.2Both 0.5 0.8 0.3 0.4

Accommodated 7.8 11.3 6.2 5.9English language learner 2.3 4.0 1.2 1.5Student with disability 5.3 6.4 4.8 3.8Both 0.1 0.9 0.2 0.6

Level 2000 2003Grade 5 70.0 76.0Grade 8 56.0 59.0

67

81

16

25

67 78

16

26

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

meeting

exceeding

55 55

29 30

5558

30 32

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

meeting

exceeding

Chapter_D2.fm Page 257 Thursday, March 13, 2008 1:21 PM

Page 266: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-258 National Assessment of Educational Progress

• • • •••

OREGON

Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.2

Lower half -6.0

Upper half -4.5

Lower quarter -9.2

Middle half -2.6

Upper quarter -5.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 258 Thursday, March 13, 2008 1:21 PM

Page 267: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-259

• • • •••

D Pennsylvania Dhrough the Pennsylvania System of School Assessment (PSSA), the stateadministers exams in grades 5 and 8 in reading and mathematics. Scores areavailable for Black and economically disadvantaged students in grades 5 and 8

and for Hispanic students in grade 8, but there are too few Hispanic students toprovide a reliable comparison. Pennsylvania uses four achievement levels forreporting purposes: below basic, basic, proficient, and advanced. Scores from 2000 arenot available for this report, so no direct comparisons could be made with scores from2003; therefore, trend graphs are not included. School-level assessment scores basedon 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 101 schools in grade 5 and 101 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White and poverty gaps in mathematics ingrades 5 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 259 Thursday, March 13, 2008 1:21 PM

Page 268: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-260 National Assessment of Educational Progress

• • • •••

PENNSYLVANIA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.80 0.022 0.85 0.018Proficient 0.83 0.008 0.87 0.011Advanced 0.75 0.021 0.82 0.016

•••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••

••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

••••••••••••

••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

Chapter_D2.fm Page 260 Thursday, March 13, 2008 1:21 PM

Page 269: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

PENNSYLVANIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-261

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 15.0 — 15.2

English language learner — 1.8 — 1.2Student with disability — 12.2 — 13.1Both — 1.0 — 0.8

Excluded — 2.9 — 1.5English language learner — 0.8 — 0.2Student with disability — 1.9 — 1.2Both — 0.3 — 0.1

Accommodated — 9.0 — 10.7English language learner — 0.5 — 0.4Student with disability — 8.0 — 9.9Both — 0.5 — 0.4

Chapter_D2.fm Page 261 Thursday, March 13, 2008 1:21 PM

Page 270: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-262 National Assessment of Educational Progress

• • • •••

PENNSYLVANIA

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.8

Lower half -2.8

Upper half -5.4

Lower quarter 0.8

Middle half -5.1

Upper quarter -7.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 262 Thursday, March 13, 2008 1:21 PM

Page 271: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

PENNSYLVANIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-263

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.6

Lower half -1.4

Upper half -8.0*

Lower quarter 0.6

Middle half -6.0*

Upper quarter -6.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 263 Thursday, March 13, 2008 1:21 PM

Page 272: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-264 National Assessment of Educational Progress

• • • •••

PENNSYLVANIA

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunchState assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.3

Lower half -1.0

Upper half -5.2

Lower quarter 1.2

Middle half -3.6

Upper quarter -7.0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

es

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 264 Thursday, March 13, 2008 1:21 PM

Page 273: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

PENNSYLVANIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-265

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.3

Lower half -4.5

Upper half -2.6

Lower quarter -2.7

Middle half -5.2

Upper quarter 0.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 265 Thursday, March 13, 2008 1:21 PM

Page 274: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 266 Thursday, March 13, 2008 1:21 PM

Page 275: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-267

• • • •••

D Rhode Island Dhode Island administers New Standards Reference Examinations (NSRE) ingrades 4 and 8 in English/language arts (ELA) and mathematics. The ELAexam is broken down into four subcontent areas: reading–basic understanding,

reading –analysis & interpretation, writing–effectiveness, and writing–conventions.The mathematics exam encompasses three subcontent areas: concepts, problemsolving, and skills. While the 2003 data were not reported by subcontent area,previous years’ data were reported this way, so those years’ data have been aggregatedto allow comparisons across years. Scores are available for Hispanic and Blackstudents, but there are too few Black students to provide a reliable comparison.Rhode Island uses five achievement levels for reporting purposes: little evidence ofachievement, below the standard, nearly achieved the standard, achieved the standard, andachieved the standard with honors. However, here data have been presented based onlyon percent proficient, defined by the state as those achieving the standard and above.School-level assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 4 and 51 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics standard (proficient) is betweenthe NAEP basic and proficient levels. This is also true for grade 8.

• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are less than the state assessment gains.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in mathematics in grades 4 and8 in 2003. Overall, the Hispanic-White gap in grades 4 and 8 in percent meetingthe state’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

R

Chapter_D2.fm Page 267 Thursday, March 13, 2008 1:21 PM

Page 276: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-268 National Assessment of Educational Progress

• • • •••

RHODE ISLAND

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.78 0.011 0.90 0.014

••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

• ••••• •••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••

•••••••••••

•••••••••••••••••••

••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

proficient

Chapter_D2.fm Page 268 Thursday, March 13, 2008 1:21 PM

Page 277: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

RHODE ISLAND D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-269

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

— Not available.

SOURCE: Rhode Island Department of Education retrieved from http://www.infoworks.ride.uri.edu/.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 22.7 26.9 19.7 23.3

English language learner 6.6 7.1 3.4 3.7Student with disability 15.2 17.4 15.9 18.0Both 0.8 2.4 0.3 1.6

Excluded 3.0 3.4 3.4 3.6English language learner 1.2 1.6 0.9 1.0Student with disability 1.6 1.2 2.4 2.1Both 0.2 0.6 0.2 0.5

Accommodated 10.1 14.9 4.3 12.7English language learner 1.8 1.9 0.5 1.2Student with disability 7.9 11.7 3.8 10.9Both 0.4 1.3 0.1 0.7

Level 2000 2003Grade 4 — 42.6Grade 8 — 35.2

212621

42

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

proficient* 27 29

27

35

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

proficient *

Chapter_D2.fm Page 269 Thursday, March 13, 2008 1:21 PM

Page 278: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-270 National Assessment of Educational Progress

• • • •••

RHODE ISLAND

Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -13.9*

Lower half -12.5*

Upper half -15.3*

Lower quarter -11.0*

Middle half -15.6*

Upper quarter -15.7*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 270 Thursday, March 13, 2008 1:21 PM

Page 279: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

RHODE ISLAND D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-271

• • • •••

Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.3*

Lower half -4.3*

Upper half -2.8

Lower quarter -3.5*

Middle half -4.1*

Upper quarter -2.6

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 271 Thursday, March 13, 2008 1:21 PM

Page 280: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 272 Thursday, March 13, 2008 1:21 PM

Page 281: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-273

• • • •••

D South Carolina Douth Carolina administers the Palmetto Achievement Challenge Tests(PACT) in English language arts and mathematics in grades 3-8. Scores areavailable for Hispanic, Black, and economically disadvantaged students, but

there are too few Hispanic students to provide a reliable comparison with Whitestudents. South Carolina uses four achievement levels for reporting purposes: belowbasic, basic, proficient, and advanced. Suppression information is not available.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 101 schools in grade 4 and 92 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. The state’s primary grade 8mathematics performance standard (proficient) is between the NAEP proficient andadvanced levels.

• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are greater than the state assessment gains.

• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grade 4 in 2003. Overall, the poverty gap in grade 8 inpercent meeting the state’s standard in mathematics in 2003 was smaller whenmeasured by NAEP compared to the state assessment.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

S

Chapter_D2.fm Page 273 Thursday, March 13, 2008 1:21 PM

Page 282: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-274 National Assessment of Educational Progress

• • • •••

SOUTH CAROLINA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.77 0.046 0.80 0.023Proficient 0.74 0.012 0.80 0.014Advanced 0.70 0.044 0.71 0.034

•••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

•••••••••••••••••

•••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

Chapter_D2.fm Page 274 Thursday, March 13, 2008 1:21 PM

Page 283: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

SOUTH CAROLINA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-275

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: South Carolina Department of Education retrieved from http://ed.sc.gov/topics/assessment/scores/.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 17.0 18.0 13.1 15.3

English language learner 0.4 1.2 0.4 0.6Student with disability 16.0 16.0 12.6 14.1Both 0.7 0.8 0.1 0.5

Excluded 5.1 6.3 4.0 7.0English language learner 0.2 0.1 0.2 0.2Student with disability 4.6 5.8 3.7 6.6Both 0.4 0.3 0.1 0.3

Accommodated 4.7 4.5 2.2 3.6English language learner # 0.2 0.1 0.1Student with disability 4.6 4.2 2.1 3.4Both 0.2 0.1 # 0.1

Level 2000 2003Grade 4 24.0 33.7Grade 8 20.0 19.2

61

80

23

39

7

14

62

80

2333

7 13

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

basic

proficient

advanced

*

63

75

19

28

7

11

6367

1920

67

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

basic

proficient

advanced

*

*

*

Chapter_D2.fm Page 275 Thursday, March 13, 2008 1:21 PM

Page 284: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-276 National Assessment of Educational Progress

• • • •••

SOUTH CAROLINA

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -5.5*

Lower half -5.3*

Upper half -5.5

Lower quarter -5.0

Middle half -5.7*

Upper quarter -4.5

Lowest

achievers

Median Highest

achievers

High

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 276 Thursday, March 13, 2008 1:21 PM

Page 285: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

SOUTH CAROLINA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-277

• • • •••

Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 3.5

Lower half 4.0*

Upper half 2.4

Lower quarter 7.2*

Middle half 1.3

Upper quarter 3.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

High

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 277 Thursday, March 13, 2008 1:21 PM

Page 286: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-278 National Assessment of Educational Progress

• • • •••

SOUTH CAROLINA

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.9

Lower half -2.7

Upper half -3.1

Lower quarter -1.3

Middle half -3.8

Upper quarter -3.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 278 Thursday, March 13, 2008 1:21 PM

Page 287: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

SOUTH CAROLINA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-279

• • • •••

Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 4.7*

Lower half 5.2*

Upper half 4.8

Lower quarter 6.3*

Middle half 3.4

Upper quarter 5.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 279 Thursday, March 13, 2008 1:21 PM

Page 288: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 280 Thursday, March 13, 2008 1:21 PM

Page 289: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-281

• • • •••

D South Dakota Douth Dakota administers the state Test of Educational Progress (STEP) ingrades 3-8 in reading and mathematics. The Dakota STEP, which is un-timedand yields both norm-referenced and standards-based scores, has as its basic

platform the new, augmented Stanford Achievement Test, Tenth Edition (SAT-10).Scores are available for economically disadvantaged students. South Dakota uses fourachievements levels for reporting purposes: below basic, basic, proficient, and advanced.The state did not participate in NAEP prior to 2003, so trend graphs are notincluded. School-level assessment scores based on 9 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 143 schools in grade 4 and 106 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the poverty gap in mathematicsin grades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

S

Chapter_D2.fm Page 281 Thursday, March 13, 2008 1:21 PM

Page 290: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-282 National Assessment of Educational Progress

• • • •••

SOUTH DAKOTA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.04 0.041 0.67 0.027Proficient 0.77 0.011 0.71 0.008Advanced 0.62 0.042 0.49 0.051

••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

basic

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

Chapter_D2.fm Page 282 Thursday, March 13, 2008 1:21 PM

Page 291: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

SOUTH DAKOTA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-283

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 17.5 — 13.0

English language learner — 2.9 — 2.4Student with disability — 13.7 — 10.1Both — 0.9 — 0.5

Excluded — 1.5 — 1.7English language learner — 0.1 — #Student with disability — 1.2 — 1.5Both — 0.1 — 0.2

Accommodated — 7.1 — 5.8English language learner — 1.2 — 0.7Student with disability — 5.5 — 4.9Both — 0.4 — 0.2

Chapter_D2.fm Page 283 Thursday, March 13, 2008 1:21 PM

Page 292: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-284 National Assessment of Educational Progress

• • • •••

SOUTH DAKOTA

Figure 2. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.7

Lower half -4.4

Upper half -1.8

Lower quarter -7.8

Middle half -2.9

Upper quarter -1.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 284 Thursday, March 13, 2008 1:21 PM

Page 293: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

SOUTH DAKOTA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-285

• • • •••

Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

# Rounds to zero.

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.3

Lower half -1.2

Upper half #

Lower quarter -4.5

Middle half 2.0

Upper quarter -0.1

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 285 Thursday, March 13, 2008 1:21 PM

Page 294: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 286 Thursday, March 13, 2008 1:21 PM

Page 295: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-287

• • • •••

D Tennessee Dhrough the Tennessee Comprehensive Assessment Program (TCAP), thestate administers exams in grades 3-8 in reading and mathematics. Scores areavailable for Hispanic, Black, and economically disadvantaged students, but

there are too few Hispanic students to provide a reliable comparison. Tennessee doesnot use multiple achievement levels for reporting purposes; instead, it reports examresults in percentiles. Scores from 2000 are not available for this report; therefore,trend graphs are not included. Suppression information is not available.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 96 schools in grade 4 and 94 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. There are not enough data to compare state standards to NAEP forgrade 4 or grade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White and poverty gaps in mathematics ingrades 4 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 287 Thursday, March 13, 2008 1:21 PM

Page 296: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-288 National Assessment of Educational Progress

• • • •••

TENNESSEE

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

NOTE: State does not use multiple achievement levels for reporting; it reports exam results in percentiles.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPercentile Rank 0.76 0.016 0.81 0.027

•••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••

•••••••••••••••••••••••

•••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

••••••••••••••••••

•••••••••••••••••••••••••

•••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 288 Thursday, March 13, 2008 1:21 PM

Page 297: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

TENNESSEE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-289

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.2 14.0 12.6 16.0

English language learner 0.7 0.9 1.4 1.6Student with disability 9.8 12.5 11.2 13.5Both 0.7 0.5 # 1.0

Excluded 2.6 2.6 2.4 3.0English language learner 0.1 0.2 0.5 0.4Student with disability 1.8 2.2 1.9 2.4Both 0.6 0.2 # 0.2

Accommodated 1.3 4.8 0.7 1.4English language learner # # 0.1 0.1Student with disability 1.3 4.6 0.6 1.3Both # 0.2 # #

Chapter_D2.fm Page 289 Thursday, March 13, 2008 1:21 PM

Page 298: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-290 National Assessment of Educational Progress

• • • •••

TENNESSEE

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -3.1

Lower half -2.4

Upper half -6.5

Lower quarter -1.0

Middle half -1.2

Upper quarter -7.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 290 Thursday, March 13, 2008 1:21 PM

Page 299: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

TENNESSEE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-291

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.7

Lower half -3.8

Upper half -3.0

Lower quarter -2.6

Middle half -2.3

Upper quarter 0.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 291 Thursday, March 13, 2008 1:21 PM

Page 300: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-292 National Assessment of Educational Progress

• • • •••

TENNESSEE

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.3

Lower half 1.9

Upper half -1.8

Lower quarter 3.2

Middle half 1.5

Upper quarter -5.8*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 292 Thursday, March 13, 2008 1:21 PM

Page 301: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

TENNESSEE D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-293

• • • •••

Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 3.6

Lower half 2.0

Upper half 4.4

Lower quarter 3.8

Middle half 2.7

Upper quarter 4.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 293 Thursday, March 13, 2008 1:21 PM

Page 302: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 294 Thursday, March 13, 2008 1:21 PM

Page 303: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-295

• • • •••

D Texas Dhe state administers the Texas Assessment of Knowledge and Skills (TAKS)in grades 3-11 in reading and mathematics. Scores are available for Hispanicand Black students. Texas reports its data only by percent passing. Before 2003,

when the TAKS was implemented, students took the Texas Assessment of AcademicSkills (TAAS). Because the test changed, direct comparisons cannot be madebetween scores from 2003 and those from 2000; therefore, trends are not included.School-level assessment scores based on 4 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 194 schools in grade 4 and 142 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard (passing)is below the NAEP basic level. This is also true for grade 8.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White gap in mathematics in grade 4 in2003. Overall, the Black-White gap in grade 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. There were insufficient data for comparingthe NAEP and state assessment measurement of the poverty gap in mathematics ingrades 4 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 295 Thursday, March 13, 2008 1:21 PM

Page 304: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-296 National Assessment of Educational Progress

• • • •••

TEXAS

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPassing 0.52 0.052 0.71 0.009

••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advancedpassing

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••

••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• •0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

passing

Chapter_D2.fm Page 296 Thursday, March 13, 2008 1:21 PM

Page 305: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

TEXAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-297

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 25.2 27.5 20.2 20.0

English language learner 10.5 12.8 6.6 4.7Student with disability 12.6 11.3 12.1 12.2Both 2.0 3.4 1.5 3.1

Excluded 6.9 7.4 8.0 7.2English language learner 0.9 0.6 1.1 0.9Student with disability 5.2 5.4 5.8 5.0Both 0.7 1.5 1.0 1.3

Accommodated 6.1 6.0 2.0 2.1English language learner 3.0 3.0 0.5 0.5Student with disability 2.7 2.4 1.2 1.3Both 0.3 0.6 0.2 0.2

Chapter_D2.fm Page 297 Thursday, March 13, 2008 1:21 PM

Page 306: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-298 National Assessment of Educational Progress

• • • •••

TEXAS

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.9

Lower half -3.7

Upper half -3.0

Lower quarter 1.6

Middle half -4.8

Upper quarter -4.3

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0 0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 298 Thursday, March 13, 2008 1:21 PM

Page 307: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

TEXAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-299

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -7.3*

Lower half -9.5*

Upper half -5.3

Lower quarter -10.4

Middle half -8.5*

Upper quarter -2.5

Lowest

achievers

Median Highest

achievers

Highest achievers

Highest achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 299 Thursday, March 13, 2008 1:21 PM

Page 308: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-300 National Assessment of Educational Progress

• • • •••

TEXAS

Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.1

Lower half -0.2

Upper half -2.1

Lower quarter 0.8

Middle half -1.5

Upper quarter -1.9

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 300 Thursday, March 13, 2008 1:21 PM

Page 309: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

TEXAS D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-301

• • • •••

Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -2.4

Lower half -3.5

Upper half -0.7

Lower quarter -2.2

Middle half -3.8

Upper quarter -1.4

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 301 Thursday, March 13, 2008 1:21 PM

Page 310: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 302 Thursday, March 13, 2008 1:21 PM

Page 311: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-303

• • • •••

D Utah Dtah administers the Stanford Achievement Test, Ninth Edition (SAT-9) ingrades 3, 5, and 8 in reading and mathematics. The scores available for thisreport do not include any breakdowns by race/ethnicity or poverty status.

Utah does not use multiple achievement levels for reporting the SAT-9; instead, itreports exam results in percentiles. Suppression information is not available.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 104 schools in grade 5 and 91 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. There are not enough data to compare state standards to NAEP forgrade 5 or grade 8.

• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in average percentile rank between 2000 and 2003.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

U

Chapter_D2.fm Page 303 Thursday, March 13, 2008 1:21 PM

Page 312: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-304 National Assessment of Educational Progress

• • • •••

UTAH

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

NOTE: State does not use multiple achievement levels for reporting; it reports exam results in percentiles.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorPercentile Rank 0.68 0.008 0.72 0.013

••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

•• •••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••

••••••••••

•••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 304 Thursday, March 13, 2008 1:21 PM

Page 313: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

UTAH D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-305

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 (state assessment grade 5) Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 13.7 21.4 13.5 16.3

English language learner 5.1 9.4 3.0 5.5Student with disability 7.8 9.5 9.8 9.1Both 0.9 2.6 0.7 1.7

Excluded 2.8 2.8 2.7 2.5English language learner 0.3 0.8 0.2 0.4Student with disability 2.2 1.3 2.2 1.9Both 0.3 0.7 0.2 0.2

Accommodated 3.7 7.1 2.7 5.1English language learner 1.3 2.0 0.5 1.2Student with disability 1.8 4.3 2.2 3.2Both 0.5 0.8 0.1 0.7

53 51

50 48

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

Percentilerank 53 54

58 57

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

Percentilerank

Chapter_D2.fm Page 305 Thursday, March 13, 2008 1:21 PM

Page 314: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 306 Thursday, March 13, 2008 1:21 PM

Page 315: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-307

• • • •••

D Vermont Dermont administers the New Standards Reference Examinations (NSRE) ingrades 4 and 8 in reading and mathematics. The reading exam is broken downinto two reading subtests (basic understanding; analysis & interpretation); the

mathematics exam is broken down into three subtests (concepts; problem solving;skills). The reading and mathematics scores are averages of the two reading subtestsand three mathematics subtests, respectively. Scores are available for economicallydisadvantaged students. Vermont uses five achievement levels for reporting purposes:little evidence of achievement, below the standard, nearly achieved the standard, achievedthe standard, and achieved the standard with honors. Because scores were only availablefor achieved the standard prior to 2003, the trend graphs are based only on that level.School-level assessment scores based on 10 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 154 schools in grade 4 and 99 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics standard (achieved) is betweenthe NAEP basic and proficient levels. This is also true for grade 8.

• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent meeting aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in the same period.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, the poverty gap in grade 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. There were no significant differences between ingrade 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

V

Chapter_D2.fm Page 307 Thursday, March 13, 2008 1:21 PM

Page 316: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-308 National Assessment of Educational Progress

• • • •••

VERMONT

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBelow 0.10 0.072 0.35 0.080Nearly 0.50 0.019 0.63 0.036Achieved 0.47 0.021 0.74 0.026Honors 0.29 0.034 0.76 0.012

••••••••••••••••••••••••••••••••••••••••••

•••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

below

achieved

honors

nearly

••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••

•••••••••••••••••••••••••••••••

•••••••••••••••••

••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

nearly

achieved

honors

below

Chapter_D2.fm Page 308 Thursday, March 13, 2008 1:21 PM

Page 317: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

VERMONT D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-309

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: State of Vermont Department of Education site at http://data.ed.state.vt.us/performance/03/STATE_03.pdf

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.5 18.4 17.0 17.7

English language learner 0.4 1.3 1.2 0.4Student with disability 15.1 16.4 15.6 16.7Both 0.1 0.7 0.2 0.7

Excluded 2.7 4.0 3.1 2.9English language learner # 0.1 0.5 #Student with disability 2.7 3.6 2.4 2.6Both 0.1 0.3 0.2 0.3

Accommodated 8.7 10.0 4.4 7.4English language learner 0.4 0.5 0.2 #Student with disability 8.3 9.2 4.2 7.2Both # 0.3 # 0.2

Level 2000 2003Grade 4 47.3 53.0Grade 8 47.0 51.7

47

61

4753

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

achieved

*

465246

52

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

achieved

Chapter_D2.fm Page 309 Thursday, March 13, 2008 1:21 PM

Page 318: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-310 National Assessment of Educational Progress

• • • •••

VERMONT

Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -14.3*

Lower half -15.7*

Upper half -14.1*

Lower quarter -12.6*

Middle half -15.6*

Upper quarter -12.9*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 310 Thursday, March 13, 2008 1:21 PM

Page 319: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

VERMONT D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-311

• • • •••

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.2

Lower half -5.6

Upper half -4.2

Lower quarter -4.7

Middle half -4.0

Upper quarter -0.7

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 311 Thursday, March 13, 2008 1:21 PM

Page 320: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 312 Thursday, March 13, 2008 1:21 PM

Page 321: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-313

• • • •••

D Virginia Dirginia administers the Standards of Learning (SOL) tests in grades 3, 5, and 8in reading and mathematics. Scores are available for Hispanic and Blackstudents, but there are too few Hispanic students to provide a reliable

comparison. Virginia uses three achievement levels for reporting purposes: failing,proficient, and advanced. Trend graphs are not included because new performancestandards are set every year. School-level assessment scores based on 9 or fewerstudents are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 5 and 103 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is below the NAEP basiclevel.

• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, the Black-White gap in grades 5 and 8 in percent meeting the state’s

standard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White and poverty gaps inmathematics in grades 5 and 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

V

Chapter_D2.fm Page 313 Thursday, March 13, 2008 1:21 PM

Page 322: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-314 National Assessment of Educational Progress

• • • •••

VIRGINIA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4 (state 5th grade standards)

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.54 0.017 0.63 0.028Advanced 0.66 0.026 0.77 0.016

••• ••••••••••••••••••••••••••••••••••••••••••••••

•••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••

•••••••••••••••••••••

••••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

advanced

proficient

Chapter_D2.fm Page 314 Thursday, March 13, 2008 1:21 PM

Page 323: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

VIRGINIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-315

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.8 19.4 14.9 16.9

English language learner 3.0 6.4 2.2 2.4Student with disability 12.3 11.3 12.3 13.1Both 0.5 1.6 0.4 1.5

Excluded 4.0 6.1 6.2 6.5English language learner 1.1 1.7 0.8 0.8Student with disability 2.5 3.8 5.3 4.9Both 0.4 0.7 0.1 0.8

Accommodated 6.6 8.1 3.9 6.4English language learner 0.9 2.4 0.2 0.5Student with disability 5.7 4.9 3.3 5.5Both # 0.8 0.3 0.4

Chapter_D2.fm Page 315 Thursday, March 13, 2008 1:21 PM

Page 324: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-316 National Assessment of Educational Progress

• • • •••

VIRGINIA

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: State assessment data used are for grade 5.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -10.3*

Lower half -13.7*

Upper half -5.8*

Lower quarter -14.8*

Middle half -11.6*

Upper quarter -3.7

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 316 Thursday, March 13, 2008 1:21 PM

Page 325: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

VIRGINIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-317

• • • •••

Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.6*

Lower half -11.3*

Upper half -5.9

Lower quarter -12.4*

Middle half -10.4*

Upper quarter -2.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

White

Black

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 317 Thursday, March 13, 2008 1:21 PM

Page 326: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 318 Thursday, March 13, 2008 1:21 PM

Page 327: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-319

• • • •••

D Washington Dhe state administers the Washington Assessment of Student Learning(WASL) in grades 4 and 7 in reading and mathematics. Scores are availablefor Hispanic and Black students, but there are too few Black students in grades

4 and 7 and too few Hispanic students in grade 7 to provide reliable comparisons.Washington uses four achievement levels for reporting purposes: far belowexpectations, below expectations, met expectations, and above expectations. Trend graphsare not included because Washington did not participate in State NAEP in 2000, andbecause scores from 2000 are not available for this report, so no direct comparisonscould be made with scores from 2003. School-level assessment scores based on 9 orfewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 96 schools in grade 4 and 85 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard (met) isbetween the NAEP basic and proficient levels. This is also true for grade 7.

• Trends. No comparisons were possible for grades 4 and 7.• Gaps. There were insufficient data for comparing the NAEP and state assessment

measurement of the Black-White and poverty gaps in mathematics in grades 4 and7 in 2003. Overall, there were no significant differences between NAEP and thestate assessment in measurement of the Hispanic-White gap in mathematics ingrade 4 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the Hispanic-White gap in mathematics in grade 7 in2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 319 Thursday, March 13, 2008 1:21 PM

Page 328: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-320 National Assessment of Educational Progress

• • • •••

WASHINGTON

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8 (state 7th grade standards)

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorBelow 0.65 0.043 0.73 0.020Met 0.69 0.019 0.69 0.026Above 0.57 0.007 0.66 0.026

••••••••••••••••••••••••••••••••••••••••

••••••••••••

•••••••••••

•••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

met

above

below

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••••••

••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

below

met

above

Chapter_D2.fm Page 320 Thursday, March 13, 2008 1:21 PM

Page 329: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

WASHINGTON D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-321

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

— Not available.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 19.1 — 16.2

English language learner — 5.2 — 3.5Student with disability — 12.2 — 11.4Both — 1.7 — 1.2

Excluded — 3.2 — 2.0English language learner — 0.9 — 0.4Student with disability — 2.1 — 1.5Both — 0.2 — 0.2

Accommodated — 7.9 — 4.6English language learner — 1.2 — 0.4Student with disability — 5.6 — 3.9Both — 1.0 — 0.4

Chapter_D2.fm Page 321 Thursday, March 13, 2008 1:21 PM

Page 330: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Hispanic-White Gap

D-322 National Assessment of Educational Progress

• • • •••

WASHINGTON

Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -0.2

Lower half -3.1

Upper half 2.6

Lower quarter -1.7

Middle half -3.7

Upper quarter 7.8

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Hispanic

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 322 Thursday, March 13, 2008 1:21 PM

Page 331: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-323

• • • •••

D West Virginia Dest Virginia administers the Stanford Achievement Test, Ninth Edition(SAT-9) in grades 3-8 in reading and mathematics. However, the dataavailable in this report include only school-level scores which have been

designated as either elementary or middle school scores based upon state-reportedgrade span information. The data available in this report include only one combinedscore for reading and mathematics, which we have treated as reading data for thisreport. For this reason, neither state assessment mathematics data nor comparisonsbased upon the mathematics data are displayed here. Suppression information is notavailable.

Summary of Compar i sonsBecause 2003 state mathematics assessment data do not exist for West Virginia, nocomparisons to NAEP were possible.

W

Chapter_D2.fm Page 323 Thursday, March 13, 2008 1:21 PM

Page 332: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-324 National Assessment of Educational Progress

• • • •••

WEST VIRGINIA

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

•••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••

•••••••••••••••••

••••••••••••

••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

Chapter_D2.fm Page 324 Thursday, March 13, 2008 1:21 PM

Page 333: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

WEST VIRGINIA D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-325

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 13.4 15.1 14.6 16.2

English language learner # 0.1 0.1 0.3Student with disability 13.2 14.6 14.3 15.7Both 0.2 0.3 0.1 0.2

Excluded 2.7 2.8 2.7 2.8English language learner # # 0.1 #Student with disability 2.6 2.8 2.6 2.7Both 0.2 # # #

Accommodated 8.0 9.1 7.7 8.5English language learner # # # #Student with disability 7.9 8.8 7.6 8.4Both 0.1 0.3 0.1 #

Chapter_D2.fm Page 325 Thursday, March 13, 2008 1:21 PM

Page 334: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 326 Thursday, March 13, 2008 1:21 PM

Page 335: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-327

• • • •••

D Wisconsin DThe state administers the Wisconsin Knowledge and Concepts Examination(WKCE) in grades 4 and 8 in reading and mathematics. Scores are availablefor Hispanic, Black, and economically disadvantaged students, but there are

too few Hispanic students in grades 4 and 8 and too few Black students in grade 8 toprovide reliable comparisons between these subgroups. Wisconsin uses fourachievement levels for reporting purposes: minimal performance, basic, proficient, andadvanced. Because new performance standards for the WKCE were set in 2003, scoresfrom 2003 and those from 2000 are not comparable; therefore, trend graphs are notincluded. School-level assessment scores based on 5 or fewer students are suppressed.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 127 schools in grade 4 and 103 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is close to the NAEP basiclevel.

• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state

assessment in measurement of the Black-White gap in mathematics in grade 4 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White gap in mathematics in grade 8 in 2003. Therewere insufficient data for comparing the NAEP and state assessment measurementof the Hispanic-White gap in mathematics in grades 4 and 8 in 2003. Overall, thepoverty gap in grade 4 in percent meeting the state’s standard in mathematics in2003 was greater when measured by NAEP compared to the state assessment.Overall, there were no significant differences between NAEP and the stateassessment in measurement of the poverty gap in mathematics in grade 8 in 2003.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 327 Thursday, March 13, 2008 1:21 PM

Page 336: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-328 National Assessment of Educational Progress

• • • •••

WISCONSIN

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.77 0.010 0.89 0.014Proficient 0.81 0.015 0.90 0.008Advanced 0.79 0.004 0.85 0.014

•••••••••••••••••••••••••••••••••••••••••

••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

basic

proficient

advanced

••••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••

•••••••••••••••••

••••••••••••••••••••••••

•••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0

001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

basic

proficient

advanced

Chapter_D2.fm Page 328 Thursday, March 13, 2008 1:21 PM

Page 337: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

WISCONSIN D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-329

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.3 20.0 16.9 17.5

English language learner 4.5 5.4 1.6 2.3Student with disability 14.1 13.4 15.0 14.3Both 0.7 1.2 0.4 0.8

Excluded 4.8 3.6 4.2 3.0English language learner 0.4 0.6 0.5 0.4Student with disability 4.1 2.6 3.6 2.3Both 0.3 0.4 0.1 0.3

Accommodated 7.9 12.3 6.2 11.3English language learner 2.4 2.5 0.4 0.9Student with disability 5.1 9.1 5.6 10.0Both 0.4 0.7 0.2 0.4

Chapter_D2.fm Page 329 Thursday, March 13, 2008 1:21 PM

Page 338: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Black-White Gap

D-330 National Assessment of Educational Progress

• • • •••

WISCONSIN

Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -8.1

Lower half -7.8

Upper half -7.2

Lower quarter -13.0

Middle half -17.3*

Upper quarter -1.5

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

White

Black

0

-80

-60

-40

-20

0

20

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-80

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 330 Thursday, March 13, 2008 1:21 PM

Page 339: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

WISCONSIN D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-331

• • • •••

Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -9.5*

Lower half -11.8*

Upper half -5.9

Lower quarter -18.3*

Middle half -6.8*

Upper quarter -9.1*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

Highest achieversHighest achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 331 Thursday, March 13, 2008 1:21 PM

Page 340: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-332 National Assessment of Educational Progress

• • • •••

WISCONSIN

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -1.6

Lower half -6.6

Upper half 0.8

Lower quarter -3.0

Middle half -2.8

Upper quarter 5.6

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 332 Thursday, March 13, 2008 1:21 PM

Page 341: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

D-333

• • • •••

D Wyoming Dhrough the Wyoming Comprehensive Assessment System (WyCAS), thestate administers criterion-referenced tests in grades 4 and 8 in reading andmathematics. Scores are available for Hispanic, Black, and economically

disadvantaged students, but there are too few Hispanic and Black students to providereliable comparisons. Wyoming uses four achievement levels for reporting purposes:novice, partially proficient, proficient, and advanced. Suppression information is notavailable.

Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 74 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1

• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. This is also true for grade 8.

• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are greater than the state assessment gains.

• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, the poverty gap in grades 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. By contrast, in grade 8, WyCAS found a largepoverty gap than NAEP did.

1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.

T

Chapter_D2.fm Page 333 Thursday, March 13, 2008 1:21 PM

Page 342: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Achievement

D-334 National Assessment of Educational Progress

• • • •••

WYOMING

Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003

Grade 4

Grade 8

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPartially Proficient 0.68 0.041 0.74 0.037Proficient 0.64 0.018 0.74 0.023Advanced 0.38 0.033 0.63 0.028

•••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••••••••

••••••••••••••••••••••••••••

•••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basicNAEP proficient

NAEP advanced

proficient

advanced

partially proficient

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••

•••••••••••••••••••

••••••••••

•••••••••••••••••••••

••••••••••••••••••••••

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122

0 50 100 150 200 250 300 350 400 450 500

NAEP Mathematics Scale

NAEP basic

NAEP proficientNAEP advanced

partially proficient

proficient

advanced

Chapter_D2.fm Page 334 Thursday, March 13, 2008 1:21 PM

Page 343: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

WYOMING D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-335

• • • •••

Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003

# Rounds to zero.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.

Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003

Grade 4 Grade 8

* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Table 3. Percentage meeting standards as reported by state: 2000 and 2003

SOURCE: Wyoming Department of Education site at https://wdesecure.k12.wy.us/stats/wde.esc.show_menu.

Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.3 17.6 12.9 16.3

English language learner 1.4 2.7 1.1 1.7Student with disability 13.2 13.3 11.4 13.3Both 0.7 1.6 0.4 1.3

Excluded 1.9 1.1 1.0 1.2English language learner # # # 0.1Student with disability 1.9 1.0 1.0 0.7Both # 0.1 # 0.3

Accommodated 5.8 10.8 3.0 9.5English language learner 0.1 0.2 # 0.2Student with disability 5.7 9.6 3.0 8.6Both # 1.0 # 0.6

Level 2000 2003Grade 4 27.0 37.0Grade 8 32.0 35.0

60

80

26

42

5

9

6071

2636

58

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

partiallyproficient

proficient

advanced

*

*

69

77

32

41

9

12

6971

3235

911

2000 20030

20

40

60

80

100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Year

State

NAEP

partiallyproficient

proficient

advanced

*

*

Chapter_D2.fm Page 335 Thursday, March 13, 2008 1:21 PM

Page 344: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Poverty Gap

D-336 National Assessment of Educational Progress

• • • •••

WYOMING

Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall -4.8*

Lower half -2.3

Upper half -7.3*

Lower quarter -2.2

Middle half -3.5*

Upper quarter -6.4*

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 336 Thursday, March 13, 2008 1:21 PM

Page 345: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

WYOMING D

Comparison between NAEP and State Mathematics Assessment Results: 2003 D-337

• • • •••

Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003

State NAEP

Gap comparison

* NAEP–State gap difference significantly different from zero (p<.05).

NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.

SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.

Population

AverageNAEP-state gap

differenceOverall 4.6*

Lower half 7.5*

Upper half 2.3

Lower quarter 6.2*

Middle half 4.8*

Upper quarter 1.2

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

s

Percentile in group

Not disadvantaged

Disadvantaged

0

Lowest

achievers

Median Highest

achievers

0

20

40

60

80

100

0 10 20 30 40 50 60 70 80 90 100

Perc

ent

mee

ting

stat

e's

prim

ary

stan

dard

sPercentile in group

Not disadvantaged

Disadvantaged

0

-60

-40

-20

0

20

40

0 10 20 30 40 50 60 70 80 90 100

Gap

in p

erce

nt m

eetin

g pr

imar

y st

anda

rds

Percentile in group

-60

Lowest

achievers

Median Highest

achievers

State

NAEP

Chapter_D2.fm Page 337 Thursday, March 13, 2008 1:21 PM

Page 346: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Chapter_D2.fm Page 338 Thursday, March 13, 2008 1:21 PM

Page 347: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Cover_back_v1.fm Page 1 Wednesday, March 12, 2008 5:24 PM

Page 348: Comparison Between NAEP and State Mathematics Assessment ...nces.ed.gov/pubs2008/2008475_2.pdf · • a comparison of NAEP and state assessment achievement changes; • state-reported

Cover_back_v1.fm Page 2 Wednesday, March 12, 2008 5:24 PM