Upload
others
View
6
Download
0
Embed Size (px)
Citation preview
U.S. Department of Education
NCES 2008-475
Comparison Between NAEP and State MathematicsAssessment Results: 2003
Volume 2
Research and Development Report
Cover_front_v2.fm Page 1 Saturday, March 22, 2008 3:30 PM
Cover_front_v2.fm Page 2 Saturday, March 22, 2008 3:30 PM
U.S. Department of Education
NCES 2008-475
Comparison Between NAEP and State MathematicsAssessment Results: 2003
Volume 2
Research and Development Report
January 2008
Don McLaughlinVictor Bandeira de MelloCharles BlankenshipKassandra ChaneyPhil EsraHiro HikawaDaniela RojasPaul WilliamMichael Wolman
American Institutes for Research
Taslima Rahman
Project Officer
National Center for Education Statistics
Cover_front_v2.fm Page 3 Saturday, March 22, 2008 3:30 PM
U.S. Department of Education
Margaret Spellings
Secretary
Institute of Education Sciences
Grover J. Whitehurst
Director
National Center for Education Statistics
Mark Schneider
Commissioner
The National Center for Education Statistics (NCES) is the primary federal entity for collecting, analyzing, andreporting data related to education in the United States and other nations. It fulfills a congressional mandate tocollect, collate, analyze, and report full and complete statistics on the condition of education in the United States;conduct and publish reports and specialized analyses of the meaning and significance of such statistics; assist stateand local education agencies in improving their statistical systems; and review and report on education activities inforeign countries.
NCES activities are designed to address high-priority education data needs; provide consistent, reliable, complete,and accurate indicators of education status and trends; and report timely, useful, and high-quality data to the U.S.Department of Education, the Congress, the states, other education policymakers, practitioners, data users, and thegeneral public. Unless specifically noted, all information contained herein is in the public domain.
We strive to make our products available in a variety of formats and in language that is appropriate to a variety ofaudiences. You, as our customer, are the best judge of our success in communicating information effectively. If youhave any comments or suggestions about this or any other NCES product or report, we would like to hear from you.Please direct your comments to
National Center for Education StatisticsInstitute of Education SciencesU.S. Department of Education1990 K Street NWWashington, DC 20006-5651¬
January 2008
The NCES World Wide Web Home Page address is http://nces.ed.gov.The NCES World Wide Web Electronic Catalog is http://nces.ed.gov/pubsearch.
Suggested Citation
McLaughlin, D.H., Bandeira de Mello, V., Blankenship, C., Chaney, K., Esra, P., Hikawa, H., Rojas, D., William, P., and Wolman, M. (2008).
Comparison Between NAEP and State Mathematics Assessment Results: 2003
(NCES 2008-475). National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. Washington, DC.
For ordering information on this report, write to
U.S. Department of EducationED PubsP.O. Box 1398Jessup, MD 20794-1398
or call toll free 1-877-4ED-Pubs or order online at http://www.edpubs.org.
Content Contact
Taslima Rahman(202) [email protected]
Cover_front_v2.fm Page 4 Saturday, March 22, 2008 3:30 PM
iii
• • • •••
Contents
Page
Explanat ion of State Prof i les . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -1
Alabama . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -11
Alaska . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -19
Ar izona . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -23
Arkansas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -29
Cal i forn ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -37
Colorado . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -45
Connect i cut . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -49
Delaware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -59
Dist r i c t of Co lumbia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -67
F lor ida . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -73
Georg ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -83
Hawai i . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -91
Idaho . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -97
I l l ino is . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -103
Indiana . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -113
Iowa . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -121
Kansas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -125
Kentucky . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -131
Louis iana . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -137
Chapter_D0.fm Page iii Thursday, March 13, 2008 1:19 PM
iv
National Assessment of Educational Progress
• • • •••
Page
Maine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -145
Mary land . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -149
Massachusetts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -153
Mich igan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -159
Minnesota . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -163
Miss i ss ipp i . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -167
Missour i . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -175
Montana . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -183
Nebraska . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -187
Nevada . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -191
New Hampshi re . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -199
New Jersey . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -203
New Mexico . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -213
New York . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -221
North Caro l ina . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -231
North Dakota . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -239
Ohio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -243
Oklahoma . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -249
Oregon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -255
Pennsy lvania . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -259
Rhode I s land . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -267
South Caro l ina . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -273
South Dakota . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -281
Tennessee . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -287
Texas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -295
Chapter_D0.fm Page iv Thursday, March 13, 2008 1:19 PM
CONTENTS
Comparison between NAEP and State Mathematics Assessment Results: 2003
v
• • • •••
Page
Utah . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -303
Vermont . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -307
Vi rg in ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -313
Washington . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -319
West V i rg in ia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -323
Wiscons in . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -327
Wyoming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D -333
Chapter_D0.fm Page v Thursday, March 13, 2008 1:19 PM
Chapter_D0.fm Page vi Thursday, March 13, 2008 1:19 PM
D-1
• • • •••
D
Explanation of State Profiles
D
he relations between the National Assessment of Educational Progress(NAEP) results and individual state assessment results vary from state to state.Individual state profiles in this section display the comparisons for each state.
Each state profile has up to 13 elements, depending on the availability of school-levelstate assessment information in the national longitudinal school-level stateassessment score database (NLSLSASD). They include:
• a summary description of the state assessment data;
• an overview of the results displayed in the profile;
• a display of the state’s achievement standard thresholds on the NAEPachievement distribution in the state;
• the correlations between NAEP and state assessment school achievement;
• the percentages of students with disabilities or English language learners;
• a comparison of NAEP and state assessment achievement changes;
• state-reported percentages of students meeting standards; and
• comparisons of NAEP and state assessment achievement gaps.
These are described below, in the context of the example profile displayed on thefollowing pages.
T
Chapter_D1.fm Page 1 Thursday, March 13, 2008 1:20 PM
D-2
National Assessment of Educational Progress
• • • •••
E lement 1Br ief descr ipt ion of the s tate assessment data
The description is based primarily on information provided on the state educationagency website, as it applies to the data used in this comparison report (school-levelscores on reading and mathematics assessments). The information included in thedescriptions includes test(s) used, grades tested, subgroup data availability,availability of data across years, and data suppression information, as well as anyinformation which would be required for understanding the results presented in theprofile.
E lement 2Br ief textua l summary of s tat i s t i ca l ly s ign i f i cant d i f ferences between NAEP and s tate assessment scores .
The summary provides a brief overview of the results being displayed in the profile. Itincludes the number of schools in each grade which are being used for thecomparison, a textual explanation of the standards comparison graphs (element 3), abrief explanation of the changes in achievement (element 6), and a summary ofsignificant results for each gap type (Black-White, Hispanic-White, and poverty–elements 8-13).
1
The summary serves to highlight the information presented in thegraphs and tables.
1. The poverty gap in achievement refers to the difference in achievement between economicallydisadvantaged students and other students, where disadvantaged students are defined as those eligiblefor free/reduced price lunch.
Chapter_D1.fm Page 2 Thursday, March 13, 2008 1:20 PM
EXPLANATION OF STATE PROFILES
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-3
• • • •••
Figure D-1.Elements 1 and 2 of the state profile
D-1
••••••
D State X Dhrough the Comprehensive Assessment System, X administers exams ingrades 4 and 7 in English language arts and grades 4 and 8 in mathematics.Scores are available for Hispanic and Black students, but there are too few
Black students in grade 8 to provide a reliable comparison. State X uses fourachievement levels for reporting purposes: warning, needs improvement, proficient, andadvanced. Assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 189 schools in grade 4 and 145 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. This is also true for grade 8.
• Trends. Between 2000 and 2003, NAEP reported a gain in grade 4 in percentproficient, which the state did not. Between 2000 and 2003, the NAEP grade 8gains in percent proficient are greater than the state assessment gains.
• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEPand state assessment measurement of the Black-White gap in mathematics ingrade 8 in 2003. Overall, there were no significant differences between NAEPand the state assessment in measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. There were insufficient data forcomparing the NAEP and state assessment measurement of the poverty gap inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However,these results must be considered in the context of the available data. NAEP and state assessmentsmay employ different test items, testing accommodations, and scoring methods; they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differencesin standards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T1
2
Chapter_D1.fm Page 3 Thursday, March 13, 2008 1:20 PM
D-4
National Assessment of Educational Progress
• • • •••
E lement 3Pos i t ion of s tandards in the ach ievement d is t r ibut ion
The position of the state’s achievement standard thresholds on the NAEPachievement distribution in the state are based on mapping the percentagesachieving state standards reported for schools participating in NAEP with thedistribution of NAEP grade 4 or grade 8 performance in those schools.
2
In some cases,the state’s standard is for an adjacent grade. In those cases, the assumption is madethat the percentage of students meeting the state’s standard for one grade would beapproximately the same as the percentage meeting a standard the state might set forthe next grade. The distributions are displayed for all states with availablepercentages achieving standards in NAEP schools.
Because Alabama, Tennessee, and Utah data files available for this report do notinclude percentages of students meeting standards, the state profiles for these states,unlike the other states, are based on the median percentile rank in each school, notthe percentages meeting state standards. Therefore, no state standard thresholds areplaced on the NAEP scale.
E lement 4Corre lat ions of NAEP and s tate assessment school ach ievement
Based on schools participating in NAEP, this table displays correlations ofpercentages reported as meeting state standards with NAEP percentages ofachievement meeting the estimated state standard in the same schools. For thisdisplay, NAEP has been rescored to estimate the percentages of students above thestate’s cutpoints indicated in element 3.
In states with multiple standards, one standard was identified for this report as theprimary standard. In nearly every case, this is the standard that is used for reportingadequate yearly progress to the federal government. For Alabama, Tennessee, andUtah, the correlations are for median percentile ranks.
2. The figure plots the relative frequency of the NAEP plausible values in the state. Since the numericalvalues on the vertical axis (i.e., the relative frequencies, or more accurately, approximate probabilitydensities) are solely a function of the fineness of the categorization of the continuous scale on thehorizontal axis, it is neither meaningful nor appropriate to display numerical values for the verticalaxis.
Chapter_D1.fm Page 4 Thursday, March 13, 2008 1:20 PM
EXPLANATION OF STATE PROFILES
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-5
• • • •••
Figure D-2.Elements 3 and 4 of the state profile
D-2 National Assessment of Educational Progress
••••••
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores:2003
grade 4
grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment ofpercentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeeds Improvement 0.78 0.015 0.88 0.015Proficient 0.82 0.008 0.87 0.012Advanced 0.74 0.033 0.87 0.023
• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
needs improvement
•• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
needs improvement
proficient
advanced
3
4
Chapter_D1.fm Page 5 Thursday, March 13, 2008 1:20 PM
D-6
National Assessment of Educational Progress
• • • •••
E lement 5Percentages of s tudents with d isab i l i t ies or Engl i sh language learners
Because measurement of trends in achievement can be affected by changes in thepercentages of students with disabilities (SD) or English language learners (ELLs),through their exclusion from testing or access to testing accommodations, informationabout these percentages are presented for NAEP assessments in 2000 and 2003. Thepercentages are presented separately for (1) English language learners (but not with adisability), (2) students with disabilities (who are not English language learners), and(3) English language learners who also have a disability. The percentages of studentsidentified with disabilities or as English language learners who participated in NAEPwithout accommodations are not included in the table.
The percentages of students excluded from NAEP participation are based on the totalstudent population. For example, if 10 percent of students have a disability and 40percent of those with a disability are excluded, that means that 4 percent of the totalstudent population is excluded. The use of full population estimates in this report isintended to minimize the effects of NAEP exclusions on the results of changes inachievement. Similarly, the percentages of students accommodated by NAEP are basedon the total student population. In the example above, if 50 percent of the includedSD/ELL students were accommodated, that would mean that accommodations wereprovided for 50 percent of the included 6 percent, or 3 percent of the total population.
E lement 6Compar ison of NAEP and s tate assessment changes in ach ievement , based on NAEP schools
Achievement changes are presented as percentages meeting the states’ standards inNAEP schools for state assessment results (lighter line) and for NAEP results (darkerline). The standards are equated in the first year of analysis, forcing the percentages tomatch in the first year by definition. Differences between NAEP and state assessmentachievement changes are revealed at the second point in time. Asterisks on the chartsindicate statistically significant differences (
p
<.05) between NAEP and stateassessment gains.
Comparisons of achievement changes are available only for states in which comparablestate scores are reported across years. Many states changed tests or changed standardsbetween 2000 and 2003 and, although data were available for the different tests, it isimpossible to construct meaningful comparisons of NAEP and state assessment gains.
E lement 7State reported percentages meet ing s tandard
The changes in achievement presented in element 6 are based on the NAEP sample ofschools, weighted to represent the state. In most states, these results can be comparedto reports issued by state education agencies on their websites.
3
These are shown in
3. The state-reported percentages were retrieved from state education agencies’ websites in July 2004.
Chapter_D1.fm Page 6 Thursday, March 13, 2008 1:20 PM
EXPLANATION OF STATE PROFILES
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-7
• • • •••
element 7. Ideally, the percentages in the table of state-reported achievement shouldmatch the state assessment percentages based on the NAEP sample of schools.However, in some cases state assessment scores were not available for all NAEPschools. This occurs, for example, when state assessment scores are for an adjacentgrade and some NAEP schools do not include the grade tested, or when they have notbeen reported by the state.
Figure D-3.Elements 5, 6, and 7 of the state profile
STATE X D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-3
••••••
Table 2. Percentages of English language learners and students with disabilitiesidentified, excluded, and accommodated in the NAEP mathematicsassessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes inpercent meeting mathematics standards, by grade: 2000 and 2003
grade 4 grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p <.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting mathematics standards as reported by state: 2003
SOURCE: State education agency website.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.4 21.9 19.4 18.4
English language learner 5.1 3.8 3.0 2.0Student with disability 13.7 17.0 15.6 15.2Both 0.6 1.0 0.9 1.2
Excluded 2.7 2.9 2.7 3.1English language learner 2.0 0.8 0.9 0.8Student with disability 0.7 1.8 1.2 1.8Both 0.0 0.3 0.6 0.5
Accommodated 10.1 15.0 8.8 10.8English language learner 1.5 1.1 1.1 0.4Student with disability 8.2 13.3 7.5 10.0Both 0.5 0.6 0.2 0.5
Level 2000 2003Grade 4 40.0 40.0Grade 8 34.0 37.0
82
89
41
51
12
19
82
84
41
38
12
11
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
needsimprovement
proficient
advanced
*
*
*
6167
34
41
10
15
61
68
3438
1013
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
needsimprovement
proficient
advanced
*
5
6
7
Chapter_D1.fm Page 7 Thursday, March 13, 2008 1:20 PM
D-8
National Assessment of Educational Progress
• • • •••
E lement 8Compar ison of NAEP and s tate assessment of the B lack–White grade 4 ach ievement gap
Three graphs and a table on the third page of the profile pertain to measurement ofan achievement gap in grade 4 in 2003. The graphs show comparisons of the gap asmeasured in NAEP schools (a) by state assessment and (b) by NAEP. In states inwhich at least 10 percent of public school membership is Black, the first achievementgap presented is the Black-White gap.
4
The two graphs at the top of the page are population profiles of the achievement ofBlack and White students as indicated by state assessment results (lighter lines) andNAEP results (darker lines). Both graphs represent percentages meeting the primarystate standard in the same sample of schools.
5
Interpretation of the population profiles is as follows: imagine the students in asubpopulation (e.g., White students) lined up along the horizontal axis, sorted fromthose in the lowest scoring segments of the subpopulation at the left to the highestscoring segments of the subpopulation at the right. The graph shows the percentageof students in each student’s school achieving the standard. For example, at themedian (50th percentile) of the White student population, White students are inschools in which about 62 percent of the White students are achieving the standard(the dashed line on the following graph), as measured by both NAEP and the stateassessment. By comparison, at the median (50th percentile) of the Black studentpopulation in the state, Black students are in schools in which about 33 percent ofthe Black students are achieving the standard (the solid line on the same graph).
The population gap profile in the lower left portion of the page displays the differencebetween the Black and White population profiles (i.e., the White profile is subtractedfrom the Black profile). The lighter line refers to state assessment of the gap; thedarker line refers to NAEP assessment of the gap. The space between those two linesrepresents the difference between NAEP and state assessment of the gap. In thisgraph, it appears that both assessments, but especially NAEP, find the gap to besomewhat larger in comparing the lower halves of the subpopulations than incomparing the upper halves.
The table at the lower right summarizes the average differences in gaps and indicateswhether the NAEP-State gap difference is significantly different from zero.
6
Positivenumbers indicate that the state assessment found the gap to be larger, negativenumbers the opposite. For example, in comparing the lower quarters of thesubpopulations, NAEP found the gap to be 1.4 percent larger (i.e., the gap between
4. At least 10 NAEP schools with sufficient numbers of minority students were required for constructinga comparison.
5. For Alabama, Tennessee, and Utah, states for which state reports of percentages meeting standardswere unavailable, comparisons are based on median percentile scores.
6. The significance was determined by a Student’s
t
. However, it is important to examine the values of aStudent’s
t
before reaching conclusions about gap differences, because in the cases of small samples,large variations in percentages meeting standards can occur by chance.
Chapter_D1.fm Page 8 Thursday, March 13, 2008 1:20 PM
EXPLANATION OF STATE PROFILES
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-9
• • • •••
the percentages of Black and White students meeting the standard was 1.4 percentgreater when the NAEP measurements were compared than when the stateassessment scores were compared.) However, Student’s
t
-test indicates that thesedifferences may well be random. In the top quarter, NAEP found the gap to be 12.4percent larger with Student’s
t
indicating that these differences are
statisticallysignificant
for this gap comparison.
Figure D-4.Element 8 of the state profile
D-4 National Assessment of Educational Progress
••••••
Figure 3. Comparison of NAEP and state assessment Black-White achievementgaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p <.05)
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.5*
Lower half -3.3
Upper half -7.8
Lower quarter -1.4
Middle half -4.3
Upper quarter -12.4*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
8
Chapter_D1.fm Page 9 Thursday, March 13, 2008 1:20 PM
D-10
National Assessment of Educational Progress
• • • •••
E lements 9 -13Other gap prof i les
Gap profiles in the same form as element 8 are also included for grade 8 and for theHispanic-White gap and the poverty gap where more than 10 percent of the studentsare in the subpopulation and sufficient data are available. All gap profiles are basedon percentages of students in schools meeting achievement standards, and for smallschools these percentages are subject to large random variations. Therefore, resultsfrom schools where very small numbers of minority students are enrolled andparticipate in the assessment are suppressed and are not represented in the populationprofiles. The
suppression threshold
for state assessment scores varies from state to state;however, in analyzing NAEP data, we omitted school-level percentages based on oneor two students.
Chapter_D1.fm Page 10 Thursday, March 13, 2008 1:20 PM
D-11
• • • •••
D
Alabama
D
labama administers the Stanford Achievement Test, Tenth Edition (SAT-10)in grades 3-8 in reading and mathematics. Scores are available for Black andeconomically disadvantaged students. Alabama does not use multiple
achievement levels for reporting purposes on the SAT-9/SAT-10; instead, it reportsexam results in percentiles. Before 2003, when the SAT-10 was implemented,students took the SAT-9. School-level assessment scores based on 10 or fewerstudents are suppressed.
Summary of Compar i sons
The results of comparisons between NAEP and state assessment results, which for2003 are based on 106 schools in grade 4 and 100 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:
1
•
Standards.
There are not enough data to compare state standards to NAEP forgrade 4 or grade 8.
•
Trends.
There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in average percentile rank between 2000 and 2003.
•
Gaps.
Overall, the Black-White and poverty gaps in grades 4 and 8 in mathematicsin 2003 were greater when measured by NAEP compared to the state assessment.There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Hispanic-White gap in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
A
Chapter_D2.fm Page 11 Thursday, March 13, 2008 1:21 PM
Achievement
D-12
National Assessment of Educational Progress
• • • •••
A
LABAMA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
NOTE: State does not use multiple achievement levels for reporting; it reports exam results in percentiles.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard error
Percentile Rank 0.80 0.010 0.84 0.016
••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••
••••••••••••••••••••••••••••
••••••••••••
•••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 12 Thursday, March 13, 2008 1:21 PM
ALABAMA
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-13
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Students 2000 2003 2000 2003
Identified
12.8 11.6 14.1 13.6English language learner 0.2 0.4 0.5 0.9Student with disability 12.6 10.6 13.3 12.2Both # 0.5 0.4 0.5
Excluded
3.2 1.6 6.4 2.2English language learner # 0.1 0.1 0.3Student with disability 3.2 1.5 6.0 1.8Both # # 0.3 0.1
Accommodated
2.9 2.4 0.6 2.6English language learner # # # #Student with disability 2.9 2.2 0.5 2.4Both # 0.1 0.1 0.1
4237
5753
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
Percentile rank41 39
5551
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
Percentile rank
Chapter_D2.fm Page 13 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-14
National Assessment of Educational Progress
• • • •••
A
LABAMA
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (
p
<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
difference
Overall -7.5*
Lower half -7.1*
Upper half -8.6*
Lower quarter -6.6*
Middle half -5.7*
Upper quarter -10.6*
Lowest
achievers
Median Highest
achieversa c h i e v e r s
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 14 Thursday, March 13, 2008 1:21 PM
ALABAMA
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-15
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (
p<.
05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
difference
Overall -8.1*
Lower half -7.6*
Upper half -7.3*
Lower quarter -5.5*
Middle half -10.8*
Upper quarter -10.1*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 15 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-16
National Assessment of Educational Progress
• • • •••
A
LABAMA
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (
p
<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
difference
Overall -4.2*
Lower half -3.0
Upper half -6.1*
Lower quarter -0.5
Middle half -2.9
Upper quarter -5.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 16 Thursday, March 13, 2008 1:21 PM
ALABAMA
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-17
• • • •••
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (
p
<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
difference
Overall -3.6
Lower half -7.3*
Upper half -0.2
Lower quarter -5.1
Middle half -5.3*
Upper quarter 1.1
Lowest
achievers
Median Highest
achievers
HH0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 17 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 18 Thursday, March 13, 2008 1:21 PM
D-19
• • • •••
D
Alaska
D
laska administers the Alaska Benchmark Examinations and the CaliforniaAchievement Tests, Sixth Edition Survey (CAT/6). The Benchmark examstest students in grade 8 in reading and mathematics; the CAT/6 tests students
in grade 4 in reading and mathematics. Scores are available for Black students ingrade 4, but there are too few students in this subgroup to provide a reliablecomparison. Alaska uses four achievement levels for reporting purposes on theBenchmark exams:
not proficient
,
below proficient
,
proficient
, and
advanced
. However,2003 data were available for only one level:
proficient
. The CAT/6 results are reportedon only two levels:
not proficient
and
proficient
. Trend graphs are not included becauseAlaska did not participate in State NAEP prior to 2003. School-level assessmentscores based on 5 or fewer students are suppressed.
Summary of Compar i sons
The results of comparisons between NAEP and state assessment results, which for2003 are based on 110 schools in grade 4 and 57 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:
1
•
Standards.
The state’s primary grade 4 mathematics performance standard(
proficient
) is between the NAEP basic and proficient levels. This is also true forgrade 8.
•
Trends.
No comparisons were possible for grades 4 and 8.•
Gaps.
There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
A
Chapter_D2.fm Page 19 Thursday, March 13, 2008 1:21 PM
Achievement
D-20
National Assessment of Educational Progress
• • • •••
A
LASKA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard error
Proficient 0.78 0.023 0.86 0.028
••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
•••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
•••••••••••••••••
•••••••••••••••••
••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
proficient
Chapter_D2.fm Page 20 Thursday, March 13, 2008 1:21 PM
ALASKA
D
Comparison between NAEP and State Mathematics Assessment Results: 2003
D-21
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003
Identified
—
30.5
—
23.4
English language learner
—
14.1
—
8.6
Student with disability
—
12.8
—
12.1
Both
—
3.6
—
2.6
Excluded
—
1.0
—
1.0
English language learner
—
0.1
—
0.2
Student with disability
—
0.8
—
0.8
Both
—
0.1
—
#
Accommodated
—
9.9
—
7.9
English language learner
—
0.9
—
0.2
Student with disability
—
7.0
—
6.9
Both
—
2.0
—
0.8
Chapter_D2.fm Page 21 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 22 Thursday, March 13, 2008 1:21 PM
D-23
• • • •••
D
Arizona
D
he state administers Arizona’s Instrument to Measure Standards (AIMS) ingrades 3, 5, and 8 in reading and mathematics. Scores are available forHispanic and Black students, but there are too few Black students to provide a
reliable comparison. Arizona uses four achievement levels for reporting purposes:
fallsfar below the standard
,
approaches the standard
,
meets the standard
, and
exceeds thestandard
. School-level assessment scores based on 10 or fewer students are suppressed.
Summary of Compar i sons
The results of comparisons between NAEP and state assessment results, which for2003 are based on 99 schools in grade 5 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:
1
• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (meeting) is close to the NAEPproficient level.
• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent meeting aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in percent meeting between2000 and 2003.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in mathematics in grades 5 and8 in 2003. Overall, the Hispanic-White gap in grades 5 and 8 in percent meetingthe state’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 23 Thursday, March 13, 2008 1:21 PM
Achievement
D-24 National Assessment of Educational Progress
• • • •••
ARIZONA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorApproaching 0.68 0.019 0.74 0.016Meeting 0.77 0.012 0.69 0.014Exceeding 0.78 0.018 0.58 0.063
•••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
approaching
meeting
exceeding
•• •••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••
•••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122222333
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
approaching
meeting
exceeding
Chapter_D2.fm Page 24 Thursday, March 13, 2008 1:21 PM
ARIZONA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-25
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 (state assessment grade 5) Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Arizona Department of Education retrieved from http://www.ade.state.az.us/profile/publicview/.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 24.9 27.4 18.8 23.9
English language learner 14.3 15.2 8.2 12.8Student with disability 9.1 7.9 9.0 8.2Both 1.6 4.3 1.7 3.0
Excluded 4.3 4.6 3.0 3.6English language learner 1.7 1.1 1.0 1.1Student with disability 1.8 2.2 1.6 1.6Both 0.8 1.3 0.4 0.9
Accommodated 8.9 4.5 4.5 5.6English language learner 4.8 1.3 2.0 1.4Student with disability 3.6 2.6 2.1 3.4Both 0.5 0.7 0.3 0.8
Level 2000 2003Grade 5 35.0 49.0Grade 8 18.0 21.0
79
88
41
55
17
28
79
89
41 50
17
37
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*
*
approaching
meeting
exceeding
54 56
18 18
6 5
5461
18 21
6 7
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
approaching
meeting
exceeding
*
Chapter_D2.fm Page 25 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-26 National Assessment of Educational Progress
• • • •••
ARIZONA
Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -12.1*
Lower half -10.8*
Upper half -14.2*
Lower quarter -7.1*
Middle half -15.1*
Upper quarter -11.0*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 26 Thursday, March 13, 2008 1:21 PM
ARIZONA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-27
• • • •••
Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.4*
Lower half -0.8
Upper half -7.6
Lower quarter -0.2
Middle half -2.5
Upper quarter -14.0*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 27 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 28 Thursday, March 13, 2008 1:21 PM
D-29
• • • •••
D Arkansas Dhrough the Arkansas Comprehensive Testing, Assessment and AccountabilityProgram (ACTAAP), the state administers Benchmark Exams in grades 4 and8 in reading and mathematics. Scores are available for Black and
economically disadvantaged students in grades 4 and 8 and for Hispanic students ingrade 4, but there are too few Hispanic students to provide a reliable comparison.Arkansas uses four achievement levels for reporting purposes: below basic, basic,proficient, and advanced. However, due to data unavailability, the trend graphs arepresented using only the proficient level. School-level assessment scores based on 9or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 117 schools in grade 4 and 101 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is close to the NAEPproficient level.
• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are less than the state assessment gains.
• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 29 Thursday, March 13, 2008 1:21 PM
Achievement
D-30 National Assessment of Educational Progress
• • • •••
ARKANSAS
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.80 0.011 0.79 0.015Proficient 0.81 0.009 0.77 0.025Advanced 0.81 0.019 0.55 0.069
•••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
Chapter_D2.fm Page 30 Thursday, March 13, 2008 1:21 PM
ARKANSAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-31
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Arkansas School Information Site retrieved from http://www.as-is.org/reportcard/.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 13.6 16.7 13.6 16.7
English language learner 1.3 2.8 0.6 2.2Student with disability 12.2 13.0 13.0 13.8Both 0.2 0.9 # 0.7
Excluded 4.0 2.2 2.2 1.9English language learner 0.1 0.8 0.4 0.5Student with disability 3.7 1.2 1.8 1.3Both 0.2 0.2 # 0.1
Accommodated 4.1 7.9 3.7 7.8English language learner 0.2 0.3 # 0.6Student with disability 3.9 7.5 3.7 7.0Both # 0.1 0.0 0.2
Level 2000 2003Grade 4 37.0 60.0Grade 8 14.0 22.0
36
53
36
60
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
proficient
*
1318
13
22
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*proficient
Chapter_D2.fm Page 31 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-32 National Assessment of Educational Progress
• • • •••
ARKANSAS
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.5*
Lower half -8.7*
Upper half -8.4*
Lower quarter -6.5
Middle half -10.1*
Upper quarter -8.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 32 Thursday, March 13, 2008 1:21 PM
ARKANSAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-33
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 0.9
Lower half 0.3
Upper half 0.8
Lower quarter 1.6
Middle half 0.3
Upper quarter -1.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 33 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-34 National Assessment of Educational Progress
• • • •••
ARKANSAS
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 0.5
Lower half 0.1
Upper half 0.3
Lower quarter 4.8
Middle half -1.2
Upper quarter -1.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 34 Thursday, March 13, 2008 1:21 PM
ARKANSAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-35
• • • •••
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 4.1
Lower half 2.9
Upper half 5.9
Lower quarter 3.3
Middle half 3.2
Upper quarter 5.9
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 35 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 36 Thursday, March 13, 2008 1:21 PM
D-37
• • • •••
D California Dhrough the Standardized Testing and Reporting (STAR) Program, the stateadministers two exams: the California Standards Tests (CST) and theCalifornia Achievement Tests, Sixth Edition Survey (CAT/6). The CST tests
students in grades 2-11 in English language arts and grades 2-7 in mathematics; theCAT/6 tests students in grades 2-11 in both reading and mathematics. Scores areavailable for Hispanic, Black, and economically disadvantaged students, but there aretoo few Black students to provide a reliable comparison. California uses fiveachievement levels for reporting purposes on the CST: far below basic, below basic,basic, proficient, and advanced. The CAT/6 results are reported as the percent at orabove the 25th, 50th, and 75th percentiles. Before 2003, when the CAT/6 wasimplemented, the Stanford Achievement Test, Ninth Edition (SAT-9) wasCalifornia’s norm-referenced test. Therefore, the scores from 2003 and from 2000 arenot comparable and since CST data are not available for 2000, the report does notinclude trend graphs. School-level assessment scores based on 10 or fewer studentsare suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 216 schools in grade 4 and 180 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics standard, proficient, is betweenthe NAEP basic and proficient levels. This is also true for grade 7.
• Trends. No comparisons were possible for grades 4 and 7.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White gap in grades 4 and 7 in 2003. Overall, theHispanic-White and poverty gaps in grade 4 in percent proficient in 2003 weregreater when measured by NAEP compared to the state assessment. Overall, therewere no significant differences between NAEP and the state assessment inmeasurement of the Hispanic-White and poverty gaps in grade 7 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 37 Thursday, March 13, 2008 1:21 PM
Achievement
D-38 National Assessment of Educational Progress
• • • •••
CALIFORNIA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8 (state 7th grade standards)
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorBelow Basic 0.56 0.039 0.63 0.028Basic 0.77 0.014 0.82 0.010Proficient 0.84 0.009 0.88 0.011Advanced 0.82 0.013 0.81 0.018
• ••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
•••••••••••••••••••••••••
••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
below basic
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••
••••••••••••••••••••••
•••••••••••••••••••••
••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
below basic
Chapter_D2.fm Page 38 Thursday, March 13, 2008 1:21 PM
CALIFORNIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-39
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 33.0 38.4 26.6 27.3
English language learner 24.8 28.5 16.4 16.5Student with disability 6.5 5.6 8.0 7.0Both 1.8 4.3 2.2 3.8
Excluded 5.6 3.4 4.2 2.6English language learner 2.3 1.5 1.3 1.2Student with disability 2.5 1.0 2.3 0.7Both 0.7 0.9 0.5 0.7
Accommodated 8.3 4.2 5.3 2.6English language learner 7.0 2.1 2.8 0.3Student with disability 1.0 1.2 1.7 1.5Both 0.2 0.9 0.9 0.8
Chapter_D2.fm Page 39 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-40 National Assessment of Educational Progress
• • • •••
CALIFORNIA
Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -11.1*
Lower half -14.7*
Upper half -7.6*
Lower quarter -13.0*
Middle half -10.5*
Upper quarter -8.8*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 40 Thursday, March 13, 2008 1:21 PM
CALIFORNIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-41
• • • •••
Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.6
Lower half -5.9*
Upper half -3.4
Lower quarter -5.1
Middle half -6.1
Upper quarter -1.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 41 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-42 National Assessment of Educational Progress
• • • •••
CALIFORNIA
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.7*
Lower half -9.5*
Upper half -4.2
Lower quarter -8.7
Middle half -8.3*
Upper quarter -3.6
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 42 Thursday, March 13, 2008 1:21 PM
CALIFORNIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-43
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.1
Lower half -2.8
Upper half -1.8
Lower quarter 1.5
Middle half -3.4
Upper quarter -1.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
High
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 43 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 44 Thursday, March 13, 2008 1:21 PM
D-45
• • • •••
D Colorado Dhrough the Colorado Student Assessment Program (CSAP), the stateadministers exams in grades 4 and 8 in reading and grades 5 and 8 inmathematics. The scores available for this report do not include any
breakdowns by race/ethnicity or poverty status. Colorado uses four achievementlevels for reporting purposes: unsatisfactory, partially proficient, proficient, and advanced.Colorado did not participate in State NAEP prior to 2003; therefore, trend graphs arenot included. School-level assessment scores based on 15 or fewer students aresuppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 5 and 104 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard (partiallyproficient) is below the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (partially proficient) is between the NAEP basic and proficientlevels.
• Trends. No comparisons were possible for grades 5 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 45 Thursday, March 13, 2008 1:21 PM
Achievement
D-46 National Assessment of Educational Progress
• • • •••
COLORADO
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorPartially Proficient 0.79 0.013 0.87 0.017Proficient 0.83 0.013 0.89 0.010Advanced 0.74 0.016 0.80 0.017
•••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
partially proficient
proficient
advanced
•••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••
•••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
partially proficient
proficient
advanced
Chapter_D2.fm Page 46 Thursday, March 13, 2008 1:21 PM
COLORADO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-47
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 19.7 — 15.4
English language learner — 7.6 — 3.7Student with disability — 10.4 — 10.7Both — 1.7 — 1.0
Excluded — 2.3 — 1.9English language learner — 0.7 — 0.6Student with disability — 1.5 — 1.1Both — 0.1 — 0.2
Accommodated — 10.8 — 8.1English language learner — 3.6 — 1.3Student with disability — 6.4 — 6.4Both — 0.9 — 0.5
Chapter_D2.fm Page 47 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 48 Thursday, March 13, 2008 1:21 PM
D-49
• • • •••
D Connecticut Dhe state administers the Connecticut Mastery Test (CMT) in grades 4 and 8in reading and mathematics. Scores are available for Hispanic, Black, andeconomically disadvantaged students. The CMT was administered from 1998-
2002 using four achievement levels for reporting purposes: below basic, basic, proficient,and goal. Results for 2003 have been reported with one additional level: advanced.Because the data included for 2000 have only percent at or above goal, the trendgraph does not include any other levels. School-level assessment scores based on 19or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 108 schools in grade 4 and 102 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard (goal) isbetween the NAEP basic and proficient levels. This is also true for grade 8.
• Trends. Between 2000 and 2003, NAEP reported a gain in grades 4 and 8 inpercent achieving performance standard (goal), which the state did not.
• Gaps. Overall, the Black-White and poverty gaps in grade 4 in percent meeting thestate’s standard in mathematics in 2003 were greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the Black-White andpoverty gaps in mathematics in grade 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of theHispanic-White gap in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 49 Thursday, March 13, 2008 1:21 PM
Achievement
D-50 National Assessment of Educational Progress
• • • •••
CONNECTICUT
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.79 0.022 0.79 0.029Proficient 0.87 0.006 0.87 0.012Goal 0.89 0.004 0.89 0.007Advanced 0.74 0.008 0.86 0.005
•••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
goal
advanced
basic
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••
•••••••••••••••
••••••••••••••••••••••••••••••••••
••••••••••••••
••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
goal
advanced
Chapter_D2.fm Page 50 Thursday, March 13, 2008 1:21 PM
CONNECTICUT D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-51
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Connecticut State Department of Education retrieved from http://www.sde.ct.gov/sde/site/default.asp.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 14.4 16.1 15.8 17.1
English language learner 2.9 3.3 2.1 2.7Student with disability 11.0 11.9 13.3 13.6Both 0.4 0.9 0.4 0.9
Excluded 4.7 4.0 6.0 3.8English language learner 1.2 0.7 1.2 0.5Student with disability 3.3 2.8 4.4 3.0Both 0.2 0.5 0.4 0.3
Accommodated 4.2 7.5 3.8 7.8English language learner 0.5 1.3 0.6 1.0Student with disability 3.7 5.9 3.2 6.6Both # 0.3 # 0.2
Level 2000 2003Grade 4 60.2 60.4Grade 8 54.8 56.1
64
72
64
59
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
goal
*
57 56
57 60
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
goal*
Chapter_D2.fm Page 51 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-52 National Assessment of Educational Progress
• • • •••
CONNECTICUT
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -9.5*
Lower half -5.2
Upper half -13.0*
Lower quarter -4.0
Middle half -11.5*
Upper quarter -14.7*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-80
-60
-40
-20
0
20
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-80
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 52 Thursday, March 13, 2008 1:21 PM
CONNECTICUT D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-53
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 0.2
Lower half -1.6
Upper half 2.7
Lower quarter -6.1
Middle half 1.9
Upper quarter 1.6
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
High
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 53 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-54 National Assessment of Educational Progress
• • • •••
CONNECTICUT
Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.4
Lower half -4.7
Upper half -6.7
Lower quarter -2.6
Middle half -6.6
Upper quarter -6.8
Lowest
achievers
Median Highest
achieversHghet achievers0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 54 Thursday, March 13, 2008 1:21 PM
CONNECTICUT D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-55
• • • •••
Figure 6. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 1.6
Lower half -0.7
Upper half 4.1
Lower quarter -2.3
Middle half 2.9
Upper quarter 6.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 55 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-56 National Assessment of Educational Progress
• • • •••
CONNECTICUT
Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.5*
Lower half -4.2
Upper half -6.4*
Lower quarter -1.4
Middle half -8.1*
Upper quarter -3.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 56 Thursday, March 13, 2008 1:21 PM
CONNECTICUT D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-57
• • • •••
Figure 8. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 0.6
Lower half 1.5
Upper half 1.0
Lower quarter -1.9
Middle half 3.0
Upper quarter -1.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 57 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 58 Thursday, March 13, 2008 1:21 PM
D-59
• • • •••
D Delaware Dhrough the Delaware Student Testing Program (DSTP), the state administersexams in grades 3, 5, and 8 in reading and mathematics. Scores are availablefor Hispanic, Black, and economically disadvantaged students, but there are
too few Hispanic students to provide a reliable comparison. Delaware uses fiveachievement levels for reporting purposes: well below the standard, below the standard,meets the standard, exceeds the standard, and distinguished performance. Scores from 2000are not available for this report, so no direct comparisons could be made with scoresfrom 2003; therefore, trend graphs are not included. School-level assessment scoresbased on 14 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 50 schools in grade 5 and 32 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (meeting) is between the NAEP basic and proficient levels.
• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White and poverty gaps in mathematics ingrades 5 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 59 Thursday, March 13, 2008 1:21 PM
Achievement
D-60 National Assessment of Educational Progress
• • • •••
DELAWARE
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorBelow 0.54 0.072 0.73 0.028Meeting 0.58 0.035 0.79 0.041Exceeding 0.60 0.047 0.81 0.038Distinguished 0.55 0.062 0.79 0.046
••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
meeting
exceeding
distinguished
below
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••
•••••••••••
•••••••••••••
••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
exceeding
distinguished
below
Chapter_D2.fm Page 60 Thursday, March 13, 2008 1:21 PM
DELAWARE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-61
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 18.0 — 17.9
English language learner — 2.2 — 1.4Student with disability — 15.0 — 15.4Both — 0.8 — 1.0
Excluded — 6.9 — 9.1English language learner — 0.8 — 0.7Student with disability — 5.8 — 8.0Both — 0.3 — 0.4
Accommodated — 7.4 — 5.6English language learner — 0.7 — 0.2Student with disability — 6.5 — 5.1Both — 0.3 — 0.4
Chapter_D2.fm Page 61 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-62 National Assessment of Educational Progress
• • • •••
DELAWARE
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.4
Lower half -5.8*
Upper half 2.9
Lower quarter -7.2*
Middle half -2.2
Upper quarter 5.6*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 62 Thursday, March 13, 2008 1:21 PM
DELAWARE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-63
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.3
Lower half -3.4
Upper half -1.0
Lower quarter -4.3*
Middle half -3.2
Upper quarter -0.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 63 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-64 National Assessment of Educational Progress
• • • •••
DELAWARE
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 0.5
Lower half -2.7
Upper half 2.5
Lower quarter -1.3
Middle half -2.0
Upper quarter 9.2*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 64 Thursday, March 13, 2008 1:21 PM
DELAWARE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-65
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 1.3
Lower half -3.0
Upper half 4.8*
Lower quarter -5.1
Middle half 1.9
Upper quarter 9.2*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 65 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 66 Thursday, March 13, 2008 1:21 PM
D-67
• • • •••
D District of Columbia Dhe District of Columbia administers the Stanford Achievement Test, NinthEdition (SAT-9) in reading and mathematics in grades 3-11. Scores areavailable for economically disadvantaged students. DC uses four performance
levels: below basic, basic, proficient, and advanced. Direct comparisons cannot be madebetween the data from 2000 and the data from 2003 because scores from 2000 are fordifferent grades than are those from 2003; therefore, trend graphs are not included.School-level assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 99 schools in grade 4 and 26 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, the poverty gap in grade 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the poverty gap inmathematics in grade 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 67 Thursday, March 13, 2008 1:21 PM
Achievement
D-68 National Assessment of Educational Progress
• • • •••
DISTRICT OF COLUMBIA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.69 0.017 0.90 0.014Proficient 0.69 0.003 0.97 0.008
•••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
•• ••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••
••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
Chapter_D2.fm Page 68 Thursday, March 13, 2008 1:21 PM
DISTRICT OF COLUMBIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-69
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.3 18.4 15.2 19.8
English language learner 6.0 5.0 4.0 4.0Student with disability 13.2 11.7 10.9 14.6Both 0.2 1.6 0.3 1.1
Excluded 5.1 4.4 6.3 6.0English language learner 1.9 0.7 1.7 0.9Student with disability 3.3 3.1 4.4 4.6Both # 0.7 0.2 0.5
Accommodated 7.0 9.8 5.9 9.0English language learner 2.3 2.6 1.5 1.4Student with disability 4.6 6.6 4.2 7.2Both 0.1 0.7 0.2 0.4
Chapter_D2.fm Page 69 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-70 National Assessment of Educational Progress
• • • •••
DISTRICT OF COLUMBIA
Figure 2. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -15.8*
Lower half -7.9*
Upper half -26.4*
Lower quarter -0.4
Middle half -12.9*
Upper quarter -35.4*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 70 Thursday, March 13, 2008 1:21 PM
DISTRICT OF COLUMBIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-71
• • • •••
Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.3
Lower half -0.3
Upper half -3.1
Lower quarter 0.2
Middle half -1.6
Upper quarter -7.4*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 71 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 72 Thursday, March 13, 2008 1:21 PM
D-73
• • • •••
D Florida Dhe state administers the Florida Comprehensive Assessment Test (FCAT) ingrades 3-10 in reading and mathematics. Scores are available for Hispanic,Black, and economically disadvantaged students. Florida uses five
achievement levels for reporting purposes: Level 1 (little success), Level 2 (limitedsuccess), Level 3 (partial success), Level 4 (some success), and Level 5 (success). Scoresfrom 2000 are not available for this report, so no direct comparisons could be madewith scores from 2003; therefore, trend graphs are not included. School-levelassessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 103 schools in grade 4 and 96 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard ((3)partial success) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, the Black-White gap in grades 4 and 8 in percent meeting the state’s
standard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White gap inmathematics in grade 4 in 2003. Overall, the Hispanic-White gap in grade 8 inpercent meeting the state’s standard in mathematics in 2003 was greater whenmeasured by NAEP compared to the state assessment. Overall, there were nosignificant differences between NAEP and the state assessment in measurement ofthe poverty gap in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 73 Thursday, March 13, 2008 1:21 PM
Achievement
D-74 National Assessment of Educational Progress
• • • •••
FLORIDA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard error(2) Limited Success 0.80 0.009 0.82 0.011(3) Partial Success 0.89 0.012 0.86 0.018(4) Some Success 0.86 0.022 0.78 0.020(5) Success 0.73 0.037 0.76 0.041
•••••••••••••••••••••••••••••••••••
•••••••••••••••••••••
•••••••••••••••••••••••••••••
•••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
partial success
some success
success
limited success
•••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
•••••••••••••••••••
••••••••••••••••••••
••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
partial success
some success
success
limited success
Chapter_D2.fm Page 74 Thursday, March 13, 2008 1:21 PM
FLORIDA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-75
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 26.3 — 19.2
English language learner — 7.9 — 5.2Student with disability — 15.3 — 12.2Both — 3.1 — 1.7
Excluded — 3.3 — 3.0English language learner — 1.2 — 1.1Student with disability — 1.5 — 1.5Both — 0.7 — 0.4
Accommodated — 14.7 — 11.3English language learner — 2.2 — 2.0Student with disability — 10.6 — 8.6Both — 1.9 — 0.7
Chapter_D2.fm Page 75 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-76 National Assessment of Educational Progress
• • • •••
FLORIDA
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.2*
Lower half -8.5*
Upper half -7.5*
Lower quarter -9.8*
Middle half -6.9*
Upper quarter -4.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 76 Thursday, March 13, 2008 1:21 PM
FLORIDA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-77
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.8*
Lower half -8.4*
Upper half -5.3
Lower quarter -5.4
Middle half -11.2*
Upper quarter -0.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 77 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-78 National Assessment of Educational Progress
• • • •••
FLORIDA
Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.8
Lower half -5.1
Upper half -3.1
Lower quarter -2.7
Middle half -6.6
Upper quarter 1.6
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 78 Thursday, March 13, 2008 1:21 PM
FLORIDA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-79
• • • •••
Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.3*
Lower half -11.2*
Upper half -2.2
Lower quarter -11.5*
Middle half -5.8
Upper quarter 2.9
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 79 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-80 National Assessment of Educational Progress
• • • •••
FLORIDA
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.4
Lower half -6.1*
Upper half -0.7
Lower quarter -5.9*
Middle half -3.4
Upper quarter 1.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 80 Thursday, March 13, 2008 1:21 PM
FLORIDA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-81
• • • •••
Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.7
Lower half -4.1
Upper half 1.1
Lower quarter -3.6
Middle half -4.9
Upper quarter 6.6
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 81 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 82 Thursday, March 13, 2008 1:21 PM
D-83
• • • •••
D Georgia Deorgia administers the Criterion-Referenced Competency Test (CRCT) ingrades 1-8 in reading and mathematics. Scores are available for Hispanic,Black, and economically disadvantaged students, but there are too few
Hispanic students to provide a reliable comparison. Georgia uses three performancelevels for reporting purposes: does not meet, meets, and exceeds the standard. School-level assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 147 schools in grade 4 and 113 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is below the NAEP basic level. This is also true for grade 8.
• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent meeting between 2000 and 2003. Between 2000 and2003, the NAEP grade 8 gains in percent meeting are less than the state assessmentgains.
• Gaps. Overall, the Black-White gap in grades 4 and 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003. Overall, there were no significant differences between NAEP andthe state assessment in measurement of the poverty gap in mathematics in grade 4in 2003. Overall, the poverty gap in grade 8 in percent meeting the state’s standardin mathematics in 2003 was greater when measured by NAEP compared to thestate assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
G
Chapter_D2.fm Page 83 Thursday, March 13, 2008 1:21 PM
Achievement
D-84 National Assessment of Educational Progress
• • • •••
GEORGIA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.83 0.017 0.80 0.012Exceeding 0.85 0.008 0.78 0.018
••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
meeting
exceeding
• •••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
•••••••••••••••••••••••
•••••••••••
••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
exceeding
Chapter_D2.fm Page 84 Thursday, March 13, 2008 1:21 PM
GEORGIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-85
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Georgia Department of Education site retrieved from http://public.doe.k12.ga.us/.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 10.9 15.7 10.6 12.8
English language learner 1.5 3.3 1.4 1.6Student with disability 9.4 11.4 9.0 10.4Both # 1.0 0.3 0.8
Excluded 3.0 2.1 4.8 2.0English language learner 0.5 0.5 1.2 0.3Student with disability 2.5 1.5 3.4 1.4Both # 0.1 0.3 0.3
Accommodated 3.9 7.3 2.6 6.0English language learner 0.2 0.8 # 0.3Student with disability 3.7 6.2 2.6 5.4Both # 0.3 # 0.3
Level 2000 2003Grade 4 62.0 74.0Grade 8 54.0 67.0
62
77
10
18
6274
10
19
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
meeting
exceeding
5560
1214
55
66
1215
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*meeting
exceeding
Chapter_D2.fm Page 85 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-86 National Assessment of Educational Progress
• • • •••
GEORGIA
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.4*
Lower half -9.7*
Upper half -7.3*
Lower quarter -10.4
Middle half -9.3*
Upper quarter -7.2*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 86 Thursday, March 13, 2008 1:21 PM
GEORGIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-87
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -13.1*
Lower half -17.4*
Upper half -9.3*
Lower quarter -19.8*
Middle half -14.3*
Upper quarter -4.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 87 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-88 National Assessment of Educational Progress
• • • •••
GEORGIA
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.9
Lower half -4.0
Upper half -3.8
Lower quarter -3.6
Middle half -4.2
Upper quarter -2.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 88 Thursday, March 13, 2008 1:21 PM
GEORGIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-89
• • • •••
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -7.5*
Lower half -10.6*
Upper half -4.7
Lower quarter -11.1*
Middle half -9.2*
Upper quarter -1.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 89 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 90 Thursday, March 13, 2008 1:21 PM
D-91
• • • •••
D Hawaii Dhe state administers the Hawaii Content and Performance Standards II(HCPS-II) exam and the Stanford Achievement Test, Ninth Edition (SAT-9). Both exams test students in grades 3, 5, and 8 in reading and mathematics.
Scores are available for Hispanic students for grade 8 and for economicallydisadvantaged students for grades 5 and 8, but there are too few Hispanic students toprovide a reliable comparison. Hawaii uses four achievement levels for reportingpurposes on the HCPS-II: well below, approaches, meets, and exceeds the standard. Theachievement levels used for reporting purposes on the SAT-9 are percent at or abovestanines 4, 5, and 7. SAT-9 results are used for trend graphs because the SAT-9 keptthe same performance levels every year, while the HCPS-II set new standards in2003. School-level assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 5 and 54 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP proficient level. This is also true for grade 8.
• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent at or abovestanine 5 are greater than the state assessment gains. Between 2000 and 2003, thestate assessment declines in grade 8 in percent stanine 5 are greater than NAEP’s.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 5 and 8 in 2003. Overall, the poverty gap in grades 5 and 8 in mathematicsin 2003 was greater when measured by NAEP compared to the state assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 91 Thursday, March 13, 2008 1:21 PM
Achievement
D-92 National Assessment of Educational Progress
• • • •••
HAWAII
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorApproaching 0.67 0.019 0.79 0.037Meeting 0.78 0.010 0.83 0.017Exceeding 0.45 0.083 0.31 0.120
•••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
approaching
meeting
exceeding
•••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••
••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
approaching
meeting
exceeding
Chapter_D2.fm Page 92 Thursday, March 13, 2008 1:21 PM
HAWAII D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-93
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 (state assessment grade 5) Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.4 16.6 20.3 20.3
English language learner 6.1 5.3 5.0 4.8Student with disability 11.9 9.9 14.4 14.2Both 1.4 1.3 0.9 1.3
Excluded 8.6 3.1 5.3 3.7English language learner 2.5 1.3 1.2 1.0Student with disability 5.3 1.3 3.8 2.2Both 0.8 0.4 0.3 0.5
Accommodated 2.7 8.2 2.0 8.8English language learner 0.2 1.7 0.3 1.3Student with disability 2.2 5.9 1.7 7.2Both 0.3 0.6 # 0.3
81
92
65
79
31
45
81 80
65 67
3133
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP *
*stanine 4
stanine 5
stanine 7
8083
61
65
19 20
80
72
61
54
19 20
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*
*stanine 5
stanine 7
stanine 4
Chapter_D2.fm Page 93 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-94 National Assessment of Educational Progress
• • • •••
HAWAII
Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.7*
Lower half -5.1*
Upper half -5.9*
Lower quarter -3.3
Middle half -6.9*
Upper quarter -5.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 94 Thursday, March 13, 2008 1:21 PM
HAWAII D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-95
• • • •••
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.6*
Lower half -4.5*
Upper half -5.0*
Lower quarter -2.9
Middle half -5.3*
Upper quarter -5.7*
Lowest
achievers
Median Highest
achievers Highest achievers
Highest achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 95 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 96 Thursday, March 13, 2008 1:21 PM
D-97
• • • •••
D Idaho Dhe state administers the Idaho Standards Achievement Tests (ISAT) in grades2-9 in reading and mathematics. Scores are available for Hispanic students.Idaho uses four achievement levels for reporting purposes: below basic,
proficient, and advanced. Scores from 2000 are not available for this report, so nodirect comparisons could be made with scores from 2003; therefore, trend graphs arenot included. School-level assessment scores based on 9 or fewer students aresuppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 114 schools in grade 4 and 86 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP basic level. The state’s primary grade 8mathematics performance standard (proficient) is between the NAEP basic andproficient levels.
• Trends. No trend comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White and poverty gaps in mathematics in grades 4 and8 in 2003. Overall, the Hispanic-White gap in grades 4 and 8 in percent meetingthe state’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 97 Thursday, March 13, 2008 1:21 PM
Achievement
D-98 National Assessment of Educational Progress
• • • •••
IDAHO
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.46 0.047 0.69 0.026Proficient 0.67 0.039 0.70 0.026Advanced 0.55 0.044 0.61 0.027
••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advancedbasic
proficient
advanced
• •••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••
•••••••••••••••••••••••
•••••••••••••••
••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
Chapter_D2.fm Page 98 Thursday, March 13, 2008 1:21 PM
IDAHO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-99
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.7 17.6 13.9 14.6
English language learner 4.1 5.9 3.3 4.5Student with disability 10.6 10.4 9.6 8.9Both 1.1 1.3 0.9 1.2
Excluded 2.3 1.6 2.0 0.7English language learner 1.2 0.6 0.4 0.2Student with disability 0.6 0.8 1.4 0.4Both 0.4 0.2 0.1 0.2
Accommodated 6.6 7.4 3.7 4.5English language learner 0.6 0.6 0.4 0.6Student with disability 5.7 5.8 2.7 3.5Both 0.3 0.9 0.6 0.4
Chapter_D2.fm Page 99 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-100 National Assessment of Educational Progress
• • • •••
IDAHO
Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -10.4*
Lower half -12.1*
Upper half -8.3
Lower quarter -11.8*
Middle half -11.4*
Upper quarter -7.1
Lowest
achievers
Median Highest
achievers Highest achieversHighest achievers0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 100 Thursday, March 13, 2008 1:21 PM
IDAHO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-101
• • • •••
Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.4*
Lower half -6.9*
Upper half -5.0
Lower quarter -9.2*
Middle half -5.9
Upper quarter -5.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achieversHghet achievers0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 101 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 102 Thursday, March 13, 2008 1:21 PM
D-103
• • • •••
D Illinois Dhe state administers the Illinois Standards Achievement Test (ISAT) ingrades 3, 5, and 8 in reading and mathematics. Scores are available forHispanic, Black, and economically disadvantaged students. Illinois uses four
achievement levels for reporting purposes: academic warning, below the standard, meetsthe standard, and exceeds the standard. However, due to data unavailability, the trendgraphs only include the top two levels. School-level assessment scores based on 10 orfewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 161 schools in grade 5 and 169 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP basic level. The state’s primary grade 8 performancestandard is between the NAEP basic and proficient levels.
• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent meeting between 2000 and 2003. For grade 8, theNAEP gains in percent meeting are less than the state assessment gains.
• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grades 5 and8 in 2003. The Hispanic-White gap in grade 5 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were no significant differences between NAEP andthe state assessment in measurement of the Hispanic-White gap in mathematics ingrade 8 in 2003. There were no significant differences between NAEP and the stateassessment in measurement of the poverty gap in mathematics in grade 5 in 2003.The poverty gap in grade 8 in percent meeting the state’s standard in mathematicsin 2003 was greater when measured by NAEP compared to the state assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 103 Thursday, March 13, 2008 1:21 PM
Achievement
D-104 National Assessment of Educational Progress
• • • •••
ILLINOIS
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorBelow the Standard 0.58 0.040 0.70 0.045Meeting 0.84 0.011 0.92 0.009Exceeding 0.82 0.021 0.82 0.018
••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
•••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
below the standard
meeting
exceeding
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••
•••••••••••••••••••••••••
•••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
exceeding
below the standard
Chapter_D2.fm Page 104 Thursday, March 13, 2008 1:21 PM
ILLINOIS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-105
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 (state assessment grade 5) Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Illinois State Board of Education retrieved from http://www.isbe.net./news/2003/isat_charts.pdf.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 17.0 22.6 15.4 18.0
English language learner 6.0 7.2 4.3 2.8Student with disability 9.9 13.6 10.6 14.0Both 1.0 1.8 0.5 1.2
Excluded 3.1 4.3 4.8 4.4English language learner 1.2 1.6 1.5 0.8Student with disability 1.5 2.0 3.0 3.2Both 0.5 0.7 0.3 0.5
Accommodated 8.6 10.9 3.5 9.3English language learner 2.8 2.2 0.4 1.1Student with disability 5.3 8.0 3.1 7.8Both 0.5 0.7 # 0.5
Level 2000 2003Grade 5 57.3 68.3Grade 8 46.8 53.1
53
65
511
53
68
510
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
meeting
exceeding
meeting
exceeding
4649
1114
46
54
1116
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*
Chapter_D2.fm Page 105 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-106 National Assessment of Educational Progress
• • • •••
ILLINOIS
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.5
Lower half -1.9
Upper half -2.6
Lower quarter -1.8
Middle half -4.2
Upper quarter 0.7
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100Pe
rcen
t m
eetin
g st
ate'
s pr
imar
y st
anda
rds
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 106 Thursday, March 13, 2008 1:21 PM
ILLINOIS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-107
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.3
Lower half -0.4
Upper half -1.8
Lower quarter 0.5
Middle half -3.7
Upper quarter 1.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
Highest achieversHighest achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 107 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-108 National Assessment of Educational Progress
• • • •••
ILLINOIS
Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -7.1*
Lower half -5.1
Upper half -8.3*
Lower quarter -5.6
Middle half -5.7
Upper quarter -8.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100Pe
rcen
t m
eetin
g st
ate'
s pr
imar
y st
anda
rds
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 108 Thursday, March 13, 2008 1:21 PM
ILLINOIS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-109
• • • •••
Figure 6. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.9
Lower half -4.1
Upper half -5.3
Lower quarter -2.8
Middle half -3.5
Upper quarter -7.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 109 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-110 National Assessment of Educational Progress
• • • •••
ILLINOIS
Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.7
Lower half -3.8
Upper half -3.5
Lower quarter -5.4
Middle half -4.8
Upper quarter -0.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100Pe
rcen
t m
eetin
g st
ate'
s pr
imar
y st
anda
rds
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 110 Thursday, March 13, 2008 1:21 PM
ILLINOIS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-111
• • • •••
Figure 8. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.6*
Lower half -4.1
Upper half -6.7
Lower quarter -1.1
Middle half -7.2*
Upper quarter -6.2
Lowest
achievers
Median Highest
achieversHghet achievers0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 111 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 112 Thursday, March 13, 2008 1:21 PM
D-113
• • • •••
D Indiana Dhe state administers the Indiana Statewide Testing for Education Progress-Plus(ISTEP+) assessment in grades 3 and 8 in English language arts andmathematics. Scores are available for Black and economically disadvantaged
students in grades 3 and 8 and for Hispanic students in grade 8, but there are too fewHispanic students to provide a reliable comparison. Indiana uses three achievementlevels for reporting purposes: not pass, pass, and pass+. The ISTEP+ is given in thefall, so 2002-03 data correspond to the exams administered in the fall of 2002. Sincethe new ISTEP+ is based upon new content and is scored on a new scale, trendgraphs are not included in this report. School-level assessment scores based on 9 orfewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 110 schools in grade 3 and 99 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 3 mathematics performance standard (pass) isbetween the NAEP basic and proficient levels. This is also true for grade 8.
• Trends. No comparisons were possible for grades 3 and 8.• Gaps. Overall, the Black-White and poverty gaps in grade 3 in percent meeting the
state’s standard in mathematics in 2003 were greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the Black-White andpoverty gaps in mathematics in grade 8 in 2003. There were insufficient data forcomparing the NAEP and state assessment measurement of the Hispanic-Whitegap in mathematics in grades 3 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 113 Thursday, March 13, 2008 1:21 PM
Achievement
D-114 National Assessment of Educational Progress
• • • •••
INDIANA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state assessment grade 3)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 3 Grade 8Standard Correlation Standard error Correlation Standard errorPass 0.44 0.013 0.83 0.022Pass Plus 0.22 0.030 0.71 0.046
••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
pass
pass plus
• •••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
pass
pass plus
Chapter_D2.fm Page 114 Thursday, March 13, 2008 1:21 PM
INDIANA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-115
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.4 16.5 12.3 15.2
English language learner 1.2 2.1 1.2 1.7Student with disability 10.0 13.7 11.1 12.7Both 0.2 0.7 0.1 0.9
Excluded 2.5 2.1 3.2 2.3English language learner 0.5 0.1 0.4 0.1Student with disability 1.8 1.7 2.8 2.0Both 0.2 0.3 # 0.3
Accommodated 6.0 6.7 3.2 6.7English language learner 0.6 0.6 # 0.4Student with disability 5.3 5.8 3.2 5.9Both 0.1 0.3 # 0.4
Chapter_D2.fm Page 115 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-116 National Assessment of Educational Progress
• • • •••
INDIANA
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 3.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -22.7*
Lower half -14.9*
Upper half -30.2*
Lower quarter -9.5
Middle half -21.7*
Upper quarter -32.5*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 116 Thursday, March 13, 2008 1:21 PM
INDIANA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-117
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.6
Lower half -2.2
Upper half 0.2
Lower quarter -5.4
Middle half -0.3
Upper quarter 1.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 117 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-118 National Assessment of Educational Progress
• • • •••
INDIANA
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 3.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -11.5*
Lower half -13.0*
Upper half -9.9*
Lower quarter -10.7*
Middle half -14.3*
Upper quarter -7.5*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 118 Thursday, March 13, 2008 1:21 PM
INDIANA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-119
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
# Rounds to zero.
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 4.2
Lower half 0.3
Upper half 8.5*
Lower quarter #
Middle half 5.3
Upper quarter 8.0*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 119 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 120 Thursday, March 13, 2008 1:21 PM
D-121
• • • •••
D Iowa Dowa administers the Iowa Tests of Basic Skills (ITBS) in grades 4 and 8 inreading and mathematics. Scores are available for Hispanic and Black studentsin grade 8, but there are too few students in these subgroups to provide a reliable
comparison. Iowa uses three achievement levels for reporting purposes (low,intermediate, and high), although the data available only included percent proficient.Iowa has defined proficient as the intermediate and high levels combined. Iowa’sscores are available for biennium periods only. For example, this year’s scores representthe biennium period 2001-02 to 2002-03. This is also the first year for which scoresare available for this report; for these reasons, trend graphs are not included. SinceIowa does not have NAEP grade 8 data for 2000, those cells in the inclusion andaccommodation table are empty. School-level assessment scores based on 10 or fewerstudents are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 133 schools in grade 4 and 114 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
I
Chapter_D2.fm Page 121 Thursday, March 13, 2008 1:21 PM
Achievement
D-122 National Assessment of Educational Progress
• • • •••
IOWA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.77 0.016 0.77 0.047
•••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••
••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
proficient
Chapter_D2.fm Page 122 Thursday, March 13, 2008 1:21 PM
IOWA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-123
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 14.6 17.9 — 17.5
English language learner 2.0 2.6 — 1.8Student with disability 12.5 14.1 — 15.1Both 0.1 1.2 — 0.6
Excluded 2.3 3.0 — 2.4English language learner 0.9 0.6 — 0.2Student with disability 1.4 2.1 — 2.2Both # 0.4 — #
Accommodated 7.0 10.6 — 9.5English language learner 0.2 0.5 — 0.7Student with disability 6.8 9.6 — 8.6Both # 0.5 — 0.3
Chapter_D2.fm Page 123 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 124 Thursday, March 13, 2008 1:21 PM
D-125
• • • •••
D Kansas Dansas administers exams in grades 5 and 8 in reading and in grades 4 and 7 inmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Hispanic students in grades 4
and 7 and too few Black students in grade 7 to provide reliable comparisons betweenthese subgroups and White students. Kansas uses five achievement levels forreporting purposes: unsatisfactory, basic, proficient, advanced, and exemplary. School-level assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 130 schools in grade 4 and 120 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 7.
• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent proficient between 2000 and 2003.
• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Black-White gap in mathematics in grade 7 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Hispanic-White gap in mathematics in grades 4 and 7 in 2003.Overall, there were no significant differences between NAEP and the stateassessment in measurement of the poverty gap in mathematics in grades 4 and 7 in2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
K
Chapter_D2.fm Page 125 Thursday, March 13, 2008 1:21 PM
Achievement
D-126 National Assessment of Educational Progress
• • • •••
KANSAS
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8 (state 7th grade standards)
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorBasic 0.65 0.011 0.71 0.009Proficient 0.66 0.021 0.72 0.014Advanced 0.63 0.024 0.68 0.020Exemplary 0.56 0.022 0.64 0.049
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••
••••••••••
•••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
exemplary
basic
•••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
proficient
advanced
exemplary
basic
Chapter_D2.fm Page 126 Thursday, March 13, 2008 1:21 PM
KANSAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-127
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8 (state assessment grade 5)
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Kansas State Department of Education retrieved fromhttp://www3.ksde.org/ayp/2003_Kansas_State_Assessment_Highlights.htm
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.7 15.8 13.7 15.9
English language learner 4.1 2.3 1.4 2.8Student with disability 10.6 12.7 12.3 12.3Both 1.1 0.7 # 0.8
Excluded 3.0 1.7 3.3 2.9English language learner # 0.4 0.2 0.6Student with disability 2.6 1.2 3.2 2.0Both 0.4 0.1 # 0.4
Accommodated 4.2 10.9 2.6 9.4English language learner 0.7 1.0 # 1.4Student with disability 3.5 9.5 2.6 7.7Both # 0.4 # 0.3
Level 2000 2003Grade 4 62.4 73.6Grade 7 54.6 60.0
8591
59
71
37
49
1221
85
92
59
74
37
52
12
22
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
basic
proficient
advanced
exemplary
78 79
55 56
33 34
1316
78 81
55
59
3338
1317
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
basic
proficient
advanced
exemplary
Chapter_D2.fm Page 127 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-128 National Assessment of Educational Progress
• • • •••
KANSAS
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -11.2*
Lower half -12.9*
Upper half -8.6
Lower quarter -14.7*
Middle half -8.9
Upper quarter -4.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 128 Thursday, March 13, 2008 1:21 PM
KANSAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-129
• • • •••
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -7.7
Lower half -7.6
Upper half -8.2
Lower quarter -6.9
Middle half -7.6
Upper quarter -10.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
High
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 129 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-130 National Assessment of Educational Progress
• • • •••
KANSAS
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 1.5
Lower half 0.2
Upper half 3.5
Lower quarter 2.2
Middle half -0.5
Upper quarter 6.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 130 Thursday, March 13, 2008 1:21 PM
D-131
• • • •••
D Kentucky Dhrough the Commonwealth Accountability Testing System (CATS), theCommonwealth administers Kentucky Core Content Tests (KCCT) in grades4 and 7 in reading and grades 5 and 8 in mathematics. Scores are available for
Black and economically disadvantaged students, but there are too few Black studentsin grade 8 to provide a reliable comparison. Kentucky uses four achievement levelsfor reporting purposes: novice, apprentice, proficient, and distinguished. School-levelassessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 117 schools in grade 5 and 112 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent proficient between 2000 and 2003.
• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grade 5 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White gap in mathematics in grade 8 in 2003. Therewere insufficient data for comparing the NAEP and state assessment measurementof the Hispanic-White gap in mathematics in grades 5 and 8 in 2003. Overall,there were no significant differences between NAEP and the state assessment inmeasurement of the poverty gap in mathematics in grades 5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 131 Thursday, March 13, 2008 1:21 PM
Achievement
D-132 National Assessment of Educational Progress
• • • •••
KENTUCKY
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorApprentice 0.52 0.049 0.66 0.035Proficient 0.53 0.019 0.72 0.026Distinguished 0.58 0.021 0.65 0.048
•••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••
••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
apprentice
proficient
distinguished
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
apprentice
proficient
distinguished
Chapter_D2.fm Page 132 Thursday, March 13, 2008 1:21 PM
KENTUCKY D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-133
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 (state assessment grade 5) Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Kentucky Department of Education retrieved fromhttp://www.ksde.org/ayp/2003_Kansas_State_Assessment_Highlights.htm.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.5 14.4 13.6 13.6
English language learner 0.5 1.0 1.1 0.9Student with disability 11.0 12.7 12.3 12.2Both 0.1 0.7 0.2 0.4
Excluded 2.6 3.2 4.5 4.4English language learner # 0.3 0.5 0.4Student with disability 2.5 2.7 3.8 3.9Both 0.1 0.2 0.2 0.1
Accommodated 5.1 6.7 4.4 5.0English language learner # # 0.1 0.1Student with disability 5.1 6.3 4.3 4.8Both # 0.3 # 0.1
Level 2000 2003Grade 5 31.3 38.1Grade 8 25.2 30.9
61
74
31
41
5 6
61 68
31 38
58
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*
apprentice
proficient
distinguished
6569
2630
6 7
65
73
26
32
6 8
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
apprentice
proficient
distinguished
*
Chapter_D2.fm Page 133 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-134 National Assessment of Educational Progress
• • • •••
KENTUCKY
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.3
Lower half -0.4
Upper half -3.9
Lower quarter -0.6
Middle half -1.9
Upper quarter 1.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 134 Thursday, March 13, 2008 1:21 PM
KENTUCKY D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-135
• • • •••
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
# Rounds to zero.
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.3
Lower half -1.5
Upper half -2.9
Lower quarter 0.5
Middle half -4.2
Upper quarter #
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 135 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-136 National Assessment of Educational Progress
• • • •••
KENTUCKY
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.2
Lower half -0.7
Upper half 1.1
Lower quarter -1.1
Middle half -1.1
Upper quarter 2.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 136 Thursday, March 13, 2008 1:21 PM
D-137
• • • •••
D Louisiana Dhe state administers the Louisiana Educational Assessment Program for the21st Century (LEAP 21) in grades 4 and 8 in English language arts andmathematics. Scores are available for Black and economically disadvantaged
students. Louisiana uses five achievement levels for reporting purposes: unsatisfactory,approaching basic, basic, mastery, and advanced. School-level assessment scores basedon 10 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 4 and 94 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(mastery) is between the NAEP proficient and advanced levels. This is also true forgrade 8.
• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent mastery aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in percent mastery between2000 and 2003.
• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 137 Thursday, March 13, 2008 1:21 PM
Achievement
D-138 National Assessment of Educational Progress
• • • •••
LOUISIANA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorApproaching Basic 0.73 0.028 0.84 0.015Basic 0.77 0.020 0.88 0.010Mastery 0.79 0.020 0.82 0.024Advanced 0.68 0.049 0.65 0.082
•• •••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
mastery
advanced
approaching basic
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••
•••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
mastery
advanced
approaching basic
Chapter_D2.fm Page 138 Thursday, March 13, 2008 1:21 PM
LOUISIANA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-139
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Louisiana Department of Education retrieved from http://www.doe.state.la.us/lde/uploads/3779.pdf.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.8 21.6 13.1 16.4
English language learner 0.4 0.7 0.7 0.6Student with disability 15.1 20.0 12.4 15.1Both 0.3 1.0 # 0.6
Excluded 2.6 2.8 2.6 4.6English language learner 0.1 # 0.1 0.2Student with disability 2.4 2.8 2.5 4.1Both 0.1 # # 0.3
Accommodated 11.1 16.0 6.2 9.6English language learner 0.2 0.5 0.3 0.1Student with disability 10.8 14.7 5.9 9.2Both 0.1 0.8 # 0.2
Level 2000 2003Grade 4 12.0 16.0
Grade 8 8.0 8.0
73
82
50
62
11
19
1
4
73 81
50 58
11 16
13
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
approachingbasic
basic
mastery
advanced
*
*
*
69
75
48
55
7
11
3
4
69 74
4752
7 93 3
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
approachingbasic
basic
mastery
advanced
Chapter_D2.fm Page 139 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-140 National Assessment of Educational Progress
• • • •••
LOUISIANA
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.7*
Lower half -1.4
Upper half -7.7*
Lower quarter -2.5
Middle half -2.9
Upper quarter -9.9*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 140 Thursday, March 13, 2008 1:21 PM
LOUISIANA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-141
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.1
Lower half 1.1
Upper half -5.1*
Lower quarter 2.5
Middle half -1.6
Upper quarter -4.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 141 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-142 National Assessment of Educational Progress
• • • •••
LOUISIANA
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.2
Lower half -0.2
Upper half -5.4
Lower quarter -2.1
Middle half -2.6
Upper quarter -6.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 142 Thursday, March 13, 2008 1:21 PM
LOUISIANA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-143
• • • •••
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.7
Lower half 1.4
Upper half -3.0
Lower quarter 2.0
Middle half -2.0
Upper quarter -3.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 143 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 144 Thursday, March 13, 2008 1:21 PM
D-145
• • • •••
D Maine Dhrough Maine’s Comprehensive Assessment System (Meccas), the stateadministers the Maine Educational Assessment (MEA) in grades 4 and 8 inreading and mathematics. The scores available for this report do not include
any breakdowns by race/ethnicity or poverty status. Maine uses four achievementlevels for reporting purposes: does not meet the standard, partially meets the standard,meets the standard, and exceeds the standard. School-level assessment scores based on 4or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP proficient and advanced levels. This is also true forgrade 8.
• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent meeting aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in percent meeting between2000 and 2003.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 145 Thursday, March 13, 2008 1:21 PM
Achievement
D-146 National Assessment of Educational Progress
• • • •••
MAINE
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPartially Meeting 0.51 0.046 0.61 0.010Meeting 0.56 0.052 0.69 0.036Exceeding 0.52 0.032 0.15 0.133
••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••
•••••••••••
••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••
••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
partially meeting
meeting
exceeding
Chapter_D2.fm Page 146 Thursday, March 13, 2008 1:21 PM
MAINE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-147
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Maine Department of Education retrieved from http://www.state.me.us/education/mea/edmea.htm.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.2 18.4 14.7 16.8
English language learner 1.1 0.7 0.3 0.5Student with disability 15.1 17.0 14.2 15.7Both 0.1 0.6 0.2 0.6
Excluded 4.5 3.4 2.7 3.8English language learner 0.3 0.1 0.1 0.1Student with disability 4.3 2.9 2.5 3.5Both # 0.4 0.1 0.3
Accommodated 6.7 10.5 4.6 7.5English language learner # 0.1 0.2 0.1Student with disability 6.7 10.4 4.4 7.2Both # 0.1 # 0.2
Level 2000 2003Grade 4 23.0 28.0Grade 8 21.0 18.0
71
82
23
35
2 3
71
72
23 29
2 3
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
partiallymeeting
meeting
exceeding
*
*
60 60
21
19
1
1
60
68
21
17
10
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
partiallymeeting
meeting
exceeding
*
Chapter_D2.fm Page 147 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 148 Thursday, March 13, 2008 1:21 PM
D-149
• • • •••
D Maryland Dhe state administers the Maryland School Assessment (MSA) in grades 3, 5,and 8 in reading and mathematics. The scores available for this report do notinclude any breakdowns by race/ethnicity or poverty status. Maryland uses
three achievement levels for reporting purposes: basic, proficient, and advanced. Before2003, when the MSA was implemented, students took the Maryland SchoolPerformance Assessment Program (MSPAP) exams. For this reason, scores from 2003and those from 2000 are not comparable; therefore, this report does not include trendgraphs. School-level assessment scores based on 4 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 106 schools in grade 5 and 96 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 5 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 149 Thursday, March 13, 2008 1:21 PM
Achievement
D-150 National Assessment of Educational Progress
• • • •••
MARYLAND
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.83 0.003 0.88 0.016Advanced 0.75 0.022 0.82 0.027
•••••••••••••••••••••••••••••••••••••
•••••••••••
••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••
••••••••••••••
•••••••••••••••••••
•••••••••••••••••
••••••••••••••••••••••
••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
proficient
advanced
Chapter_D2.fm Page 150 Thursday, March 13, 2008 1:21 PM
MARYLAND D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-151
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.5 15.7 13.3 15.7
English language learner 1.5 2.9 1.4 2.2Student with disability 10.7 11.7 11.2 12.9Both 0.3 1.1 0.7 0.7
Excluded 2.5 3.8 2.7 4.1English language learner 0.8 0.9 0.8 0.7Student with disability 1.6 2.3 1.6 3.1Both 0.1 0.6 0.3 0.3
Accommodated 5.5 6.2 3.7 4.8English language learner 0.1 0.4 0.2 0.2Student with disability 5.5 5.4 3.4 4.5Both # 0.4 0.2 0.1
Chapter_D2.fm Page 151 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 152 Thursday, March 13, 2008 1:21 PM
D-153
• • • •••
D Massachusetts Dhrough the Massachusetts Comprehensive Assessment System (MCAS), theCommonwealth administers exams in grades 4 and 7 in English language artsand grades 4 and 8 in mathematics. Scores are available for Hispanic and
Black students, but there are too few Black students in grade 8 to provide a reliablecomparison. Massachusetts uses four achievement levels for reporting purposes:warning (failing), needs improvement, proficient, and advanced. School-level assessmentscores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 161 schools in grade 4 and 128 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. This is also true for grade 8.
• Trends. Between 2000 and 2003, NAEP reported a gain in grade 4 in percentproficient, which the state did not. Between 2000 and 2003, the NAEP grade 8gains in percent proficient are greater than the state assessment gains.
• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Black-White gap in mathematics in grade 8 in2003. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Hispanic-White gap in mathematics in grades 4and 8 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the poverty gap in mathematics in grades 4 and 8 in2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 153 Thursday, March 13, 2008 1:21 PM
Achievement
D-154 National Assessment of Educational Progress
• • • •••
MASSACHUSETTS
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeeds Improvement 0.78 0.015 0.88 0.015Proficient 0.82 0.008 0.87 0.012Advanced 0.74 0.033 0.87 0.023
• ••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
needs improvement
•• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
•••••••••
••••••••••••
•••••••••••••••••••••••••••
••••••••••
••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
needs improvement
proficient
advanced
Chapter_D2.fm Page 154 Thursday, March 13, 2008 1:21 PM
MASSACHUSETTS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-155
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Massachusetts Dept. of Education from http://www.doe.mass.edu/mcas/2003/results/summary.pdf.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.4 21.9 19.4 18.4
English language learner 5.1 3.8 3.0 2.0Student with disability 13.7 17.0 15.6 15.2Both 0.6 1.0 0.9 1.2
Excluded 2.7 2.9 2.7 3.1English language learner 2.0 0.8 0.9 0.8Student with disability 0.7 1.8 1.2 1.8Both # 0.3 0.6 0.5
Accommodated 10.1 15.0 8.8 10.8English language learner 1.5 1.1 1.1 0.4Student with disability 8.2 13.3 7.5 10.0Both 0.5 0.6 0.2 0.5
Level 2000 2003Grade 4 40.0 40.0Grade 8 34.0 37.0
82
89
41
51
12
19
82
84
41
38
12
11
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
needsimprovement
proficient
advanced
*
*
*
6167
34
41
10
15
61
68
3438
1013
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
needsimprovement
proficient
advanced
*
Chapter_D2.fm Page 155 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-156 National Assessment of Educational Progress
• • • •••
MASSACHUSETTS
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.5*
Lower half -3.3
Upper half -7.8
Lower quarter -1.4
Middle half -4.3
Upper quarter -12.4*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 156 Thursday, March 13, 2008 1:21 PM
MASSACHUSETTS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-157
• • • •••
Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.7
Lower half -1.6
Upper half -12.0*
Lower quarter 0.4
Middle half -6.6*
Upper quarter -12.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 157 Thursday, March 13, 2008 1:21 PM
Hispanic-White
D-158 National Assessment of Educational Progress
• • • •••
MASSACHUSETTS
Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.3
Lower half -1.3
Upper half -7.4
Lower quarter -0.1
Middle half -3.3
Upper quarter -8.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 158 Thursday, March 13, 2008 1:21 PM
D-159
• • • •••
D Michigan Dhrough the Michigan Educational Assessment Program (MEAP), the stateadministers exams in grades 4 and 7 in reading and grades 4 and 8 inmathematics. The scores available for this report do not include any
breakdowns by race/ethnicity or poverty status. Michigan uses four achievementlevels for reporting purposes: Level 4 (apprentice), Level 3 (basic performance), Level 2(met expectations), and Level 1 (exceeded expectations). Because the MEAP examschanged in 2003, direct comparisons cannot be made between scores from 2003 andthose from 2000; therefore, trend graphs are not included. School-level assessmentscores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 133 schools in grade 4 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 159 Thursday, March 13, 2008 1:21 PM
Achievement
D-160 National Assessment of Educational Progress
• • • •••
MICHIGAN
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.54 0.027 0.87 0.005Meeting 0.74 0.011 0.87 0.009Exceeding 0.80 0.018 0.84 0.018
•••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
meeting
exceeding
•• ••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
•••••••••••••
••••••••••••••
•••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
meeting
exceeding
Chapter_D2.fm Page 160 Thursday, March 13, 2008 1:21 PM
MICHIGAN D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-161
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.1 15.0 10.7 14.7
English language learner 1.0 4.3 0.3 2.1Student with disability 10.0 9.7 10.3 12.1Both 0.1 1.0 # 0.4
Excluded 3.3 4.1 3.9 4.7English language learner 0.7 0.6 0.3 0.5Student with disability 2.5 3.2 3.5 3.9Both 0.1 0.2 # 0.2
Accommodated 4.4 5.7 2.2 6.1English language learner # 0.6 # 1.0Student with disability 4.4 4.6 2.2 5.2Both # 0.5 # 0.0
Chapter_D2.fm Page 161 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 162 Thursday, March 13, 2008 1:21 PM
D-163
• • • •••
D Minnesota Dhe state administers the Minnesota Comprehensive Assessments (MCA) ingrades 3 and 5 in reading and mathematics. Scores are available for Black andeconomically disadvantaged students in grade 5, but there are too few Black
students to provide a reliable comparison. Minnesota uses five achievement levels forreporting purposes: Level 1 (gaps in knowledge), Level 2a (partial knowledge), Level 2b(satisfactory), Level 3 (proficient), and Level 4 (superior). Grade 8 trends are notincluded in this report because the state does not test this grade. School-levelassessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 100 schools in grade 5 (no grade 8 schools), are shown graphicallyon the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. There are not enoughdata to compare state standards to NAEP for grade 8.
• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent proficient between 2000 and 2003. No comparisonswere possible for grade 8.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 5 and 8 in 2003. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the poverty gap in mathematicsin grade 5 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the poverty gap in mathematics in grade 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 163 Thursday, March 13, 2008 1:21 PM
Achievement
D-164 National Assessment of Educational Progress
• • • •••
MINNESOTA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
— Not available. † Not applicable.SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard error(2a) Partial Knowledge 0.71 0.048 — †(2b) Satisfactory 0.79 0.017 — †(3) Proficient 0.77 0.016 — †(4) Superior 0.62 0.017 — †
•••••••••••••••••••••••••••••••••••••••••••
••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
satisfactory
proficient
superior
partial knowledge
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••
••••••••••••••••••••••••
••••••••••••
•••••••••••••••••
•••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 164 Thursday, March 13, 2008 1:21 PM
MINNESOTA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-165
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting grade 4 mathematics standards: 2000 and 2003
Grade 4 (state assessment grade 5)
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: MInnesota Department of Education retrieved from http://education.state.mn.us/CLASS/mcaGraphs.do?
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.4 18.3 15.1 16.3
English language learner 4.4 4.6 2.9 3.3Student with disability 11.4 12.6 11.8 12.6Both 0.6 1.1 0.3 0.4
Excluded 2.2 2.7 1.6 2.3English language learner 0.3 0.4 0.5 0.5Student with disability 1.5 2.1 1.0 1.8Both 0.4 0.1 0.2 0.1
Accommodated 7.4 7.1 2.6 6.2English language learner 2.3 1.2 0.2 0.9Student with disability 4.8 5.4 2.3 5.1Both 0.2 0.6 # 0.2
Level 2000 2003Grade 5 45.6 57.0
8793
64
72
48
57
13
19
87
94
64
78
48
58
1319
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
partialknowledge
satisfactory
proficient
superior
*
Chapter_D2.fm Page 165 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-166 National Assessment of Educational Progress
• • • •••
MINNESOTA
Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.9
Lower half -2.0
Upper half -3.0
Lower quarter -1.0
Middle half -3.9
Upper quarter -1.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 166 Thursday, March 13, 2008 1:21 PM
D-167
• • • •••
D Mississippi Dhrough the Mississippi Grade Level Testing Program, the state administersMississippi Curriculum Tests (MCT) in grades 2-8 in reading andmathematics. Scores are available for Black and economically disadvantaged
students. Mississippi uses four achievement levels for reporting purposes: minimal,basic, proficient, and advanced. However, this year data were not available for theadvanced level. Scores from 2000 are not available for this report, so no directcomparisons could be made with scores from 2003; therefore, trend graphs are notincluded. School-level assessment scores based on 10 or fewer students aresuppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 4 and 102 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is below the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (proficient) is close to the NAEP basic level.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White gap in mathematics in grade 4 in2003. Overall, the Black-White gap in grade 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003. Overall, there were no significant differences between NAEP andthe state assessment in measurement of the poverty gap in mathematics in grades 4and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 167 Thursday, March 13, 2008 1:21 PM
Achievement
D-168 National Assessment of Educational Progress
• • • •••
MISSISSIPPI
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.66 0.040 0.77 0.026Proficient 0.79 0.016 0.82 0.012
•••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
Chapter_D2.fm Page 168 Thursday, March 13, 2008 1:21 PM
MISSISSIPPI D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-169
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 5.9 10.1 10.5 9.4
English language learner # 0.3 0.1 0.7Student with disability 5.9 9.2 10.4 8.6Both # 0.6 0.1 #
Excluded 2.7 5.4 5.5 4.9English language learner # 0.3 0.1 0.3Student with disability 2.7 4.7 5.3 4.6Both # 0.5 0.1 #
Accommodated 2.1 1.2 1.3 1.6English language learner # # # #Student with disability 2.1 1.2 1.3 1.6Both # # # #
Chapter_D2.fm Page 169 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-170 National Assessment of Educational Progress
• • • •••
MISSISSIPPI
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.1
Lower half -0.3
Upper half -1.5
Lower quarter -2.0
Middle half #
Upper quarter -3.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
H
H0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 170 Thursday, March 13, 2008 1:21 PM
MISSISSIPPI D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-171
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -6.9*
Lower half -8.1*
Upper half -6.7*
Lower quarter -6.6
Middle half -8.2*
Upper quarter -4.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 171 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-172 National Assessment of Educational Progress
• • • •••
MISSISSIPPI
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.7
Lower half -1.1
Upper half -5.7
Lower quarter 0.1
Middle half -4.4
Upper quarter -4.9
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 172 Thursday, March 13, 2008 1:21 PM
MISSISSIPPI D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-173
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.5
Lower half -5.2
Upper half -4.0
Lower quarter -3.4
Middle half -5.3
Upper quarter -5.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 173 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 174 Thursday, March 13, 2008 1:21 PM
D-175
• • • •••
D Missouri Dhrough the Missouri Assessment Program (MAP), the state administers examsin grades 3 and 7 in communication arts (which includes reading) and grades4 and 8 in mathematics. Scores are available for Black and economically
disadvantaged students. Missouri uses five achievement levels for reporting purposes:step 1, progressing, nearing proficiency, proficient, and advanced. The total populationassessment scores based on 4 or fewer students are suppressed; the disaggregatedpopulation assessment scores based on 29 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 126 schools in grade 4 and 114 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is between the NAEPproficient and advanced levels.
• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are greater than the state assessment gains.
• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 175 Thursday, March 13, 2008 1:21 PM
Achievement
D-176 National Assessment of Educational Progress
• • • •••
MISSOURI
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProgressing 0.40 0.080 0.79 0.017Nearing Proficient 0.68 0.034 0.73 0.039Proficient 0.69 0.016 0.62 0.033Advanced 0.45 0.027 0.44 0.079
••••••••••••••••••••••••••••••••••••••••••••
••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
nearing proficiency
proficient
advanced
progressing
• ••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
•••••••••
•••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
nearing proficient
proficient
advanced
progressing
Chapter_D2.fm Page 176 Thursday, March 13, 2008 1:21 PM
MISSOURI D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-177
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Missouri Dept. of Education site at http://www.dese.state.mo.us/divimprove/assess/stateresults.html.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.4 16.8 14.7 16.0
English language learner 1.2 1.5 0.3 0.7Student with disability 14.1 14.5 14.4 14.9Both 0.1 0.8 # 0.4
Excluded 2.6 3.5 2.9 3.8English language learner 0.6 0.3 0.3 0.2Student with disability 2.0 3.0 2.7 3.4Both 0.1 0.3 # 0.2
Accommodated 7.6 9.6 6.7 9.0English language learner 0.2 0.9 # 0.4Student with disability 7.5 8.4 6.7 8.4Both # 0.4 # 0.1
Level 2000 2003Grade 4 36.7 37.2Grade 8 14.0 13.9
97 99
79
86
37
46
8
11
97
98
79
80
37
37
8
6
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
*
*
*
proficient
advanced
nearingproficient
progressing
75 81
4148
13
18
1
2
75
83
41
48
1313
11
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
progressing
nearingproficient
proficient
advanced
*
Chapter_D2.fm Page 177 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-178 National Assessment of Educational Progress
• • • •••
MISSOURI
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -13.3*
Lower half -7.2*
Upper half -18.8*
Lower quarter -3.6
Middle half -14.5*
Upper quarter -21.2*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 178 Thursday, March 13, 2008 1:21 PM
MISSOURI D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-179
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.8
Lower half 0.5
Upper half -3.6
Lower quarter 1.0
Middle half -0.9
Upper quarter -3.9
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 179 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-180 National Assessment of Educational Progress
• • • •••
MISSOURI
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.7
Lower half 3.0
Upper half -10.3
Lower quarter 5.4
Middle half -3.8
Upper quarter -13.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 180 Thursday, March 13, 2008 1:21 PM
MISSOURI D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-181
• • • •••
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.6
Lower half 0.9
Upper half -1.9
Lower quarter 1.8
Middle half -2.1
Upper quarter -2.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 181 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 182 Thursday, March 13, 2008 1:21 PM
D-183
• • • •••
D Montana Dhrough the Montana Comprehensive Assessment System (MontCAS), thestate administers Iowa Tests of Basic Skills (ITBS) in grades 4 and 8 in readingand mathematics. The scores available for this report do not include any
demographic breakdowns by race/ethnicity or poverty status. Montana uses fourachievement levels for reporting purposes: novice, nearing proficiency, proficient, andadvanced. Scores from 2000 are not available for this report, so no direct comparisonscould be made with scores from 2003; therefore, trend graphs are not included.School-level assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 142 schools in grade 4 and 101 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 183 Thursday, March 13, 2008 1:21 PM
Achievement
D-184 National Assessment of Educational Progress
• • • •••
MONTANA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNearing Proficient 0.69 0.021 0.73 0.019Proficient 0.72 0.020 0.72 0.033Advanced 0.44 0.058 0.43 0.039
••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advancednearing proficient
proficient
advanced
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
•••••••••••••••••
••••••••••
••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
nearing proficiency
proficient
advanced
Chapter_D2.fm Page 184 Thursday, March 13, 2008 1:21 PM
MONTANA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-185
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.3 15.9 11.7 13.6
English language learner 0.4 2.1 0.2 1.5Student with disability 11.9 12.0 11.3 11.1Both # 1.8 0.2 1.1
Excluded 1.8 1.8 2.3 1.7English language learner 0.2 # # #Student with disability 1.6 1.7 2.1 1.6Both # 0.2 0.2 0.1
Accommodated 5.6 7.5 3.3 6.4English language learner # 0.4 # 0.5Student with disability 5.6 6.5 3.3 5.4Both # 0.6 # 0.5
Chapter_D2.fm Page 185 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 186 Thursday, March 13, 2008 1:21 PM
D-187
• • • •••
D Nebraska Dhrough the School-based Teacher-led Assessment and Reporting System(STARS), Nebraska administers exams in grades 4 and 8 in reading andmathematics. Nebraska alternates reading and mathematics exams by the
year: the state tested reading in 2001 and 2003 and mathematics in 2000 and 2002.Nebraska uses one achievement level for reporting purposes: meeting the standard.Because Nebraska alternates reading and mathematics tests, there are nomathematics data available for 2003. School-level assessment scores based on 9 orfewer students are suppressed.
Summary of Compar i sonsBecause 2003 state mathematics assessment data do not exist for Nebraska, nocomparisons to NAEP were possible.
T
Chapter_D2.fm Page 187 Thursday, March 13, 2008 1:21 PM
Achievement
D-188 National Assessment of Educational Progress
• • • •••
NEBRASKA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
•••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••
•••••••••••
•••••••••••••
••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
••••••••••••••••••••
••••••••••
••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 188 Thursday, March 13, 2008 1:21 PM
NEBRASKA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-189
• • • •••
Table 1. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 18.0 20.2 13.2 16.3
English language learner 3.0 4.0 1.8 2.1Student with disability 14.9 15.1 11.1 13.5Both 0.2 1.1 0.2 0.6
Excluded 3.4 3.0 3.6 3.5English language learner 1.2 0.6 0.4 0.8Student with disability 2.3 1.9 2.9 2.6Both # 0.5 0.2 0.1
Accommodated 4.3 8.7 2.2 5.3English language learner 0.4 0.9 0.3 0.2Student with disability 3.9 7.4 1.9 4.8Both # 0.4 # 0.3
Chapter_D2.fm Page 189 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 190 Thursday, March 13, 2008 1:21 PM
D-191
• • • •••
D Nevada Devada administers the Iowa Tests of Basic Skills (ITBS) in grades 4 and 7 inreading and mathematics. Scores are available for Hispanic, Black, andeconomically disadvantaged students, but there are too few Black students to
provide a reliable comparison. Nevada uses four achievement levels for reportingpurposes: Level 1 (below the standard), Level 2 (approaching the standard), Level 3(meeting the standard), and Level 4 (exceeding the standard). Before 2003, when theITBS was implemented, students took the TerraNova, and scores were reported bypercentile rank only. Because of this switch in tests, direct comparisons cannot bemade between ITBS scores from 2003 and TerraNova scores from 2000. Therefore,trend graphs are not included in this report. School-level assessment scores based on10 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 4 and 63 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. This is also true forgrade 7.
• Trends. No comparisons were possible for grades 4 and 7.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White gap in mathematics in grades 4 and 7 in 2003.Overall, the Hispanic-White gap in grades 4 and 7 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, the poverty gap in grade 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. Overall, there were no significant differencesbetween NAEP and the state assessment in measurement of the poverty gap inmathematics in grade 7 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
N
Chapter_D2.fm Page 191 Thursday, March 13, 2008 1:21 PM
Achievement
D-192 National Assessment of Educational Progress
• • • •••
NEVADA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
grade 8 (state 7th grade standards)
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorApproaching:2 0.78 0.014 0.77 0.019Meeting:3 0.81 0.034 0.82 0.011Exceeding:4 0.78 0.015 0.77 0.020
••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
approaching
meeting
exceeding
••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
••••••••••••••••••••
••••••••••••••••
••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
approaching
meeting
exceeding
Chapter_D2.fm Page 192 Thursday, March 13, 2008 1:21 PM
NEVADA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-193
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.8 26.4 15.9 18.0
English language learner 9.8 13.5 4.4 5.8Student with disability 8.8 9.6 10.9 10.5Both 1.2 3.3 0.6 1.7
Excluded 6.8 4.3 3.6 2.4English language learner 3.4 1.7 1.0 0.5Student with disability 2.6 1.8 2.3 1.4Both 0.8 0.8 0.3 0.5
Accommodated 5.0 7.8 4.7 6.3English language learner 1.1 2.4 0.3 1.0Student with disability 3.7 4.2 4.3 4.7Both 0.2 1.2 0.1 0.6
Chapter_D2.fm Page 193 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-194 National Assessment of Educational Progress
• • • •••
NEVADA
Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -7.2*
Lower half -11.4*
Upper half -3.3
Lower quarter -9.4*
Middle half -9.9*
Upper quarter 0.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 194 Thursday, March 13, 2008 1:21 PM
NEVADA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-195
• • • •••
Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.1*
Lower half -7.6*
Upper half -2.3
Lower quarter -7.3*
Middle half -7.2*
Upper quarter 1.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 195 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-196 National Assessment of Educational Progress
• • • •••
NEVADA
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -7.1*
Lower half -9.7*
Upper half -4.6
Lower quarter -9.7*
Middle half -6.9*
Upper quarter -5.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 196 Thursday, March 13, 2008 1:21 PM
NEVADA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-197
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
# Rounds to zero.
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 7.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall #
Lower half -3.2*
Upper half 3.4*
Lower quarter -4.7*
Middle half -1.1
Upper quarter 5.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 197 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 198 Thursday, March 13, 2008 1:21 PM
D-199
• • • •••
D New Hampshire Dhrough the New Hampshire Educational Improvement and AssessmentProgram (NHEIAP), the state administers exams in grades 3, 6, and 10 inEnglish language arts and mathematics. Scores are available for economically
disadvantaged students. New Hampshire uses four achievement levels for reportingpurposes: novice, basic, proficient, and advanced. Scores from 2000 are not available forthis report, so no direct comparisons could be made with scores from 2003; therefore,trend graphs are not included. State assessment data and comparisons based uponthose data are not displayed for grade 8 because New Hampshire does not test grade8. School-level assessment scores based on 10 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 108 schools in grade 3 (no grade 8 schools), are shown graphicallyon the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 3 mathematics performance standard (basic) isbetween the NAEP basic and proficient levels.
• Trends. No comparisons were possible for grade 3.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White and Hispanic-White gaps in grade 3 mathematicsin 2003. Overall, the poverty gap in grade 3 in percent meeting the state’s standardin mathematics in 2003 was greater when measured by NAEP compared to thestate assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 199 Thursday, March 13, 2008 1:21 PM
Achievement
D-200 National Assessment of Educational Progress
• • • •••
NEW HAMPSHIRE
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 3th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
— Not available.† Not applicable.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 3 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.46 0.017 — †Proficient 0.45 0.023 — †Advanced 0.32 0.054 — †
••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
basic
••• •••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 200 Thursday, March 13, 2008 1:21 PM
NEW HAMPSHIRE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-201
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 19.9 — 19.7
English language learner — 1.8 — 1.1Student with disability — 17.3 — 18.3Both — 0.8 — 0.3
Excluded — 3.0 — 3.5English language learner — 0.5 — 0.3Student with disability — 2.4 — 3.2Both — 0.2 — #
Accommodated — 12.0 — 9.8English language learner — 0.6 — 0.4Student with disability — 11.1 — 9.2Both — 0.4 — 0.3
Chapter_D2.fm Page 201 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-202 National Assessment of Educational Progress
• • • •••
NEW HAMPSHIRE
Figure 2. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.State assessment data used are for grade 3.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -10.8*
Lower half -17.1*
Upper half -4.8
Lower quarter -18.0*
Middle half -14.1*
Upper quarter -0.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 202 Thursday, March 13, 2008 1:21 PM
D-203
• • • •••
D New Jersey Dhe state administers the New Jersey Assessment of Skills and Knowledge (NJASK) in grade 4 in English language arts and mathematics and the GradeEight Proficiency Assessment (GEPA) in English language arts and
mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students. New Jersey uses three achievement levels for reportingpurposes: partially proficient, proficient, and advanced. Before 2003, when the NJ ASKwas implemented, grade 4 students took the Elementary School ProficiencyAssessment (ESPA). Trend graphs are not included because New Jersey did notparticipate in State NAEP prior to 2003. School-level assessment scores based on 10or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 109 schools in grade 4 and 107 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, the Black-White and Hispanic-White gaps in grade 4 in percent
meeting the state’s standard in mathematics in 2003 were greater when measuredby NAEP compared to the state assessment. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the Black-White and Hispanic-White gaps in mathematics in grade 8 in 2003. Overall, therewere no significant differences between NAEP and the state assessment inmeasurement of the poverty gap in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 203 Thursday, March 13, 2008 1:21 PM
Achievement
D-204 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.84 0.009 0.90 0.007Advanced 0.78 0.020 0.85 0.014
••••••••••••••••••••••••••••••••••••••
•••••••••••••••
•••••••••••••••••
••••••••••••••••
••••••••••
••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••
••••••••••••••
•••••••••••••••••••••
••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
proficient
advanced
Chapter_D2.fm Page 204 Thursday, March 13, 2008 1:21 PM
NEW JERSEY D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-205
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 18.2 — 18.1
English language learner — 3.8 — 2.7Student with disability — 13.7 — 14.6Both — 0.7 — 0.7
Excluded — 2.3 — 2.3English language learner — 0.7 — 1.2Student with disability — 1.3 — 0.9Both — 0.3 — 0.2
Accommodated — 14.5 — 13.7English language learner — 2.5 — 1.3Student with disability — 11.6 — 11.9Both — 0.4 — 0.5
Chapter_D2.fm Page 205 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-206 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.5*
Lower half -7.7
Upper half -10.4*
Lower quarter -4.9
Middle half -12.1*
Upper quarter -6.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 206 Thursday, March 13, 2008 1:21 PM
NEW JERSEY D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-207
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.7
Lower half -1.5
Upper half -3.1
Lower quarter -3.1
Middle half -1.4
Upper quarter -1.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 207 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-208 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -14.7*
Lower half -13.6*
Upper half -16.1*
Lower quarter -10.3
Middle half -17.6*
Upper quarter -14.4*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 208 Thursday, March 13, 2008 1:21 PM
NEW JERSEY D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-209
• • • •••
Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.0
Lower half -3.8
Upper half 0.3
Lower quarter -1.2
Middle half -2.7
Upper quarter 2.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 209 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-210 National Assessment of Educational Progress
• • • •••
NEW JERSEY
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.7
Lower half -4.3
Upper half -7.3
Lower quarter 3.8
Middle half -8.2
Upper quarter -8.8*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 210 Thursday, March 13, 2008 1:21 PM
NEW JERSEY D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-211
• • • •••
Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
# Rounds to zero.
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.1
Lower half -4.2
Upper half #
Lower quarter -3.2
Middle half -3.5
Upper quarter 1.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 211 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 212 Thursday, March 13, 2008 1:21 PM
D-213
• • • •••
D New Mexico Dew Mexico administers the TerraNova in grades 3-9 in English language artsand mathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Black students to provide a
reliable comparison. New Mexico uses quartiles for reporting purposes. Scores from2000 are not available for this report, so no direct comparisons could be made withscores from 2003; therefore, trend graphs are not included. School-level assessmentscores based on 4 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 89 schools in grade 4 and 68 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard (top half)is between the NAEP basic and proficient levels. This is also true for grade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White gap in mathematics in grades 4 and 8 in 2003.Overall, the Hispanic-White gap in grades 4 and 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the poverty gap in mathematicsin grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
N
Chapter_D2.fm Page 213 Thursday, March 13, 2008 1:21 PM
Achievement
D-214 National Assessment of Educational Progress
• • • •••
NEW MEXICO
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorTop 75% 0.76 0.024 0.77 0.039Top half 0.77 0.014 0.81 0.016Top 25% 0.70 0.029 0.83 0.023
••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••
•••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
top 75%
top half
top 25%
•••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••
••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
top 75%
top half
top 25%
Chapter_D2.fm Page 214 Thursday, March 13, 2008 1:21 PM
NEW MEXICO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-215
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 31.3 39.7 25.0 32.3
English language learner 16.5 22.4 7.9 12.6Student with disability 11.1 10.8 13.6 12.3Both 3.7 6.5 3.5 7.3
Excluded 5.7 3.5 7.3 2.5English language learner 0.8 1.4 0.6 0.5Student with disability 3.4 1.1 4.9 1.1Both 1.5 1.0 1.8 0.9
Accommodated 9.8 14.5 4.0 14.3English language learner 4.5 6.0 1.3 4.2Student with disability 4.0 5.6 2.1 6.9Both 1.3 2.9 0.5 3.3
Chapter_D2.fm Page 215 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-216 National Assessment of Educational Progress
• • • •••
NEW MEXICO
Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.5*
Lower half -7.7
Upper half -7.8
Lower quarter -8.0
Middle half -7.5
Upper quarter -10.9*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 216 Thursday, March 13, 2008 1:21 PM
NEW MEXICO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-217
• • • •••
Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -7.2*
Lower half -7.5*
Upper half -6.3
Lower quarter -5.7
Middle half -9.8*
Upper quarter -5.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 217 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-218 National Assessment of Educational Progress
• • • •••
NEW MEXICO
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.9
Lower half -7.9
Upper half 1.8
Lower quarter -11.9
Middle half -1.0
Upper quarter 2.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 218 Thursday, March 13, 2008 1:21 PM
NEW MEXICO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-219
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.7
Lower half -1.8
Upper half -0.5
Lower quarter 2.4
Middle half -5.3
Upper quarter 3.9
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 219 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 220 Thursday, March 13, 2008 1:21 PM
D-221
• • • •••
D New York Dew York administers exams in grades 4 and 8 in English language arts andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students. New York uses four achievement levels for reporting
purposes: Step 1, Level 2 (needs help), Level 3 (meets expectations), and Level 4 (exceedsexpectations). The total population assessment scores based on 4 or fewer students aresuppressed; disaggregated data suppression rules vary from school to school.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 141 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is close to the NAEP basic level. The state’s primary grade 8 mathematicsperformance standard (meeting) is between the NAEP basic and proficient levels.
• Trends. There were no significant differences between grade 4 NAEP and stateassessment gains in percent meeting between 2000 and 2003. Between 2000 and2003, the NAEP grade 8 gains in percent meeting are less than the state assessmentgains.
• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grade 4 in2003. Overall, the Black-White gap in grade 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White andpoverty gaps in mathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
N
Chapter_D2.fm Page 221 Thursday, March 13, 2008 1:21 PM
Achievement
D-222 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorNeed Help 0.70 0.016 0.80 0.011Meeting 0.86 0.011 0.85 0.009Exceeding 0.74 0.016 0.76 0.025
• •••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••
•••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
need help
meeting
exceeding
••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
••••••••••••••
••••••••••••••••••••••••
•••••••••••••••••••••••••••
••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
need help
meeting
exceeding
Chapter_D2.fm Page 222 Thursday, March 13, 2008 1:21 PM
NEW YORK D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-223
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: New York State Department of Education retrieved fromhttp://www.emsc.nysed.gov/repcrd2003/statewide/total-public-overview.htm
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.0 19.1 16.2 20.0
English language learner 5.4 5.8 4.7 4.2Student with disability 9.5 11.3 10.5 14.0Both 1.1 2.0 1.1 1.8
Excluded 4.6 5.5 4.0 5.4English language learner 2.4 2.7 1.2 1.4Student with disability 1.5 2.0 1.8 3.4Both 0.6 0.8 1.0 0.6
Accommodated 9.5 11.2 7.3 11.6English language learner 1.5 1.7 1.0 1.8Student with disability 7.5 8.5 6.2 8.8Both 0.5 1.1 0.1 1.0
Level 2000 2003Grade 4 65.0 79.0Grade 8 40.0 51.0
93
96
68
76
20
28
9395
68
79
20
31
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
need help
meeting
exceeding
78 80
41
48
69
78
85
41
54
610
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
need help
meeting
exceeding
*
*
Chapter_D2.fm Page 223 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-224 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.1
Lower half -3.8
Upper half -3.5
Lower quarter -5.5
Middle half -5.6
Upper quarter -3.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 224 Thursday, March 13, 2008 1:21 PM
NEW YORK D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-225
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -9.8*
Lower half -11.2*
Upper half -8.2*
Lower quarter -13.1*
Middle half -7.9*
Upper quarter -10.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 225 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-226 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.0
Lower half -5.6
Upper half -3.8
Lower quarter -7.8
Middle half -6.0
Upper quarter -3.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 226 Thursday, March 13, 2008 1:21 PM
NEW YORK D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-227
• • • •••
Figure 6. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.9
Lower half -8.1*
Upper half -4.4
Lower quarter -8.9*
Middle half -4.7
Upper quarter -4.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 227 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-228 National Assessment of Educational Progress
• • • •••
NEW YORK
Figure 7. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.3
Lower half -1.1
Upper half -1.0
Lower quarter -1.4
Middle half -3.1
Upper quarter 0.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 228 Thursday, March 13, 2008 1:21 PM
NEW YORK D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-229
• • • •••
Figure 8. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.6
Lower half -2.9
Upper half 1.1
Lower quarter -3.9
Middle half -2.0
Upper quarter 0.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 229 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 230 Thursday, March 13, 2008 1:21 PM
D-231
• • • •••
D North Carolina Dn accordance with the ABCs of Public Education, North Carolina administersEnd-of-Grade (EOG) exams in grades 3-8 in reading and mathematics. Scoresare available for Hispanic, Black, and economically disadvantaged students, but
there are too few Hispanic students to provide a reliable comparison. North Carolinauses four achievement levels for reporting purposes: Level I (insufficient mastery), LevelII (inconsistent mastery), Level III (consistent mastery), and Level IV (superior). School-level assessment scores based on 4 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 151 schools in grade 4 and 129 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(consistent mastery) is below the NAEP basic level. This is also true for grade 8.
• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent consistent mastery between 2000 and 2003.
• Gaps. Overall, there were no significant differences between NAEP and stateassessment in measurement of Black-White and poverty gaps in mathematics ingrades 4 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
I
Chapter_D2.fm Page 231 Thursday, March 13, 2008 1:21 PM
Achievement
D-232 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorInconsistent Mastery 0.24 0.075 0.59 0.054Consistent Mastery 0.63 0.044 0.71 0.016Superior 0.85 0.023 0.79 0.014
••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advancedinconsistent mastery
consistent mastery
superior
••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••
••••••••••••••••
•••••••••••••••••••
•••••••••••••••••
•••••••••••
•••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
inconsistent mastery
consistent mastery
superior
Chapter_D2.fm Page 232 Thursday, March 13, 2008 1:21 PM
NORTH CAROLINA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-233
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
— Not available.SOURCE: North Carolina Department of Public Instruction site at http://www.ncreportcards.org/src/stateDetails.jsp?Page=1&pYear=2002-2003
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 16.3 20.6 15.7 18.4
English language learner 2.3 3.3 1.5 2.8Student with disability 13.8 15.3 13.8 14.3Both 0.3 2.0 0.4 1.3
Excluded 5.1 4.1 5.0 3.8English language learner 0.7 0.5 0.7 0.6Student with disability 4.1 3.2 3.9 2.7Both 0.3 0.4 0.4 0.5
Accommodated 7.9 11.7 6.9 11.7English language learner 0.8 1.3 0.3 1.2Student with disability 7.1 9.2 6.6 9.8Both # 1.1 # 0.6
Level 2000 2003Grade 4 — 92.1Grade 8 — 82.4
98
100
85
93
40
57
9898
85 92
40
59
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
consistentmastery
superior
inconsistentmastery
*
96
97
81
84
44
50
96
94
81
82
4448
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
inconsistentmastery
consistentmastery
superior
*
Chapter_D2.fm Page 233 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-234 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.8
Lower half -7.0
Upper half -2.9*
Lower quarter -6.2
Middle half -5.6*
Upper quarter -0.9
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 234 Thursday, March 13, 2008 1:21 PM
NORTH CAROLINA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-235
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.5
Lower half -7.9*
Upper half -1.1
Lower quarter -11.2*
Middle half -3.5
Upper quarter 1.2
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 235 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-236 National Assessment of Educational Progress
• • • •••
NORTH CAROLINA
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.1
Lower half -5.0
Upper half 1.3
Lower quarter -7.7
Middle half -1.5
Upper quarter 2.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 236 Thursday, March 13, 2008 1:21 PM
NORTH CAROLINA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-237
• • • •••
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.1
Lower half -2.8
Upper half 0.7
Lower quarter -3.7
Middle half -1.5
Upper quarter 1.3
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
Highest achievers
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 237 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 238 Thursday, March 13, 2008 1:21 PM
D-239
• • • •••
D North Dakota Dhrough the North Dakota State Assessment (NDSA) Program, the stateadministers the CAT (California Achievement Test)/TerraNova, SecondEdition, in grades 4 and 8 in reading and mathematics. The scores available
for this report do not include any breakdowns by race/ethnicity or poverty status.North Dakota uses only one achievement level: meeting the standard. Scores from2000 are not available for this report, so no direct comparisons could be made withscores from 2003; therefore, trend graphs are not included. Suppression informationis not available.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 176 schools in grade 4 and 31 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(meeting) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 239 Thursday, March 13, 2008 1:21 PM
Achievement
D-240 National Assessment of Educational Progress
• • • •••
NORTH DAKOTA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.64 0.022 0.75 0.048
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
meeting
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
Chapter_D2.fm Page 240 Thursday, March 13, 2008 1:21 PM
NORTH DAKOTA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-241
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.1 17.5 11.1 15.5
English language learner 1.3 2.3 0.4 1.3Student with disability 10.6 13.7 10.2 13.4Both 0.1 1.5 0.6 0.8
Excluded 1.4 1.7 1.6 1.5English language learner 0.1 0.1 # #Student with disability 1.3 1.4 1.4 1.3Both # 0.3 0.2 0.2
Accommodated 4.0 7.4 2.0 6.8English language learner 0.1 0.1 # 0.2Student with disability 3.8 6.7 2.0 6.1Both 0.1 0.5 # 0.5
Chapter_D2.fm Page 241 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 242 Thursday, March 13, 2008 1:21 PM
D-243
• • • •••
D Ohio Dhio administers proficiency tests in grades 4, 6, and 9 in reading andmathematics. Scores are available for Hispanic, Black, and economicallydisadvantaged students, but there are too few Hispanic students to provide a
reliable comparison. Ohio uses four achievement levels for reporting purposes: belowbasic, basic, proficient, and advanced. However, we only have data for the proficientlevel in 2000; therefore, we report the changes using this performance level only.State assessment data and comparisons based upon those data are not displayed forgrade 9 because there are not enough schools that have grades 8 and 9 to allow areliable comparison with NAEP. School-level assessment scores based on 10 or fewerstudents are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 163 schools in grade 4 (no grade 8 schools), are shown graphicallyon the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. There are not enoughdata to compare state standards to NAEP for grade 8.
• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent proficient areless than the state assessment gains. No comparisons were possible for grade 8.
• Gaps. Overall, the Black-White and poverty gaps in grade 4 in percent meeting thestate’s standard in mathematics in 2003 were greater when measured by NAEPcompared to the state assessment. There were insufficient data for comparing theNAEP and state assessment measurement of the Black-White and poverty gaps inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
O
Chapter_D2.fm Page 243 Thursday, March 13, 2008 1:21 PM
Achievement
D-244 National Assessment of Educational Progress
• • • •••
OHIO
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
— Not available.† Not applicable.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.80 0.012 — †Proficient 0.81 0.011 — †Advanced 0.66 0.019 — †
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 244 Thursday, March 13, 2008 1:21 PM
OHIO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-245
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting grade 4 mathematics standards: 2000 and 2003
Grade 4
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
— Not available.
SOURCE: Ohio Department of Education retrieved fromhttp://www.ode.state.oh.us/GD/Templates/Pages/ODE/ODEDetail.aspx?page=3&TopicRelationID=400&Content=15350.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 12.0 13.1 11.4 13.4
English language learner 0.4 0.7 0.8 0.6Student with disability 11.6 11.5 9.8 12.4Both # 0.8 0.8 0.4
Excluded 4.7 4.4 4.4 5.1English language learner 0.2 0.2 0.3 0.2Student with disability 4.5 3.9 3.3 4.8Both # 0.4 0.8 0.1
Accommodated 5.4 6.7 2.9 5.3English language learner # 0.1 0.1 0.2Student with disability 5.4 6.2 2.8 5.0Both # 0.4 # 0.1
Level 2000 2003Grade 4 — 58.0
43
5342
59
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
proficient
*
Chapter_D2.fm Page 245 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-246 National Assessment of Educational Progress
• • • •••
OHIO
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.3*
Lower half -4.6
Upper half -12.0*
Lower quarter -0.9
Middle half -8.4*
Upper quarter -15.1*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 246 Thursday, March 13, 2008 1:21 PM
OHIO D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-247
• • • •••
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.2*
Lower half -8.3*
Upper half -8.2*
Lower quarter -8.3*
Middle half -8.3*
Upper quarter -8.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 247 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 248 Thursday, March 13, 2008 1:21 PM
D-249
• • • •••
D Oklahoma Dhrough the Oklahoma State Testing Program (OSTP), the state administersOklahoma Core Curriculum Tests (OCCT) in grades 5 and 8 in reading andmathematics. Scores are available for Hispanic and Black students, but there
are too few Hispanic students to provide a reliable comparison. Oklahoma uses fourachievement levels for reporting purposes: unsatisfactory, limited knowledge, satisfactory,and advanced. School-level assessment scores based on 5 or fewer students aresuppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 132 schools in grade 5 and 123 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(satisfactory) is close to the NAEP basic level. The state’s primary grade 8mathematics performance standard (satisfactory) is below the NAEP basic level.
• Trends. Between 2000 and 2003, the state reported declines in grade 4 in percentsatisfactory, which NAEP did not. There were no significant differences betweengrade 8 NAEP and state assessment gains in percent satisfactory between 2000 and2003.
• Gaps. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Black-White gap in mathematics in grades 5 and8 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the Hispanic-White and poverty gaps in mathematicsin grades 5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 249 Thursday, March 13, 2008 1:21 PM
Achievement
D-250 National Assessment of Educational Progress
• • • •••
OKLAHOMA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorLittle Knowledge 0.36 0.073 0.51 0.038Satisfactory 0.58 0.016 0.71 0.021Advanced 0.42 0.033 0.64 0.026
•••••••••••••••••••••••••••••••••••••••••••
••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
satisfactory
advanced
limited knowledge
••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
limited knowledge
satisfactory
advanced
Chapter_D2.fm Page 250 Thursday, March 13, 2008 1:21 PM
OKLAHOMA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-251
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 (state assessment grade 5) Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Oklahoma State Department of Education site at http://www.sde.state.ok.us/home/defaultns.html.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 20.3 21.8 14.6 19.0
English language learner 4.4 5.0 1.6 3.1Student with disability 14.9 15.2 12.8 13.9Both 1.1 1.6 0.2 2.0
Excluded 5.0 3.6 3.9 2.3English language learner 0.6 0.5 0.3 0.3Student with disability 4.2 2.7 3.5 1.8Both 0.2 0.5 0.1 0.3
Accommodated 4.7 8.0 2.8 6.7English language learner 0.7 0.5 0.1 0.5Student with disability 3.5 6.9 2.7 5.5Both 0.6 0.6 # 0.6
Level 2000 2003Grade 5 85.0 72.0Grade 8 71.0 73.0
93 96
8690
1015
9398
86
69
1014
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
limitedknowledge
satisfactory
advanced
* 88 89
71
74
13 15
88
95
71
71
1316
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
limitedknowledge
satisfactory
advanced
*
Chapter_D2.fm Page 251 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-252 National Assessment of Educational Progress
• • • •••
OKLAHOMA
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.5
Lower half -0.1
Upper half -11.9*
Lower quarter 4.7
Middle half -5.6
Upper quarter -12.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 252 Thursday, March 13, 2008 1:21 PM
OKLAHOMA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-253
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.7
Lower half -2.8
Upper half 1.3
Lower quarter 0.9
Middle half -3.0
Upper quarter 0.9
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 253 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 254 Thursday, March 13, 2008 1:21 PM
D-255
• • • •••
D Oregon Dhe state administers the Oregon Statewide Assessment in grades 3, 5, and 8 inreading and mathematics. Scores are available for Hispanic and Blackstudents in grade 8, but there are too few Black students to provide a reliable
comparison. Oregon uses five achievement levels for reporting purposes: very low, low,nearly meets the standard, meets the standard, and exceeds the standard. However, due todata unavailability, this report is based on only the top two standards. Suppressioninformation is not available.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 5 and 105 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(meeting) is close to the NAEP basic level for grade 4. The state’s primary grade 8mathematics performance standard (meeting) is between the NAEP basic andproficient levels.
• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in percent meeting between 2000 and 2003.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in mathematics in grades 5 and8 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the Hispanic-White gap in mathematics in grade 5 in2003. Overall, there were no significant differences between NAEP and the stateassessment in measurement of the Hispanic-White gap in mathematics in grade 8in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 255 Thursday, March 13, 2008 1:21 PM
Achievement
D-256 National Assessment of Educational Progress
• • • •••
OREGON
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorMeeting 0.51 0.031 0.77 0.022Exceeding 0.67 0.029 0.80 0.015
•••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
meeting
exceeding
••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••
•••••••••••
•••••••••••
•••••••••••••
•••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
meeting
exceeding
Chapter_D2.fm Page 256 Thursday, March 13, 2008 1:21 PM
OREGON D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-257
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 (state assessment grade 5) Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Oregon Department of Education site at http://www.ode.state.or.us/search/results/?id=126.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 18.3 26.7 16.9 19.5
English language learner 4.6 9.4 4.3 5.1Student with disability 12.8 14.8 11.7 12.8Both 0.9 2.4 0.8 1.6
Excluded 2.7 4.1 2.5 3.2English language learner 0.7 0.6 0.5 0.5Student with disability 1.5 2.7 1.7 2.2Both 0.5 0.8 0.3 0.4
Accommodated 7.8 11.3 6.2 5.9English language learner 2.3 4.0 1.2 1.5Student with disability 5.3 6.4 4.8 3.8Both 0.1 0.9 0.2 0.6
Level 2000 2003Grade 5 70.0 76.0Grade 8 56.0 59.0
67
81
16
25
67 78
16
26
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
meeting
exceeding
55 55
29 30
5558
30 32
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
meeting
exceeding
Chapter_D2.fm Page 257 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-258 National Assessment of Educational Progress
• • • •••
OREGON
Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.2
Lower half -6.0
Upper half -4.5
Lower quarter -9.2
Middle half -2.6
Upper quarter -5.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 258 Thursday, March 13, 2008 1:21 PM
D-259
• • • •••
D Pennsylvania Dhrough the Pennsylvania System of School Assessment (PSSA), the stateadministers exams in grades 5 and 8 in reading and mathematics. Scores areavailable for Black and economically disadvantaged students in grades 5 and 8
and for Hispanic students in grade 8, but there are too few Hispanic students toprovide a reliable comparison. Pennsylvania uses four achievement levels forreporting purposes: below basic, basic, proficient, and advanced. Scores from 2000 arenot available for this report, so no direct comparisons could be made with scores from2003; therefore, trend graphs are not included. School-level assessment scores basedon 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 101 schools in grade 5 and 101 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White and poverty gaps in mathematics ingrades 5 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 259 Thursday, March 13, 2008 1:21 PM
Achievement
D-260 National Assessment of Educational Progress
• • • •••
PENNSYLVANIA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.80 0.022 0.85 0.018Proficient 0.83 0.008 0.87 0.011Advanced 0.75 0.021 0.82 0.016
•••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••
••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
••••••••••••
••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
Chapter_D2.fm Page 260 Thursday, March 13, 2008 1:21 PM
PENNSYLVANIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-261
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 15.0 — 15.2
English language learner — 1.8 — 1.2Student with disability — 12.2 — 13.1Both — 1.0 — 0.8
Excluded — 2.9 — 1.5English language learner — 0.8 — 0.2Student with disability — 1.9 — 1.2Both — 0.3 — 0.1
Accommodated — 9.0 — 10.7English language learner — 0.5 — 0.4Student with disability — 8.0 — 9.9Both — 0.5 — 0.4
Chapter_D2.fm Page 261 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-262 National Assessment of Educational Progress
• • • •••
PENNSYLVANIA
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.8
Lower half -2.8
Upper half -5.4
Lower quarter 0.8
Middle half -5.1
Upper quarter -7.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 262 Thursday, March 13, 2008 1:21 PM
PENNSYLVANIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-263
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.6
Lower half -1.4
Upper half -8.0*
Lower quarter 0.6
Middle half -6.0*
Upper quarter -6.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 263 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-264 National Assessment of Educational Progress
• • • •••
PENNSYLVANIA
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunchState assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.3
Lower half -1.0
Upper half -5.2
Lower quarter 1.2
Middle half -3.6
Upper quarter -7.0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
es
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 264 Thursday, March 13, 2008 1:21 PM
PENNSYLVANIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-265
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.3
Lower half -4.5
Upper half -2.6
Lower quarter -2.7
Middle half -5.2
Upper quarter 0.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 265 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 266 Thursday, March 13, 2008 1:21 PM
D-267
• • • •••
D Rhode Island Dhode Island administers New Standards Reference Examinations (NSRE) ingrades 4 and 8 in English/language arts (ELA) and mathematics. The ELAexam is broken down into four subcontent areas: reading–basic understanding,
reading –analysis & interpretation, writing–effectiveness, and writing–conventions.The mathematics exam encompasses three subcontent areas: concepts, problemsolving, and skills. While the 2003 data were not reported by subcontent area,previous years’ data were reported this way, so those years’ data have been aggregatedto allow comparisons across years. Scores are available for Hispanic and Blackstudents, but there are too few Black students to provide a reliable comparison.Rhode Island uses five achievement levels for reporting purposes: little evidence ofachievement, below the standard, nearly achieved the standard, achieved the standard, andachieved the standard with honors. However, here data have been presented based onlyon percent proficient, defined by the state as those achieving the standard and above.School-level assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 111 schools in grade 4 and 51 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics standard (proficient) is betweenthe NAEP basic and proficient levels. This is also true for grade 8.
• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are less than the state assessment gains.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and poverty gaps in mathematics in grades 4 and8 in 2003. Overall, the Hispanic-White gap in grades 4 and 8 in percent meetingthe state’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
R
Chapter_D2.fm Page 267 Thursday, March 13, 2008 1:21 PM
Achievement
D-268 National Assessment of Educational Progress
• • • •••
RHODE ISLAND
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.78 0.011 0.90 0.014
••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
• ••••• •••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••
•••••••••••
•••••••••••••••••••
••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
proficient
Chapter_D2.fm Page 268 Thursday, March 13, 2008 1:21 PM
RHODE ISLAND D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-269
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
— Not available.
SOURCE: Rhode Island Department of Education retrieved from http://www.infoworks.ride.uri.edu/.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 22.7 26.9 19.7 23.3
English language learner 6.6 7.1 3.4 3.7Student with disability 15.2 17.4 15.9 18.0Both 0.8 2.4 0.3 1.6
Excluded 3.0 3.4 3.4 3.6English language learner 1.2 1.6 0.9 1.0Student with disability 1.6 1.2 2.4 2.1Both 0.2 0.6 0.2 0.5
Accommodated 10.1 14.9 4.3 12.7English language learner 1.8 1.9 0.5 1.2Student with disability 7.9 11.7 3.8 10.9Both 0.4 1.3 0.1 0.7
Level 2000 2003Grade 4 — 42.6Grade 8 — 35.2
212621
42
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
proficient* 27 29
27
35
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
proficient *
Chapter_D2.fm Page 269 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-270 National Assessment of Educational Progress
• • • •••
RHODE ISLAND
Figure 3. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -13.9*
Lower half -12.5*
Upper half -15.3*
Lower quarter -11.0*
Middle half -15.6*
Upper quarter -15.7*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 270 Thursday, March 13, 2008 1:21 PM
RHODE ISLAND D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-271
• • • •••
Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.3*
Lower half -4.3*
Upper half -2.8
Lower quarter -3.5*
Middle half -4.1*
Upper quarter -2.6
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 271 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 272 Thursday, March 13, 2008 1:21 PM
D-273
• • • •••
D South Carolina Douth Carolina administers the Palmetto Achievement Challenge Tests(PACT) in English language arts and mathematics in grades 3-8. Scores areavailable for Hispanic, Black, and economically disadvantaged students, but
there are too few Hispanic students to provide a reliable comparison with Whitestudents. South Carolina uses four achievement levels for reporting purposes: belowbasic, basic, proficient, and advanced. Suppression information is not available.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 101 schools in grade 4 and 92 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. The state’s primary grade 8mathematics performance standard (proficient) is between the NAEP proficient andadvanced levels.
• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are greater than the state assessment gains.
• Gaps. Overall, the Black-White gap in grade 4 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Black-White gap inmathematics in grade 8 in 2003. There were insufficient data for comparing theNAEP and state assessment measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. Overall, there were no significantdifferences between NAEP and the state assessment in measurement of the povertygap in mathematics in grade 4 in 2003. Overall, the poverty gap in grade 8 inpercent meeting the state’s standard in mathematics in 2003 was smaller whenmeasured by NAEP compared to the state assessment.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
S
Chapter_D2.fm Page 273 Thursday, March 13, 2008 1:21 PM
Achievement
D-274 National Assessment of Educational Progress
• • • •••
SOUTH CAROLINA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.77 0.046 0.80 0.023Proficient 0.74 0.012 0.80 0.014Advanced 0.70 0.044 0.71 0.034
•••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
•••••••••••••••••
•••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
Chapter_D2.fm Page 274 Thursday, March 13, 2008 1:21 PM
SOUTH CAROLINA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-275
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: South Carolina Department of Education retrieved from http://ed.sc.gov/topics/assessment/scores/.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 17.0 18.0 13.1 15.3
English language learner 0.4 1.2 0.4 0.6Student with disability 16.0 16.0 12.6 14.1Both 0.7 0.8 0.1 0.5
Excluded 5.1 6.3 4.0 7.0English language learner 0.2 0.1 0.2 0.2Student with disability 4.6 5.8 3.7 6.6Both 0.4 0.3 0.1 0.3
Accommodated 4.7 4.5 2.2 3.6English language learner # 0.2 0.1 0.1Student with disability 4.6 4.2 2.1 3.4Both 0.2 0.1 # 0.1
Level 2000 2003Grade 4 24.0 33.7Grade 8 20.0 19.2
61
80
23
39
7
14
62
80
2333
7 13
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
basic
proficient
advanced
*
63
75
19
28
7
11
6367
1920
67
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
basic
proficient
advanced
*
*
*
Chapter_D2.fm Page 275 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-276 National Assessment of Educational Progress
• • • •••
SOUTH CAROLINA
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -5.5*
Lower half -5.3*
Upper half -5.5
Lower quarter -5.0
Middle half -5.7*
Upper quarter -4.5
Lowest
achievers
Median Highest
achievers
High
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 276 Thursday, March 13, 2008 1:21 PM
SOUTH CAROLINA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-277
• • • •••
Figure 4. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 3.5
Lower half 4.0*
Upper half 2.4
Lower quarter 7.2*
Middle half 1.3
Upper quarter 3.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
High
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 277 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-278 National Assessment of Educational Progress
• • • •••
SOUTH CAROLINA
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.9
Lower half -2.7
Upper half -3.1
Lower quarter -1.3
Middle half -3.8
Upper quarter -3.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 278 Thursday, March 13, 2008 1:21 PM
SOUTH CAROLINA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-279
• • • •••
Figure 6. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 4.7*
Lower half 5.2*
Upper half 4.8
Lower quarter 6.3*
Middle half 3.4
Upper quarter 5.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 279 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 280 Thursday, March 13, 2008 1:21 PM
D-281
• • • •••
D South Dakota Douth Dakota administers the state Test of Educational Progress (STEP) ingrades 3-8 in reading and mathematics. The Dakota STEP, which is un-timedand yields both norm-referenced and standards-based scores, has as its basic
platform the new, augmented Stanford Achievement Test, Tenth Edition (SAT-10).Scores are available for economically disadvantaged students. South Dakota uses fourachievements levels for reporting purposes: below basic, basic, proficient, and advanced.The state did not participate in NAEP prior to 2003, so trend graphs are notincluded. School-level assessment scores based on 9 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 143 schools in grade 4 and 106 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. This is also true forgrade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the poverty gap in mathematicsin grades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
S
Chapter_D2.fm Page 281 Thursday, March 13, 2008 1:21 PM
Achievement
D-282 National Assessment of Educational Progress
• • • •••
SOUTH DAKOTA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.04 0.041 0.67 0.027Proficient 0.77 0.011 0.71 0.008Advanced 0.62 0.042 0.49 0.051
••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
basic
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
Chapter_D2.fm Page 282 Thursday, March 13, 2008 1:21 PM
SOUTH DAKOTA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-283
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 17.5 — 13.0
English language learner — 2.9 — 2.4Student with disability — 13.7 — 10.1Both — 0.9 — 0.5
Excluded — 1.5 — 1.7English language learner — 0.1 — #Student with disability — 1.2 — 1.5Both — 0.1 — 0.2
Accommodated — 7.1 — 5.8English language learner — 1.2 — 0.7Student with disability — 5.5 — 4.9Both — 0.4 — 0.2
Chapter_D2.fm Page 283 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-284 National Assessment of Educational Progress
• • • •••
SOUTH DAKOTA
Figure 2. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.7
Lower half -4.4
Upper half -1.8
Lower quarter -7.8
Middle half -2.9
Upper quarter -1.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 284 Thursday, March 13, 2008 1:21 PM
SOUTH DAKOTA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-285
• • • •••
Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
# Rounds to zero.
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.3
Lower half -1.2
Upper half #
Lower quarter -4.5
Middle half 2.0
Upper quarter -0.1
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 285 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 286 Thursday, March 13, 2008 1:21 PM
D-287
• • • •••
D Tennessee Dhrough the Tennessee Comprehensive Assessment Program (TCAP), thestate administers exams in grades 3-8 in reading and mathematics. Scores areavailable for Hispanic, Black, and economically disadvantaged students, but
there are too few Hispanic students to provide a reliable comparison. Tennessee doesnot use multiple achievement levels for reporting purposes; instead, it reports examresults in percentiles. Scores from 2000 are not available for this report; therefore,trend graphs are not included. Suppression information is not available.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 96 schools in grade 4 and 94 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. There are not enough data to compare state standards to NAEP forgrade 4 or grade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White and poverty gaps in mathematics ingrades 4 and 8 in 2003. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White gap in mathematics in grades4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 287 Thursday, March 13, 2008 1:21 PM
Achievement
D-288 National Assessment of Educational Progress
• • • •••
TENNESSEE
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
NOTE: State does not use multiple achievement levels for reporting; it reports exam results in percentiles.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPercentile Rank 0.76 0.016 0.81 0.027
•••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••
•••••••••••••••••••••••
•••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
••••••••••••••••••
•••••••••••••••••••••••••
•••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 288 Thursday, March 13, 2008 1:21 PM
TENNESSEE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-289
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 11.2 14.0 12.6 16.0
English language learner 0.7 0.9 1.4 1.6Student with disability 9.8 12.5 11.2 13.5Both 0.7 0.5 # 1.0
Excluded 2.6 2.6 2.4 3.0English language learner 0.1 0.2 0.5 0.4Student with disability 1.8 2.2 1.9 2.4Both 0.6 0.2 # 0.2
Accommodated 1.3 4.8 0.7 1.4English language learner # # 0.1 0.1Student with disability 1.3 4.6 0.6 1.3Both # 0.2 # #
Chapter_D2.fm Page 289 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-290 National Assessment of Educational Progress
• • • •••
TENNESSEE
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -3.1
Lower half -2.4
Upper half -6.5
Lower quarter -1.0
Middle half -1.2
Upper quarter -7.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 290 Thursday, March 13, 2008 1:21 PM
TENNESSEE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-291
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.7
Lower half -3.8
Upper half -3.0
Lower quarter -2.6
Middle half -2.3
Upper quarter 0.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 291 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-292 National Assessment of Educational Progress
• • • •••
TENNESSEE
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.3
Lower half 1.9
Upper half -1.8
Lower quarter 3.2
Middle half 1.5
Upper quarter -5.8*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 292 Thursday, March 13, 2008 1:21 PM
TENNESSEE D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-293
• • • •••
Figure 5. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 3.6
Lower half 2.0
Upper half 4.4
Lower quarter 3.8
Middle half 2.7
Upper quarter 4.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 293 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 294 Thursday, March 13, 2008 1:21 PM
D-295
• • • •••
D Texas Dhe state administers the Texas Assessment of Knowledge and Skills (TAKS)in grades 3-11 in reading and mathematics. Scores are available for Hispanicand Black students. Texas reports its data only by percent passing. Before 2003,
when the TAKS was implemented, students took the Texas Assessment of AcademicSkills (TAAS). Because the test changed, direct comparisons cannot be madebetween scores from 2003 and those from 2000; therefore, trends are not included.School-level assessment scores based on 4 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 194 schools in grade 4 and 142 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard (passing)is below the NAEP basic level. This is also true for grade 8.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White gap in mathematics in grade 4 in2003. Overall, the Black-White gap in grade 8 in percent meeting the state’sstandard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. Overall, there were no significant differences betweenNAEP and the state assessment in measurement of the Hispanic-White gap inmathematics in grades 4 and 8 in 2003. There were insufficient data for comparingthe NAEP and state assessment measurement of the poverty gap in mathematics ingrades 4 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 295 Thursday, March 13, 2008 1:21 PM
Achievement
D-296 National Assessment of Educational Progress
• • • •••
TEXAS
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPassing 0.52 0.052 0.71 0.009
••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advancedpassing
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••
••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••• •0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
passing
Chapter_D2.fm Page 296 Thursday, March 13, 2008 1:21 PM
TEXAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-297
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 25.2 27.5 20.2 20.0
English language learner 10.5 12.8 6.6 4.7Student with disability 12.6 11.3 12.1 12.2Both 2.0 3.4 1.5 3.1
Excluded 6.9 7.4 8.0 7.2English language learner 0.9 0.6 1.1 0.9Student with disability 5.2 5.4 5.8 5.0Both 0.7 1.5 1.0 1.3
Accommodated 6.1 6.0 2.0 2.1English language learner 3.0 3.0 0.5 0.5Student with disability 2.7 2.4 1.2 1.3Both 0.3 0.6 0.2 0.2
Chapter_D2.fm Page 297 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-298 National Assessment of Educational Progress
• • • •••
TEXAS
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.9
Lower half -3.7
Upper half -3.0
Lower quarter 1.6
Middle half -4.8
Upper quarter -4.3
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0 0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 298 Thursday, March 13, 2008 1:21 PM
TEXAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-299
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -7.3*
Lower half -9.5*
Upper half -5.3
Lower quarter -10.4
Middle half -8.5*
Upper quarter -2.5
Lowest
achievers
Median Highest
achievers
Highest achievers
Highest achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 299 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-300 National Assessment of Educational Progress
• • • •••
TEXAS
Figure 4. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.1
Lower half -0.2
Upper half -2.1
Lower quarter 0.8
Middle half -1.5
Upper quarter -1.9
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 300 Thursday, March 13, 2008 1:21 PM
TEXAS D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-301
• • • •••
Figure 5. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -2.4
Lower half -3.5
Upper half -0.7
Lower quarter -2.2
Middle half -3.8
Upper quarter -1.4
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 301 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 302 Thursday, March 13, 2008 1:21 PM
D-303
• • • •••
D Utah Dtah administers the Stanford Achievement Test, Ninth Edition (SAT-9) ingrades 3, 5, and 8 in reading and mathematics. The scores available for thisreport do not include any breakdowns by race/ethnicity or poverty status.
Utah does not use multiple achievement levels for reporting the SAT-9; instead, itreports exam results in percentiles. Suppression information is not available.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 104 schools in grade 5 and 91 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. There are not enough data to compare state standards to NAEP forgrade 5 or grade 8.
• Trends. There were no significant differences between grades 4 and 8 NAEP andstate assessment gains in average percentile rank between 2000 and 2003.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White, Hispanic-White, and poverty gaps inmathematics in grades 5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
U
Chapter_D2.fm Page 303 Thursday, March 13, 2008 1:21 PM
Achievement
D-304 National Assessment of Educational Progress
• • • •••
UTAH
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
NOTE: State does not use multiple achievement levels for reporting; it reports exam results in percentiles.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorPercentile Rank 0.68 0.008 0.72 0.013
••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
•• •••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••
••••••••••
•••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 304 Thursday, March 13, 2008 1:21 PM
UTAH D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-305
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 (state assessment grade 5) Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 13.7 21.4 13.5 16.3
English language learner 5.1 9.4 3.0 5.5Student with disability 7.8 9.5 9.8 9.1Both 0.9 2.6 0.7 1.7
Excluded 2.8 2.8 2.7 2.5English language learner 0.3 0.8 0.2 0.4Student with disability 2.2 1.3 2.2 1.9Both 0.3 0.7 0.2 0.2
Accommodated 3.7 7.1 2.7 5.1English language learner 1.3 2.0 0.5 1.2Student with disability 1.8 4.3 2.2 3.2Both 0.5 0.8 0.1 0.7
53 51
50 48
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
Percentilerank 53 54
58 57
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
Percentilerank
Chapter_D2.fm Page 305 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 306 Thursday, March 13, 2008 1:21 PM
D-307
• • • •••
D Vermont Dermont administers the New Standards Reference Examinations (NSRE) ingrades 4 and 8 in reading and mathematics. The reading exam is broken downinto two reading subtests (basic understanding; analysis & interpretation); the
mathematics exam is broken down into three subtests (concepts; problem solving;skills). The reading and mathematics scores are averages of the two reading subtestsand three mathematics subtests, respectively. Scores are available for economicallydisadvantaged students. Vermont uses five achievement levels for reporting purposes:little evidence of achievement, below the standard, nearly achieved the standard, achievedthe standard, and achieved the standard with honors. Because scores were only availablefor achieved the standard prior to 2003, the trend graphs are based only on that level.School-level assessment scores based on 10 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 154 schools in grade 4 and 99 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics standard (achieved) is betweenthe NAEP basic and proficient levels. This is also true for grade 8.
• Trends. Between 2000 and 2003, the NAEP grade 4 gains in percent meeting aregreater than the state assessment gains. There were no significant differencesbetween grade 8 NAEP and state assessment gains in the same period.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, the poverty gap in grade 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. There were no significant differences between ingrade 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
V
Chapter_D2.fm Page 307 Thursday, March 13, 2008 1:21 PM
Achievement
D-308 National Assessment of Educational Progress
• • • •••
VERMONT
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBelow 0.10 0.072 0.35 0.080Nearly 0.50 0.019 0.63 0.036Achieved 0.47 0.021 0.74 0.026Honors 0.29 0.034 0.76 0.012
••••••••••••••••••••••••••••••••••••••••••
•••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
below
achieved
honors
nearly
••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••
•••••••••••••••••••••••••••••••
•••••••••••••••••
••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
nearly
achieved
honors
below
Chapter_D2.fm Page 308 Thursday, March 13, 2008 1:21 PM
VERMONT D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-309
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: State of Vermont Department of Education site at http://data.ed.state.vt.us/performance/03/STATE_03.pdf
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.5 18.4 17.0 17.7
English language learner 0.4 1.3 1.2 0.4Student with disability 15.1 16.4 15.6 16.7Both 0.1 0.7 0.2 0.7
Excluded 2.7 4.0 3.1 2.9English language learner # 0.1 0.5 #Student with disability 2.7 3.6 2.4 2.6Both 0.1 0.3 0.2 0.3
Accommodated 8.7 10.0 4.4 7.4English language learner 0.4 0.5 0.2 #Student with disability 8.3 9.2 4.2 7.2Both # 0.3 # 0.2
Level 2000 2003Grade 4 47.3 53.0Grade 8 47.0 51.7
47
61
4753
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
achieved
*
465246
52
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
achieved
Chapter_D2.fm Page 309 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-310 National Assessment of Educational Progress
• • • •••
VERMONT
Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -14.3*
Lower half -15.7*
Upper half -14.1*
Lower quarter -12.6*
Middle half -15.6*
Upper quarter -12.9*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 310 Thursday, March 13, 2008 1:21 PM
VERMONT D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-311
• • • •••
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.2
Lower half -5.6
Upper half -4.2
Lower quarter -4.7
Middle half -4.0
Upper quarter -0.7
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 311 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 312 Thursday, March 13, 2008 1:21 PM
D-313
• • • •••
D Virginia Dirginia administers the Standards of Learning (SOL) tests in grades 3, 5, and 8in reading and mathematics. Scores are available for Hispanic and Blackstudents, but there are too few Hispanic students to provide a reliable
comparison. Virginia uses three achievement levels for reporting purposes: failing,proficient, and advanced. Trend graphs are not included because new performancestandards are set every year. School-level assessment scores based on 9 or fewerstudents are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 107 schools in grade 5 and 103 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 5 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is below the NAEP basiclevel.
• Trends. No comparisons were possible for grades 5 and 8.• Gaps. Overall, the Black-White gap in grades 5 and 8 in percent meeting the state’s
standard in mathematics in 2003 was greater when measured by NAEP comparedto the state assessment. There were insufficient data for comparing the NAEP andstate assessment measurement of the Hispanic-White and poverty gaps inmathematics in grades 5 and 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
V
Chapter_D2.fm Page 313 Thursday, March 13, 2008 1:21 PM
Achievement
D-314 National Assessment of Educational Progress
• • • •••
VIRGINIA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4 (state 5th grade standards)
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 5 Grade 8Standard Correlation Standard error Correlation Standard errorProficient 0.54 0.017 0.63 0.028Advanced 0.66 0.026 0.77 0.016
••• ••••••••••••••••••••••••••••••••••••••••••••••
•••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••
•••••••••••••••••••••
••••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
advanced
proficient
Chapter_D2.fm Page 314 Thursday, March 13, 2008 1:21 PM
VIRGINIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-315
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.8 19.4 14.9 16.9
English language learner 3.0 6.4 2.2 2.4Student with disability 12.3 11.3 12.3 13.1Both 0.5 1.6 0.4 1.5
Excluded 4.0 6.1 6.2 6.5English language learner 1.1 1.7 0.8 0.8Student with disability 2.5 3.8 5.3 4.9Both 0.4 0.7 0.1 0.8
Accommodated 6.6 8.1 3.9 6.4English language learner 0.9 2.4 0.2 0.5Student with disability 5.7 4.9 3.3 5.5Both # 0.8 0.3 0.4
Chapter_D2.fm Page 315 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-316 National Assessment of Educational Progress
• • • •••
VIRGINIA
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: State assessment data used are for grade 5.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -10.3*
Lower half -13.7*
Upper half -5.8*
Lower quarter -14.8*
Middle half -11.6*
Upper quarter -3.7
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 316 Thursday, March 13, 2008 1:21 PM
VIRGINIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-317
• • • •••
Figure 3. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.6*
Lower half -11.3*
Upper half -5.9
Lower quarter -12.4*
Middle half -10.4*
Upper quarter -2.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
White
Black
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 317 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 318 Thursday, March 13, 2008 1:21 PM
D-319
• • • •••
D Washington Dhe state administers the Washington Assessment of Student Learning(WASL) in grades 4 and 7 in reading and mathematics. Scores are availablefor Hispanic and Black students, but there are too few Black students in grades
4 and 7 and too few Hispanic students in grade 7 to provide reliable comparisons.Washington uses four achievement levels for reporting purposes: far belowexpectations, below expectations, met expectations, and above expectations. Trend graphsare not included because Washington did not participate in State NAEP in 2000, andbecause scores from 2000 are not available for this report, so no direct comparisonscould be made with scores from 2003. School-level assessment scores based on 9 orfewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 96 schools in grade 4 and 85 schools in grade 7, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard (met) isbetween the NAEP basic and proficient levels. This is also true for grade 7.
• Trends. No comparisons were possible for grades 4 and 7.• Gaps. There were insufficient data for comparing the NAEP and state assessment
measurement of the Black-White and poverty gaps in mathematics in grades 4 and7 in 2003. Overall, there were no significant differences between NAEP and thestate assessment in measurement of the Hispanic-White gap in mathematics ingrade 4 in 2003. There were insufficient data for comparing the NAEP and stateassessment measurement of the Hispanic-White gap in mathematics in grade 7 in2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 319 Thursday, March 13, 2008 1:21 PM
Achievement
D-320 National Assessment of Educational Progress
• • • •••
WASHINGTON
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8 (state 7th grade standards)
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 7Standard Correlation Standard error Correlation Standard errorBelow 0.65 0.043 0.73 0.020Met 0.69 0.019 0.69 0.026Above 0.57 0.007 0.66 0.026
••••••••••••••••••••••••••••••••••••••••
••••••••••••
•••••••••••
•••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
met
above
below
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••••••
••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
below
met
above
Chapter_D2.fm Page 320 Thursday, March 13, 2008 1:21 PM
WASHINGTON D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-321
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
— Not available.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified — 19.1 — 16.2
English language learner — 5.2 — 3.5Student with disability — 12.2 — 11.4Both — 1.7 — 1.2
Excluded — 3.2 — 2.0English language learner — 0.9 — 0.4Student with disability — 2.1 — 1.5Both — 0.2 — 0.2
Accommodated — 7.9 — 4.6English language learner — 1.2 — 0.4Student with disability — 5.6 — 3.9Both — 1.0 — 0.4
Chapter_D2.fm Page 321 Thursday, March 13, 2008 1:21 PM
Hispanic-White Gap
D-322 National Assessment of Educational Progress
• • • •••
WASHINGTON
Figure 2. Comparison of NAEP and state assessment Hispanic-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -0.2
Lower half -3.1
Upper half 2.6
Lower quarter -1.7
Middle half -3.7
Upper quarter 7.8
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Hispanic
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 322 Thursday, March 13, 2008 1:21 PM
D-323
• • • •••
D West Virginia Dest Virginia administers the Stanford Achievement Test, Ninth Edition(SAT-9) in grades 3-8 in reading and mathematics. However, the dataavailable in this report include only school-level scores which have been
designated as either elementary or middle school scores based upon state-reportedgrade span information. The data available in this report include only one combinedscore for reading and mathematics, which we have treated as reading data for thisreport. For this reason, neither state assessment mathematics data nor comparisonsbased upon the mathematics data are displayed here. Suppression information is notavailable.
Summary of Compar i sonsBecause 2003 state mathematics assessment data do not exist for West Virginia, nocomparisons to NAEP were possible.
W
Chapter_D2.fm Page 323 Thursday, March 13, 2008 1:21 PM
Achievement
D-324 National Assessment of Educational Progress
• • • •••
WEST VIRGINIA
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
•••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••
•••••••••••••••••
••••••••••••
••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
Chapter_D2.fm Page 324 Thursday, March 13, 2008 1:21 PM
WEST VIRGINIA D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-325
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 13.4 15.1 14.6 16.2
English language learner # 0.1 0.1 0.3Student with disability 13.2 14.6 14.3 15.7Both 0.2 0.3 0.1 0.2
Excluded 2.7 2.8 2.7 2.8English language learner # # 0.1 #Student with disability 2.6 2.8 2.6 2.7Both 0.2 # # #
Accommodated 8.0 9.1 7.7 8.5English language learner # # # #Student with disability 7.9 8.8 7.6 8.4Both 0.1 0.3 0.1 #
Chapter_D2.fm Page 325 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 326 Thursday, March 13, 2008 1:21 PM
D-327
• • • •••
D Wisconsin DThe state administers the Wisconsin Knowledge and Concepts Examination(WKCE) in grades 4 and 8 in reading and mathematics. Scores are availablefor Hispanic, Black, and economically disadvantaged students, but there are
too few Hispanic students in grades 4 and 8 and too few Black students in grade 8 toprovide reliable comparisons between these subgroups. Wisconsin uses fourachievement levels for reporting purposes: minimal performance, basic, proficient, andadvanced. Because new performance standards for the WKCE were set in 2003, scoresfrom 2003 and those from 2000 are not comparable; therefore, trend graphs are notincluded. School-level assessment scores based on 5 or fewer students are suppressed.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 127 schools in grade 4 and 103 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is between the NAEP basic and proficient levels. The state’s primarygrade 8 mathematics performance standard (proficient) is close to the NAEP basiclevel.
• Trends. No comparisons were possible for grades 4 and 8.• Gaps. Overall, there were no significant differences between NAEP and the state
assessment in measurement of the Black-White gap in mathematics in grade 4 in2003. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White gap in mathematics in grade 8 in 2003. Therewere insufficient data for comparing the NAEP and state assessment measurementof the Hispanic-White gap in mathematics in grades 4 and 8 in 2003. Overall, thepoverty gap in grade 4 in percent meeting the state’s standard in mathematics in2003 was greater when measured by NAEP compared to the state assessment.Overall, there were no significant differences between NAEP and the stateassessment in measurement of the poverty gap in mathematics in grade 8 in 2003.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 327 Thursday, March 13, 2008 1:21 PM
Achievement
D-328 National Assessment of Educational Progress
• • • •••
WISCONSIN
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorBasic 0.77 0.010 0.89 0.014Proficient 0.81 0.015 0.90 0.008Advanced 0.79 0.004 0.85 0.014
•••••••••••••••••••••••••••••••••••••••••
••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
basic
proficient
advanced
••••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••
•••••••••••••••••
••••••••••••••••••••••••
•••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0
001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
basic
proficient
advanced
Chapter_D2.fm Page 328 Thursday, March 13, 2008 1:21 PM
WISCONSIN D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-329
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 19.3 20.0 16.9 17.5
English language learner 4.5 5.4 1.6 2.3Student with disability 14.1 13.4 15.0 14.3Both 0.7 1.2 0.4 0.8
Excluded 4.8 3.6 4.2 3.0English language learner 0.4 0.6 0.5 0.4Student with disability 4.1 2.6 3.6 2.3Both 0.3 0.4 0.1 0.3
Accommodated 7.9 12.3 6.2 11.3English language learner 2.4 2.5 0.4 0.9Student with disability 5.1 9.1 5.6 10.0Both 0.4 0.7 0.2 0.4
Chapter_D2.fm Page 329 Thursday, March 13, 2008 1:21 PM
Black-White Gap
D-330 National Assessment of Educational Progress
• • • •••
WISCONSIN
Figure 2. Comparison of NAEP and state assessment Black-White achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -8.1
Lower half -7.8
Upper half -7.2
Lower quarter -13.0
Middle half -17.3*
Upper quarter -1.5
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
White
Black
0
-80
-60
-40
-20
0
20
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-80
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 330 Thursday, March 13, 2008 1:21 PM
WISCONSIN D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-331
• • • •••
Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -9.5*
Lower half -11.8*
Upper half -5.9
Lower quarter -18.3*
Middle half -6.8*
Upper quarter -9.1*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
Highest achieversHighest achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 331 Thursday, March 13, 2008 1:21 PM
D-332 National Assessment of Educational Progress
• • • •••
WISCONSIN
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -1.6
Lower half -6.6
Upper half 0.8
Lower quarter -3.0
Middle half -2.8
Upper quarter 5.6
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 332 Thursday, March 13, 2008 1:21 PM
D-333
• • • •••
D Wyoming Dhrough the Wyoming Comprehensive Assessment System (WyCAS), thestate administers criterion-referenced tests in grades 4 and 8 in reading andmathematics. Scores are available for Hispanic, Black, and economically
disadvantaged students, but there are too few Hispanic and Black students to providereliable comparisons. Wyoming uses four achievement levels for reporting purposes:novice, partially proficient, proficient, and advanced. Suppression information is notavailable.
Summary of Compar i sonsThe results of comparisons between NAEP and state assessment results, which for2003 are based on 145 schools in grade 4 and 74 schools in grade 8, are showngraphically on the following pages. A brief summary of the results follows:1
• Standards. The state’s primary grade 4 mathematics performance standard(proficient) is close to the NAEP proficient level. This is also true for grade 8.
• Trends. Between 2000 and 2003, the NAEP grades 4 and 8 gains in percentproficient are greater than the state assessment gains.
• Gaps. There were insufficient data for comparing the NAEP and state assessmentmeasurement of the Black-White and Hispanic-White gaps in mathematics ingrades 4 and 8 in 2003. Overall, the poverty gap in grades 4 in percent meeting thestate’s standard in mathematics in 2003 was greater when measured by NAEPcompared to the state assessment. By contrast, in grade 8, WyCAS found a largepoverty gap than NAEP did.
1. All statements of differences are based on statistical tests at the 5% significance level. However, theseresults must be considered in the context of the available data. NAEP and state assessments mayemploy different test items, testing accommodations, and scoring methods; and they may involvedifferent students in each school, at different times of the year, with different motivationalcharacteristics. At the present time, in spite of controlling for effects of school sampling, differences instandards, and NAEP exclusion rates, we cannot identify specific reasons for differences betweenNAEP and state assessment results.
T
Chapter_D2.fm Page 333 Thursday, March 13, 2008 1:21 PM
Achievement
D-334 National Assessment of Educational Progress
• • • •••
WYOMING
Figure 1. Distribution of grades 4 and 8 NAEP mathematics achievement scores: 2003
Grade 4
Grade 8
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 1. School-level correlations between NAEP and state assessment of percentages of students achieving state’s mathematics standards: 2003
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Grade 4 Grade 8Standard Correlation Standard error Correlation Standard errorPartially Proficient 0.68 0.041 0.74 0.037Proficient 0.64 0.018 0.74 0.023Advanced 0.38 0.033 0.63 0.028
•••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••••••••
••••••••••••••••••••••••••••
•••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basicNAEP proficient
NAEP advanced
proficient
advanced
partially proficient
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••
•••••••••••••••••••
••••••••••
•••••••••••••••••••••
••••••••••••••••••••••
••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••0001111122
0 50 100 150 200 250 300 350 400 450 500
NAEP Mathematics Scale
NAEP basic
NAEP proficientNAEP advanced
partially proficient
proficient
advanced
Chapter_D2.fm Page 334 Thursday, March 13, 2008 1:21 PM
WYOMING D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-335
• • • •••
Table 2. Percentages of English language learners and students with disabilities identified, excluded, and accommodated in the NAEP mathematics assessments, by grade: 2000 and 2003
# Rounds to zero.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2000 and 2003 Mathematics Assessments.
Figure 2. Comparison of NAEP and state assessment achievement changes in percent meeting mathematics standards, by grade: 2000 and 2003
Grade 4 Grade 8
* NAEP and state assessment 2000-2003 changes are significantly different (p<.05).
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Table 3. Percentage meeting standards as reported by state: 2000 and 2003
SOURCE: Wyoming Department of Education site at https://wdesecure.k12.wy.us/stats/wde.esc.show_menu.
Grade 4 Grade 8Students 2000 2003 2000 2003Identified 15.3 17.6 12.9 16.3
English language learner 1.4 2.7 1.1 1.7Student with disability 13.2 13.3 11.4 13.3Both 0.7 1.6 0.4 1.3
Excluded 1.9 1.1 1.0 1.2English language learner # # # 0.1Student with disability 1.9 1.0 1.0 0.7Both # 0.1 # 0.3
Accommodated 5.8 10.8 3.0 9.5English language learner 0.1 0.2 # 0.2Student with disability 5.7 9.6 3.0 8.6Both # 1.0 # 0.6
Level 2000 2003Grade 4 27.0 37.0Grade 8 32.0 35.0
60
80
26
42
5
9
6071
2636
58
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
partiallyproficient
proficient
advanced
*
*
69
77
32
41
9
12
6971
3235
911
2000 20030
20
40
60
80
100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Year
State
NAEP
partiallyproficient
proficient
advanced
*
*
Chapter_D2.fm Page 335 Thursday, March 13, 2008 1:21 PM
Poverty Gap
D-336 National Assessment of Educational Progress
• • • •••
WYOMING
Figure 3. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 4 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall -4.8*
Lower half -2.3
Upper half -7.3*
Lower quarter -2.2
Middle half -3.5*
Upper quarter -6.4*
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 336 Thursday, March 13, 2008 1:21 PM
WYOMING D
Comparison between NAEP and State Mathematics Assessment Results: 2003 D-337
• • • •••
Figure 4. Comparison of NAEP and state assessment poverty achievement gaps in percent meeting grade 8 mathematics standards: 2003
State NAEP
Gap comparison
* NAEP–State gap difference significantly different from zero (p<.05).
NOTE: The poverty gap refers to the difference in achievement between economically disadvantaged studentsand other students, where disadvantaged students are defined as those eligible for free/reduced-price lunch.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statis-tics, National Assessment of Educational Progress (NAEP), 2003 Mathematics Assessment: Full population esti-mates. The National Longitudinal School-Level State Assessment Score Database (NLSLSASD) 2004.
Population
AverageNAEP-state gap
differenceOverall 4.6*
Lower half 7.5*
Upper half 2.3
Lower quarter 6.2*
Middle half 4.8*
Upper quarter 1.2
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
s
Percentile in group
Not disadvantaged
Disadvantaged
0
Lowest
achievers
Median Highest
achievers
0
20
40
60
80
100
0 10 20 30 40 50 60 70 80 90 100
Perc
ent
mee
ting
stat
e's
prim
ary
stan
dard
sPercentile in group
Not disadvantaged
Disadvantaged
0
-60
-40
-20
0
20
40
0 10 20 30 40 50 60 70 80 90 100
Gap
in p
erce
nt m
eetin
g pr
imar
y st
anda
rds
Percentile in group
-60
Lowest
achievers
Median Highest
achievers
State
NAEP
Chapter_D2.fm Page 337 Thursday, March 13, 2008 1:21 PM
Chapter_D2.fm Page 338 Thursday, March 13, 2008 1:21 PM
Cover_back_v1.fm Page 1 Wednesday, March 12, 2008 5:24 PM
Cover_back_v1.fm Page 2 Wednesday, March 12, 2008 5:24 PM