1. ValidityDifferent Curricular AimsInterpretation of CurriculumLevel of RigorPopulation of Subgroup VariancesDifferences in Content Standards

2. Validity0Administration Specialists from NAEP Sample PopulationModifications only if available 3. Validity 0Timing0School Culture 4. Validity 0Consequences NO RewardsNO SanctionsSURVEY Of Achievement and Growth 5. Scoring BAdministration Sampling0C0A 6. Reliability0Scoring Procedures 0 Scoring Staff 0 Scoring System0 Scoring Procedures 7. ReliabilityMultiple Choice-Computer ScannedConstructed ResponseDichotomously Scored Items Polytomously Scored ItemsItem Blocking 8. Reliability Constructed Response0Re-Scoring 0Current Year 0Previous Assessment0Back reading and Trend Scoring 9. Reliability Dichotomously Score ItemsScored either Correct or Incorrect May be multiple Choice or Constructed Response 10. Reliability Polytomously Scored ItemsMore than Two Possible Ways to Score 11. ReliabilityItem Blocking