Before we begin, please make yourself comfortable and complete the STAR Pre-Test Quiz

Before we begin, Before we begin, please make yourself please make yourself

comfortable and comfortable and complete the complete the

STAR Pre-Test QuizSTAR Pre-Test Quiz

Standardized Testing and Standardized Testing and Reporting (STAR) ProgramReporting (STAR) Program

Pre-Test Workshop Pre-Test Workshop

January 2013

ObjectivesObjectives

STAR coordinators will:

• Follow current STAR procedures properly.

• Ensure all materials are handled securely and appropriately.

• Train site coordinators to conduct testing consistently.

Handout (H) Page 12013 STAR Pre-Test Workshop || Slide 3

AgendaAgenda

• Introductions• Objectives and agenda• New for STAR 2013• STAR coordinator responsibilities• Writing tests• Multiple-choice tests• California Standards Tests (CSTs)

BREAK

2013 STAR Pre-Test Workshop || Slide 4 H 1

Agenda (after break)Agenda (after break)

• California Modified Assessment (CMA) • Standards-based Tests in Spanish (STS)• California Alternate Performance

Assessment (CAPA)• After testing• Expedited return of results• Summary• Early Assessment Program (EAP) tests

2013 STAR Pre-Test Workshop || Slide 5 H 1

NEW FOR STAR 2013NEW FOR STAR 2013

2013 STAR Pre-Test Workshop || Slide 6

New for STAR 2013New for STAR 2013

• Emphasis on heightened security New security affidavit

• New and updated videos• Answer docs:

No CBEDS (section 14), collected in CALPADS

No ASAM No SEID English-learner program

participation (section 17) definitions changes

CAPA Section A1 added

• STS for dual immersion• Expedited return of results


Coordinator Manual (M) Pages 2, 116

H 1

DISTRICT AND SITE DISTRICT AND SITE COORDINATOR COORDINATOR RESPONSIBILITIESRESPONSIBILITIES


District Coordinators’ District Coordinators’ ResponsibilitiesResponsibilities

• #1 Responsibility—SecurityNo unauthorized electronic devices used

in classroom during testing For testing purposes, any electronic device

that is not specifically designated as an accommodation or modification in the student’s IEP or Section 504 plan is unauthorized.

Security audits to occur


Q 1

H 2

M 10, 30

Security AuditsSecurity Audits• At randomly selected schools and district offices

• Before, during, or after testing

• Are materials secure, accounted for, and locked up when not in use?

• Are correct administrative procedures being followed? For example: Instructional materials have been removed or

covered.Students are not being coached through the exams.Only appropriate accommodations and/or

modifications are being provided, et. al.No unauthorized electronic devices are being used.


District Coordinators’ District Coordinators’ ResponsibilitiesResponsibilities

• #2 Responsibility—Train Coordinators:Emphasis on heightened securityNew and updated videosAdditions to DFAsRoom sign with reminder of no

electronic devices To be posted in clear view of students Included in District Coordinator kit Available on startest.org Can be photocopied


H 2

M 30


VideoVideo

• Site Coordinator video, General, first part about security only


STAR Site Coordinator STAR Site Coordinator ResponsibilitiesResponsibilities

• Train examiners.• Ensure examiners READ and sign affidavits.

Coordinator retains.• Prevent errors.• Secure test materials.• Verify materials are marked

correctly to ensure correctstudent scores.

• Guarantee correct enrollment counts.• Return materials promptly.


M 48

H 2

Site Coordinators: Train ExaminersSite Coordinators: Train Examiners

• READ and sign affidavits.• Emphasize NO unauthorized electronic devices.• MAKE SURE CORRECT TESTS ARE GIVEN.• Students who are not testing may not stay in the

classroom where a test is being administered.• If students need to be taken to another room to

finish testing, BE SURE THEY ARE ESCORTED BY SCHOOL DISTRICT STAFF. Do not allow students to walk to another room with test materials by themselves.


H 2

M 50−52

Site Coordinators Site Coordinators Train Examiners (cont.)Train Examiners (cont.)

• Examiners CANNOT: Review test questions before, during, or after

testing.Check students’ answers including (but not

limited to):1. Advise students of wrong answer or to check an answer;

or

2. Withhold answer docs until students demonstrate they have the right answers.

H 2 2013 STAR Pre-Test Workshop || Slide 16

M 50−52


Examiners shall monitor students throughout testing to make sure students are:

On correct part Not going on to other parts or back to a

previously completed partNot skipping a question on their answer

document (so that they are off by one or more)Not using unauthorized electronic devices during

testing session


M 50−52


• Examiners shall ensure there is enough time to complete a part before beginning the part.


Training tips

H 2

OtherOther District STAR CoordinatorDistrict STAR CoordinatorResponsibilitiesResponsibilities

• Receive, count, store, distribute, track, collect, count and return materials.

• Coordinate testing schedule.• Coordinate collection of

demographic data.Pre-ID (preferred)Or hand-mark answer

documentsComplete the Demographic

Fields Form (if needed)

M 9, 20, 28−31


WRITING TESTSWRITING TESTS


Writing TestsWriting Tests

• Writing tests are required.CST and CMAGrades 4 and 7

• Examiners need to ensurecorrect test (CST or CMA) given.Check IEPs to determine

whether CST or CMA.See bottom of

response booklet and DFA.

H 3

M 32–36, 53–58


Writing TestsWriting Tests• When in 2013?

March 5(makeup March 6)

May 7(makeup May 8)Only if not in session March 5


M 6

Before Writing Essay:Before Writing Essay:Section 1Section 1

• All students must complete, even if Pre-ID was used.


After Writing TestAfter Writing Test

If the student used a word processor:• Mark Section A3, “Accommodations and

Modifications,” D or T. If A3 is not marked, the test will not be scored

• Print out pages and write name of student, school, and district on back of each page.

• Place print-out inside Writing Response Booklet.

• Return with scorables.


H 3

M 35–36, 57–58Q 2

After Writing Test (cont.)After Writing Test (cont.)

If a student with an accommodation, wrote response on loose-leaf paper or in large print or in braille document:•Essay must be transcribed into Writing Response booklet or it will not be scored.•Mark A3, Accommodations.

B if student wrote on separate paperG if student used brailleH if student used large print


After Writing Test (cont.)After Writing Test (cont.)

• Return all materials with either the scorables (if student given test) or nonscorables (if student not given test).

• Return by:Sites: 1 day after testingDistricts: 2 days after testing

M 35–36, 57–58


MULTIPLE-CHOICE TESTSMULTIPLE-CHOICE TESTS


STAR Program Multiple-Choice TestsSTAR Program Multiple-Choice Tests• CSTs

All students take CSTs unless taking CMA or CAPAGrades 2–11

• CMAGrades 3–11; varies by grade and content areaMust have IEP and meet eligibility criteria

• STSFor Spanish-speaking English-learners and for English-

speaking Spanish-learners (purchased separately)Grades 2–11 MUST also take CST and/or CMA


M 3

Before Multiple-Choice TestingBefore Multiple-Choice Testing

• Receive boxes:All boxes may not come in single delivery. Before signing receipt, check number of boxes.

• Prep answer documents:2013 onlyNo copyingProvide examiners with information about

which demographics are to be completed.Ensure correct NPS code.


H 4

Before Multiple-Choice Testing (Cont’d)Before Multiple-Choice Testing (Cont’d)

• Confirm which tests each student takes.

• Confirm any accommodations or modifications students will use and where they will be tested.

• Prepare materials:Test bookletsNo. 2 pencilsScratch paperRulers, if required (used with regular-print

booklets only)Signs


During Multiple-Choice TestingDuring Multiple-Choice Testing

• Monitor for use of unauthorized electronic devices.

• Give correct test booklets and answer documents to students whose names are on answer documents.

• Make sure students are taking the correct test and marking answers in the correct section of the answer document.

• Ensure students complete all parts of each test.


H 5

During Multiple-Choice Testing During Multiple-Choice Testing (cont.)(cont.)

• Give breaks only at end of a part as indicated by stop sign.

• Mark answer documents:Correctly mark test name

Note: if the test name is not marked, the test will not be scored. Tests that are hand scored in the fall do not go into API/AYP.

Correctly mark version #


H 5

At Start of Testing: Section 1At Start of Testing: Section 1

• All students must complete, even if Pre-ID was used.

• At start of end-of-course testing, mark EOC test name:



• Use Directions for Administration (DFAs) correctly. Read ALL “SAY” boxes

exactly as written. Be sure to read and complete

“First Day of Testing” section with students.

ONLY translate boxes with “T” (NO CST/CMA/STS questions, prompts, or passages may be translated).

Grades 9−11 are in single DFAfor each test: CST, CMA, STS.


H 5


• Schedule breaks Ensure there is enough time to

complete a part before beginning the part.

See DFA for more information on breaks.


CALIFORNIA STANDARDS CALIFORNIA STANDARDS TESTS (CSTs)TESTS (CSTs)


California Standards Tests California Standards Tests (CSTs)(CSTs)

• Grades 2–11• Unless taking CMA or CAPA• Subjects tested:

English–Language Arts (ELA): all grades;writing for grades 4 and 7

Mathematics: grades 2–7 and end-of-course (EOC) grades 7–11

Note: Rulers used for grade 2 CST only

Science: grades 5, 8, 10, and EOC 9–11History–Social Science: grades 8, 11, and EOC 9–11


M 37–40, 59–62

H 6

Who Takes Which CST for Mathematics?Who Takes Which CST for Mathematics?

• Grades 2–6: Grade-level test requiredNote: Rulers used for grade 2 CST ONLY

• Grade 7: Grade-level mathematics test or Algebra I required


H 6

M 14–17, 84

• Grade 8: One of the following is required:CST for General Mathematics (if no math

course or completing a course for which there is not an EOC mathematics CST); or

Algebra I; orGeometry; orAlgebra II; orIntegrated Math 1, 2, or 3


H 6

M 14–17, 84Q 5Who Takes Which CST for Mathematics?Who Takes Which CST for Mathematics?

Q 3, 4• Grade 9: One of the following is required:

CST for General Mathematics (if no math course or completing a course for which there is not an EOC mathematics CST); or

EOC mathematics CST; orCST for Summative High School Mathematics

• Grades 10–11: One of the following is required:EOC mathematics CST; orCST for Summative High School MathematicsNo assessment required if not taking a mathematics

course UNLESS eligible to take Summative High School Mathematics


H 6

M 14–17, 84

Who Takes Which CST for Mathematics?Who Takes Which CST for Mathematics?

Summative High School MathematicsSummative High School Mathematics

• Students in grades 9–11 will take the CST for Summative High School Mathematics based on:Completion of Algebra I, Geometry, AND

Algebra II courses in previous years; orCompletion of course aligned with Integrated

Math 3 blueprint in a previous year; orPreviously took the CST for Summative High

School Mathematics.


M 14−17

H 6

Q 3

Mark Correct Mathematics Test Taken . . . Mark Correct Mathematics Test Taken . . .

. . . or student will not receive a SCORE.Also include correct version number.


VideoVideo

• Site Coordinator video, CST HS video through math only


CST for ScienceCST for Science

• Required grade-level scienceGrades 5, 8, 10: all students shall take the

grade-level test.Found in grade-level test booklets: no need to

order separately.Students in grade 10 shall also take an end-of-

course science test: If enrolled in standards-based science course EOC test booklets must be ordered separately


H 6

M 15, 18

CST for ScienceCST for Science

• Grades 9–11 EOCCompleted an applicable science

course in the 2012 summer session or will complete it during 2012–13 school year: Review state blueprints. Review curriculum. Determine which, if any, EOC science

CST students in each course will take.

Mark correct EOC test and version number on the answer document.


H 6

M 15, 18, 85

CST for History-Social ScienceCST for History-Social Science

• Grades 8, 11 required

• EOC World History, grades 9−11Students in grade 11 who are

completing a world history course will take BOTH the U.S. History test AND the EOC CST for World History.


M 19, 85

BREAKBREAK


CALIFORNIA MODIFIED CALIFORNIA MODIFIED ASSESSMENT (CMA)ASSESSMENT (CMA)


CMA Participation CriteriaCMA Participation Criteria

• Have an IEP• Meet the SBE-adopted eligibility criteria• Previously took CST and scored below basic

or far below basic• Previously took CAPA and scored proficient

or advanced in previous 2 years• See full participation criteria:

STAR District and Test Site Coordinator Manualhttp://www.cde.ca.gov/ta/tg/sr/participcriteria.asp


H 7

M 13, 15, 17–18, 74–75, 85

CMA Participation Criteria CMA Participation Criteria (cont.)(cont.)

• ANNUALLY, IEP specifies: Whether the student takes the CMA or the CST

with appropriate accommodations and/or modifications, regardless of previous CMA performance levels

CMA subject(s)Variations and/or accommodations

• Examiners should check the student’s IEP to see whether and which CMA test the student should take.


H 7

M 13, 15, 17–18, 74–75, 85

CMA ParticipationCMA Participation

• No additional modifications are allowed.If modifications needed, student should

take CST with modifications.

• Enrolled in grades 3–11.

• May take the CMA for some subjects, CST for other subjects.

• Must take grade-level CSTs when a CMA is not offered.


H 7

M 13, 15, 17–18, 74–75, 85

CMA Tests for 2013CMA Tests for 2013• CMA for ELA in grades 3–11

CMA for Writing in grades 4 and 7• CMA for Mathematics in grades 3–7• CMA for Algebra I (EOC for grades 7–11)• CMA for Geometry (EOC for grades 8–11)

Note: If CMA students in grades 8 or 9 are NOT taking Algebra I or Geometry, the IEP should designate the appropriate CST math test accordingly. There is no CMA for General Mathematics.

• CMA for Science in grades 5 and 8• CMA for Life Science in grade 10

*Required History–Social Science for grades 8 and 11 MUST be taken with CST.


H 8

Q 4 M 13, 15, 17–18, 74–75, 85

2013 CMA Materials for Grades 3−72013 CMA Materials for Grades 3−7

• CMA booklets for grade 3:Separate scorable test booklet If no CST taken, return CST test booklet with

nonscorables.

• CMA for grades 4–7:CST and CMA in same answer documentGrade 5 ONLY allows calculator

(if written into the IEP).

• If both CST and CMA taken, must mark Section 7c for CMA tests taken.


M 37–39

2013 CMA Materials for Grades 8−112013 CMA Materials for Grades 8−11

• CMA for grades 8 and 11Must order both CST and CMA grade-level test booklets

for each student taking one or more CMA exams. All students MUST take the CST History–Social

Science in grade 8 and U.S. History in grade 11.

• CMA for grades 9 and 10Order the grade-level CMA test booklets for only the

CMA tests to be administered. Order CST only if needed. Students in grades 9 and 10 may take only CMA (ELA,

Algebra I, Geometry, grade 10 Life Science).


2013 CMA Materials for Grades 8−11 2013 CMA Materials for Grades 8−11 (cont.)(cont.)

• Answer docs separate from CSTs

• If Pre-ID’d:For grades 8–11, if at least one CMA test is pre-

identified for a student, the student will receive both the CMA and the CST pre-identified answer documents.

Return only used answer documents for scoring.

• If NOT Pre-ID’d:Answer documents sent based on test booklets

ordered.

M 20–21, 37–39


CST/CMA Answer DocumentCST/CMA Answer DocumentRight side of inside of answer doc grades 4−7

CMA section has:

• Different subject icons from CST

• Alternate row shading for the response bubbles

• Three options choices

• Fewer number of questions

H 9

M 129


CMA Grade 7 Answer DocumentCMA Grade 7 Answer DocumentMathematics SectionMathematics Section

• Grade 7 mathematics and Algebra I have different numbers of questions


VideoVideo

• CMA 7-11 Video


STANDARDS-BASED TESTS STANDARDS-BASED TESTS IN SPANISH (STS)IN SPANISH (STS)


Who Takes the STS?Who Takes the STS?

• Required for Spanish-speaking English learners (ELs), grades 2–11, who either:Receive instruction in Spanish

regardless of the length of time they have been enrolled in schools in the U.S. or one of its territories; or

Have been enrolled in a school in the U.S. or one of its territories less than 12 cumulative months.

H 10

M 14–15


Who Takes the STS?Who Takes the STS?

• As an option, districts may also test Spanish-speaking ELs in grades 2–11 who are not receiving instruction in Spanish.


H 10

M 14–15

Other STS StipulationsOther STS Stipulations

• Students taking the STS must also take CSTs or the CMA.

• Students who take CAPA do NOT take STS.


2013 STS Materials2013 STS Materials

• STS for Reading/Language Arts (RLA) in grades 2–11

• STS for Mathematics in grades 2–7 Rulers for grades 2 and 5

• STS for Algebra I (EOC for grades 7–11)

• STS for Geometry (EOC for grades 8–11)Students in grades 8 and 9 who are not taking Algebra I

or Geometry courses take NO STS mathematics, but do take the appropriate CST end-of-course mathematics test.


H 10

M 14-15Q 5

VideoVideo

• Site Coordinator video, STS Elementary


CALIFORNIA ALTERNATE CALIFORNIA ALTERNATE PERFORMANCE ASSESSMENT PERFORMANCE ASSESSMENT (CAPA)(CAPA)


CAPACAPA

• Performance-based, one-on-one test

• For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations

• Student must have an IEP

• IEP specifies CAPA and level

• Do not take STS


M 13, 15

H 11

CAPA Answer DocumentCAPA Answer Document

• Use only 2013 answer document.

• Ensure correct CAPA Levelis marked in 7a.

• Level I only can have 5 as a score.


M 13, 15

H 11

CAPA ObserversCAPA Observers

• Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS).

• Double ratings are randomly selected.• Observers must mark Observer and BOTH

examiners and observers must sign their separate answer documents.


M 49–50, 140Q 6

H 11

Preparing To Administer the CAPAPreparing To Administer the CAPAObserver’s Answer DocObserver’s Answer Doc

1 – Name, etc.3 – Date of Birth5 – Name6 – Gender7a – CAPA Level7b – Grade11 – Student ID12a – SSID

Use blank from overage.Use blank from overage.Observers must mark Observers must mark

sectionssections


VideoVideo

• Site Coordinator video, CAPA


AFTER TESTINGAFTER TESTING


After TestingAfter Testing

• PaperworkComplete back of answer document.Transcribe voided answer documents.Complete SGID.Complete Master File.

• Pack: scorables vs. nonscorablesAttach correct shipping labels.


After TestingAfter TestingAnswer DocumentsAnswer Documents

• Train examiners to:Erase NOTHING in answer circles.


After TestingAfter TestingAnswer Documents (cont.)Answer Documents (cont.)

• Avoid teaching students in second and third grade to mark through answer circles to eliminate answers. Such marks MAY NOT be erased by adults.


After TestingAfter TestingComplete Back of Answer DocumentComplete Back of Answer Document

• A1 DO NOT complete without CDE notification

• A2 Special Conditions

• A3 Accommodations and ModificationsPart a: mark “IEP” and/or “Section 504 plan” to

indicate which program/plan student has, WHETHER USED ACCOMMODATIONS OR MODIFICATIONS OR NOT. Note: IEP is required to take CMA, CAPA.

Part b, mark codes for all accommodations student used as specified in IEP and/or 504 plan.

• A4 English Learner Test Variations For each test, what was actually used


M 41, 134, Inside back

cover

16a—Disability Code16a—Disability Code

• If not in Pre-ID, mark after testing.• For CST and STS:

Mark “000” if no IEP; orDisability Code from IEP.

• For CMA and CAPA:Disability code is

REQUIRED.“000” not valid

for CMA or CAPA.Also, be sure to mark the “IEP” or

“504 Plan” circle in section A3a even if the student does not use any accommodations or modifications.


M 120–21

H 12

Q 7

CAUTIONCAUTION

• If no disability is marked, but CMA answer circles have marks,

Or CAPA answer doc is completed:Disability defaults to “unknown.”Must be corrected during Demographic Data

Corrections or not counted as participating in API/AYP.


Q 7

H 12

• Transcribe Braille and large print (or not processed)

In Section A3 on the back of the answer document mark “G” or “H.”

Damaged answer documents

Write VOID onfront of answer document(s) and return with nonscorables.

H 13

After TestingAfter Testing


School and Grade Identification Sheet School and Grade Identification Sheet (SGID)(SGID)

• Complete for each set of answer documents or test booklets.

• Check counts to be accurate; include docs of students not tested with reason why in A2.

• Place on answer documents for correct: Grade School Processing stops

if not correct.


M 25, 92Q 8, 10

H 14

Pre-printed

SGID (cont.)SGID (cont.)• Make sure the REQUIRED fields are completed to ensure

accurate processing.TestGrade

Mark only one For CST/CMA, STS only

Number of documentsTest start date=first day of testing within window

Used by CDE accountability officeSchool code

NOT pre-slugged For home/hospital or independent study, enter 7-digit

district code


H 14

After TestingAfter TestingMaster File SheetsMaster File Sheets

• Return for each school and district.• Check counts of answer docs and SGIDs to

be accurate.• Required with scorables if materials were

ordered:Write “0” (zero), no

blanks, for each item ordered.

If not tested, note that school did not test.


M 67, 94Q 9, 10

H 15

Home/Hospital/Independent Home/Hospital/Independent Study Study

• On answer document, A3, mark as accommodation “M” if home/hospital.

• On SGID enter correct home hospital/independent study school code = same as 7-digit county district code.

• If test booklets/answer documents ordered, but those with that school code did not test, must return Master File Sheet with zeros next to each unused, ordered item.


H 15

Nonpublic School Answer Nonpublic School Answer DocumentsDocuments

• Put on answer doc each NPS unique school code.

• Put under SGID with 0000001 school code.

• Return with district materials.


M 26, 41–42

After TestingAfter TestingWhich Answer Documents to ReturnWhich Answer Documents to Return

• Return answer documents for students with special conditions identified in Section A2.

• Must return CST and/or CMA answer documents only if test taken.Students taking CMA in grades 8 or 11 must return

CST answer document.

• If no CST, CMA, CAPA, or STS test taken, securely destroy Pre-ID answer documents.


After Testing: What to ReturnAfter Testing: What to Return


• All students enrolled on the first day of testing must return an answer document.

• Must return the secure CST and STS DFAs for grade 2 with nonscorables.

• Return used grades 2 and 3 test booklets with scorables.

• Must return all CAPA Examiner’s Manuals with nonscorables.

• Must return all grade 4−11 complete test booklets and unused grades 2, 3 test booklets with nonscorables. If only cover or part returned, considered security breach.

After Testing: Pack and ReturnAfter Testing: Pack and Return

• Return all documents within an administration in same shipment.

• Separate scorables (with SGID) from nonscorables: make sure grade on answer documents matches grade on SGID.


M 35, 41, 46

Late Material ReturnLate Material Return

• Contact STAR TAC.• Indicate school and district with

returns.• If late scorables: Depending on stage

of processing at scoring center, there may be a fee to process.

• Late returns are considered a security breach.


EXPEDITED RETURN OF EXPEDITED RETURN OF RESULTSRESULTS


Expedited Return of Expedited Return of CST & CMA ResultsCST & CMA Results

• Results available within 2–3 weeks of receipt of materials at scoring centerQC process for early tests before results release.

• Scorable materials must be complete and include all information, including accurate SGID.

• Downloadable file from STAR Management System:Receive an e-mail notification of a link to a data

file.File will include only a subset of fields.Use with caution: final results subject to change.


Q 10

SUMMARY & QUIZSUMMARY & QUIZ


SummarySummary

• What’s New?• Responsibilities,

including security & training

• Writing tests• Multiple-choice

tests

• CSTs• CMA• STS• CAPA• After testing• Expedited return of

results


Quiz AnswersQuiz Answers

1. D

2. A

3. C

4. C

5. A

6. D

7. C

8. B

9. B

10.B


For more information, go to:For more information, go to:

• http://www.cde.ca.gov/ta/tg/sr/

• http://www.startest.org/

• Or call the STAR Technical Assistance Center at 800-955-2954


EARLY ASSESSMENT EARLY ASSESSMENT PROGRAM (EAP)PROGRAM (EAP)

Next…


Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2012 Educational Testing Service. All rights reserved.

2013 EAP Updates

04/19/23

• Security is Important– Only staff administering the tests should have access to

them.– Students must return all essay topic booklets and they must

be returned.– No electronic devices during testing

• EAP Information– www.calstate.edu/eap– www.csusuccess.org

95

Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2012 Educational Testing Service. All rights reserved. 04/19/2396