2008 MAP Test Coordinator’s Manual (TCM)

1

Test Coordinator’s Manual

2008Produced by the Department of Elementary and Secondary Education

in collaboration with CTB/McGraw-Hill and STL RIFs

2

2008 MAP Test Coordinator’s Manual (TCM)

The TCM is primarily focused on the responsibilities of:

District Test Coordinators (DTC) School Test Coordinators (STC)

The TCM also contains: An Overview Timelines A Glossary of Terms

3

Missouri Assessment Program

MAP 2008

Communication Arts…….Grades 3-8 & 11Math………………...........Grades 3-8 & 10Science…………………...Grades 5, 8 & 11

4

Dates to Remember:Arrival of Materials

Feb. 20-27, 2008…………..Test Coordinator packages to district

March 3-14, 2008………….Test Materials arrive in districts

Testing WindowMarch 31-April 25, 2008…. Administer Assessments

Testing MaterialsApril 11, 2008………………Deadline for ordering additional

testing materials without incurring additional shipping cost

NOTE: If testing materials are ordered after April 11, the district will be responsible for paying the shipping

costs.

April 21, 2008………………Final deadline for ordering additional testing materials

5

Dates to Remember:Return of Materials

April 28, 2008………………Deadline to contact CTB/McGraw-Hill for pickup of testing materials

May 1, 2008………………..Deadline for testing materials to be picked up by CTB’s transportation vendor

Test ResultsAugust-October 2008……..Reports shipped to

districts

6

DTC’s Responsibilities:Checks, reviews and distributes testing

materials to the STCTrains STC on MAP processesAssumes STC role when necessary Guarantees security for all testing materialsCommunicator between district and CTB

(MAP Service Line 1-800-544-9868) Collects and returns all testing materials to

CTB/McGraw-Hill

7

STC’s ResponsibilitiesReceives and checks all testing materials from

the DTCAssumes DTC role when necessary Guarantees security of all testing materialsDisseminates Examiner’s ManualsTrains all ExaminersChecks Group Information Sheets (GIS)Completes School/Group ListsCollects all testing materials after testing, checks

and organizes materials for return to the DTC

8

Examiner’s Responsibility

• Examiner responsibilities are addressed in the 2008 MAP Test Examiner’s Manual provided for each grade 3-8, 10 and 11.

9

• 2008 MAP includes all required tests, bound together in one book: – Communication Art – Mathematics– Science

• Organized in this order

• Content area labels are not required.

• Scorable and unused test materials MUST be boxed separately.

• High School Test Booklets are still individual content areas:– Math Grade 10– Comm. Arts Grade 11– Science Grade 11

Summary of 2008 Changes (p. 2)

10

• A Missing Test Materials Form is used to notify CTB of contaminated and/or destroyed test books.

• Form included in the Test Coordinator’s Kit.

• Voluntary Social Studies assessment will not be offered in 2008.

• In 2009-2010 Government and American History required EOC Assessments.

• Field test items are embedded throughout the operational form of the MAP this year.

Changes (cont.)

11

• A single School/Group List for all books is being used this year.

• One Group Information Sheet (GIS) per grades 3 -10

• Two GIS for 11th grade: – One GIS for C.A.; &

– One GIS for Science.

Changes (cont.)

12

• Changes in STC’s responsibilities now include:

– Packing test materials in the return, shipping boxes; and

– Affixing the return, shipping labels.

• Test materials are now required to be shipped in GREEN shaded boxes provided by CTB/McGraw-Hill.

IF THENMore boxes are needed -- The DTC will order them.

Boxes are used other than those provided by CTB/McGraw-Hill --

Green stock labels, which are included in the Test Coordinator’s Kit, must be affixed to them.

Changes (cont.)

13

• After testing, the STC should collect and securely destroy all Examiner’s Manuals.

• A 5% overage of test books is included in each school’s shipment.

• Plus, a 5% overage is also sent to the DTC.

• Front cover of the test book has a new line for district and school name. This information is needed on books without pre-code labels.

• The Test Book Accountability Form replaces the Security Barcode Verification Form.

Changes (cont.)

14

• Neither an SIS nor a blank test book will be returned for students taking the MAP-Alternate Assessment (MAP-A).

• A new bubble was added for the Blind/Visually Impaired student who does not read Braille:

04 Oral Reading – Blind/Partial Sight.

Changes (cont.)

15

NCLB requires all eligible Missouri students to take the MAP test.

Only two groups are exempt:

Group 1: MAP-Alternate (MAP-A)

Group 2: ELL students in the United States, 12 months or fewer, may be

exempt from taking only the Communication Arts test.

Guidelines for Testing (p3)

16

The following are examples of special populations:• IEP students

– The IEP team determines the individual accommodations for students

– Any accommodation should be bubbled on SIS

• Individual Accommodation Program (IAP 504) students

– IAP 504 students can receive the same accommodations as IEP students

– Any accommodation should be bubbled on SIS


17

Students Testing Out-of-District:

• The DTC (where the student is enrolled) delivers the testing materials to the serving districts/agencies

• After testing, the completed materials are returned back to the DTC

• A GIS must be completed and placed with the book(s) to determines where students’ results will be reported


18

Homebound Students:• Must take the test if they are receiving

homebound services

• Must have test administered by a trained Examiner who guarantees the security of testing materials

• May be tested either at home or school


19

Homeschool Students:• May take part in the MAP with the local district at

the district’s discretion

• Must test if enrolled in a MAP content area

• Must test at local school

• Each homeschooled student will have their own GIS

• Should not be in core data and will not have bar code label


20

Missouri Virtual Instruction Program (MoVIP)

• Only non-public school students will be taking the MAP at designated testing centers across the state.


21

Student Make-up Sessions:

IF THEN

Absent during one or more sessions --

Schedule make-up session(s)

Student is unable to test during make-up session --

Follow Student Absences Procedure


22

Student Absences

1. Write student’s name on front of the unused test book

2. Affix student barcode label if accurate

3. Complete SIS if student barcode label is inaccurate

4. Code SIS for absences

5. Return test book with scorable books


23

Large Print/Braille Procedures: Must be transcribed to a “Form A” regular

edition test book to receive score

Large Print and Braille editions must be labeled, “Contents transcribed to a regular test book -- DO NOT SCORE”

Must return Large Print and Braille editions with the unused testing materials

See Braille Omit Return Instruction Sheet for specifics on handling and packaging


24

Translators:For Mathematics and Science MAP Assessments only:

Tests can be read to students in their native language

ELL students can use their native language to give oral or written responses to assessment items

ELL students’ responses must be translated into English and scribed verbatim into a regular test book

Translators must be trained in administering the MAP

Translators can review tests before administering the test in a secure environment

Translators must guarantee security of MAP testing materials

ELL accommodation codes apply (see Examiner’s Manual codes).

Guidelines for Testing (cont.)

25

Invalidations

• Three categories for test invalidation:– Student discovered cheating

– Examiner paraphrased test questions in any content area

– Examiner reads any part of the Communication Arts test to student(s) other than students who are Blind/Visually impaired who do not read Braille

.


26

Invalidation Procedures:The STC must:• Be in agreement with Examiner regarding the test

invalidation• Complete the Teacher Invalidation grid on the SIS• Provide demographic information to the DTC• Include invalidated test materials with the scorable

testing materials

The DTC must:• DTC sends written communication to the Director of

Assessment at DESE and a copy to Director of Accountability, Data and Accreditation. Also retain a copy in district files.


27

Test Coordinators Roles pp 7-8

Check lists for DTC and STC:

• Convenient check lists are provided to the DTC and STC on pages 7 and 8 of the TCM

• DTC and STC must ensure all functions are completed

• DTC and STC share responsibilities for both check lists if either are not available to fulfill their duties

28

Test Coordinators Roles (p 9)Student Barcode Labels:

• Student barcode labels are in the Test Coordinator’s Kit

• Student barcode labels include:– Information from MOSIS Phase III (pre-code system)– Demographic information (but not all biographical data) from

the pre-code file

• CTB-McGraw-Hill prints and provides:• One biographical master label• Two student barcode labels

• DTC and STC do the following:– Check student barcode label against the student pre-code roster for

accuracy– Determine accuracy of labels– Handle exceptions appropriately

29

30

Error in:

Student Name, Birth Date,

Gender, Race/Ethnicity, and

MOSIS ID

Handling Student Barcode Labels

Don’t use barcode;

bubble in all info on SIS

If label is affixed and

then found to be wrong

Place two blank labels

over the incorrect label

and then bubble all

information the SIS

31

Using Student Barcode Labels

No student barcode label

Notify local student data

management person to

enroll/submit the

student in core data.

Bubble in all info on SIS

Leave barcode

area blank!

Wrong student label

is affixed

Place blank label

over incorrect label; and

Then affix correct label

32

• Test Coordinator’s Packet

DTC folder

STC folders

• Testing Materials– If not sufficient materials to administer the

test immediately call Missouri Assessment Program Service Line 1-800-544-9868

– See Order Additional Testing Materials Chart deadline dates p. 12

Step 1: Review Testing Materials (pp 11-12)

33

DTC Folder• District Packing List• District Cover Letter• Materials Ordering and Inventory Information Flyer• Test Book Accountability Form• Add/Short Form – District• Missing Test Materials Form• Braille Omit Return Instruction Sheet• Student Barcode Label Instruction Sheet• Test Coordinator’s Manuals • Blank District Return Shipping Labels:

• Blue for scorable materials• White for unused Inventory

Step 1: Review Testing Materials (p 11)

34

STC Folder• School Packing List• School Cover letter• Add/Short Form – School• Braille Omit Return Instruction Sheet• School Group Lists (SGL)• Group Information Sheet (GIS) for each teacher and grade• Test Coordinator’s Manuals• Blank Green stock labels• Return Shipping Labels:

– Blue for scorable materials– White for unused Inventory

• Student Barcode Label Instruction Sheet• Student Pre-code Roster• Blank Barcode Label Stock• Student Barcode Labels


35

Testing Materials:• Packaged by school• Shipped to the district’s office or the

designated address used in the online order• Include:

– Examiner’s Manuals– Test books – Large white envelops – Ancillary testing materials


36

CORRECTION• An error exists on the 2008 8th/10th grade Math

reference sheet that was already printed and shrink-wrapped. DESE and CTB made the correction last May when the error was first discovered; however, the corrected version did not make it to CTB’s Manufacturing department.

• The second part of the Midpoint Formula should be (b+d)/2, not (b+c)/2.

• An errata sheet (a correction sheet) will be mailed, notifying schools of the error and providing the correction.

• Additionally, on DESE’S website, the corrected version has been posted that schools may download and print.

37

Verify Shipment:

• Compare packing list material against shipment

• Follow procedures for ordering more materials if needed, using Add/Short Form


38

Map Spring 2008Ordering Additional Testing Materials Missouri Assessment Program

Service Line 1-800-544-9868

Start Date End Date Shipping Mode

Shipping Costs

March 14 April 11 USP Ground Service

CTB

April 14th April 21st Next-day or 2nd day Service

District

39

Security Barcode:

• Used for test book security

• Used for inventory – each book consecutively numbered

• Used to ensure 100% accountability of test books

• Used for missing inventory reports generated by CTB/McGraw-Hill

• Used by DESE to track barcode numbers, district and school name

• Located on lower right-hand corner directly above “Spring 2008”

Step 2: Distribute Testing Materials(p 13)

40


Test Book Accountability Form:

• This form replaces the past Security Barcode Form

• Deals with the security barcode information

• One copy is needed for each school in the district

• The form is used to ensure 100% accountability of test books

• Instructions for the DTC and STC are outlined on page 13 - 15 in TCM

• Pretest and post-test responsibilities regarding the form apply to both the DTC and STC

• This form or a copy of it is never given to the Examiners

41


DTC’s Pretest Administration:• Maintains security

• Tracks security barcodes to confirm start and end barcode numbers for each shrink-wrapped bundle using Test Book Accountability Form

• Matches numbers with packing list

• Reports discrepancies to CTB• Check that each STC has the testing materials

that they need

42


STC’s Pretest Administration:• Maintains security

• Open shrink wrap bundle and verify bar code order of the test books and packing list

• Report any discrepancies on the Test Book Accountability Form and notify DTC

• Keep Test Book Accountability Form—Do not give to Examiners

43


Examiner’s Pretest Administration:

• Maintains security

• Count and document the number of books received

• Document bar code information

44

Step 2: Distribute Testing Materials(p 14-15)

Examiner’s Post-test Administration:• Maintains security• Assemble and organize testing materials to return

to the STC • Count books and verify barcode • Check SIS accuracy• Separate used and unused books• Place the “To-Be-Scored” test booklets in large

white envelopes (Do NOT seal the envelopes)

45


STC’s Post-test Administration:• Maintains security• Verify return of all test booklets• Complete lines 6 & 7 on Test Book Accountability Form• Separate “To-Be-Scored” from the unused test books and

put them in separate boxes (DO NOT seal the envelopes)• Affix the shipping labels on all boxes• Return all boxes and the Test Book Accountability Form to

DTC• Keep a copy of the Test Book Accountability Form and any

other documentation in your records– Any books not accounted for should be documented on Lines 9 and

10 of Test Book Accountability Form.

• STC is responsible for 100% rate of return of all test books

46


DTC’s Post-test Administration:

• Maintains security

• Verify accuracy of the Test Book Accountability Form from each school

• Check for signatures

• Fax all Test Book Accountability Forms from your district to CTB

• Verify documentation of any contaminated test books. See page 16

47


DTC’s Post-test Administration, Contaminated Test Books:• Examiner notifies STC• Contaminated book must be:

Recopied to new test book (same form) the STC/DTC or the student may have to start over with a new book

• Securely destroy test at site • Complete a Missing Test Materials form• Complete an explanation with security bar number and

demographic information• Fax copies of all documentation to CTB• When sending completed Test Book Accountability form to

CTB, be sure to attach letters pertaining to contaminated test books

48

Step 2: Distribute Testing Materials(p 16 & 17)

Ordering additional materials:

• Each school will receive a 5% overage

• The district will receive a 5% overage

• Use school and district overage before ordering new materials

• DO NOT SHARE TEST BOOKS BETWEEN SCHOOLS

49

Step 2: Distribute Testing MaterialsSteps in the Life Cycle of Test Administration:

• DTC guarantees the security of the testing materials.

• DTC distributes the materials to all STC’s in the district.

• DTC delivers appropriate testing materials for out-of-district students, prior to the first day of testing. Also, the DTC makes arrangements for returning materials after testing is complete.

• STC distributes the 2008 MAP Examiner’s Manuals to all who will administer the test as soon as possible.

• STC collects all student draft work and scratch paper and securely destroys after testing.

• DTC saves their folder and boxes for use after test administration.

50

Step 2: Distribute Testing Materials

Security Testing Materials (p 17):• Testing materials shall not be photocopied, duplicated, or

made accessible to non-testing personnel

• Testing materials shall not be viewed by Examiners

NOTE: The exceptions are ELL translators and Special Education teachers who are

pre- selecting items

• Testing materials shall not be left in an unsecured area at any time, for any reason -- must be locked in room or cabinet at school or district office before, between and after testing sessions

• Test books shall not be shared between schools

51

Step 2: Distribute Testing MaterialsEach Examiner should have the following (p 18):

• Examiner’s Manual for appropriate grade level

• Appropriate quantities of books, manipulatives and reference sheets

• Student barcode labels for each student

• Pre-coded Group Information Sheet (GIS):– One for each grade, 3-8– One for Grade 10 Mathematics– One for Grade 11 Communication Arts;– One for Grade 11 Science– No separate GIS for Special Education students

• Appropriate quantity of large white envelopes (each holds approximately 5-10 books)

52

Step 3: Collect Testing Materials (p 19 & 20)

Instructions for the STC:• Bulleted items on pages 19 and 20 are used to ensure that

all tasks are completed appropriately

• A test book is returned for every eligible student (except MAP- A students)

• One test book is returned for each student, except Grade 11, where two books will be submitted per student – CA and SC

• Check for student bar code label or completed SIS

• Student’s name is on the front of the test book and if there is no bar code then the district and school name too.

• All manipulatives, Examiner’s Manuals, reference sheets, writing prompt drafts, scratch paper, and contaminated test books are securely destroyed

53

Step 3: Collect Testing Materials (p 19)

Markings in Test Books Instructions for STC:In order to be scored properly, the following must take place:

1. Test books completed in ink are transcribed into another test book with a non-mechanical #2 pencil

2. Student responses written on coding tracks/margins are erased and transcribed onto the response line or box

3. All stray marks on the coding track are erased

4. All underlining of text is erased around the answer choices

5. Test books marked with highlighters are transcribed into other test books for scoring

54

Step 4: Check the Organization of Materials Collected (p 21)

Instructions for the School Test Coordinator

Collect large white envelopes with test books in the exact order prescribed on page 21-22 – information on the front of each envelope should be completed.

Large white envelopes should contain the following:

• A completed GIS for each testing grade or group• MAP test books with student barcode labels and/or

completed SISs (remember that for each invalidated test, the test book with a completed SIS must be placed in the envelope)

•

55


Instructions for the School Test Coordinator•

Unused books include:– Test books which are damaged or have manufacturing

errors– Test books written in a language other than English– Test books that are partially used (child moved before

completing a content test)– Test books that are Braille/Large Print editions with

contents transcribed to a regular test book—Contents transcribed to a regular test book

• “DO NOT SCORE” should be written on the front and back of each of these test books.

56


Instructions for the School Test Coordinator

Clarification on partially used books and student

moving during testing • A child completes a content of the test and moves –

The MOSIS Core Data file that is submitted in April must be updated.

If the child is officially removed from school attendance records, core data will capture the updated information. Write DO NOT SCORE across the CONTENT TEST, not the whole test book, which is incomplete due to the child moving. The test book should be returned for scoring.

Do not fill in the absentee spaces for any incomplete sessions after the child has un-enrolled.

57

Step 4: Check the Organization of Materials Collected (p 21-22)

Instructions for STCTo prepare materials for the DTC:

• White envelopes should remain unsealed for the DTC to verify contents

• Be certain that a student has only one test book. If their responses are in more than one test book, transcribe them into one test book.

• Only responses in regular edition test books will be scored

58

Step 5: Student Information Sheet (SIS)(pp 23-24)

• Each Group/Examiner’s materials MUST be grouped together

• Physical Conditions of test book and SIS can affect/interfere with scoring. Those conditions are listed on pages 23-24.

• Biographical data must be checked on the barcode label & pre-code roster

• SIS of the test book must be completed only when:– Pre-coded student barcode label cannot be used– Pre-code roster information is inaccurate for a student

• A completed SIS and/or a test book with a student barcode label must be received for every eligible student

59

60

Step 6: Teacher/Group Information Sheet (GIS)(p 28)

• GIS provides data that is used on reports – notify the DTC if any errors exist on the GIS

• GIS is submitted for each grade, except Grade 11 which requires two

• GIS has both hand-entered and pre-coded information – both must be accurate

• GIS is scannable and cannot be photocopied

• GIS’s are placed on top of test books whose scores are to be reported together—See picture on page 30

61

62

Step 7: Complete School/Group List (SGL)(pp 31-33)

• SGL is used by CTB McGraw-Hill to inventory test books• SGL can be photocopied• SGL should have an entry for every GIS that was

completed• SGL information includes:

– Pre-coded:• District Name and code number• School Name and code number• County Code Number

– Hand-written:• Contact person’s name, email and phone number• Group Name is identical to “Teacher Name”/Grade Level on GIS• Grade • Grade 11 only, indicate Communications Arts or Science• Total number of scorable books being returned

• Sample SGL on page 32 • Directions for completing fields on page 33

63

64

Step 8: Organize Materials for the DTC(pp 34-35)

The STC will:1. Reuse the CTB/McGraw-Hill green-shaded boxes in

which testing materials arrived2. Package the following scorable materials:

– School/Group Lists– Large white envelopes, organized by grade in ascending order,

accompanied by GIS forms

3. Package unused test books4. Affix shipping labels on the side of each box and

number each set of boxes separately:– Blue labeled on scorable books, numbered 1 of X, 2 of X, etc.– White labels on unused books, numbered 1 of X, 2 of X, etc.

5. Send materials to the DTC in unsealed boxes

65

Step 9: Package and Ship Testing Material(p 36-38)

The DTC will:

• Ensure all testing materials are received from each school in the district

• Verify TCM instructions for the STC were followed exactly

• Contact any STC who delays returning materials

• Add enough packing material to secure tests

• Schedule testing material pickup online

• Schedule pickup no later than April 28, 2008

• Follow instructions outlined in TCM on page 37-38

• Fax Test Book Accountability Forms to CTB/McGraw-Hill

66

Level Not Determined (LND)This designation is for students who did not receive a MAP score for any one of the following three reasons:

1. An SIS is returned to CTB/McGraw-Hill with a blank test book;

2. A student does not attempt any items in one or more sessions; or

3. A student is absent all 3 sessions.

Glossary of Terms (p 39-41)

67

Questions???? Questions????

Missouri Department of Elementary and Secondary Education

800-845-3545 (Assessment Section)

Documents

2008 MAP Test Coordinator’s Manual (TCM)