End-of-Course Assessment Test Coordinators Manual Training Phase I and Phase II 2009/2010 1

End-of-Course Assessment

Test Coordinator’s

Manual Training

Phase I and Phase II

2009/20101

AgendaEOC General Information and Changes

Testing Windows & Test Formats

Online Test Examiner’s Manual

Questions

2

End-of-Course AssessmentsRequired Tests

English IIAlgebra IBiologyGovernment

3

End-of-Course AssessmentsPhase I Assessments

Include: English II, Algebra I, and Biology

Were the first group of EOC tests created

Became operational in Spring 2009

Required for AYP, APR and/or NCLB

4

End-of-Course AssessmentsPhase I Assessments ~ Session II

Points are not the same for each content area

‣ English II writing prompt is worth 4 points

‣ Algebra I PE is worth 4 points

‣ Biology PE is worth 20 points 5

End-of-Course AssessmentsPhase II Assessments

Include: English I, Algebra II, Geometry, American History, and

Government

Were the second group of EOC tests created

Become operational October 13, 2009

6


Government is the only required Phase II Assessment

Government is required for APR

7


• Have selected response (SR) items only

• English I has 52 items – 7 passages with 6 or 8 items each

• All other Phase II Assessments have 50 items each.

• All are worth 40 points

8

End-of-Course AssessmentsScoring EOC

SR Items for both Phase I and Phase II Assessments are officially scored by Riverside Publishing immediately after testing

Official SR scores are returned to the district within 5 business days from receipt of tests

9


WPs and PEs are officially scored by the Assessment Resource Center (ARC) at a later time

Unscored WP and PE items are scanned and electronic copies are returned to the district for local scoring 5 business days from receipt of tests

10


Session I official scores and locally scored Session II results can be included in a student’s final grade

DESE highly recommends that EOC Assessments be used as 10-25% of the students’ final grades

The percentage is a district-level decision

11


Riverside Publishing sends two e-mails with attachments to the DTC – one for training and one for scoring

Task Scoring Workshop and Teacher Interface have URLs, user names, and passwords

12


User names and passwords for Task Scoring Workshop and Teacher Interface allow teachers access to secure materials

For security reasons, the passwords are not forwarded to the STC or teachers until district testing is complete

13

End-of-Course AssessmentsEOC score results

Official scores for PEs and WPs arrive in the district in August

Both Session I & II are combined into a Scale Score for Student Reports

Official state scores will be used for AYP and APRCrystal Reports have breakdown of Session I and

Session II scoresTeachers will be able to compare their scored Session

II assessments to the official state-scored Session II

14

End-of-Course AssessmentsEOC score results

Advanced Proficient Basic Below Basic

SubjectRaw

ScoreCut

ScoreRaw

ScoreCut

ScoreRaw

ScoreCut

ScoreRaw

ScoreCut

Score

Algebra I 31-39 225-250 22-30 200-224 13-21 177-199 0-12 100-176

Biology 45-55 225-250 32-44 200-224 18-31 177-199 0-17 100-176

English II 33-39 225-250 24-32 200-224 15-23 180-199 0-14 100-179

15

End-of-Course AssessmentsLevel Not Determined (LND)

• For EOC Assessments, a district will receive a Level Not Determined (LND) for a student if that student NEVER participates in a required EOC Assessment (English II, Algebra I, Biology, Government) before they graduate • beginning with the graduating class of 2011

• EOC Assessments are not a graduation requirement

16

End-of-Course AssessmentsLowest Obtainable Scale Score (LOSS)

Students who participate in an EOC Assessment receive scores

A student receives the Lowest Obtainable Scale Score (LOSS) if a student’s test is invalidated for cheating or paraphrasing in any content area because they have participated in the test

17

End-of-Course AssessmentsIndividualized Education Program (IEP)

Students who have an IEP with accommodations can be accommodated during testing

18

End-of-Course AssessmentsChanges and Updates

The “Not Enrolled” bubble is used for a student who begins any session of an EOC Assessment and moves either out of the district or from building to building within a district before finishing the entire assessment

The sending school should keep documentation on file about the student’s move

In the manuals EOC Assessments will be categorized as Phase I and Phase II

19

End-of-Course AssessmentsChanges and Updates

Dictionaries, thesauruses, and grammar handbooks can be used with the writing prompt for English II, Session II

When students are taking the online version of the test, do not mark a student as absent until the END of the district’s testing window

English II will not have a stand alone field test this year - however, the Phase II GIS has a bubble for an English II field test so please disregard

20

AgendaEOC General Information and Changes



Questions

21

EOC TESTING WINDOWS for SJSD

• Fall/Winter• 11/30 – 12/4 Biology and English II• 12/7 – 12/11 Algebra I and Government

• Spring• 4/19 – 4/23 Biology and English II• 4/26 – 4/30 Algebra I and Government

• Summer

22

EOC in Two Versions

Paper/Pencil version

Online version

23

End-of-Course AssessmentsAll Phase I Assessments

Two sessions:

• Session I - Selected Response Items

• Session II - Performance Events (PE) or Writing Prompts (WP)

24

End-of-Course AssessmentsPhase I, Session I Assessments

Have 47 selected response (multiple choice) items

Present students with a question followed by four response options

Are worth 35 points total

25

End-of-Course AssessmentsPhase I, Session II Assessments

• Require students to work through more complicated items

• Make allowances for more than one approach to a correct answer

• Allow insight into a student’s ability to apply knowledge and understanding to real-life situations

26

Session II Performance Events for Algebra I and Biology

Assesses student’s applied knowledgeAlgebra I PE assesses CLEs with a Level 3

DOK from the Algebraic Relationships strand

Biology PE assesses the Inquiry strand

27

Session II Writing Prompt for English IIOn-demand writing proficiency

Scored holistically, using a four-point scoring guide

The prompt may be persuasive, descriptive, expository, or narrative

28

Phase I Fall/Winter Spring 2010 Summer 2010Algebra ISession I

35 operational + 12 EFT

35 operational + 12 EFT,

35 operational + 12 EFT,

Algebra I Session II 2 PE, taking about 30 minutes each

2 PE, taking about 30 minutes each

2 PE, taking about 30 minutes each

BiologySession I




BiologySession II

2 PE scenarios with approximately 6 – 12 separate items per scenario, taking about 30 minutes for each scenario



English II Session I 35 operational + 12 EFT



English II Session II 1 Writing Task 1 Writing Task 1 Writing Task

Snapshot of Phase I

29

Snapshot of Phase IIPhase II Fall/Winter Spring 2010 Summer 2010

American Government




American History 40 operational + 10 EFT



English I 40 operational + 10 EFT



Integrated Math 2 40 operational + 10 EFT



Integrated Math 3 40 operational + 10 EFT



Geometry 40 operational + 10 EFT



Algebra 2 40 operational + 10 EFT



30

Agenda

EOC General Information and Changes



Questions

31

Purpose of Test Coordinators Manual

Detailed instructions for:Preparing for online testingDelivering of online testsAdministering of online tests

32

Test CoordinatorsDistrict Test Coordinator (DTC) – the point

person for testing in a school district

School Test Coordinator (STC) – the point person for testing in a particular building

These are sometimes the same person and/or they may have interchangeable roles

33

Breakdown of EOC Assessments

Guidelines for Testing: PrepareNotify parents in advance so that students will be

well-restedPre-read the manualInclusions of Special PopulationsMake-up SessionsUse of TranslatorsInvalidation ProceduresAccommodations and Status Codes

34

Special PopulationsIEP students must take all EOC Assessments

administered by the district or portions of each content-area assessment as determined by the IEP team

IAP/504 Students

35

Students Not Tested• MAP-Alternate (MAP-A)• ELL students who have been in the US for 12

months or fewer (cumulative time) may be exempt from the English II assessment

Students who move before or during testing (p. 5)If a student was enrolled to take an EOC

Assessment but moved prior to test administration, the sending school should keep documentation on file about the student’s move

The receiving district tests the student in any applicable EOC Assessment

The “Not Enrolled” bubble is used for a student who begins any session of an EOC Assessment and moves before finishing the entire assessment, either out of the district or from building to building within a district. The sending school should keep documentation on file about the student’s move.

36

Students Who Are Absent During TestingDistricts should make every attempt to have all

students take the entire test. If a student is absent and unable to take the test during the testing window, the school should keep documentation on file about the student’s absence and use the following procedures :1. If a student is absent and unable to take the test at a

later test window, fill in the “Absent” bubble

2. If a student is absent and the district will assess the student during the next testing window, fill in the “District Team Decision – Delayed” bubble

3. The districts may re-enroll the student in the next semester’s testing window.

37

Use of TranslatorsTranslators must be trained in test

administration

No for English I and English II assessments

Yes for all other Phase I and Phase II tests

Native language responses are acceptable from ELL students – transcribe appropriately

38

Invalidation ProceduresCheck the chart (Page 7)

Mark appropriately

39

Test Invalidation Reasons

40Neither student behavior nor the judgment of student effort can invalidate test.

What Districts Must Do When Invalidating A TestAgreement on Invalidation (between STC and

Examiner)

Information STC must provide to DTC

The Letter to DESE from the Superintendent

A Copy of the letter for the District

41

Accommodations and Status Codes (Pages 22 - 23)

Student accommodations are recorded for the entire assessment

Accommodation Code definitions can be found in the EOC manual and on the DESE website. Check the appropriate box for the corresponding test.

Status code definitions can be found in the Test Examiner’s Manuals.

42

Electronic DevicesYes to Calculators – at minimum, students

can use, a four-function calculator for Algebra I – both sessions (nothing with Internet access of a Qwerty keypad)

No to cell/mobile phones, electronic music players, digital cameras, handheld scanners, gaming devices, any portable device that can be connected to the internet, etc.

43

Testing Periods – Phase I Suggested Times Algebra I

Session I = 90 – 100 minutesSession II = 60 – 70 minutes

BiologySession I = 55 – 60 minutesSession II = 65 – 70 minutes

English II Session I = 90 – 110 minutesSession I = 90 - 100 minutes

Testing Periods – Phase II Suggested Times

Government – 60 - 80 minutesAmerican History – 60 - 80 minutesEnglish I - 90 - 110 minutesAlgebra II – 90 - 100 minutesGeometry – 90 - 100 minutes

DTC ResponsibilitiesThe District Test Coordinator (DTC) is

responsible for training ALL School Test Coordinators (STCs) on EOC Assessment processes.

Communicating with RPC (Riverside Publishing Company) – one point of contact for the district

Responsible for test securityOrdering additional materials if/when needed

46

STC ResponsibilitiesEnsure EOC Browser is on each workstation for

test deliveryInput students who were not included in the

MOSIS precode file to the online testing systemVerify/edit student demographic information for

pre-imported studentsContact District Assessment Office if any

students need to be transferredView/set student classes, testing statuses, and

accommodations

47

District Team Decision – Delayed

This is a bubble designed for students who are not yet ready to take the EOC assessment for which they were enrolled.

PRIOR to the testing window(s), the district should have their “delay” procedure clearly in place

The procedure should:include decision parameters include who is on the team to make the decisionbe in writing

48

Bubble and DocumentIf the district believes a particular student is not

ready to take the EOC assessment for which he/she was enrolled, the district team makes the decision based upon the qualifications in the procedure.

The STC bubbles in the “District Team Decision – Delayed”

The district keeps documentation about the decision to delay testing.

49

Post Test Administration Task Scoring WorkshopThe Task Scoring Workshop is an Internet-based tool that

provides training on how to score the Session II portion of the Phase I Missouri End-of-Course assessments. Through this system, teachers have access to scoring rubrics, anchor papers, annotations and practice papers that allow them to practice the scoring process independently.

Once Riverside has received a district’s testing materials, an e-mail will be sent to the DTC with the Task Scoring Workshop URL, user IDs, and passwords. The e-mail will be sent from [email protected] with the subject line of “MO EOC: Task Scoring Workshop.” The DTC is responsible for distributing the information to their teachers. Please note that this information should not be distributed until all testing has been completed for a subject area.

50

Post Test Administration Teacher InterfaceThe Teacher Interface is the system through which teachers are

able to view students’ selected response raw scores and view, print, and locally score the unscored, scanned copies of their students’ performance events. Teachers are able to include these scores in the students’ final grades. However, the official state scoring of the Session II items will not occur until a later time. Teacher Interface does not provide export files of raw scores, nor does it allow for batch printing of the performance events/writing prompts.

Within 5 business days of Riverside receiving a district’s testing materials, an e-mail will be sent to the DTC with the Teacher Interface URL, user IDs, and passwords. The e-mail will be sent from [email protected] with the subject line of the DTC’s name followed by “MO EOC Teacher Interface.” DTCs and STCs will have access to a performance event summary report for their buildings. Teachers will have access to their class roster page with the selected response raw scores and performance event images. 51

Accommodation Codes List for English Language Learners (ELL)

The following slide are the only accommodations allowed for ELL students.

Oral reading, oral reading in native language, or the use of a bilingual dictionary during the English II assessment will result in the LOSS (Lowest Obtainable Scale Score).

52

53

Accommodations List for Students with Disabilities

Has changed since last year!

54

Note 1 for Students with DisabilitiesNOTE 1: Oral reading, oral reading in native language or signing any English assessment will result in the LOSS (Lowest Obtainable Scale Score). The use of a bilingual dictionary during the English I or English II, Session I assessment will result in the LOSS. Students identified as blind/visually impaired (who do not read Braille) may use the oral reading accommodation if it is their primary instructional method.

55

Note 2 for Students with Disabilities Paraphrasing test questions invalidates all EOC

Assessment student scores for accountability purposes.

56

Note 3 for Students with DisabilitiesUse of magnifying equipment, amplification equipment, graph paper and testing with the teacher facing the student are not listed as accommodations because these are not required to be reported as accommodations for the EOC Assessments.

Examiner’s Manual Phase I & II

Directions for Administering Online Assessments

English II (Pages 34-37) Biology (Pages 38-41) Algebra I (Pages 42-47)Government (Pages 54-55)

57

Test MaterialsStudent Materials

Computer workstation with EOC Browser

Scratch, graph or draft paper (not provided)

At minimum four-function calculators for Algebra I (not provided and not required)

Algebra I reference sheet (for Algebra I Sessions I and II)

Dictionary, thesaurus, grammar handbook (for English II Session II only – not provided)

58

Prepare for Test AdministrationOrganize the classroom

Plan seating arrangements/computer usageEliminate distractions under your controlUse a Do Not Disturb sign (not provided) on your

doorRemove or cover any maps, charts, or other

materials that relate to the content and processes of the test.

Make testing arrangements for students who do not finish testing in the allotted time frame.

59

Electronic Devices At minimum, students may use a four-function

calculator during the Algebra I (Session I and Session II) Assessment. Other electronic devices must not be accessible during the testing session. Such items include, but are not limited to: cellular/mobile phoneselectronic music playersdigital camerashandheld scannersportable gaming devicesany portable device that can connect to the

Internet60

Administer the TestsSpecific directions for each content area are

in the Examiner’s manual.

The following symbol is used throughout the specific directions:

61

Agenda

EOC General Information and Changes



Questions

62

•Re-Read the Manuals

63

•Who Calls Riverside?The district should have one point of contact – the DTC!

What If We Still Have Questions After Today?

Documents

End-of-Course Assessment Test Coordinators Manual Training Phase I and Phase II 2009/2010 1