1

District Assessment Training for 2009-10

• Welcome • Thank you for all you do and will be asked to do• Get coffee, water or juice• Get assessment notebook materials• Sign-in for CPD credit• Submit leave requests to Wayne Goates• Introducing assessment secretary Sharon Wills • Good news – state testing is generally the same as

last year

2

3

4

District Assessment Notebook• Orchid Information At-A-Glance• 2009-10 Test Coordinators• Salmon Oregon Achievement Standards Summary• 2009-10 Elementary Work Sample Overviews• 2009-10 Middle School Work Sample Overviews• 2009-10 High School Work Sample Overviews• Grey 2009-10 District Assessment Calendar• 2009-10 Oregon’s Assessment of Knowledge & Skills (OAKS)• Statewide Testing Schedule• Tan OAKS Online Keyboard Navigation Key• Pink STC – School Test Coordinator Assurance of Test Security• Canary TA – Test Administrator Assurance of Test Security • Blue NTA – Non-Administrator Assurance of Test Security• Ivory Security Practices & Examples• Green 2009-10 Test Administration Manual• Canary 2009-10 Appendices for Test Administration Manual• Buff OAKS Online User Management System (UMS) • Ivory Extended Assessment Updates and Information• Pink English Language Proficiency Assessment (ELPA)• Blue 2009-10 Oregon Online Assessment Reporting System Users Guide

5

6

When Are You Starting OAKS Online Testing?

A new secure test browser must be installed.

7

8

Test Administration Manual (green)

Oregon Administrative Rule 581-022-0610 Administration of State Tests – 5 pages

I. Introduction - who must read what on page 2II. Test Roles – DTC, STC, TA & regional helpIII. Student Confidentiality – No names with SSIDIV. Test Security with reporting & security formsV. Accommodations and ModificationsVI. Student and Assessment OptionsVII. English Language LearnersVIII.Students with Disabilities

9

Test Administration Manual Requirements

• School Test Coordinators must read and understand Parts I – VIII and the appendices.

• Test Administrators must read and understand Parts I – V and Appendices A & R, as well as appendices specific to assessments which they will be administering.

10

11

Test Administration Manual was updated on September 21

• Appendix A: Extended the test window for HS Online Writing

• Appendices D & E: Provided updated timeline for the phase-in of the Essential Skills graduation requirement

• Appendices I, J, K, & L: Corrected the session expiration period to 45 calendar days

12

Oregon Assessment of Knowledge and Skills (OAKS)

• OAKS Online • OAKS Paper&Pencil/Braille/Large Print• OAKS Writing Performance Assessment• OAKS Extended• English Language Proficiency Assessment

(ELPA)

• Manual includes information about PSAT, NAEP, Aprenda and Work Samples

13

Required Assessment Options

• Reading & Math: at grades 3 – 8, and 10• Science: at grades 5, 8, and 10• Writing: at grades 4, 7, and 10

Students in grades 9, 11, and 12 may also take the High School level test.

In preparation for the implementation of the new Mathematics content standards, there will be an additional set of “field test” questions.

14

Online Assessment Options

• Reading & Mathematics: Up to 3 online opportunities at grades 3 – 8, and 10

• Science: Up to 3 online opportunities at grades 5, 8, and 10

• Writing: 1 online opportunity at grade 10

Students in grades 9, 11, and 12 may also take the grade 10 test.

15

Up to 3 Online Opportunities

Multiple Opportunities are a means of limiting the impact of the “real world” on a student’s results including: Adult errors, network problems, student illness, etc. Therefore 3 opportunities for each student are not guaranteed.

16

Paper/Pencil, Braille, and Large Print

Reading and Mathematics: 1 opportunity at grades 3 – 8, and 10.

• Science: 1 opportunity at grades 5, 8, and 10.

• Writing: 1 opportunity at grades 4, 7 and 10.

17

OAKS Writing Assessment

OAKS Paper Writing Performance • 1 opportunity at grades 4, 7, and 10.

OAKS Online Writing Performance• 1 opportunity at grade 10.

• Students in grades 9, 11 and 12 may also take the High School level test.

• Students in High School must not under any circumstance take more than 1 opportunity.

18

OAKS Extended Assessments

• Reading & Math : 1 opportunity at grades

3 – 8, and 10.

• Science: 1 opportunity at grades 5, 8, and 10.

• Writing: 1 opportunity at grades 4, 7, and 10.

19

OAKS General Review

• The Assessment options generally are the same this year as last year

• ELPA will be integrated into OAKS Online

• Oaks Online Writing will be available to all H.S. students, but a H.S. student only has 1 writing opportunity.

20

School Test Coordinator Role

• STCs may set school test schedules for OAKS tests (Online, Paper/Pencil, and Writing) in collaboration with DTCs.

• STCs must coordinate determination of appropriate assessment options for students.

• STCs must coordinate secure storage, distribution, and inventory of paper test materials for the school.

• STCs help code students who do not test because they were not enrolled during the school test window using Administration Code 8 in student centered staging.

• May not Set school test schedules for Extended Assessments or the ELPA.

21

School Test Coordinators Role

• STCs coordinate determination of appropriate assessment options for students.

• STCs assist DTCs in ensuring that all test administrators receive test administration and security training.

• STCs ensure security of paper test materials before, during, and after testing.

22

Test Administrators

• TAs must read the 2009-10 Test Administration Manual, receive annual test administration and security training, and sign an Assurance of Test Security form before administering state tests.

• TAs may only provide upon request students with allowable resources listed by content area in the 2009-10 Test Administration Manual Appendices.

• TAs may only provide the version of allowable resources provided by ODE. These are posted online at

http://www.ode.state.or.us/search/page/?=2346• TAs must read verbatim the student directions provided by

content area in the 2009-10 Test Administration Manual Appendices.

• TAs must sign the Test Security form in order to administer tests.

23

Test Administrators

• TAs may not allow untrained aides, volunteers, or substitutes to assist with test administration.

• TAs may not coach students (including requiring students to show their work).

• Students may not access non-allowable resources such as textbooks or class notes

• Students must not talk to or help other students during testing.

24

Test Administrators

• TA reviews the Test Administration Manual before testing, focusing on test security and content-specific allowable resources and accommodations.

• TA spaces students appropriately or provides visual barriers to prevent students from seeing others’ tests.

• TA reads student directions verbatim and circulates through test environment to ensure proper testing conditions.

• TA makes available but does not require students to use allowable resources.

25

Test Administrators Review

• TAs must receive training each year

• TAs enforce valid test environment for students

• When in doubt about a particular testing practice:

– Check the Manual

– Check your training notes

– Ask your School Test Coordinator

– If all else fails, assume the answer is “no”

26

Test Security

• Purpose: To protect the integrity and confidentiality of secure test items, prompts, and passages. The security of these materials is necessary so that they can be used in later years to measure trends in performance. In addition, test security helps to ensure test results can be used in accountability reporting

• Definition: A test impropriety is any instance where a test is not administered in a manner consistent with the Test Administration Manual or OAR 581-022-0610 Administration of State Tests

27

Secure Testing Environment

• A quiet environment, void of distractions and supervised by a trained test administrator

• Visual barriers or adequate spacing between students

• Student access to only allowable resources

• All paper test materials collected and accounted for after each testing event

• Student data is treated as confidential

28

• Mathematics symbols (including #s) can not be read aloud125 + 25 =

• Test Administrators may not explicitly or implicitly direct a student to identify reasons or strategies used to determine test answers, nor otherwise provide instructional or learning strategies for guidance during the assessment process (see Administration Manual for examples of Allowable Resources)

• Any teacher review or analysis of test items constitutes a breach in test security – both districts and teachers are responsible

• Do not score the tests or otherwise give students any feedback as to how well you believe they are performing

Secure Testing Environment

29

Secure Testing Environment

• TAs must ensure that students use the correct SSID and take the correct test.

• TAs must securely shred test materials such as reading passages, scratch paper, or other paper hand-outs written on by students after each testing event

• Test materials must be securely stored at all times

• Test improprieties must be reported to ODE within 1 day of learning of them and the investigation must be completed within 30 days.

• If a DTC can not investigate an impropriety, the district must assign someone else to the task

30

31

Secure Testing Environment

• TAs must not review or analyze secure test items

• Students must not access non-allowable resources such as cell phones, iPods, or e-mail

• Students must not remove test materials from the test environment

• TAs must not copy or retain any test materials, including secure test booklets, writing prompts, or reading passages

• DTCs, STCs, and TAs must not share their UMS log-in information with anyone (even other authorized UMS users)

32

Security Suggestions

• Using colorful materials to identify which students have printed reading passages remaining at their stations

• When setting up the test environment, the TA should ensure that the TA’s computer is set to print in the computer lab where the students are testing.

• The TA uses the class roster to mark which students received printed reading passages and then matches the class roster to the printed reading passages collected at the end of the testing event to account for all printed reading passages

33

Security Review

• Test materials must be inventoried and securely stored both before and after each testing event.

• Only authorized staff who have signed an Assurance of Test Security Form may have access to secure test materials.

• Scratch paper and all other printed materials written on by students during testing must be collected and securely shredded at the end of each testing event.

• DTCs must report all test improprieties to ODE within 1 day of learning of them. Report form is available at:

www.ode.state.or.us/go/testsecurity

34

Needed Login InformationFrom Appendix H

35

36

Test Administration Procedures

• Oregon assessment tests are NOT timed tests

• Students should be allowed to continue working as long as they are making reasonable progress

• Administering the test in smaller segments is an acceptable practice (remember test security)

• Providing less time than indicated by the guidelines in the Test Administration Manual is an extreme disadvantage to students

• If a student “rushes” through the test, this will be counted as one of their opportunities. Test Administrators must monitor student progress to reduce this risk.

37

Breaking Up the Test

• If you know you will be administering the test in multiple sessions, remind students before they begin testing that they will be resuming the test at another date/time

• When students resume a test, the test will start on the same number/passage where he/she previously stopped

• If a student pauses an OAKS Online test for 20 minutes or more, the student will not be able to return to previously answered or marked questions.

• When resuming a test, Test Administrators should review the process and re-read the student directions.

38

Student Readiness for Testing

– Familiarize students with test format by allowing them to take Sample/Practice Tests, if available

– Explain to students that the purpose of the assessment is to “measure your current progress on state content standards” and remind them that “I can’t help you with reading passages, test questions, test answers or formulas.”

– Encourage students to “do their best”

39

Accommodations Overview

Accommodation — a change in how a test is presented to or responded to by a student.

– Provides the student equal access and equal opportunity to demonstrate proficiency.

– Is considered “standard administration;” students have the opportunity to “meet” or “exceed” the standard.

– Should be consistent with support provided during individual student’s instruction.

– Braille and large print paper/pencil tests are available.– Listed at www.ode.state.or.us/search/page/?=487

40

Extended Assessments

• Extended assessments must be identified on a student’s IEP

• IEP teams should determine whether the student would be best served by the standard or scaffolded extended assessment

• Results will be included in AYP calculations

• Only “qualified” assessors should administer extended assessments

41

ELPA - English Language Proficiency Assessment

• Enrolled after May 1, 2010 – only ELPA

• Enrolled May 2, 2009 to May 1, 2010 – ELPA and OAKS Math & Science

• Enrolled before May 2, 2009 – must take ELPA and all other OAKS tests

42

English Language Proficiency Assessment (ELPA)

• 1 opportunity for grade bands:

K – 1, 2 – 3, 4 – 5, 6 – 8, and 9 – 12.

• ELPA will be integrated into OAKS Online.

43

DIBELS, Maze & Common Math

DIBELS Grades K – 5 Sept, Jan, May

Maze (optional)

Grades 6 – 8 September & March

Common Math

Grades K – 8Pre & Post Test

at Trimester

44

Writing Test Schedule

• Grades 4, 7, & HS students Paper & Pencil– January 11- February 26– For HS students only: April 12 – 30

• Online Writing for HS students – January 11 to April 30

• Students in High School must not under any circumstance take more than 1 opportunity.

45

Essential Skills

• Class of 2012 – Sophomores must read & comprehend variety of text.

• Class or 2013 – Freshman must do above and write clearly and accurately

• Class of 2014 – 8th grade must do above and apply mathematics in variety of settings

46

Work Sample Requirements

• The change in the law does not go into effect until July 1, 2008

• For writing, speaking, and mathematics problem solving, students in grades 3, 4, 5, 6, 7 & 8 must complete one work sample scored with the state scoring guide, meeting the performance standard.

• Students at the CIM level must complete 2 work samples from different strands (SRCs 3, 4, or 5) in mathematics problem solving; and 3 samples in writing (one persuasive, one expository AND one imaginative or narrative). In speaking, CIM students must complete 3 samples (one persuasive, one informative, and one unrehearsed).

47

Work Sample Requirements

• For scientific inquiry, students in grades 3 – 8 and at the CIM level must complete one work sample, scored in the required dimensions.

• For social science analysis, students in grades 6 – 8 and at the CIM level may complete one work sample, scored in the required dimensions. To earn the Social Sciences Endorsement, students must complete one work sample scored with the state scoring guide, meeting the performance standard.

The phase in schedule for science work samples can be found at: http://www.ode.state.or.us/search/page/?id=518

The phase in schedule for social sciences work samples can be found at: http://www.ode.state.or.us/search/page/?id=34

48