TELPAS 2015 Kristen Joslin, DTC. This training does not replace your responsibility to read and...

TELPAS 2015Kristen Joslin, DTC

This training does not

replace your responsibility to read and follow all

manuals and supplements.

Manuals to consider:

2015 DCCM

Test Security Supplement

TELPAS: Rater Manual

TELPAS: Reading Test Administrator Manual

General Information• Grades K-12 LEP students including parent

denials• Components

▫ K-1 reading, writing, listening and speaking▫ 2-12 writing, listening, speaking and on-line reading

test• Test Dates

▫ Writing Collection: Feb 16 - March 26 ▫ Reading online: March 16 - April 8 (should not have

“absent” students)▫ Late arrivals – _________ or later, reading test only

Who Takes TELPAS

All ELLs in grades K–12, including those whose parents decline bilingual/ESL program services, are assessed annually.

TEA 5

In extremely rare cases, an ELL receiving special education services may be exempted from particular TELPAS domain(s) by the ARD committee in conjunction with the LPAC.

LEP & SpEd Students• The ARD and LPAC committee meet

TOGETHER to determine domain by domain for rating and testing students.

• Documented on “ESL/Bilingual & Special Education Test Assignment and Accommodations” Form

• Deadline is February 21, 2014

NO BLANKET EXEMPTIONS.

Years in U.S. SchoolsO Years in US Schools is often confusing

because pre-K and Kinder are not included in the count. It starts with grade 1

O Keep in mind the 60 day ruleO Years in U.S. schools are important because

they are used to determine accountability performance requirements for AYP and the Progress Measurement

O For more information refer to the LPAC Manual

TEA Dates

4

Date Activity

1/12 Assembling and Verifying Grades 2–12 Writing Collections Course available

1/23 End date for district coordinator training—all TELPAS components

1/26 Online basic training courses for new K–1 and 2–12 raters available

1/26 Supplemental support provider recorded Web-based training available

2/6 End date for campus coordinator training—holistically assessed components

2/16 End date for training raters and verifiers on administration procedures

2/16 Earliest eligibility date for TELPAS writing samples

2/16 Calibration window opens for new and returning raters—first 2 sets

2/25 Third and final calibration set available

3/16–4/8 TELPAS assessment window

4/09–4/10

TELPAS data verification window

Test Security and Confidentiality

O Protect the contents of all online assessment and student performance (ratings and writing samples) documentation

O Train and sign oath prior to handling testing materials.

O No viewing, discussing, providing answers to secure testing materials (paper or on-line)

O This also includes sharing answers to the raters training in Tx Training Center.

Campus Test Coordinator Responsibilities

TELPAS

Campus Coordinator Responsibilities

• Read all manuals • You will act as the writing collection verifier

• Enter/verify student information in the online system

• Ensure computer systems have been checked before testing▫ Contact Jamie Scott if

you have computer issues

Campus Coordinator Responsibilities

• Ensure that all eligible students are identified and tested (Howard)

• Oversee the implementation of validity and reliability

• You and your principal are responsible for test security on your campus

• Supervise and actively monitor testing

• Be the campus contact for all questions about testing

• Report testing irregularities and security violations immediately

• Campus documentation will go into the notebook and returned by May 1.

Things to Know About TELPAS Rater Training

and Administration Procedures

TEA 13

Overview of the Rating ProcessODistricts identify ELLs in grades K–12 and

designate raters to assess studentsOTest administration procedures and

holistic rating training conducted to prepare grades K–12 raters to assess English language proficiency consistent with the holistic scoring rubrics, the Proficiency Level Descriptors (PLDs)

ORaters gather writing samples for ELLs in grades 2–12 to include in each student’s writing collection

ORaters use PLDs to assign students a rating in each language domain assessed

14

Rater Credentials

Each teacher selected to rate an ELL must

1) have the student in class

2) be knowledgeable about the student’s ability to use English in instructional and informal settings

3) hold valid education credentials such as a teacher certificate or permit

4) be appropriately trained, as required by TEA TEA

15

TELPAS Rater Responsibilities

O A student’s TELPAS rater is the teacher designated by the district as the official rater of the student’s English language proficiency.

O The student’s rater must rate the student in all domains for which the student is eligible. A student is not permitted to have one rater for some domains and another rater for other domains.

TEA 16

TEA 17

Collaboration with Others

In determining the proficiency ratings

of their assigned students, raters are

highly encouraged to collaborate with

other teachers and school personnel

who have knowledge of the students’

English proficiency.

New and Returning Rater Definitions

for K–1 and 2–12

•A returning rater who has not completed the basic online training within the past three years will be required to complete training as a new rater.

TEA

18

TEA

19

Two Types of TrainingO Online basic training course

This course is for new raters. It provides instruction on using the PLD rubrics and gives raters practice rating students in each language domain. There are separate courses for K–1 and 2–12.

O Online calibration This is for all raters. Raters use the PLDs to rate students in each language domain. Raters have three opportunities to calibrate on assigned grade cluster.

Returning Raters

Online Basic Training Course

Online Calibration (Sets 1 and 2*)

If not calibrated: Supplemental Holistic Rating Training

Final Online Calibration (Set 3)

Spring TELPAS Administration Procedures Training

As a key part of this training, information from the TELPAS Manual for Raters and Test Administrators is reviewed to prepare raters to proceed with online holistic rating training

Fall ELPS-TELPAS Foundational (Awareness) Training

For teachers who will be trained as new TELPAS raters in the spring if they lack this foundation

Online Calibration (Sets 1 and 2*)

New Raters

*Set 2 required only if not successful on Set 1

When and where do raters take the online training?

O I will notify raters of which training they will be required to attend by Feb. 30.

O March 2 or 3: New Raters (all day)

O March 4 or 5: Returning Raters (half day)

O If calibration is not completed, raters may do so during school hours, at home after school, or on weekends.

O The online training system allows raters to access the training from any computer that meets the minimum system requirements.

TEA

21

Why is calibration necessary?

O Calibration helps ensure that raters have adequate training, including ample practice and feedback, before they assess their students in the spring.

O Calibration ensures that raters clear their heads and consider only the elements of student performance included in the PLDs.

O Calibration supports assessment validity and reliability and is an important part of holistically scored assessment processes.

TEA

22

Is calibration a test?No, it is a training method that ensures that raters have enough guidance, practice, and support to assess students consistently and accurately.

TEA

23

Preparing for Calibration Sets

ONew raters must complete the online basic training course before beginning calibration.

OReturning raters have the option to review the online basic training course (which includes rating activities) before beginning calibration.

Other Things to Know About Calibration

O Raters affirm online that they will keep the contents of the calibration sets secure and confidential.

O Calibration activities are taken from a bank and randomized. Trainees will rate different sets of students.

O Raters can work at their own pace, go back and review students, and change ratings as they work.

TEA

24

Other Things to Know About Calibration

O Raters can exit and return later to finish. They click a “submit” button when they are finished with a set.

O After completing a calibration set, raters immediately see results. Results show the rating assigned by the rater and the correct rating.

O Raters see annotations explaining the ratings. Raters should use the annotations to go back and review any incorrectly rated students.

TEA

25

Will raters be able to refer to any resources during calibration

activities?Yes, raters should use their rating rubrics (PLDs) and refer to, as needed, information from the:O online basic training course

O holistic rating PowerPoints produced by TEA

O TELPAS Manual for Raters and Test Administrators

O Educator Guide to TELPAS

TEA

26

Proficiency Level Descriptors (PLDs)

The PLDs are the rubrics teachers use to determine students’ English language proficiency for ongoing formative assessment and the spring TELPAS administration.

Originally developed for TELPAS, the PLDs were incorporated into the Texas English language proficiency standards (ELPS) in the 2007–2008 school year to reinforce their use in instruction.

TEA

27

6 Sets of PLDsO Listening Grades K–12

O Speaking Grades K–12

O Reading Grades K–1Grades 2–12 (online)

O Writing Grades K–1

Grades 2–12 (writing collection)

TEA

28

TEA

29

Key Features of Each Proficiency Level

O BeginningO Little or no English ability

O IntermediateO Limited ability, simple language structures,

high-frequency vocabulary, routine contexts

O AdvancedO Grade appropriate, with second language

acquisition supportO Advanced High

O Grade appropriate, with minimal second language acquisition support

How many students must be rated successfully?

To be successful, raters need to rate students in

their assigned grade cluster with at least 70%

accuracy.

TEA

30

Supplemental Holistic Rating Training

O Raters not successful after sets 1 and 2 must receive supplemental training.

O After the rater has received supplemental training, he or she will be able to access the third and final calibration set.

TEA

31

Recap of Calibration Process

OThere are 3 sets of 10 students.ORaters who calibrate on set 1 are done.ORaters who don’t calibrate on set 1 go on to

set 2. Raters who calibrate on set 2 are done.

ORaters who don’t calibrate on set 2 receive supplemental training.

ORaters attempt third and final calibration set.

ORaters who calibrate on set 3 are done.

TEA

23

What happens if a rater is unsuccessful in calibrating?

Two outcomes are possible for individuals who complete the calibration activities but are not successful:

O The district may choose not to assign the individual to be a TELPAS rater.

O If the individual is needed to serve as a rater, the district must implement rater support procedures to ensure that the rater’s students are evaluated consistent with the rating rubrics.

Individuals are not authorized to serve as raters unless they complete the required training

components.

TEA

33

Rating Roster

There must be teacher collaboration on ratings as part of the Validity & Reliability process

An Additional Rater is required if the Rater did not pass the Calibration set with a 70% or higher after the 3rd attempt

TELPAS Validity and Reliability Procedures

O TEA mandated district procedures

O For all language domains – grades K-12: O Raters will collaborate with other teachers of

the students in determining the student’s rating. One collaborator will initial the TELPAS Rating roster for each child

O For writing – grades 2-12: O All writing collections will be approved/verified

before raters may begin the rating process.

Course and Calibration Certificates

O Raters who take the basic training course get a certificate from the online TxTrainingCenter after completing the course components.

O Raters will receive a certificate of successful calibration when they calibrate.

O They will be given direction to print them off and turn into you.

O All certificates will go in the TELPAS Documentation notebook

TEA

36

Assembling and

Verifying W

riting

Collections

Assembling and Verifying Writing Collections

O2 – 12O Five writing samplesO At least one narrative about a past eventO At least two academic writing samples

from math, science, or social studies.O All samples must have student’s full

name and date accomplished on themO Only writing samples on or after

February 16th may be used

Assembling and Verifying Writing Collections

O May be a “clean” copy from work by the student to include a journal

O No corrections by teacher or peersO May be typed but spelling and

grammar checker must be offO The writing collection cover sheet

and verification from Appendix A must be completed and attached on top of the samples for each student

What Not to Be Include in Collections

• Copied from a textbook, lesson, or other written sources.

• Papers done with heavy use of a dictionaries or thesaurus

• Papers with teacher’s, peers, or parents corrections

• Written primarily in another language than English

• Worksheets or Q and A writing assignments

• Brief, incomplete, or rushed papers

Verifier ResponsibilitiesAttend training on administrative proceduresObtain access to Texas Training CenterComplete online training “Assembling and

Verifying Writing Collections” Print Certificate of Completion and put in

notebookVerify student writing collections in accordance

with the checklistSign OathVerifier cannot be a TELPAS Rater

Online Training- VerifiersVerifiers need self register for an account in the

Texas Training Center https://texas.pearson.desire2learn.com

Site Code: telpas2015Returning users that have forgotten their login information click on the “Login Help” link

New Users click on the “Self Registration” link

Page 57 in Rater Manual

Online Training- VerifiersVerifiers need to self register for an account in

the Texas Training Center https://texas.pearson.desire2learn.com

Site Code: telpas2015Click on TELPAS 2015 under the “My Texas

TrainingCenter Program” header then:

Verifying the Writing Collection

Verifiers ensure that the writing collections meet all of the criteria based on the Verification Checklist by initialing each item (checklist is on the back of the Writing Collection Cover Sheet) page 54 of Rater Manual

Verifiers sign the bottom of checklistWriting Collections are secure materials

TELPAS Reading

TELPAS Reading

O TELPAS reading is conducted as an online only assessment

O Administered to all LEP students in grades 2-12

O Since it is online, there are no test booklets or answer documents to handle or process

TELPAS Reading Accommodations

O Refer to on-line accommodationsO It is possible that a required accommodation

is not available with online testing. In those cases, we will have to request approval from TEA to give a paper version of the test and order the materials. This is not a last minute process. Plan Ahead!!

TELPAS Reading Make-Ups

O All students must be assessed within the assessment window

O If a student is absent the day you have them scheduled to take TELPAS reading then move them to another session that will test later within the TELPAS assessment window

O The TEA expectation is that we test every eligible student within the TELPAS assessment window

Tutorials• All students are required to take the tutorial

prior to the day of the test. May take as many times as campus wants.

• Tutorials are about how to use the computer not necessary the type of test questions

• Keep a student roster for documentation of the tutorials for the TELPAS Documentation notebook

• http://www.texasassessment.com/TELPAS/tutorials/

• Student Tutorial Administration Directions are available at the bottom

Ratings

O If a student is not rated in one or more domains, select one of the following:

E = Extenuating CircumstancesX = ARD Decision

DOMAINS LEVEL

Listening Beginning

Speaking Intermediate

Reading Advanced

Writing Advanced High

Entering Ratings

• I will responsible for creating and managing Rating Entry Groups.

• You will be responsible for entering your raters ratings before the verification window. (noted on the calendar)

Entering RatingsO K-1 need to be grouped in a Rating Entry

Groups so that student ratings can be entered online. Ratings entered for K-1 include listening, speaking, reading, and writing.

O 2-12 can be sorted one way for entering ratings and for reading another way. Ratings for students will be entered for listening, speaking and writing.

On-line Reading

Administratio

n

DATES• On-line reading assessment: March 16 – April

8• Schedule of schools

▫ HS:▫ JH:▫ BSI:▫ Moss:▫ Goliad:▫ Marcy:▫ Washington:

Prepare for TELPAS Reading GR 2-12

• Links to the web-based tutorials available for each grade cluster on Testing Department website.

• No downloading or installation is necessary to access and use the tutorials.

• With NO sample items in the actual test, make sure to schedule lab time for students to practice with the tutorial.

TELPAS Reading

O Students in grades 2-12 are assessed through an online multiple-choice test.

Grade Clusters

2

3

4-5

6-7

8-9

10-12

Testing Accommodations

O Refer to the TELPAS Reading manual (page 8-9)

O Not Permitted:O Reading assistanceO Reference materialsO Test questions or selections translatedO Test questions, answer choices, or

selections clarified

Reading Test Administrator • Reading Test Administrator is the person who,

during the test session, guides students through opening their tests, and begins the test itself.

• The test administrator is responsible for maintaining test security and for managing breaks/interruptions.

• Reading Test Administrator:▫ Rater▫ Certified Teacher

Computer Check• Jamie will complete TestNav System

Check

O If on test day, computers FAIL to launch TestNav:O Contact me Ext. 1047 Cell 940-389-

5979O Campus NameO Room Number

Materials Needed for Testing

O Copy of manualO Seating ChartO Test Session RosterO Student Authorization Letters (secure

documents)O Scratch paper for each studentO Pencils for each student

TELPAS Reading Manual p: 19

Student Authorization Letters

• Each student must have a Student Authorization Letter in order to log in to a test.

• The authorization letter contains the web address that students enter to access TestNav with the unique username and test coded needed.

• A password is not required to log into a test, so the password field will be blank.

• You can print these letters any time before students in the session are to log in to the test. The letters must be kept in a secure location until the test is administered.

• Click the GET AUTHORIZATION button on the Session Roster screen to access.

• Place in the TELPAS Documentation notebookTELPAS Reading Manual p: 18

Testing Environment• At least one trained administrator for every

30 students.• Computer monitors prepared to discourage

students from viewing each other’s monitor.• Bulletin boards and instructional displays

that might aid students during testing must be removed or covered.

• The testing room should be quiet, well lighted, comfortable, with enough space to work.

• “Testing-Do Not Disturb” sign posted outside the testing room.

Testing Procedures• Seating chart is completed to include students’ names,

locations, and test administrator information.• The test is untimed.• Work stations are cleared of books and other materials.• Student MUST remain seated and no conversing while

testing.• Each student must be allowed to work at his or her

individual speed.• NO reference materials are allowed.• Allowed to use scratch paper, but all scratch paper must

be destroyed after test administration.• Active monitoring during the test session.• After students have finished, they may read or leave the

room.• BEFORE a student who has finished testing leaves the

room, test administrator must ensure the student’s test is in “Submitted” status.

TELPAS Reading Manual p: 20-21

Other Testing IssuesO Answering student questions O Computer monitor glareO Student breaksO LunchO Cell phonesO EmergenciesO Changing rooms

TELPAS Manual p: 21-22

Starting a Test

A test session MUST be started before any students can log in to TestNav and begin the test.

A test session does not start until the TEST ADMINISTRATOR clicks the Start button on the Session Details screen, regardless of the scheduled start time and date.

TELPAS Reading Manual p: 23

Launching the Test

• Before students in GR 2-5 can begin the test, TestNav must be launched on each student’s computer, and the login ID and test code found on each Student Authorization Letter MUST be entered by the Test Administrator.

• Do NOT begin a test for an ABSENT student.

TELPAS Reading Manual p: 31

Launching the TestO Test administrators guide students

through the login process for GR 6-12

TELPAS Reading Manual p: 37

Monitoring Sessions

• Session Details screen

• Periodically click Refresh

• Real-time test status

STATUS:•Ready•Active•Exited•Resumed •Resumed-Upload•Completed•Marked Complete

TELPAS Reading Manual p: 24-25

ResumeO If a student exits TestNav---

O Return to Session Details and select the checkbox next to that student’s name.

O A resume checkbox is only available if that student’s status is Started, Exited, or Resume.

O Click the Resume Test button to resume all students you checked.

O Students launch TestNav and login using same Login ID and code from authorization letter.

TELPAS Manual p: 25

Submitting AnswersO Student needs to click Final Submit before

they are doneO Exiting TestNav alone does NOT submit

answersO Refresh to ensure students status are

Completed

“Do Not Score”O Session Details screen select student’s

name.O Click Edit button. O Select Reading “Do Not Score” Score

Code. O A designation must be selected. O Absent students are to be MOVED into a

make-up session prior to stopping the session.

TELPAS Reading Manual p: 26

Stopping a SessionO Ensure each student’s status is Completed

or Marked Complete on the Session Details screen.

O Click the Stop button to stop the test session.

O Call me if you have questions/concerns

Secure TELPAS Information• Content of the online reading test is

secure and confidentiality must be maintained.

• Student Authorization Letters are to be kept secure until needed for testing.

• All student data in the TELPAS system or entered into the system is confidential.

• Passwords and user IDs used in the TELPAS system are secure and should be kept confidential.

TELPAS Reading Training

O Test administrator MUST read the TELPAS Reading Test Administrator Manual.

Campus Coordinator Documentation

O Notebook

O Collect and put Student Writing Collections in the students’ permanent record files.

Paper Administrations of TELPAS Reading

•Process not changing

•Paper test booklets (including large print, if applicable) approved by TEA in rare circumstances• Accommodations that are not available in TestNav• Unavoidable technological problems that make

online testing impossible• Other special situations (e.g., homebound

students, JJAEPs, etc.)77

Spring 2015

Paper Administrations of TELPAS Reading

Set up test sessionChoose correct form group type (transcribe paper

form, not operational online test form)Transcribe responses

Each question has one screen; test administrators will go screen by screen to transcribe the response to each question

Responses must match exactly the responses indicated by the student in the test booklet

Submit test for scoringFor TELPAS, students must be put into rating entry

groups so proficiency ratings and rater information can be entered

78

Process for Transcribing Student Responses

Keep in Mind…

Paper testing won’t be approved on basis that student knows very little English has limited exposure to computers

Don’t forget the TELPAS online student tutorials!

79

Questions

To Do…O Collect NotebooksO Verify raters and studentsO Review schedule of eventsO Sign oaths:

O Campus Testing Coordinator for TELPAS

O Test Administrator for TELPAS Reading

O Writing Collection Verifier