Embed Size (px)
Citation preview
TELPAS 2015Kristen Joslin, DTC
This training does not
replace your responsibility to read and follow all
manuals and supplements.
Manuals to consider:
2015 DCCM
Test Security Supplement
TELPAS: Rater Manual
TELPAS: Reading Test Administrator Manual
General Information• Grades K-12 LEP students including parent
denials• Components
▫ K-1 reading, writing, listening and speaking▫ 2-12 writing, listening, speaking and on-line reading
test• Test Dates
▫ Writing Collection: Feb 16 - March 26 ▫ Reading online: March 16 - April 8 (should not have
“absent” students)▫ Late arrivals – _________ or later, reading test only
Who Takes TELPAS
All ELLs in grades K–12, including those whose parents decline bilingual/ESL program services, are assessed annually.
TEA 5
In extremely rare cases, an ELL receiving special education services may be exempted from particular TELPAS domain(s) by the ARD committee in conjunction with the LPAC.
LEP & SpEd Students• The ARD and LPAC committee meet
TOGETHER to determine domain by domain for rating and testing students.
• Documented on “ESL/Bilingual & Special Education Test Assignment and Accommodations” Form
• Deadline is February 21, 2014
NO BLANKET EXEMPTIONS.
Years in U.S. SchoolsO Years in US Schools is often confusing
because pre-K and Kinder are not included in the count. It starts with grade 1
O Keep in mind the 60 day ruleO Years in U.S. schools are important because
they are used to determine accountability performance requirements for AYP and the Progress Measurement
O For more information refer to the LPAC Manual
TEA Dates
4
Date Activity
1/12 Assembling and Verifying Grades 2–12 Writing Collections Course available
1/23 End date for district coordinator training—all TELPAS components
1/26 Online basic training courses for new K–1 and 2–12 raters available
1/26 Supplemental support provider recorded Web-based training available
2/6 End date for campus coordinator training—holistically assessed components
2/16 End date for training raters and verifiers on administration procedures
2/16 Earliest eligibility date for TELPAS writing samples
2/16 Calibration window opens for new and returning raters—first 2 sets
2/25 Third and final calibration set available
3/16–4/8 TELPAS assessment window
4/09–4/10
TELPAS data verification window
Test Security and Confidentiality
O Protect the contents of all online assessment and student performance (ratings and writing samples) documentation
O Train and sign oath prior to handling testing materials.
O No viewing, discussing, providing answers to secure testing materials (paper or on-line)
O This also includes sharing answers to the raters training in Tx Training Center.
Campus Test Coordinator Responsibilities
TELPAS
Campus Coordinator Responsibilities
• Read all manuals • You will act as the writing collection verifier
• Enter/verify student information in the online system
• Ensure computer systems have been checked before testing▫ Contact Jamie Scott if
you have computer issues
Campus Coordinator Responsibilities
• Ensure that all eligible students are identified and tested (Howard)
• Oversee the implementation of validity and reliability
• You and your principal are responsible for test security on your campus
• Supervise and actively monitor testing
• Be the campus contact for all questions about testing
• Report testing irregularities and security violations immediately
• Campus documentation will go into the notebook and returned by May 1.
Things to Know About TELPAS Rater Training
and Administration Procedures
TEA 13
Overview of the Rating ProcessODistricts identify ELLs in grades K–12 and
designate raters to assess studentsOTest administration procedures and
holistic rating training conducted to prepare grades K–12 raters to assess English language proficiency consistent with the holistic scoring rubrics, the Proficiency Level Descriptors (PLDs)
ORaters gather writing samples for ELLs in grades 2–12 to include in each student’s writing collection
ORaters use PLDs to assign students a rating in each language domain assessed
14
Rater Credentials
Each teacher selected to rate an ELL must
1) have the student in class
2) be knowledgeable about the student’s ability to use English in instructional and informal settings
3) hold valid education credentials such as a teacher certificate or permit
4) be appropriately trained, as required by TEA TEA
15
TELPAS Rater Responsibilities
O A student’s TELPAS rater is the teacher designated by the district as the official rater of the student’s English language proficiency.
O The student’s rater must rate the student in all domains for which the student is eligible. A student is not permitted to have one rater for some domains and another rater for other domains.
TEA 16
TEA 17
Collaboration with Others
In determining the proficiency ratings
of their assigned students, raters are
highly encouraged to collaborate with
other teachers and school personnel
who have knowledge of the students’
English proficiency.
New and Returning Rater Definitions
for K–1 and 2–12
•A returning rater who has not completed the basic online training within the past three years will be required to complete training as a new rater.
TEA
18
TEA
19
Two Types of TrainingO Online basic training course
This course is for new raters. It provides instruction on using the PLD rubrics and gives raters practice rating students in each language domain. There are separate courses for K–1 and 2–12.
O Online calibration This is for all raters. Raters use the PLDs to rate students in each language domain. Raters have three opportunities to calibrate on assigned grade cluster.
Returning Raters
Online Basic Training Course
Online Calibration (Sets 1 and 2*)
If not calibrated: Supplemental Holistic Rating Training
Final Online Calibration (Set 3)
Spring TELPAS Administration Procedures Training
As a key part of this training, information from the TELPAS Manual for Raters and Test Administrators is reviewed to prepare raters to proceed with online holistic rating training
Fall ELPS-TELPAS Foundational (Awareness) Training
For teachers who will be trained as new TELPAS raters in the spring if they lack this foundation
Online Calibration (Sets 1 and 2*)
New Raters
*Set 2 required only if not successful on Set 1
When and where do raters take the online training?
O I will notify raters of which training they will be required to attend by Feb. 30.
O March 2 or 3: New Raters (all day)
O March 4 or 5: Returning Raters (half day)
O If calibration is not completed, raters may do so during school hours, at home after school, or on weekends.
O The online training system allows raters to access the training from any computer that meets the minimum system requirements.
TEA
21
Why is calibration necessary?
O Calibration helps ensure that raters have adequate training, including ample practice and feedback, before they assess their students in the spring.
O Calibration ensures that raters clear their heads and consider only the elements of student performance included in the PLDs.
O Calibration supports assessment validity and reliability and is an important part of holistically scored assessment processes.
TEA
22
Is calibration a test?No, it is a training method that ensures that raters have enough guidance, practice, and support to assess students consistently and accurately.
TEA
23
Preparing for Calibration Sets
ONew raters must complete the online basic training course before beginning calibration.
OReturning raters have the option to review the online basic training course (which includes rating activities) before beginning calibration.
Other Things to Know About Calibration
O Raters affirm online that they will keep the contents of the calibration sets secure and confidential.
O Calibration activities are taken from a bank and randomized. Trainees will rate different sets of students.
O Raters can work at their own pace, go back and review students, and change ratings as they work.
TEA
24
Other Things to Know About Calibration
O Raters can exit and return later to finish. They click a “submit” button when they are finished with a set.
O After completing a calibration set, raters immediately see results. Results show the rating assigned by the rater and the correct rating.
O Raters see annotations explaining the ratings. Raters should use the annotations to go back and review any incorrectly rated students.
TEA
25
Will raters be able to refer to any resources during calibration
activities?Yes, raters should use their rating rubrics (PLDs) and refer to, as needed, information from the:O online basic training course
O holistic rating PowerPoints produced by TEA
O TELPAS Manual for Raters and Test Administrators
O Educator Guide to TELPAS
TEA
26
Proficiency Level Descriptors (PLDs)
The PLDs are the rubrics teachers use to determine students’ English language proficiency for ongoing formative assessment and the spring TELPAS administration.
Originally developed for TELPAS, the PLDs were incorporated into the Texas English language proficiency standards (ELPS) in the 2007–2008 school year to reinforce their use in instruction.
TEA
27
6 Sets of PLDsO Listening Grades K–12
O Speaking Grades K–12
O Reading Grades K–1Grades 2–12 (online)
O Writing Grades K–1
Grades 2–12 (writing collection)
TEA
28
TEA
29
Key Features of Each Proficiency Level
O BeginningO Little or no English ability
O IntermediateO Limited ability, simple language structures,
high-frequency vocabulary, routine contexts
O AdvancedO Grade appropriate, with second language
acquisition supportO Advanced High
O Grade appropriate, with minimal second language acquisition support
How many students must be rated successfully?
To be successful, raters need to rate students in
their assigned grade cluster with at least 70%
accuracy.
TEA
30
Supplemental Holistic Rating Training
O Raters not successful after sets 1 and 2 must receive supplemental training.
O After the rater has received supplemental training, he or she will be able to access the third and final calibration set.
TEA
31
Recap of Calibration Process
OThere are 3 sets of 10 students.ORaters who calibrate on set 1 are done.ORaters who don’t calibrate on set 1 go on to
set 2. Raters who calibrate on set 2 are done.
ORaters who don’t calibrate on set 2 receive supplemental training.
ORaters attempt third and final calibration set.
ORaters who calibrate on set 3 are done.
TEA
23
What happens if a rater is unsuccessful in calibrating?
Two outcomes are possible for individuals who complete the calibration activities but are not successful:
O The district may choose not to assign the individual to be a TELPAS rater.
O If the individual is needed to serve as a rater, the district must implement rater support procedures to ensure that the rater’s students are evaluated consistent with the rating rubrics.
Individuals are not authorized to serve as raters unless they complete the required training
components.
TEA
33
Rating Roster
There must be teacher collaboration on ratings as part of the Validity & Reliability process
An Additional Rater is required if the Rater did not pass the Calibration set with a 70% or higher after the 3rd attempt
TELPAS Validity and Reliability Procedures
O TEA mandated district procedures
O For all language domains – grades K-12: O Raters will collaborate with other teachers of
the students in determining the student’s rating. One collaborator will initial the TELPAS Rating roster for each child
O For writing – grades 2-12: O All writing collections will be approved/verified
before raters may begin the rating process.
Course and Calibration Certificates
O Raters who take the basic training course get a certificate from the online TxTrainingCenter after completing the course components.
O Raters will receive a certificate of successful calibration when they calibrate.
O They will be given direction to print them off and turn into you.
O All certificates will go in the TELPAS Documentation notebook
TEA
36
Assembling and
Verifying W
riting
Collections
Assembling and Verifying Writing Collections
O2 – 12O Five writing samplesO At least one narrative about a past eventO At least two academic writing samples
from math, science, or social studies.O All samples must have student’s full
name and date accomplished on themO Only writing samples on or after
February 16th may be used
Assembling and Verifying Writing Collections
O May be a “clean” copy from work by the student to include a journal
O No corrections by teacher or peersO May be typed but spelling and
grammar checker must be offO The writing collection cover sheet
and verification from Appendix A must be completed and attached on top of the samples for each student
What Not to Be Include in Collections
• Copied from a textbook, lesson, or other written sources.
• Papers done with heavy use of a dictionaries or thesaurus
• Papers with teacher’s, peers, or parents corrections
• Written primarily in another language than English
• Worksheets or Q and A writing assignments
• Brief, incomplete, or rushed papers
Verifier ResponsibilitiesAttend training on administrative proceduresObtain access to Texas Training CenterComplete online training “Assembling and
Verifying Writing Collections” Print Certificate of Completion and put in
notebookVerify student writing collections in accordance
with the checklistSign OathVerifier cannot be a TELPAS Rater
Online Training- VerifiersVerifiers need self register for an account in the
Texas Training Center https://texas.pearson.desire2learn.com
Site Code: telpas2015Returning users that have forgotten their login information click on the “Login Help” link
New Users click on the “Self Registration” link
Page 57 in Rater Manual
Online Training- VerifiersVerifiers need to self register for an account in
the Texas Training Center https://texas.pearson.desire2learn.com
Site Code: telpas2015Click on TELPAS 2015 under the “My Texas
TrainingCenter Program” header then:
Verifying the Writing Collection
Verifiers ensure that the writing collections meet all of the criteria based on the Verification Checklist by initialing each item (checklist is on the back of the Writing Collection Cover Sheet) page 54 of Rater Manual
Verifiers sign the bottom of checklistWriting Collections are secure materials
TELPAS Reading
TELPAS Reading
O TELPAS reading is conducted as an online only assessment
O Administered to all LEP students in grades 2-12
O Since it is online, there are no test booklets or answer documents to handle or process
TELPAS Reading Accommodations
O Refer to on-line accommodationsO It is possible that a required accommodation
is not available with online testing. In those cases, we will have to request approval from TEA to give a paper version of the test and order the materials. This is not a last minute process. Plan Ahead!!
TELPAS Reading Make-Ups
O All students must be assessed within the assessment window
O If a student is absent the day you have them scheduled to take TELPAS reading then move them to another session that will test later within the TELPAS assessment window
O The TEA expectation is that we test every eligible student within the TELPAS assessment window
Tutorials• All students are required to take the tutorial
prior to the day of the test. May take as many times as campus wants.
• Tutorials are about how to use the computer not necessary the type of test questions
• Keep a student roster for documentation of the tutorials for the TELPAS Documentation notebook
• http://www.texasassessment.com/TELPAS/tutorials/
• Student Tutorial Administration Directions are available at the bottom
Ratings
O If a student is not rated in one or more domains, select one of the following:
E = Extenuating CircumstancesX = ARD Decision
DOMAINS LEVEL
Listening Beginning
Speaking Intermediate
Reading Advanced
Writing Advanced High
Entering Ratings
• I will responsible for creating and managing Rating Entry Groups.
• You will be responsible for entering your raters ratings before the verification window. (noted on the calendar)
Entering RatingsO K-1 need to be grouped in a Rating Entry
Groups so that student ratings can be entered online. Ratings entered for K-1 include listening, speaking, reading, and writing.
O 2-12 can be sorted one way for entering ratings and for reading another way. Ratings for students will be entered for listening, speaking and writing.
On-line Reading
Administratio
n
DATES• On-line reading assessment: March 16 – April
8• Schedule of schools
▫ HS:▫ JH:▫ BSI:▫ Moss:▫ Goliad:▫ Marcy:▫ Washington:
Prepare for TELPAS Reading GR 2-12
• Links to the web-based tutorials available for each grade cluster on Testing Department website.
• No downloading or installation is necessary to access and use the tutorials.
• With NO sample items in the actual test, make sure to schedule lab time for students to practice with the tutorial.
TELPAS Reading
O Students in grades 2-12 are assessed through an online multiple-choice test.
Grade Clusters
2
3
4-5
6-7
8-9
10-12
Testing Accommodations
O Refer to the TELPAS Reading manual (page 8-9)
O Not Permitted:O Reading assistanceO Reference materialsO Test questions or selections translatedO Test questions, answer choices, or
selections clarified
Reading Test Administrator • Reading Test Administrator is the person who,
during the test session, guides students through opening their tests, and begins the test itself.
• The test administrator is responsible for maintaining test security and for managing breaks/interruptions.
• Reading Test Administrator:▫ Rater▫ Certified Teacher
Computer Check• Jamie will complete TestNav System
Check
O If on test day, computers FAIL to launch TestNav:O Contact me Ext. 1047 Cell 940-389-
5979O Campus NameO Room Number
Materials Needed for Testing
O Copy of manualO Seating ChartO Test Session RosterO Student Authorization Letters (secure
documents)O Scratch paper for each studentO Pencils for each student
TELPAS Reading Manual p: 19
Student Authorization Letters
• Each student must have a Student Authorization Letter in order to log in to a test.
• The authorization letter contains the web address that students enter to access TestNav with the unique username and test coded needed.
• A password is not required to log into a test, so the password field will be blank.
• You can print these letters any time before students in the session are to log in to the test. The letters must be kept in a secure location until the test is administered.
• Click the GET AUTHORIZATION button on the Session Roster screen to access.
• Place in the TELPAS Documentation notebookTELPAS Reading Manual p: 18
Testing Environment• At least one trained administrator for every
30 students.• Computer monitors prepared to discourage
students from viewing each other’s monitor.• Bulletin boards and instructional displays
that might aid students during testing must be removed or covered.
• The testing room should be quiet, well lighted, comfortable, with enough space to work.
• “Testing-Do Not Disturb” sign posted outside the testing room.
Testing Procedures• Seating chart is completed to include students’ names,
locations, and test administrator information.• The test is untimed.• Work stations are cleared of books and other materials.• Student MUST remain seated and no conversing while
testing.• Each student must be allowed to work at his or her
individual speed.• NO reference materials are allowed.• Allowed to use scratch paper, but all scratch paper must
be destroyed after test administration.• Active monitoring during the test session.• After students have finished, they may read or leave the
room.• BEFORE a student who has finished testing leaves the
room, test administrator must ensure the student’s test is in “Submitted” status.
TELPAS Reading Manual p: 20-21
Other Testing IssuesO Answering student questions O Computer monitor glareO Student breaksO LunchO Cell phonesO EmergenciesO Changing rooms
TELPAS Manual p: 21-22
Starting a Test
A test session MUST be started before any students can log in to TestNav and begin the test.
A test session does not start until the TEST ADMINISTRATOR clicks the Start button on the Session Details screen, regardless of the scheduled start time and date.
TELPAS Reading Manual p: 23
Launching the Test
• Before students in GR 2-5 can begin the test, TestNav must be launched on each student’s computer, and the login ID and test code found on each Student Authorization Letter MUST be entered by the Test Administrator.
• Do NOT begin a test for an ABSENT student.
TELPAS Reading Manual p: 31
Launching the TestO Test administrators guide students
through the login process for GR 6-12
TELPAS Reading Manual p: 37
Monitoring Sessions
• Session Details screen
• Periodically click Refresh
• Real-time test status
STATUS:•Ready•Active•Exited•Resumed •Resumed-Upload•Completed•Marked Complete
TELPAS Reading Manual p: 24-25
ResumeO If a student exits TestNav---
O Return to Session Details and select the checkbox next to that student’s name.
O A resume checkbox is only available if that student’s status is Started, Exited, or Resume.
O Click the Resume Test button to resume all students you checked.
O Students launch TestNav and login using same Login ID and code from authorization letter.
TELPAS Manual p: 25
Submitting AnswersO Student needs to click Final Submit before
they are doneO Exiting TestNav alone does NOT submit
answersO Refresh to ensure students status are
Completed
“Do Not Score”O Session Details screen select student’s
name.O Click Edit button. O Select Reading “Do Not Score” Score
Code. O A designation must be selected. O Absent students are to be MOVED into a
make-up session prior to stopping the session.
TELPAS Reading Manual p: 26
Stopping a SessionO Ensure each student’s status is Completed
or Marked Complete on the Session Details screen.
O Click the Stop button to stop the test session.
O Call me if you have questions/concerns
Secure TELPAS Information• Content of the online reading test is
secure and confidentiality must be maintained.
• Student Authorization Letters are to be kept secure until needed for testing.
• All student data in the TELPAS system or entered into the system is confidential.
• Passwords and user IDs used in the TELPAS system are secure and should be kept confidential.
TELPAS Reading Training
O Test administrator MUST read the TELPAS Reading Test Administrator Manual.
Campus Coordinator Documentation
O Notebook
O Collect and put Student Writing Collections in the students’ permanent record files.
Paper Administrations of TELPAS Reading
•Process not changing
•Paper test booklets (including large print, if applicable) approved by TEA in rare circumstances• Accommodations that are not available in TestNav• Unavoidable technological problems that make
online testing impossible• Other special situations (e.g., homebound
students, JJAEPs, etc.)77
Spring 2015
Paper Administrations of TELPAS Reading
Set up test sessionChoose correct form group type (transcribe paper
form, not operational online test form)Transcribe responses
Each question has one screen; test administrators will go screen by screen to transcribe the response to each question
Responses must match exactly the responses indicated by the student in the test booklet
Submit test for scoringFor TELPAS, students must be put into rating entry
groups so proficiency ratings and rater information can be entered
78
Process for Transcribing Student Responses
Keep in Mind…
Paper testing won’t be approved on basis that student knows very little English has limited exposure to computers
Don’t forget the TELPAS online student tutorials!
79
Questions
To Do…O Collect NotebooksO Verify raters and studentsO Review schedule of eventsO Sign oaths:
O Campus Testing Coordinator for TELPAS
O Test Administrator for TELPAS Reading
O Writing Collection Verifier
