Fall ELL Assessment Update

Fall ELL Assessment Update

September 09, 2013TETN Event #20783Student Assessment DivisionTexas Education Agency

Disclaimer These slides have been prepared by the

Student Assessment Division of the Texas Education Agency

If any slide is changed for local use, please remove the TEA footer at the bottom of the slide

TEA Fall ELL Assessment Update - DRAFT 2

Topics

What’s New

STAAR Spanish Highlights

STAAR L

TELPAS

Key Steps to Take this Fall

ELL Progress Measure


What’s New


What’s New at TEA? Assessments for students served by special

education and assessments for ELLs are now the responsibility of the Assessments for Special Populations Unit in the Student Assessment Division.


STAAR L Practice Sets Practice sets consist of approximately 25 items

for each STAAR L assessment To be posted in early 2014 Will be available in online format similar to

TELPAS so that students may experience the items as they will be presented in the operational administration.


STAAR L and SSI Beginning 2013–2014, 5th and 8th grade

students assessed with STAAR L in mathematics will be held to same SSI requirements for both mathematics and reading, including retesting, as students taking the general STAAR assessments


Special English I EOC ProvisionsTAC §101.1007

For ELLs who ― have been enrolled in U.S. schools 3 school years or less (5 or

less if qualifying unschooled asylee/refugee) and have not yet attained TELPAS advanced high reading rating

When enrolled in English I/ESOL I course, eligible ELL shall not be required to retake assessment each time it is administered if student passes course but does not meet standard

Rule to be posted for public comment in October for 30 days

Note: Students are not exempt from testing while in the course Provisions do not apply to English II


TELPAS Standards Review Committees comprised of ELL focus group

members and educators convened in August to review standards for grades 2–12 TELPAS reading tests

Cut scores adjusted for each proficiency level of each grade cluster test

These standards will be implemented spring 2014


Data Collection Changes Beginning in the 2013–2014 school year, students

must be enrolled for 60 consecutive school days for that year to count in years in U.S. schools calculations. Please note that this is not to be calculated retroactively.

Unschooled Asylee Refugee Continue as it has in the past

Students with Interrupted Formal Education (SIFE) SIFE and Limited Prior Schooling groups from 2012–2013

have been collapsed This data will be collected through the student data

upload Specific information will be included in the 2014

DCCMTEA Fall ELL Assessment Update - DRAFT 10

TELPAS Administration Manuals

Spring test administration manuals will be split — TELPAS Rater Manual TELPAS Reading Test Administrator Manual

This should decrease the number of additional manuals ordered by districts


Spanish STAAR Highlights


STAAR Spanish Available for students in grades 3–5

Grades 3–5 reading and math Grade 4 writing

Grade 5 science Same grades and subjects are tested as

English


Who Takes STAAR Spanish? Students for whom Spanish version of STAAR

test is the most appropriate measure of academic progress

LPAC determines if STAAR Spanish is an appropriate assessment for ELLs and non-ELLs


STAAR– Increased Expectations

Focus is on the most essential curriculum: readiness standards

Content and skills are addressed at a greater depth and cognitive complexity

Rigor evident on the test as a whole individual test questions more inferential questions performance standards


Test Development Process20 Steps


Key Steps in STAAR Item Development

Annual Activities: Testing contractor develops items TEA reviews items and ensures items meet

quality assurance Educators review the items for appropriateness

before they are field tested (language, grade level, TEKS, free from bias, etc.)

Items are field tested Data of items is reviewed Items with solid data are included in the Item

Bank Tests are constructed from the Item Bank


How is STAAR Spanish Developed?

Follow the same guidelines as English item development

Reading and Writing The items and/or passages are developed

separately to account for cultural and linguistics differences.

Mathematics and Science Items from English development are

translated or transadapted into Spanish.


Transadaptation Process for STAAR Spanish Math and Science

Test items for STAAR Spanish are selected from the English development

Goal is to build tests for regular STAAR and STAAR Spanish using the same items if appropriate

Item writing and review process for transadapted items ensure that items in Spanish are linguistically and culturally appropriate and that they meet grade-level expectations

Every year bilingual educators review selected items for STAAR Spanish tests


Spanish/English Alignment on STAAR Tests

STAAR Spanish and regular STAAR both – follow the same item development

guidelines use the same blueprints adhere to same guidelines to build tests

in terms of range of content tested and cognitive complexity

expect same student performance


2013

SpanishTotal Students

in 2013(Satisfactory)

LII-2013

(Advanced)

LIII-2013(Unsatisfactory)LI

-2013

Grade 03 READ 36,841 68% 15% 32%

Grade 04 READ 24,323 57% 11% 43%

Grade 04 WRIT 25,436 59% 3% 41%

Grade 05 READ 10,785 70% 10% 30%

Grade 03 MATH 19,024 59% 8% 41%

Grade 04 MATH 9,426 51% 7% 49%

Grade 05 MATH 3,606 44% 5% 56%

Grade 05 SCIENCE 5,370 41% 2% 59%


2013 STAAR Spanish Student Performance

Grade Subject 2012 2013 % Change

3 Math 56% 59% 3%

Reading 65% 68% 3%

4 Math 53% 51% -2%

Reading 60% 57% -3%

Writing 64% 59% -5%

5 Math* 49% 44% -5%

Reading* 69% 70% 1%

Science 41% 41% 0%

* Primary Administrations


STAAR Spanish Student PerformanceSpring 2012 and 2013

Key Elements for Success in STAAR

Understand the level of performance the TEKS require

Teach students the academic vocabulary Teach both readiness and supporting content

and skills Emphasize critical/inferential thinking, problem

solving, and application rather than isolated or memorized content and skills

Reinforce connections between different content areas (e.g., math and science, math and reading)


EXAMPLES OF TRANSADAPTED ITEMS


Grade 3 Math


Grade 3 Math – Spanish


Grade 5 Science


Grade 5 Science – Spanish


Grade 5 Math


Grade 5 Math – Spanish


Additional Information

2013 STAAR tests were released in August Grade 4 Writing Scoring Guides are

available on the Student Assessment website

Timeline for new mathematics curriculum


Timeline for New Mathematics TEKSSTAAR Grades 3–8

New TEKS adopted in April 2012 Convene advisory groups in 2013 New STAAR items are being developed to

address new TEKS in 2014 Implement new TEKS in 2014–2015 school

year New STAAR items are field-tested in 2014–

2015 school year New STAAR items are assessed in 2015–

2016 school year


STAAR L


2013 STAAR L Administrations Online interface provided certain linguistic

accommodations for qualifying students: Clarification in English at the word or phrase level for

pre-determined words Words read aloud at the word-by-word level

35,000 students across the state were administered STAAR L across all administration in 2013


STAAR L Online Student Tutorial

Available early spring 2014 Minor updates to grades 3–8; Updates to EOC

version to address assessment changes from HB 5

Should be used to familiarize students with clarification and read aloud accommodations and standard TestNav tools

Test administration directions for operational STAAR L assessments will assume some familiarity with online interface


STAAR L Paper Administrations

Paper test booklets (and ECGs as applicable) will be approved by TEA in rare circumstances Accommodations that are not available in

TestNav Unavoidable technological problems that make

online testing impossible Other special situations (e.g., homebound

students, JJAEPs, etc.) Similar to TELPAS paper request process Detailed information about STAAR L paper

request process will be posted on Coordinator Manual Resources page at http://www.tea.state.tx.us/student.assessment/manuals/dccm


http://www.tea.state.tx.us/student.assessment/manuals/dccm

http://www.tea.state.tx.us/student.assessment/manuals/dccm


STAAR L Paper Administrations

Student who was approved for a paper administration in the spring but is retesting in December will not automatically receive paper materials

DTC should forward prior approval to TEA at [email protected] so paper materials can be ordered from Pearson

mailto:[email protected]

ELLs with Parental Denials TAC §101.1005 (f)

Reminder: These students are not eligible for special ELL assessment, accommodation, or accountability provisions No testing in Spanish No linguistic accommodations during testing No English I EOC special provisions No unschooled asylee/refugee provisions

ELLs with parental denials may, however, use bilingual, ESL, or other allowable dictionaries as part of dictionary policy for STAAR reading and writing tests in grade 6 and up; under this policy, use of dictionaries not considered linguistic accommodation


TELPAS


TELPAS Administration

Assessment window for spring: March 17–April 9

Data verification window: April 10–11


TELPAS Spring DatesDate Activity

Jan 9 Assembling and Verifying Grades 2–12 Writing Collections course available

Jan 24 End date for district coordinator training—all TELPAS components

Jan 27 Online basic training courses for new K–1 and 2–12 raters available

Jan 27 Supplemental support provider recorded Web-based training available

Feb 7 End date for campus coordinator training—holistically assessed components

Feb 17 Calibration window opens for new and returning raters—first 2 sets

Feb 17 End date for training raters on administration procedures

Feb 17 Earliest eligibility date for TELPAS writing samples

Feb 26 3rd and final calibration set available; supplemental training begins

Mar 17-Apr 9

TELPAS assessment window


Holistic Rating Training Resources2013–2014 training resources:

PowerPoint presentations (updated) Making the ELPS-TELPAS Connection: K–12 Overview

Introductory Training on the PLDs (separate modules for K–1 and 2–12)

Grades 2–12 Writing Collection Overview

Holistic Rating Training Requirements

Educator Guide to TELPAS

These resources will be available on the TELPAS Resources webpage at

www.tea.state.tx.us/student.assessment/ell/telpas/TEA Fall ELL Assessment Update - DRAFT 42

http://www.tea.state.tx.us/student.assessment/ell/telpas/

TELPAS Calibration – Spring 2012 and 2013


Grades K–1

Grade 2

Grades 3–5

Grades 6–8

Grades 9–12

2012 Total Successful Calibration

s

29205100%

15464100%

36054100%

1716099%

1498898%

2013 Total Successful Calibration

s

29689100%

15336100%

3641599%

1746099%

1545498%

2012 Successful after Set 1

2659991%

1386390%

3014283%

1323377%

996465%


2590187%

1146675%

2343264%

1365977%

1215477%

TELPAS Calibration – Spring 2012 and 2013


Grades K–

1

Grade 2

Grades 3–5

Grades 6–8

Grades 9–12


23658%

13369%

494814%

343320%

380425%


323411%

320321%

1012628%

242414%

270217%


2411%

2652%

9643%

4943%

12208%


5542%

6674%

28578%

13778%

5984%

2012 Unsuccessful

after Set 3

80%

130%

1360%

870%

2462%

2013 Unsuccessful

after Set 3

470%

460%

2501%

1991%

3792%

TELPAS Course Completions– Spring 2013


Course Completions

Assembling and Verifying Writing Collections

8138

Grades K–1 Online Basic Training Course 17961

Grades 2–12 Online Basic Training Course 22741

TELPAS Release There will be a full release of TELPAS

forms for all grade bands in 2014. These are to be released in an online

format to allow them to be seen in the TestNav environment, just as the students see the operational test.


Key Steps to Take This Fall


1. Conduct ELPS and TELPAS professional development sessions

Teachers are required to implement the ELPS and content area TEKS in instruction

District and campus administrators need working knowledge of ELPS and TELPAS

TELPAS familiarization training is good for future raters good way to reinforce use of PLDs all year

long


2. Help support teacher use of TELPAS results and ELPS PLDs to monitor and maximize learning of English

Beginning of year: Review ELLs’ past TELPAS results to see if

making steady progress in learning English

TELPAS confidential campus student rosters include 2 years of test scores how long student has been in U.S. schools


3. Help support LPAC use of TELPAS results and ELPS PLDs to monitor and maximize learning of English

LPAC meetings during school year: Use previous spring’s TELPAS results and

current year’s teacher input to gauge progress in English proficiency review and adjust linguistic

accommodations used in instruction plan for instructional interventions, if

necessary plan for linguistic accommodations

during state assessment TEA Fall ELL Assessment Update - DRAFT 50

Remember When implemented effectively in instruction,

linguistic accommodations accelerate learning of academic content and

English

reduce length of time and degree to which substantial linguistic accommodations needed

The ELPS, as measured by TELPAS, support

better learning of the TEKS, as measured by STAAR


ELL Progress Measure


What Will the TEXAS ELL Progress Measure Look Like?

ELL Progress Measure will: take into account the amount of time

needed to acquire English affects time needed to fully learn and demonstrate grade-level academic skills in English

be applied to all content areas Brochure with more information to be

posted this fall on the ELL Assessments webpage at http://www.tea.state.tx.us.student.assessment/ell


http://www.tea.state.tx.us/student.assessment/ell/

http://www.tea.state.tx.us/student.assessment/ell/

ELL Progress Measure Conceptual Model

TEA Fall ELL Assessment Update - DRAFT54

Satisfactory

Initial Years in Schools

Initial TELPAS Composite Proficiency

Level

Plan

1Beginning and Extenuating

Circumstances5-Year Plan

1 Beginning 4-Year Plan1 Intermediate 3-Year Plan1 Advanced 2-Year Plan1 Advanced High 1-Year Plan

2Intermediate or Below

and Extenuating Circumstances

5-Year Plan

2 Intermediate or Below 4-Year Plan2 Advanced 3-Year Plan2 Advanced High 2-Year Plan

3Advanced or Below and

Extenuating Circumstances

5-Year Plan

3 Advanced or Below 4-Year Plan3 Advanced High 3-Year Plan

4Advanced High or Below

and Extenuating Circumstances

5-Year Plan

4 Any TELPAS Score 4-Year Plan

DRAFT

TEA Fall ELL Assessment Update - DRAFT

55

ELL Progress Measure Plan Expectation

5-Yr Plan

1st Year (E1)

2nd Year (E1)

3rd Year (E2)

4th Year (E3)

5th Year (LII)

4-Yr Plan

1st Year (E1)

2nd Year (E2)

3rd Year (E3)

4th Year (LII)

3-Yr Plan

1st Year (E2)

2nd Year (E3)

3rd Year (LII)

2-Yr Plan1st Year (E3)

2nd Year (LII)

1-Yr Plan 1st Year (LII)

DRAFT

TEA Fall ELL Assessment Update - DRAFT56

How Will the ELL Progress Measure be Used?

ELL Progress Measure will be incorporated into the 2014 state accountability reports Used to calculate accountability for

both Index 1 & 2 For detailed information regarding the

accountability system: http://ritter.tea.state.tx.us/perfreport/account/2013/20130328coe/pi_technical_5-23-13.pdf


http://ritter.tea.state.tx.us/perfreport/account/2013/20130328coe/pi_technical_5-23-13.pdf



Upcoming ELL Assessment Training

Annual ESC LPAC Assessment Training TETN October 8, 20139:00 a.m. – 12:00 p.m.Event #20784Open to ESCs only


Would you like to Participate in an Educator Committee?

Educators are invited to review items before they are field tested for:

STAAR (all programs) and TELPAS

Please go to the following link to nominateyourself or other educators: http://educator.force.com/TX


Actual Educators’ Comments

“This was a great learning experience”“I would love to participate again”“Fue una experiencia muy bonita y educativa”“The meeting was informative and made me feel like I made a difference”“Awesome experience!”“!Aprendí mucho!”“Excellent process and very beneficial!”“I really felt that I contributed with my opinions”


Contact Information

Go to www.tea.state.tx.us/student.assessment and click on ELL Assessments

Call the TEA Student Assessment Division at (512) 463-9536

Email us at [email protected]


http://www.tea.state.tx.us/student.assessment

mailto:[email protected]

Documents

Fall ELL Assessment Update