UCSummer Institute

June2011

Alicia Lateer-Huhn

DATA-BASED DECISION MAKING & COLLABORATIVE PROBLEM SOLVING

ASSESSMENT

THE BIG PICTURE

Academic Systems Behavioral Systems

Adapted from OSEP Effective School-Wide Interventions

Decisions about tiers of support are data-based

80-90% School-Wide Interventions

80-90% School-Wide Interventions

5-10% Targeted Interventions

5-10% Targeted Interventions

1-5% Intensive Individualized Interventions

1-5% Intensive Individualized Interventions

Universal Screening

ProgressMonitoring

Progress Monitoring and Diagnostics

What question are we trying to answer?

Screening

Monitoring Progress

Instructional Planning (Diagnostic)

Program Evaluation / Outcomes

ASSESSMENT IS USED FOR DIFFERENT PURPOSES:

Tier 1: Universal screening

Tier 2:Progress Monitoring and additional information

Tier 3:More frequent progress monitoringMore assessments based upon individualized needs (e.g. pre-requisite skills, diagnostics)

*On-going assessments (e.g. formative, mastery, short-cycle, and informal assessments) are part of all 3 tiers and used in meaningful ways

RTI ASSESSMENTS

WHAT QUESTION ARE WE TRYING TO ANSWER WITHIN AN RTI FRAMEWORK?

• Universal Screening– Connected to key academic content or behavior– Conducted at least 3 times per year on a regular basis,

using comparable test forms– Administered school wide to all students– Used to determine if additional examination is warranted– Features: short, few items, focus on critical indicators

• 2 critical pieces of information– Is the Tier 1 core effective?

• For all students (aggregated)?• For each subgroup of students (disaggregated)?

– Who are the students needing additional support? What percent?

TIER 1 ASSESSMENT

Criteria Reliable and valid indicators of skills highly

associated with academic success (reading and math)

Sensitive and accurate Simple, quick, cost effective measures that are

easily repeatable for continuous progress monitoring (practical)

Standardized

• Reliability is critical. Need a process for training and integrity checks of data collection

A SCHOOLWIDE ASSESSMENT SYSTEM-

UNIVERSAL SCREENING

Universal Screening Tools: • Reading

– Dynamic Indicators of Basic Early Literacy Skills (DIBELS)– www.dibels.org or dibels.uoregon.edu

– Curriculum Based Measurement (CBM; www.aimsweb.com or www.studentprogress.org)– Oral Reading Fluency– Maze

• Math– Curriculum Based Measurement (e.g. www.aimsweb.com )

– Number sense– Computation fluency– Algebraic principles

• Behavior– School Wide Information System (SWIS; www.swis.org)

How will we match students to appropriate supports (Why are they struggling?)? Step 1:

All students at or below a team-selected percentile (e.g. 45th percentile) on state or district testing related to literacy

UNIVERSAL SCREENING: A MULTIPLE STEP PROCESS AT

SECONDARY LEVEL

Heartland AEA, IA

1st gate: Assessment: Use of OAA/OGT (reading,

social studies, science) and other available building screening data, such as CBM and common formative assessments to screen out students who are progressing well in Reading. May also consider Office Discipline Referral (ODR) data.

Support: Pass = Daily Reading/English course focus

on “big ideas.” All content-area teachers providing effective vocabulary and comprehension instruction

Doesn’t Pass = Go to Gate 2

MULTI-GATED SYSTEM FOR SECONDARY

2nd gate:

Assessment: Fluency assessment Oral Reading Fluency – Probes available for 7 th

and 8th grade on www.aimsweb.com, create probes for 9th-12th on interventioncentral.org or use 8th-grade passages from Aimsweb

Support: Pass = Needs additional instructional support

in comprehension and/or vocabulary Doesn’t Pass = Goes to Gate 3

MULTI-GATED SYSTEM FOR SECONDARY

Use Oral Reading Fluency data (i.e., words correct per minute) and accuracy information to determine if student “passes”Purpose is to determine which students have adequate fluency. It’s important to know if students are:

accurate and fluent inaccurate and fast inaccurate and slow accurate and slow

School team would need to set its own decision rules Example: any student who scores below the 50% percentile on oral reading fluency and any student who is less than 97% accurate would go to Gate 3

CONSIDERATIONS FOR ORF GATE

3rd gate:

Assessment: Phonics AssessmentExample: placement assessment from a

research-based phonics intervention chosen for Tier 2 or advanced phonics assessment

Support: Pass = Needs additional support in fluency

Access to supplemental Tier 1 fluency intervention (e.g. Read Naturally, Six Minute Solution)

Doesn’t Pass = Tier 1 plus Tier 2 supportElective reading class where a research-based intervention

is implemented. Program should focus on phonics in addition to fluency, vocabulary, and comprehension (e.g. use of Corrective Reading, REWARDS, Language!)

MULTI-GATED SYSTEM FOR SECONDARY

How do you know the data are:

Accurate?Valid?Reliable?

Now, what questiondo the data answer?

BEFORE YOU MAKE ANY DATA-BASED DECISIONS…

Assessment inventoryDo you have tools that answer the question: How healthy is your system?Are students making progress/demonstrating mastery on targeted skills from Tier 1 core instruction?

Are you missing assessment tools?

TURN AND TALK

All students receiving Tier 2 and 3 interventions are assessed on an on-going basis.

Quick assessments (1-5 minutes) Administered frequently (weekly, bi-weekly)

Brief, parallel versions Sensitive to changes in student performance

Individual student graphs with goal and aim-line

TIER 2PROGRESS MONITORING

Progress monitoring is designed to:Estimate rates of student improvement and skill development.

Identify students who are not demonstrating adequate progress.

Compare the efficacy of different forms of instruction and design more effective, individualized instructional programs for students struggling to progress.

PROGRESS MONITORING

DIBELS/AIMSwebBenchmarksMastery testsDiagnosticsDRA

Placement testsChecklistsSelf-monitoringCBM

T I E R 3 A S S E S S M E N T S

•Progress Monitoring-same characteristics as tier 2, but more frequent/intensive monitoring•Decision rules made with at least 7 data points•Diagnostic assessment to ensure accurate focus of intervention

•Sample reading assessments

For students who are struggling, further diagnostic assessment may be completed to gather more in-depth information:specific skill deficits and patterns of skills the student does or does not have to determine instructional placement

(May be used at Tier 2; always used at Tier 3)

TIER 3 ADDITIONAL ASSESSMENT:DIAGNOSTICS / INSTRUCTIONAL

PLACEMENT

Must establish clear decision rules for data and intervention implementation. This is a fluid model!! Clear procedures are needed.Moving from Tier 1 to Tier 2Moving from Tier 2 to Tier 1Moving from Tier 2 to Tier 3Moving from Tier 3 to Tier 2

DECISION RULES FOR MOVING BETWEEN TIERS

Student DataHave at least 7 data points in a phase3 Data-point decision rule—If 3 consecutive data-points

are found below the aim line, suggests that you need to change the intervention.

3 Data points above the goal line suggests need for a change: in goal, fade intervention support, move to more challenging material.

Intervention Implementation Data Intervention occurred at least 80% of the time (child

and teacher present) Integrity was checked every other month and was done

with at least 85% adherence

EXAMPLES OF DECISION RULES FOR MOVING BETWEEN TIERS

COLLABORATIVE PROBLEM SOLVING

CREATING A CULTURE OF

COLLABORATION

Do We Really Collaborate?!

OIP Facilitator’s Guide, September 2010

A COLLABORATIVE TEAM:

A group of people working interdependently to achieve a common goal for which members are mutually accountable.

DuFour, Eaker, & DuFour, 2007

COLLABORATIVE PROBLEM SOLVING

1. Problem Definition: What is the problem (discrepancy between actual and expected performance?

2. Problem Analysis: Why is the problem occurring?3. Goal Setting: What do we want to see happening

by when?4. Plan Development & Implementation : What

will be done to meet the goal and how will progress be measured?

5. Plan Evaluation: Did we implement the plan as described and is it working?

Elementary and Secondary VersionsPurpose of the Planning Tool and supporting

documentsUtilizes the Collaborative Problem Solving

ProcessAvailable electronically:

www.sst13.org Response to Intervention

RTI PLANNING TOOLS

MOVING UPSTREAM:A STORY OF PREVENTION AND

INTERVENTION

MiBLSi

In a small town, a group of fishermen gathered down at the river. Not long after they got there, a child came floating down the rapids calling for help. One of the group on the shore quickly dived in and pulled the child out.

MiBLSi

Minutes later another child came, then another, and then many more children were coming down the river. Soon everyone was diving in and dragging children to the shore, then jumping back in to save as many as they could.

MiBLSi

In the midst of all this frenzy, one of the group was seen walking away. Her colleagues were irate. How could she leave when there were so many children to save? After long hours, to everyone’s relief, the flow of children stopped, and the group could finally catch their breath.

At that moment, their colleague came back. They turned on her and angrily shouted: “HOW COULD YOU WALK OFF WHEN WE NEEDED EVERYONE HERE TO SAVE THE CHILDREN?”

MiBLSi

She replied, It occurred to me that someone ought to go upstream and find out why so many kids were falling into the river. What I found is that the old wooden bridge had several planks missing, and when some children tried to jump over the gap, they couldn’t make it and fell through into the river. So I got someone to fix the bridge.

MiBLSi

THANKS!!!!