PBIS Data Review:

Presented by Susan Mack & Steven Vitto

One Common Voice – One Plan

DoImplement Plan

Monitor PlanEvaluate Plan

PlanDevelop Action Plan

Gather Getting Ready

Collect School DataBuild School Profile

StudentAchievement

StudyAnalyze Data

Set Goals Set Measurable Objectives

Research Best Practice

RtI

RtI Core Principles(Batsche, et al., 2005)

• We can effectively teach all children.

• Intervene early.

• Use a multi-tier model of service delivery.

• Use a problem-solving method to make decisions within a multi-tier model.

• Use evidence-based, scientifically validated interventions/instruction to the extent available.

• Monitor student progress to inform instruction.

• Use data to make decisions.• Use assessment for the purpose of screening,

diagnostics, and progress monitoring.

(p.19-20)

6

• We want to gather information that tells us:–How well we are implementing/doing something: Systems/Process/Fidelity Data

AND–Whether what we’re doing is working: Student Outcome Data

GatherGather

Purpose of Systems Review

Leadership teams will:

• Review implementation fidelity data.

• Reflect on their role in leading the PBIS process.

• Develop a plan for continuing to implement and refine the critical features of a PBIS model.

Don’t forget, it’s all about the students!

Systems/Process Measures

• Includes: Team Implementation Checklist, Self-Assessment Survey, The BoQ,

• Answer the questions:

– Are we doing what we have learned?

– How well are we doing it, when, where, who?

• Having this information helps us to accurately interpret our student outcomes.

• Completed quarterly as a team• Takes approximately 10 minutes to complete• Is used as a planning guide for successful

School-Wide PBS Implementation

Team Implementation Checklist Team Implementation Checklist (TIC)(TIC)

Team Implementation Checklist Team Implementation Checklist (TIC)(TIC)

Evaluating PBIS Team Implementation Checklist

• Have we met criteria?

• Are we making progress?

• What areas can we celebrate?

• What areas need more work?

• What is the plan to achieve criteria on the TIC?

Percent Fully Implemented

Percent Partially Implemented

Percent Not Implemented

Feature

Team Implementation Checklist: Implementation by Feature Chart Example A

Have we met criteria?Not Yet

Are we making progress?Yes in these areas

What can we celebrate?These areas

What areas need more work?These areas

Team Implementation Checklist: Implementation by Feature Chart Example B

Have we met criteria?Are we making progress?What can we celebrate?What areas need more work?

Complete the TIC WorksheetComplete the TIC Worksheet

What are your priorities for meeting What are your priorities for meeting criteria on the Team Implementation criteria on the Team Implementation Checklist?Checklist?

20 minutes20 minutes

Your TurnYour Turn

Why conduct Self-Assessment Survey in

addition to Checklist?• Checklists are conducted by team, all/most staff complete

survey

• Look for areas of convergence/agreement across tools

– Increases confidence of data

• Look for areas of divergence across tools

– Decrease confidence of data?

– Possible reasons for disparity…

• Lack of understanding of questions

• Staff not fully aware of work of Building Leadership Team

• Support component not fully “In Place”

Differences between the Team Implementation Checklist and the Self-Assessment Survey

Team Implementation Checklist

Self-Assessment Survey

Purpose?

Evaluate on-going progress towards schoolwide PBS

Evaluate extent that all systems (schoolwide, nonclassroom, classroom, individual) are in place

When administered?

Quarterly Annually

Who completes?PBIS school team, completed as a team

All school staff (or representative sample) completed individually

Time involved? 10-15 minutes 30-45 minutes

Using Data to Support Implementation of

Positive Behavior Interventions and Supports (PBIS)

• The PBIS Self Assessment Survey (SAS) will help principals and coaches to:

– Re-establish buy-in from staff.

– Develop clarity around the core features of PBIS.

Analyzing Self-Assessment Survey Results

• Established?

> 66% respondents identifying system as “In Place”

• Priority?

> 50% respondents identifying system as “High Priority”

• Which one of the 4 systems should be focus? Why?

– If schoolwide not established, then it should be the focus

– Otherwise consider systems that are close to being established and staff priority

Have we met criteria?Not yet

What can we celebrate? This AreaWhat areas need more work? Everything Else

WIllowTree Elementary

What areas need more work?What areas need more work?

Have we met criteria?

What can we celebrate?

What areas need more work?4/30/2008

5/11/2009

5/2/2010

Have we met criteria?

What can we celebrate?

What areas need more work?

Using your SAS results, complete the Using your SAS results, complete the S.A.S. WorksheetS.A.S. Worksheet

What are your priorities for meeting What are your priorities for meeting criteria on the Self-Assessment Survey?criteria on the Self-Assessment Survey?

Your TurnYour Turn

Big Ideas for Gathering Data in an Efficient, Effective Way

• Stay organized (schedule, forms readily available for use)

• Provide training to ensure consistent, accurate data collection.

• Get the data back in front of the people who are doing the work. Actively use the data for decision-making.

• Keep the results in a central location.

Systems/Process/Fidelity Measures

• Tell us about our implementation fidelity: Are we doing what we said we would do, when and how we said we would do it?

• When engaged in systems change, we will likely be able to see changes in adult behavior before we are able to see changes in student behavior. Systems/process/fidelity data help us know if we are on the right track early on and can reinforce our initial work.

• Having this information helps us to accurately interpret our student outcomes.

Indicators that your systems/process/fidelity data might

not be accurate• First time completing the measure, scores of

fully implemented across the board.

• There is a mismatch between your process outcome measures and your student outcome measures.

• There is a mismatch between the leadership team’s perceptions of implementation and the full staff perception.

Sharing Data with Staff

• Help bring staff along with the work the leadership team is spearheading.

• Share graphs, implementation improvement, especially information that is relevant (scores related to the classroom, results from SAS), etc.

• SAS, TIC data should presented in conjunction with student outcome data (SWIS)

• Leadership team perceptions should be complemented by staff perceptions of implementation.

Progress Monitoring

• SWIS Data Entry

A. problems and concern

B. fidelity issues

• SWIS Data Reports

A. who is seeing the data

B. how are the being utilized

• Check-in Check-Out Data

Benchmarks of Quality

• BoQ are used by teams to identify areas of success and areas for improvement, and by the Positive Behavior Interventions and Supports (PBIS) project to identify model PBIS schools.

Benchmarks of Quality Scoring Form and Scoring Guide

Read through each of the items on the Scoring Form. Answer as a team

Team discussion should be generated by referring to the BoQ Scoring Guide

20 minutes

Team TimeTeam Time

Progress Monitoring Decision Flowchart

1. Using the big five SWIS reports to complete the SWIS worksheet

2. Develop a precision statement based on your analysis of the data

3.Develop an action plan based on your analysis of the data

4.Use the SWIS flow chart to determine any problems

20 minutes

Team TimeTeam Time

Critical Features of Team Conversations During the Study

Phase:• Have conversation that revolves around the data.

• Have data available and organized in a central location (data binder, assessment booklet).

• Ensure all team members are actively engaged in the data review process and conversation.

• Discuss strengths and weaknesses of the data.

• Note items for celebration to share with staff.

• Document areas of need, action items, and plans all in writing.

22

Critical pieces to include in the School Improvement Plan based

on your work with PBIS

• References to Data

• Strategies and Activities related to a Schoolwide Positive Behavior Interventions and Supports

Imagine the rest of the group is your Imagine the rest of the group is your school staff. Provide us with a brief school staff. Provide us with a brief update on our schoolupdate on our school’’s progress. s progress.

1.1. What celebrations do you have to share What celebrations do you have to share with us? with us?

2.2. What will our next steps and priorities be? What will our next steps and priorities be?

3.3. What feedback do you want from us?What feedback do you want from us?

Example Team Action PlanningExample Team Action Planning

Action Planning

• Where do we go from here?

• Next Steps?

• Evaluation

The BEP (CICO) ProgramAgenda

• Overview the Program

The BEP Program Video

• Review Process for Accessing the BEP Program

• Review BEP tools

• Review Progress Monitoring for student involved in the BEP Program

• Conducting a BEP team meeting