Notes for Trainers (Day 8 2015 Training)
Teams will have seen versions of this presentation a few times and the intention is to review what data tools are available for their team to use Reviewing PBIS Apps will be ongoing; this is a good reminder for teams to go back in to site and relook at data Suggest going through this fairly quick, focus on slide information most crucial for teams to know based on cohort data results, and incorporate local examples of data The Tiered Fidelity Inventory(TFI) will be new for teams The intention is to provide an introduction to TFI, let them know its there, and use it to evaluate Tiers 12 and/or Tier 3 at their school At Spring Training teams will get more information on the TFI For most teams, TFI will be more useful down the road Adapted from the Illinois PBIS Network
Using Evaluation Tools, On-Line Systems, and Data-Based Decision Making Adapted from the Illinois PBIS Network Evaluation Tools: Team Implementation Checklist (TIC)
Self Assessment Survey (SAS) School Evaluation Tool (SET) Tiered Fidelity Inventory (TFI) School-Wide Information System (SWIS) PBIS Tier 1 Evaluation Tools Team Implementation Checklist (TIC)
Benchmarks of Quality (BoQ) for after full implementation School Evaluation Tool (SET) Self-Assessment Survey (SAS) Tier 1, Tier 2 and/or Tier 3 Evaluation Tool
Tiered Fidelity Inventory (TFI) Tool may be used to evaluation Tier 1, Tier 2 and/or Tier 3 or all three at once More on this later Classes of Data Effort data (What we think were doing; Self-perception data) Team Implementation Checklist (TIC) Self-Assessment Survey (SAS) Outcome data (Is it having an effect?) Big 5 Graphs Triangle % Fidelity data (Is the plan being implemented as intended; Are we actually following the plan)? School Evaluation Tool (SET) Benchmarks of Quality (BoQ) Tiered Fidelity Inventory (TFI) PBIS Assessment within PBIS Apps
Team Implementation Checklist Self Assessment Survey School Evaluation Tool Tiered Fidelity Inventory A Brief Overview of PBIS Apps: link to www.pbisapps.org Login Dashboard Accessing Reports Accessing Reports cont PBIS Assessment Reports Team Implementation Checklist (TIC)
Self-assessment tool for monitoring the implementation of school-wide PBIS Team self-assessment in 6 areas Establish commitment Establish and maintain team Self-Assessment Establish School-wide Expectations Establish Information system Build capacity for function-based support Team Implementation Checklist (TIC) cont
WHO: Universal PBIS Team WHAT: Gudies development, implementation, monitoring and improvement process for building a positive school culture and climate WHERE: at school during a Universal PBIS Team meeting WHEN: 3X/year HOW: One person enters the data online at Team Implementation Checklist (cont) TIC Total Score Report TIC Subscale Report TIC Individual Items Report School-Wide Evaluation Tool (SET)
Designed to determine the extent to which schools are implementing School-wide Positive Behavior Supports (PBIS) accurately (as intended) Some schools may already be using some core features accurately, but not all yet High standard! research level tool to evaluate PBIS implementation SET data can be used to: Assess features that are in place
Determine annual goals Evaluate on-going efforts Design and revise procedures Compare year to year PBIS implementation over time SET Evaluates 7 Areas Expectations defined
Behavioral expectations taught Acknowledgement procedures Correction procedures Monitoring and evaluation Management District-level Support SET Subscales SET Items Outcome Data SWIS (School wide Information System)
New Format on the website Provides end of year Triangle percentages Note: Looking for the same types of data no matter what system your school/district uses SWIS Report Options Average Referrals per Day per Month
Referrals by Problem Behavior Referrals by Location Referrals by Student Referrals by Time Referrals by Day of the Week Referrals by Grade Referrals by Ethnicity SWIS Graphs SWIS Reports Average Referrals per Day per Month Referrals by Problem Behavior Referrals by Location Referrals by Time Referrals by Student Multiple Year Comparison Graphs Self Assessment Survey (SAS)
Evaluates staff perception of the extent to which PBIS systems are in place within a building School-wide Non-Classroom Classroom Individual Student SAS provides entire staff (certified and non-certified) perspective SAS School-Wide Systems SAS Basics WHO: All teachers, staff and administrators in building
WHAT: status and need in 4 systems (school, classroom, non-classroom and individual students) WHERE: school WHEN: Annually HOW: All staff take online survey online at PBIS Assessment ww.pbisapps.org SAS Total Score SAS Subscale SAS Item Report TFI Tiered Fidelity Inventory
Team can use the TFI to measure fidelity at Tier I, Tier 2 and/or Tier 3 individually, or all at once External Facilitator Guided Team self assessment based on data collected from a walk through tool and other data sources available at the building level TFI Basics External Facilitator and Team complete
Walk through process ( minutes to complete) May be used for progress monitoring (3x/year) May be used as annual fidelity evaluation Questions are scored on an operationalizedrubric: 2= fully in place 1= in progress 0= not started TFI on PBIS Assessment Eventually evaluate all 3 Tiers Data-Based Decision-Making
Developing precise statements Solution Development Prevention, Teaching , Rewarding, Extinction, Corrective Consequence, and continual Data Collection Action Plan for Results Implement Action Plan RE-evaluate Results and adjust (ongoing, continuous improvement cycle) Data for Ongoing Problem-Solving
Start with the perceptions, then the data Use data in decision layers Is there a problem? (overall ODR rate) Localize the problem Location, problem behavior, students, time of day) Get specific Dont drown in the data (i.e., use layers) Be efficient Uses of Data Review current status and identify problems early
Use on regular bases (e.g., every 2 weeks) to monitor key indicators and ID problems before they escalate Refine problem statement to a level of precision that allows functional solutions Use data to test possible solutions Use data to evaluate if solutions are working If many students are making the same mistake, its likely the system that needs to change first OK! Time to Complete the TIC!
Complete the TIC on paper first as a team Coach reads the questions Team decides together; ALL members vote After completing the TIC on paper, coach enters scores into PBIS apps Engage in action planning BASED upon your assessment results Team Action Planning Time
What does your data tell you about current strengths? Where are areas of need? Are the needs confirmed by more than one data source? What would you like to see as a future outcome in those areas? Prioritize Generate ideas to address the area Create a plan (who/what/where/when etc.) Frequently monitor and adjust using updated data as your guide Team Planning Checklist
This tool can be used to guide action planning It includes the following areas to consider: Expectations Reward/Recognition Systems Responding to Rule Violations Monitoring and Decision Making Management Building Leadership External Leadership Efficiency Overcoming Barriers