Making Data-Based Decisions

Tim Lewis, Ph.D.University of Missouri

OSEP Center on Positive Behavioral Interventions and Supports

pbis.org

Data-Based Decision Making1. Determine what questions you want to

answer2. Determine what data will help to answer

questions3. Determine the simplest way to get data4. Put system in place to collect data 5. Analyze data to answer questions

Focus on both Academic and Social Outcomes

1. Determine what questions you want to answer

Examples• Can we predict problems/success?

– When/where/who? • Possible “function” of problem behavior?• Who needs targeted or intensive academic

supports?• What environmental changes/supports are

needed?

2. Determine what data will help to answer questions

• Existing data set(s)• Current data collection• Additional / new data

• Confidence in accuracy?• Complete picture?

3. Determine the simplest way to get data

• Agreement on definitions• Standard forms / process• Frequency of collection• Target “Multi-purpose” data/use

Train ALL staff on use & provide on-going TA

4. Put system in place to collect data

• Build on existing systems• Add components over time• Central entry point

– Electronic

5. Analyze data to answer questions

• Trends• Instruction & supports in place/not in-place• Pre/post “big outcomes”• Comparisons (norm / local)

– Relative growth– Absolute growth

By Location1998-99/#ODR by Location

301

76

2

7955

436 36 38

1 8 10

50

100

150

200

250

300

350

ClassroomLunchroomLobby

Playground/Recess

BusBus LineHallwayBathroom

Gym

Computer LabLibrary Activity

Location

#ODR

By Behavior1998-99 #ODR/Behavior

0

20

40

60

80

100

120

140

160

180

200

Fighting Class Disruption Non-compliance InappropriateLanguage

Cut Class/Out ofArea

Property Smoking/Drugs

Behavior

By Student1998-99 By Student

0123456789

10111213141516171819202122232425

1 9 17 25 33 41 49 57 65 73 81 89 97 105 113 121 129 137 145 153 161 169 177Student #

# of ODR

By # of Referrals1988-99 #ODR per Student

80

32

16 15

84 4 3 2

42 3 3

0 1 0 1 1 0 0 1 0 10

10

20

30

40

50

60

70

80

90

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23#Referrals

0

5

10

15

20

Ave Referrals per Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast year

0

5

10

15

20

Ave Referrals per Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast year

0

5

10

15

20

Ave Referrals per Day

Sept Oct Nov Dec Jan Feb Mar Apr May Jun

School Months

Office Referrals per Day per MonthLast Year and This Year

IF...

FOCUS ON...

£ More than 40% of students receive one or more office

referrals £ More than 2.5 office referrals per student

School Wide System

£ More than 35% of office referrals come from non-classroom settings

£ More than 15% of students referred from non-classroom settings

Non-Classroom System

£ More than 60% of office referrals come from the classroom

£ 50% or more of office referrals come from less than 10% of classrooms

Classroom Systems

£ More than 10-15 students receive 5 or more office referrals

Targeted Group Interventions / Classroom Systems

£ Less than 10 students with 10 or more office referrals £ Less than 10 students continue rate of referrals after

receiving targeted group settings £ Small number of students destabilizing overall

functioning of school

Individual Student Systems

Final Thoughts

• Don’t collect data for collection sake – make sure informs the process

• Don’t “drown” in data – keep focused on the question

• Data without context are simply numbers