82
The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

Embed Size (px)

Citation preview

Page 1: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and

Academic Outcomes

Page 2: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

A Partnership

The Kansas City, Kansas Public Schools, in collaboration with the University of Kansas and Software Outfitters, have developed a web-based analysis tool for improving academic and social outcomes for all students.

Page 3: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data-Based Decision Making

The Data Analyzer tool was developed to help school teams make data-based decisions re: students’ problem behaviors in the context of school-wide Positive Behavior Support (PBS) systems. Technology is combined with comprehensive PBS to help school districts and states enhance educational outcomes for students and improve access to the general curriculum.

Page 4: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Schools Were Asked to:

Use data to understand the concerns in their schoolUse data to help guide the vision/mission, school improvement plan goals, and outcomesUse data to evaluate accurately the circumstances surrounding identified issues and concerns

Page 5: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Frustrations Schools Were Experiencing

Schools had limited access to dataAccess to current data was periodic & inconsistentAbility to display data was non-existentTraining issuesTime demands

Schools requested:Easy access to dataCurrent/updated informationGraphically-displayed data

Page 6: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

SolutionData Analyzer

A desktop Internet-based tool that enables the user to make up-to-the-minute, real-time decisions about how to intervene effectively

Users can easily monitor outcomes of interventions

Key tool when implementing behavior supports

Ease of useGraphical displayReal time data

Page 7: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data Analyzer Allows Schools To Access….

Academic and behavioral data for individual students, groups of students, and school-wide/all students in a school or customized cluster of schools in the following areas: Office Discipline Referrals (ODRs) Historical school-wide data on ODRs Tracking individual/group behavioral interventions Disposition of ODRs Average daily attendance Grade Point Averages and State Assessment scores Parent contact information

Page 8: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data Analyzer Allows Schools To Access….

Individual student academic and behavior profiles displaying: attendance information State assessment information course and grade information graduation progress and requirements identification of “at risk” students based on district-

defined thresholds general student demographics

Page 9: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

School Personnel Can…Monitor academic and social-behavioral outcomes for studentsMake data-based decisions regarding students and effectively monitor the impact of their interventionsAccess live web-feeds to allow instant interaction with the database for moment-to-moment monitoring of academic and behavioral interventions and outcomes (using password-protected access that can be set at various levels by school/district administrators to assure complete student confidentiality and assure privacy)

Page 10: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data Analyzer

We decided that if a “picture is worth a thousand words” then…..

…..a few clicks of a mouse are even better.

Page 11: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data Analyzer

SASI Data Gems Data Osiris Data

Compass Data Foundation

Student Information Management

• Discipline• Attendance• Grades• Demographics• Assessments• Special Education• ELL• SLC

• Discipline• Attendance• Grades• Demographics• Assessments• Special Education• ELL• SLC

Student Data

Page 12: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data Analyzer

SASI Data Gems Data Osiris Data

Compass Data Foundation

Student Information Management

Data Analyzer

• Data Analyzer• Attendance Analyzer• Grades Analyzer• Graduation Analyzer• Assessments Analyzer

• Data Analyzer• Attendance Analyzer• Grades Analyzer• Graduation Analyzer• Assessments Analyzer

Data Analysis

Page 13: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data Analyzer

SASI Data Gems Data Osiris Data

Compass Data Foundation

Student Information Management

Data Analyzer

Page 14: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

School-Wide Example

Using the Data Analyzer to Evaluate School-Wide Data

Page 15: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

My Concerns….

I am the Assistant Principal at Coronado Middle School; it is late in October (beginning of 2nd quarter) and it feels as if we have a lot of office referrals…

Step One: Problem Evaluation

Page 16: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Problem Evaluation

Use data to understand the concerns in your school

Use data to help guide your vision, goals and outcomes

Use data to accurately evaluate the circumstances surrounding your concerns

Page 17: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 18: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data To Support My Concerns

Class disruptions

Defying authority

Truancy

Fighting with other students

Disrespect

Page 19: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 20: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data To Support My Concerns

It appears that the Small Learning Community that is having the most challenges is #6. Most of their students are 8th graders…

Page 21: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 22: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data To Support My Concerns

It looks like 8th grade is my primary concern at this time…

Page 23: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 24: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data To Support My Concerns

It also appears that 8th grade African American students are having more office disciplinary referrals than other students, accounting for a large percentage of the referrals

Page 25: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 26: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 27: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data To Support My Concerns

It appears Tuesdays are the most challenging day of the week for students at Coronado Middle School.…

Page 28: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 29: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data To Support My Concerns

Not only have we learned that at Coronado MS, 8th grade African American students are facing the most behavioral challenges, we now know that boys are having more office referrals than girls.

Page 30: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes
Page 31: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Data To Support My Concerns

We also know that SPED students have accounted for 170 out of the total of 806 office disciplinary referrals, but that is far less than the number of ODRS for African American, male, 8th graders.

So I will start there…Step Two: Brainstorming Ideas/Possible Solutions

Page 32: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Brainstorming Ideas

After you have looked at the data for your school and analyzed the problem, what would be your suggestions for interventions that are consistent with PBS approaches?

Page 33: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Possible SolutionsI will provide extra teaching on respectful behavior to the 8th grade boys in my schoolI will provide incentives & praise to 8th grade boys who are respectful and not disruptiveI will provide additional supports for teachers to minimize ODRs for classroom disruptionsI will encourage parents to acknowledge and praise their children when they do not have office referralsThis leads to Step Three: Take Action…..

Page 34: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Take Action

Develop an Action Plan that allows you to implement goals to respond to your concernsHow will I implement suggestions when I am busy dealing with so many concerns?Ideas? Barriers to implementation?Facilitators to success?

Page 35: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Evaluate Your Actions

How did we do?

I evaluated the problem with data, prioritized solutions, and took action

I then returned to Data Analyzer to evaluate the outcomes

Page 36: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 37: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Evaluating Outcomes

We had fewer office disciplinary referrals at Coronado Middle School during the second semester (so far) than the first semester….

Page 38: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 39: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Evaluating Outcomes

We definitely had a reduction in office disciplinary referrals in the third quarter when compared to the second quarter…

Page 40: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 41: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Evaluating Outcomes

We implemented our Action Plan in October and look at November…it is much better.The remainder of the year continued to be better than October with a small jump up in January. Next year, what months would be good months to implement our Action Plan?

Page 42: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

Individual Student Example

Using Data Analyzer to Evaluate Individual Student Data

Page 43: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes
Page 44: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Concerns with BehaviorClass disruptionsViolated lunch rulesIncited a fightThreatened school personnelAdding to disruptionsDefying authorityBattery against a studentAggravated abuse of staffTruancyDisrespect

Page 45: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 46: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Individual Student Profile

Parent Contact Information

School Demographic Information

Red flagsTest scoresAttendanceGradesOffice Disciplinary Referrals

Page 47: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes
Page 48: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Individual Student Profile (Continued)

Grades

Class schedule

Page 49: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes
Page 50: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Individual Student Profile Continued

Course History

School History

Grade History

Page 51: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 52: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Individual Student Profile (Continued)

Progress towards graduation

Attendance by period

Tardies and discipline issues

Future icons will be activated to include graphs that summarize attendance, tardies, discipline, and suspension information for Carlos and other students

Page 53: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes
Page 54: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Individual Student Profile (Continued)

State Assessments

National Assessments

Individuals goals (IEP, 504 or other goals)

Journal for notes

Alerts

Page 55: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Next Generation

The Data Analyzer:

Proactive Analysis

Page 56: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Proactive Versus Reactive Solutions

“Ironically, the best time to intervene with children with challenging behavior is

when no problem behavior is occurring…”

-George Sugai (2004)

Page 57: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Next Release Directions

More powerful queries

Proactive analysis and pattern recognition

Intervention tracking and success analysis

Individual student “watch” capabilities

User-created custom graphs

Page 58: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 59: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

The Snapshot is…

An automatic report that will display on your desktop for quick and easy data viewing

A way to use data and know the implications of the interventions through intervention tracking

A source of information for schools to know how their data compare with data from other similar schools in the district or state.

Page 60: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 61: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Features of the Snapshot

Individual student alerts

Triangle data for your school

Triangle data for all comparison schools

Overall frequency of discipline referrals

Historical office referral data

Intervention tracking

Ability to customize

Page 62: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 63: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Added Features Include:

The ability to manage by discipline groups

The ability to manage by frequency of office disciplinary referrals

Intervention tracking

Thresholds and patterns of behavior

Student watch

Page 64: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 65: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Interventions

Select a pre-determined intervention to implement

Or, select and enter unique interventions developed at the school

Detailed list of the interventions and the types of intervention that have been implemented

Page 66: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 67: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Intervention Tracking Form

Allow school personnel to select or enter interventions and include the three levels of interventions: school-wide, group and individual student

Include start dates and type of intervention

Can select an individual student and check to put the student on a watch alert

Can have e-mail alerts

Page 68: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 69: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Overall Office Discipline Referral Graph

Allows for monitoring of office discipline referrals, including scroll-over discipline code identification.

Page 70: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 71: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Select an Intervention

This feature allows you to select an intervention from a drop-down menu that will display on screen for intervention tracking

Page 72: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 73: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Pre-Post Data

This feature will allow for monitoring of office discipline referrals prior to intervention (pre) and after intervention (post) based upon the intervention and timeline of intervention

Page 74: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 75: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Graph Over Time

This feature allows for office discipline referrals to be tracked by day of month over time; you can scroll forward and backward across time

Page 76: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 77: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Intervention Condition

This feature allows you to insert an intervention condition line to delineate when specified interventions start and end

Allows easier monitoring of impact of specific interventions on specific types of office disciplinary referrals.

Page 78: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Page 79: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Historical Data

This features allows for viewing of data across years to monitor and evaluate larger school-wide variables and their impact over time.

Page 80: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

The Specifics

How much does Data Analyzer cost?

How can my school access Data Analyzer?

When will it be available in its current form?

When will future features and added enhancements be available?

Page 81: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

Contact InformationRob Harsh, Software Outfitters

[email protected]

Amy McCart, Ph.D. University of Kansas

[email protected]

Larry Englebrick, Ed.D., KCKPS USD 500

[email protected]

Nikki Wolf and Peter Griggs, University of Kansas

[email protected] and [email protected]

Page 82: The Data Analyzer A Comprehensive Web-Based Data Analysis System for Examining Student Behavioral and Academic Outcomes

The Data Analyzer

In Closing….

“Making decisions from reliable data is an important part

of creating a safe and effective school

environment.”

-Horner, Sugai, & Todd, 2001