Elizabeth Dabney, Data Quality Campaign Bob Swiggum, Georgia Department of Education

@EdDataCampaign #DFA2012

26th Annual Management Information Systems [MIS] Conference:

State Actions to Ensure Effective Data Use

Elizabeth Dabney, Data Quality CampaignBob Swiggum, Georgia Department of Education February 13, 2013

@EdDataCampaign #DFA2012

What is the Data Quality Campaign (DQC)?

» A nonprofit, nonpartisan, national advocacy organization based in Washington, DC

» Launched in 2005 » Committed to realizing the vision of an education system in

which all stakeholders—from parents to policymakers—are empowered with high-quality data from the early childhood, K–12, postsecondary, and workforce systems to make decisions that ensure every student graduates high school prepared for success in college and the workplace

» Supports state policymakers and other key leaders to promote the development and effective use of statewide longitudinal data systems

» Developed the 10 Essential Elements (development) and 10 State Actions (use)

2

@EdDataCampaign #DFA2012

Who is Bob Swiggum?

» Chief Information Officer, Georgia Department of Education (GDOE)

» Responsible for the overall direction of technology for the GDOE

» Leads the Technical Services, Instructional Technology, and Virtual School functions

» Prior to working for the GDOE, he worked for Fortune 500 companies in technology roles

» Member of DQC Board of Directors

3

@EdDataCampaign #DFA2012

How DQC Defines Data

» We define data as:– More than test scores, including attendance and course-

taking, as well as teacher and financial information– Any information stakeholders need to make decisions,

which means more than state-level data– P–20W data that span early childhood through

postsecondary and the workforce» We think the most useful data are:

– Longitudinal: follow individual students over time and across systems and sectors

– Actionable: timely, user friendly, and tailored to users– Contextual: robust, comparable, and presented as part of

a bigger picture

4

@EdDataCampaign #DFA2012

How DQC Defines Effective Data Use: Continuous Improvement

PAST:COMPLIANCE

PRESENT:ACCOUNTABILITY

FUTURE:CONTINUOUS IMPROVEMENT

5

@EdDataCampaign #DFA2012

How Far Have States Come in Ensuring Effective Data Use?

The average state had 4-5

of the 10 Essential

Elements of Statewide

Longitudinal Data Systems

The average

state had 9-10

Elements, all states

committed to build all

10

8 states using state funds for

their P–20 data

system

36 states using state funds for

their P–20 data system

17 states publicly

posting at least two reports using

aggregate longitudinal

data

42 states publicly

posting at least two reports using

aggregate longitudinal

data

2005 2006 2007 2008 2009 2010 2011 2012

6

@EdDataCampaign #DFA2012

About Data for Action

» DQC invites each state’s governor’s office to participate in the survey. The governor’s office can appoint a designee to respond to the survey in collaboration with stakeholders.

» An online survey tool is used to collect self-reported information from each of the 50 states, DC, and Puerto Rico.– In part one of the survey, states answer a series of questions

about each of the 10 State Actions.– In part two, states report on emerging data issues and promising

practices in the field.» DQC determines whether or not states receive credit for each

Action based on states’ responses.» States responded to the survey in summer 2012, reflecting

the current status of their work at that time.

7

@EdDataCampaign #DFA2012

Data for Action: 10 State Actions to Support Effective Data Use

BUILDING CAPACITY TO USE DATA8.Develop research agenda 9.Build educator capacity10.Raise awareness of available data

LINKING P–20W Data1.Link P–20W data systems2.Create stable, sustained support3.Develop governance structures4.Build data repositories

ENSURING DATA ACCESS5.Provide timely data access6.Create individual student progress reports 7.Create longitudinal reports

8

@EdDataCampaign #DFA2012

No State Has All 10 State Actions

9

@EdDataCampaign #DFA2012

Gaining, Maintaining, and Lagging Actions

LAGGING

GAINING

GAINING

GAINING

GAINING

MAINTAINING

LAGGING

LAGGING

MAINTAINING

MAINTAINING

10

@EdDataCampaign #DFA2012

Where is DQC Going in 2013?

» 10 State Actions remain the same» Deep dive on a few topics that align to the 10 State

Actions (e.g., linking K–12 and postsecondary data, high school feedback reports, teacher access to data, teacher-student data link)– Experts develop rubric and criteria to measure quality

implementation– Review of survey data and evidence– Experts verify states that meet criteria

» Expanded state profile to tell the data story of each state

11

@EdDataCampaign #DFA2012

Linking P–20W Data

SELECTED FINDINGSThere is a growing demand for data to answer critical policy questions, but P–20W data sharing is lacking.»46 states link and share K–12 and early childhood data»43 states link and share K–12 and postsecondary data »14 states link and share K–12 and workforce data »17 states link and share postsecondary and workforce data»10 states link and share data between K–12 and workforce and postsecondary and workforce

12

@EdDataCampaign #DFA2012

Georgia’s View

» Georgia’s P–20W database is currently a P–20, moving to a P–20W.

» It is a research database not an operational database.

» Also acts as a data exchange between educational agencies which eliminates the need for individual MOUs.

13

@EdDataCampaign #DFA2012

Ensuring Data Access

SELECTED FINDINGSStates are increasingly providing stakeholders access to data and producing reports using longitudinal data, but few states are ensuring that parents have access to the data they need.»41 states are providing access to aggregate-level data to superintendents, state staff, and the public.»41 states produce reports about individual students, such as early warning reports (28 states).»47 states produce reports about groups of students using longitudinal data, such as high school feedback reports.»9 states are providing access to student-level data for parents.

14

@EdDataCampaign #DFA2012

Georgia’s View

» How something is delivered is as important as what you are delivering.

» Georgia’s LDS is accessed by teachers, administrators, parents, and students through the local district’s student information system so there is no extra ID or password needed.

» Appears to be a part of the local system.

15

@EdDataCampaign #DFA2012

Building Capacity to Use Data

SELECTED FINDINGS States are increasingly providing training to stakeholders but have not done enough to build the capacity of all education stakeholders to effectively use data. »39 states train teachers and principals to use longitudinal data to tailor instruction and inform schoolwide policies and practices. »40 states train teachers and principals to use and interpret specific reports.

16

@EdDataCampaign #DFA2012

Georgia’s View

» Key to building capacity is to understand what you are building capacity for.

» Teachers do not have the time or training to be data miners.

» They need actionable information so LDS needs to do the mining, analysis, and differentiation for the teacher and offer solutions to the issues that are found.

17

GADOE

LEA Access to Integrated GADOE Systems

DistrictStudent

Information System

DistrictParent Portal

Ready Now

Working on

One integrated set of data that all

systems and reports use.

Tunnel

18

Georgia’s Path to Personalized Learning

Actionable Info Resources

TRL 2.0 Provides

teachers with ability to

quickly find digital

resources and professional development

that are aligned to standards.

Tools:•IIS-Digital Resources linked to common core

TRL 2.5 Provides

districts with the ability to

load local resources.

Tools:•IIS- Learning Object Repository

TRL 3.0 Provides teachers with the ability to assign and monitor

use of digital resources to

students. Provides student with access

to personalized learning.

Tools:•IIS-Learning Management System•Individual Education plans/Response to Intervention System

TRL 4.0 Provides teachers with the ability to

measure effectiveness of

instruction.Tools:•IIS-Learning Progression Maps•IIS-Data Analysis Tool•Formative Assessment Load•Online Assessment System•Financial Systems

Improve Teacher Skills

Tools:•IIS-Professional Development System

Measure Teacher Skills

Tools:•Performance Index•Growth Model•Observations•Surveys•IIS-High School Feedback Report•IIS-Data Analysis Tool

Longitudinal Data Metrics

Teachers &

Students/Parents

Teachers, School &

District Personnel

(i.e., Principals, Guidance

Counselors, School

Psychologist, etc.)

Audience

High Quality 21st Century Classroom

Instruction

LDSProvides

Longitudinal data and

analysis to assist in differentiation

of their students.

Tools:•Dashboards•Reports•LEXILE Reading Scores•Growth Model•Interstate Data Exchange

Personalized Learning

Environment for Every K12

Student

LDS – Longitudinal Data System

TRL – Teacher Resource Link

IIS – Instructional Improvement System

19

@EdDataCampaign #DFA2012

Georgia’s View

*System demonstration slides include fictitious names.

20

@EdDataCampaign #DFA2012

Georgia’s View

*System demonstration slides include fictitious names.

21

@EdDataCampaign #DFA2012

Georgia’s View

*System demonstration slides include fictitious names.

22

@EdDataCampaign #DFA2012

Georgia’s View

*System demonstration slides include fictitious names. 23

@EdDataCampaign #DFA2012

Georgia’s View

*System demonstration slides include fictitious names.

24

@EdDataCampaign #DFA2012

Georgia’s View

*System demonstration slides include fictitious names.

25

@EdDataCampaign #DFA2012

Georgia’s View

*System demonstration slides include fictitious names.

26

@EdDataCampaign #DFA2012

Georgia’s View

27

@EdDataCampaign #DFA2012

Georgia’s View

28

@EdDataCampaign #DFA2012

Additional Data for Action Resources

Please visit www.DataQualityCampaign.org/DFA2012 for: »National Analysis: National trends in states’ progress on building and using state longitudinal data systems to improve student achievement according to DQC’s 10 State Actions »State-by-State Analysis: Individual state profiles and the ability to compare states to one another »Policy Issues: Deeper analyses about states’ data capacity to support various education policies and practices such as teacher effectiveness, parent empowerment, college choice, early warning systems, and high school feedback

29

@EdDataCampaign #DFA2012

Contact Us

Elizabeth DabneySenior Associate

Data Quality Campaignedabney@dataqualitycampaign.org

Bob SwiggumChief Information Officer

Georgia Department of Educationrswiggum@doe.k12.ga.us

30