37
Data Decisions Action Aligning Assessments for Better Instructional Decision Making

Data, decisions, action slideshare

Embed Size (px)

DESCRIPTION

Districts have an abundance of data but often do not know how or when to use it. Take an inventory of your existing assessments, decide if they are being used correctly and then eliminate overlaps and fill in gaps. Now you are ready to develop an assessment plan based on need.

Citation preview

Page 1: Data, decisions, action slideshare

Data Decisions

Action

Aligning Assessments for Better

Instructional Decision Making

Page 2: Data, decisions, action slideshare

Student progress

CCSS

Teacher evaluation

Instructional Technology

Collaborative Teaming

Data based decisions

Initiatives in Silos of Practice

Lacks clarity about overall purpose

Page 3: Data, decisions, action slideshare
Page 4: Data, decisions, action slideshare

Teaming

Teacher evaluations

Student Progress

CCSS

Instructional designs

Data based

decisions

There is clarity about overall purpose: student progress

System methodology coordinates silos of practice. All pieces more effective

Page 5: Data, decisions, action slideshare

What do you do to update methodology?

0 Like cleaning a closet – look at what you have, discard what is not needed and sort remaining by use

Page 6: Data, decisions, action slideshare

Everything should be made as simple as possible, but not simpler.

Albert Einstein

Page 7: Data, decisions, action slideshare

Simplicity and Need

Need data to inform instruction

Protect instructional minutes

Page 8: Data, decisions, action slideshare

An organized assessment plan

Page 9: Data, decisions, action slideshare

Looking in your Assessment Closet: The Assessment Worksheet

Page 10: Data, decisions, action slideshare
Page 11: Data, decisions, action slideshare
Page 12: Data, decisions, action slideshare

Validity

Is it testing what it claims to test? History or complicated vocabulary?

Can we relate scores on the test to the skill being targeted? Achievement or computer skills?

Page 13: Data, decisions, action slideshare

Reliability

Minimize “measurement error” Test taker variables – hot/cold, noise, lack of sleep Test scoring and interpretation

Page 14: Data, decisions, action slideshare

OK, it’s reliable and valid,

now what?

Page 15: Data, decisions, action slideshare

Examine the purposes for assessments.

What do you need assessments to do?

Page 16: Data, decisions, action slideshare

What do we need assessments to do?

Problem Identification

Problem Analysis

Plan Development & Implementation

Plan Evaluation

Page 17: Data, decisions, action slideshare

Find areas of need

Problem Identification

Problem Analysis

Plan Development & Implementation

Plan Evaluation

Page 18: Data, decisions, action slideshare

Type Desirable

Features

Most Efficient

Tool(s)

Universal Screening

Screening

General outcome

measure

Brief

Low Cost

Sensitive to

Between

Persons

Differences

Curriculum Based

Measurement

(CBM)

Early Warning

System

Universal Behavior

data

Purpose: Problem Identification

Page 19: Data, decisions, action slideshare

What are you screening for?

Traditional methodology

“Within child” variables as source of underachievement: processing, attention, motivation

Updated methodology

“Educator owned” variables as source of underachievement: curriculum, instruction and environment

What to screen for at each level… Kindergarten to 5th – basic skills, social emotional

Middle school – basic skills (until 7th or 8th depending on population), progress toward graduation, social emotional

High School - Progress toward graduation, Standards based learning

Page 20: Data, decisions, action slideshare

Diagnose why there is need…

Problem Identification

Problem Analysis

Plan Development & Implementation

Plan Evaluation

Page 21: Data, decisions, action slideshare

Type Desirable Features Most Efficient

Tool(s)

Diagnostic

Common Formative

Assessments

Formative

Assessments

Mastery Measurement

Adequate number of

items per skill

Production-Type

Responses

Longer to administer

and score

Focus is on skills and

the thought process

Curriculum series tests

MAP

Informal classroom

evaluation (error analysis

etc.)

Course quizzes/exams

Functional behavioral

analysis

Frequency, duration,

counts – peer discrepancy

Interviews/Observations

Purpose: Problem Analysis

Page 22: Data, decisions, action slideshare

Point to the best way to address the need…

Problem Identification

Problem Analysis

Plan Development & Implementation

Plan Evaluation

Page 23: Data, decisions, action slideshare

Type Desirable Features Most Efficient

Tool(s)

All available sources

Multiple sources

Data sources

converge to support a

hypothesis

At least one source of

hard data

Purpose: Plan Development and Implementation

Page 24: Data, decisions, action slideshare

Is it working?

Problem Identification

Problem Analysis

Plan Development & Implementation

Plan Evaluation

Page 25: Data, decisions, action slideshare

Type Desirable Features Most Efficient

Tool(s)

General outcome

measure

Mastery

measurement/Summative

Diagnostic

High stakes/standardized

Progress monitoring

Linked to Important

Outcomes

Goals – Decision rules

Sensitive to Within

Person Differences

Curriculum series tests

MAP

Informal classroom

evaluation (error analysis

etc.)

Course quizzes/exams

Functional behavioral

analysis

Frequency, duration,

counts – peer discrepancy

Interviews/Observation

Purpose: Plan Evaluation

Page 26: Data, decisions, action slideshare

Universal Screening

Diagnostic

Plan/Program Evaluation

Progress Monitoring

Early Warning System

MAP Common Formative Assessment

Curriculum Based Measurement

Page 27: Data, decisions, action slideshare

Role that each plays in educational decisions

Page 28: Data, decisions, action slideshare

Classroom assessments – formative and summative – mastery

measurement

Are the students learning the material I am currently teaching and what changes can I

make to increase their learning?

How much of what was taught in the lesson/unit/course did the students learn?

Universal Screening and Progress Monitoring General Outcome Measurement -

Common formative assessment (CFA)

As a result of the program my students are receiving, do the indicators suggest that they are on the path to becoming college and

career ready? What changes can I make in my

program to improve student performance?

Program evaluation High Stakes Tests - summative

Have my students met the state

criteria for proficiency?

Diagnostic Assessment for some students

Why is this student(s) failing

to make progress in this

program?

Assessments in Education Miller Guidance, Inc.

Page 29: Data, decisions, action slideshare

Assessment Hierarchy 0 Now let’s put your clothes back in the closet.

Page 30: Data, decisions, action slideshare
Page 31: Data, decisions, action slideshare

What we have and what we are going to need.

Page 32: Data, decisions, action slideshare

Reading CBM – K-5

K-5 Reading

Reading CBM – K-5 MAP – 2-5 Reading St. Unit Tests

WISC-IV DRA-2 Fountas and Pinnell

Reading CBM – K-5 Reading CBM – K-5

Fountas and Pinnell

ISAT MAP Reading CBM Reading St. Unit Tests

Page 33: Data, decisions, action slideshare

Now we can start the discard list (and sometimes a change list!)

Page 34: Data, decisions, action slideshare
Page 35: Data, decisions, action slideshare

PSAE Course exams

EXPLORE PLAN ACT

Course quizzes – per teacher

Attendance Expulsions/Suspensions

Grades 9-12

Reading CBM – K-5

Cognitive and achievement tests

Page 36: Data, decisions, action slideshare

Now we can start the discard list (and sometimes an add list!)

Add: Universal screener Common Formative Assessment Progress monitoring

Page 37: Data, decisions, action slideshare

For more information contact:

Mary Miller

Miller Guidance Solutions, Inc.

[email protected]

Or visit our website:

www.millerguidance.com