Empowerment Evaluation with David Fetterman

CROSS CULTURAL

The International: Crew

Australia Canada Ethiopia Finland Mexico Nepal New Zealand South Africa

3The Engine

Definition Theory Concepts Steps

EE?

Use of evaluation concepts, techniques, & findings to foster improvement & self-determination

Expanded definition An evaluation approach that aims to increase the probability of achieving program success by (1) providing program stakeholders with tools for assessing the planning, implementation, & self-evaluation of their program, & (2) mainstreaming evaluation as part of the planning & management of the program/organization.

Empowerment Evaluation

Underlying Theories of Empowerment Evaluation

PROCESS USE: the more that people engage in the act of conducting their own evaluations the more likely it is that they will find the results credible and act on the recommendations

Knowledge Utilization

Theory Number One

Aligning Theories of Action and Use

theory of action theory of use

espoused observed behavior

Theories Number Two and Three

Key Empowerment Evaluation Concepts

Evidence

Critical Friend

Culture of Evidence

Cycles of Reflection & Action

Community of Learners

Reflective Practitioners

Coaching: Critical Friend

Critical Friend - believes in the type of program but still asks the critical questions to ensure an honest but constructive critique and self-assessment (including across grantees)

Critical Friend

1. Mission 2. Taking Stock 3. Planning for the Future

Empowerment Evaluation3 Steps

1. Democratic 2. Transparent 3. Group Values 4. Honor existing mission but go where

the energy is in the room 5. Giving Voice and Making Meaning

Mission

• List activities

• Prioritize (dots)

Taking Stock (Part I)

Activities Prioritization with Dots

Communication

!Product Development

!Fundraising

• Rating 1 (low) – 10 (high)

• Dialogue

Taking Stock (Part II)

Activities DF DE SEC AVG.Communicatio

n3 6 3 4

Teaching 4 5 9 6

Funding 5 2 1 2.67Prod Dev Develop

1 8 4 4.33

Average 3.25 5.25 4.25 4.25

• Goals • Strategies • Evidence

Planning for the Future

Accountability & Outcomes

• Arkansas - Academically Distressed Schools

!

• Hewlett Packard - $15 Million Digital Village

• Stanford School of Medicine - Curriculum

!

• Arkansas - Tobacco Prevention Programs

GainsAltheimer Comparison

August 2002 to January 2003

7.4 7.1 7.2 6.9 6.7 6.1 5.96.7 6.5 6.2

6.9 6.5 5.95.2 5

5.9 5.3 5.9 5.3 4.7

Tea

chin

g

Pla

nn

ing

Cla

ssroom

Man

agem

ent

Coop

eratio

n

Motiv

atio

n

Reso

urces

Com

mu

nica

tion

Assessm

ent

Positiv

e Rela

tion

ship

s

Up

date P

aren

ts

0

2

4

6

8

10

Aug. 2002 Jan. 2003

Aug. 2002 6.9 6.5 5.9 5.2 5 5.9 5.3 5.9 5.3 4.7

Jan. 2003 7.4 7.1 7.2 6.9 6.7 6.1 5.9 6.7 6.5 6.2

Test ScoresElaine School District

59

38.5

0

10

20

30

40

50

60

70

Percent of Students at or below the 25th percentile

Fall 2001 Spring 2003

Tribal Digital Village

Largest Wireless System in the Country

Stanford School of Medicine

p=0.04 Dialogue

STEP 1

PGY-1

Accreditation

Arkansas Tobacco Prevention: ROI

Grantee Evaluation Dashboard

• Goals (where grantee wants to go at the end of 5 years)

• Benchmarks (points along the way each year)

• Actual Performance (where grantee is now - today)

• Baseline (where grantee started)

Tobacco-Free Environment Program

Dashboard - 1 Year

Actual Performance 0 1 3

Benchmarks 1 2 3 4

Goals 4 4 4 4

Baseline 1 1 1 1

Qtr 2Qtr 1 Qtr 3 Qtr 4

1 Year Tobacco-Free Environment

0

1

2

3

4

Baseline Qtr 1 Qtr 2 Qtr 3 Qtr 4

Actual

Benchmark

Goal

4 Quarter -Tobacco-Free Environment: Baseline, Benchmarks, Actual

Performance & GoalActual Performance Benchmarks

5 Year Tobacco-Free Environment

0

5

10

15

20

25

30

Baseline 2010 2011 2012 2013 2014

30

21

18

9

22

30

20

15

10

5

0

Benchmark Number of Tobacco-Free EnvironmentsActual Number of Tobacco-Free Environments

Act

ual

Ben

chm

ark

Goal

Building Evaluation Capacity

Arkansas Evaluation Center

Tech Tools

Technological Tools of the Trade: A Metaphor

Align Tools with the Principles of Empowerment

Evaluation

Online Surveys Digital Photography

Blogs Picture Sharing

Docs & Spreadsheets Collaborative Web Sites

Videoconferencing YouTube

Word Cloud

YouTube

Infographics Data Visualization

Evaluation Capacity Building: Empowerment

2013

Stanford University Press New!

2014

Sage Press

Radio Interviews: New Frontiers

Dr. David Fetterman FettermanAssociates@gmail.com

!(650) 269-5689

Fetterman & Associates

25 Years Experience at

Stanford University

American Evaluation

Association!Past-President