Distinguished Evaluator SeriesBuilding Evaluation Capacity

June 14, 2011

An Invitation to tell it Like it is

Evaluation

HOOP? HELP?

NOT-FOR PROFIT

In what ways is evaluation a hoop to jump through for not-for-profits?

In what ways is evaluation a help for not-for-profits?

How did HFGC evaluation get from 1998 to 2011?

We had some lofty evaluation thoughts

Data Driven Decision Making

Empowering

Funder and NFP on the same page

Increase Sustainability

How Do For-Profits and Not-For-Profits Differ?

For-Profits Not-For-Profits

Cost Center

Care Center

Care Center

Cost Center

How are Research and Evaluation Designs Different?

Basic Research

Applied Research

Evidence Based -Practice

Evaluation

Who should do the evaluating?

• External Evaluator• Internal Evaluator (build internal capabilities)

Lots of Reading on Evaluation

State-of the Art

Learned from Grantees

KaZammmm

• Logic Model• Process Evaluations (What you do)– Formative Stuff

• Outcome Evaluations (What happens because you do it)– Summative Stuff

Logic Model (Logical Framework)

• Activities and Outcomes Approach • Project theory– Story Approach– Story of why and how the project works– Demonstrates connections between program

science, the program operations, and expected outcomes

What We Sort of Knew and Where We Didn’t Know Much

Problem

Intervention

Outcomes

Problem

Intervention

Outcomes

Goal

Objectives•Infrastructure•Implementation•Sustainability

Created a mutually agreeable evaluation plan

• HFGC created the boxes (evaluation forms) • Grantees filled boxes in a way that worked for

them• HFGC shared the wisdom learned over time

from successful and unsuccessful projects• Evaluation plan part of mutual expectations in

contract

Evaluation Use

• Grantees asked to review plan quarterly• Make changes if needed• Review next quarter• Get assistance from Program Officer if needed• HFGC learned that groups of similar grantees

helped one another established grantee groups

• Grantees provided input and plan simplified

We Learned that to truly be useful that grantmaking was more than $$$

• Workshops– Evaluation– Communications– Business Plan– Many others

• Policy and advocacy work• Individual and Group consultation• Technical Assistance

We evaluated our approaches to evaluation

• Grantee Perception Study• Sustainability Study• Workshop Evaluations

Revisit Use of Evaluation (2011-????)

So for the rest of the day we will

• Look at how others around the country are evaluating (PBS film)

• Reflect on evaluation in our organizations• Hear a panel of experts and the wisdom of the

audience