Results-Based Accountability (RBA) 101 - Syndey 2014 Conference

FPSI/RLG 1

The Five W’s and How ofResults-Based Accountability™

Social Outcomes Measurement Conference

Sydney, AU

Adam LueckingResults Leadership Group

www.resultsleadership.org

MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES


Agenda• Results-Based

Accountability:Who, what, when, where, why & how?

• Questions and Answers


Why RBATo implement the 5 conditions of Collective

Impact

• Common language

• Shared measurement

systems

• Mutually reinforcing

activities

• Continuous communication

• Backbone support

organization


Why RBATo create Measurable Impact

Measurable Impact

akaTurning the

Curve


Why RBATo know you are making a

difference


Why RBATo bring precision to your passion

How much did we do?How well did we do it?Is anyone better off?


Where RBA?


Who RBA?






How RBA?•Introduction to core concepts

•Population Accountability•Performance Accountability

•Turn the Curve Thinking•Tie it all Together


Two Key Principles for Achieving Measurable Impact

1. Starting with ends, working backwards to means

2. Data-driven, transparent Decision Making


2 - - Kinds of Accountability

3 - Kinds of Performance Measures. • How much did we do? • How well did we do it? • Is anyone better

off?

7 - Questions from ends to means in less than an hour (aka. Turn the Curve Thinking)

• Population accountability • Performance accountability

RBA in a Nutshell2-3-7

FPSI/RLG 16

Results-Based Accountability is made up of two parts:

about the well-being ofCLIENT POPULATIONS

about the well-being ofWHOLE POPULATIONS

Population Accountability

Performance AccountabilityFor Communities – Cities – Counties – States - Nations

For Programs – Agencies – and Service Systems


FPSI/RLG 17

DEFINITIONSDEFINITIONSRESULT RESULT

INDICATOR INDICATOR

PERFORMANCE MEASUREPERFORMANCE MEASURE

Children succeeding in school, Safe communities, Clean environment

Rate of high school graduation, Crime rate, Air quality index

1. How much did we do? 1. How much did we do? 2. How well did we do it? 2. How well did we do it? 3. Is anyone better off? 3. Is anyone better off?

A condition of well-being for children, adults, families or communities.

A measure which helps quantify the achievement of a result.

A measure of how well a program, agency or service system is working.

PO

PU

LA

TIO

N

PO

PU

LA

TIO

N

AC

CO

UN

TA

BIL

ITY

AC

CO

UN

TA

BIL

ITY

PE

RF

OR

MA

NC

E

PE

RF

OR

MA

NC

E

AC

CO

UN

TA

BIL

ITY

AC

CO

UN

TA

BIL

ITY

Three types:Three types:

Language Discipline[ ]


FPSI/RLG 18

Why Distinguish Population from Performance Accountability?

ENDS

MEANS

RESULT&

INDICATORS

A STRATEGY

& PERFORMANCE MEASURES

Customer resultService delivery

A question

of

versus

Ends

Means


FPSI/RLG 19

Interagency System

Program A

Comprehensive Strategy/Partners

Agency/ProgramPerformance Measures

Interagency Service System Performance Measures

EN

DM

EA

NS

Indicator

Children Live in Safe And Stable Homes


1. Doing the right things?

1. Doing the right things?

2. Doing those things right?2. Doing those things right?


FPSI/RLG 20MEASURABLE RESULTS FOR CLIENTS AND COMMUNITIES

FPSI/RLG 21

Population

+ Geographic Area

+ Condition of Well Being

= Result


Populations?

• All people in Sydney

• All Australians

• All children prenatal to 5 years old

• People with developmental disabilities

• People that enjoy water sports


Geographic Area?

• Australia• New South Wales• Sydney• Glebe


Conditions of Well Being?

• Healthy• Safe • Living with Dignity• Economically Secure • Succeeding in School


FPSI/RLG 25

Selecting Indicators


FPSI/RLG 26

Criteria for

Selecting IndicatorsCommunication Power

Proxy Power

Data Power

Does the indicator communicate to a broad range of audiences?

Does the indicator say something of central importance about the result?Does the indicator bring along the data HERD?

Quality data available on a timely basis.


FPSI/RLG 27

Choosing IndicatorsWorksheet

Result_______________________

Candidate IndicatorsCommunication

PowerProxyPower

DataPower

H M LMeasure 1

Measure 2

Measure 3

Measure 4

Measure 5

Measure 6

Measure 7

Measure 8

HDataDevelopmentAgenda

H M L H M L

H L

H H H


Performance Accountability


Selecting Performance

Measures


FPSI/RLG 30

How much did we do?

The Three Kinds of Program Performance Measures

How welldid we do

it?

Is anyonebetter off?

Quantity Quality

Eff

ect

E

ffo

rt

# %

RBA Guide

Page 7


FPSI/RLG 31

Selecting Headline Performance Measures

How much did we do? # Clients/customers served

# Activities (by type of activity)


FPSI/RLG 32

Selecting Headline Performance Measures

How much did we do?How well did we do it?

% Common measurese.g. workload ratio, staff turnover rate, % staff fully trained, unit cost

% Activity-specific measurese.g. % timely intakes, % accreditation standards met


RLG 33

Selecting Headline Performance MeasuresHow well did we do it?

Is anyone better off?

#/% Skills / Knowledge(e.g. cognitive, social, physical)

#/% Attitude(e.g. toward language, parenting)

#/% Behavior(e.g. reading to child at home)

#/% Circumstances (e.g. child care, transportation)

How much did we do?


FPSI/RLG 34

How much did we do?

Health Plan or Practice

How well did we do it?


Number ofpatientstreated

Percent ofpatients treated

in less than1 hour

Quantity Quality

E

ffec

t

Eff

ort

#children

fullyimmunized

%children

fullyimmunized


FPSI/RLG 35

How much did we do?

Education



Quantity QualityE

ffec

t

Eff

ort

Number ofstudents

Student-teacherratio

Number ofhigh schoolgraduates

Percent ofhigh schoolgraduates


FPSI/RLG 36

How much did we do?

Fire Department



Number ofresponses

ResponseTime

Number of firerelated deaths

(in catchment)

Rate offire deathsper 100,000

Quantity QualityE

ffec

t

Eff

ort


FPSI/RLG 37

How much did we do?

Not All Performance Measures Are Created Equal



LeastImportant

Quantity QualityE

ffec

t

Eff

ort 2nd Most

Important

3rd MostImportant

MostImportant

Least

Most


How much did we do?

The Matter of Control



Quantity Quality

Eff

ect

Eff

ort

LeastControl

PARTNERSHIPS

MostControl


Turn the Curve Thinking™


FPSI/RLG 40

Story behind the baseline

Partners (with a role to play in turning the curve)

What Works

Strategy (w/ Budget)

Result or Program:

DataBaseline

How are we doing?

Why?

Help?

Options?

Propose to do?

Turn-the-Curve Thinking™: Talk to Action


FPSI/RLG 41

Result or Program:____________Turn-the-Curve Thinking™ Talk to Action

Data Baseline

How are we doing?


FPSI/RLG 42

The Matter of Baselines

Baselines have two parts: history and forecast

History ForecastTurning the Curve

OK?

Return* onInvestment

* The “ROI” is not financial, it is Results


FPSI/RLG 43

Data Baseline

Result or Program:_____________Turn-the-Curve Thinking™: Talk to Action

Story behind the baseline Research Agenda Why?


FPSI/RLG 44

Force Field Analysis

Factors Contributing?

Factors Restricting?


FPSI/RLG 45

The Story Behind the Baseline Root Causes (ask “Why?” five

times)

Positive and negative

Prioritize – which are the most important to address to “turn the curve” of the baseline?

Research agenda?


FPSI/RLG 46

DataBaseline


Result or Program:_____________

Research Agenda

Turn-the-Curve Thinking™ Talk to Action

Partners (with a role to play in turning the curve)Help?


FPSI/RLG 47

Partners Who are partners who may have

a role to play in turning the curve?

Does the story behind the curve suggest any new partners?


FPSI/RLG 48

Data Baseline



Result or Program:______________

Research Agenda


What Works Research AgendaOptions?


FPSI/RLG 49

What Works Options for actions to “turn the

curve”?

Research-based?

Low-cost/no-cost?

Off-the-wall ideas?

Research agenda?


FPSI/RLG 50

Data Baseline



What Works

Result or Program: _______________

Research Agenda

Research Agenda


Criteria: Leverage; Feasible; Specific; Values

StrategyPropose to do?


FPSI/RLG 51

Action Plan Leverage: will turn the curve of the

baseline?

Feasible (a.k.a. “reach”)?

Specific: who, what, when, where, how?

Consistent with values?


Population and



Results and Indicators

Result: to which you contribute to most directly.

Indicators:

Story:

Partners:

What would it take?:

Your Role: as part of a larger strategy.


Program:

Performance measures:

Story:

Partners:

Action plan to get better:


Service Systems, Agencies, Divisions, Programs andPerformance Measures


FPSI/RLG 54

State, Region, City,

Neighborhood …

E.g., InteragencyCollaboration

Agency

Population

Accountability

Performance

Accountability

Performance

Accountability

Organizationwith

“System” with

Community with a

its clients

its clients

whole population

Population and Performance Accountability: Agency


A Schematic for Results-Based Budgeting and Grant Making

RLG/FPSI 55

1.Community Result

2.Indicators

3.Story Behind the Baselines

4.Strategy Programs Program A Program B Program C

Local __________ Federal __________ Businesses _________ Civic __________ Non-profits _________

Program A

Performance Measures

Story Behind the Baselines

• Action Plan & Budget


Management, Budgeting & Strategic Planning

Management

Monthly or quarterly performance

assessment and action planning using the framework./steps.

Use framework / steps at all levels of

implementation in the agency.

RLG/FPSI 56

Budgeting

Use the Performance Report format for

budget hearings and budget submissions to

present current performance and what

will be done next year to improve.

Budget priorities informed by the Strategic Plan

Strategic Planning

Population Level Results & Indicators, comprehensive

strategy among and all stakeholders

Agency Level

Each department’s role in comprehensive strategy.

Agency’s multi-year priorities.



Management, Budgeting & Strategic Planning

ManagementMonthly or quarterly

performance assessment and

action planning using the

framework./steps.

Use framework / steps at all levels of

implementation in the agency.

RLG/FPSI 57

BudgetingUse the Performance

Report format for budget hearings and

budget submissions to present current

performance and what will be done next year to

improve.

Budget priorities informed by the Strategic Plan

Strategic Planning

Population Level Results & Indicators, comprehensive

strategy among all stakeholders

Agency Level

Agency’s role in comprehensive strategy.

Agency’s multi-year priorities.

Pro

gram

Acc

ount

abili

ty

Program

Accountability

Program

Accountability


FPSI/RLG 58

Agency/Division/ProgramAGENDA

1. New data

2. New story behind the curve

3. New partners

4. New information on what works.

5. Changes to action plan/ budget

6. Adjourn


When RBA?

Now!