24
Results Based Accountability Sue Gallagher, Director of Research, Planning and Analysis Children’s Services Council of Broward County [email protected] | 954-377-1000 School Board of Broward County September 11, 2013

Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

Results  Based  Accountability    

Sue Gallagher, Director of Research, Planning and AnalysisChildren’s Services Council of Broward County

[email protected] | 954-377-1000

School Board of Broward CountySeptember 11, 2013

Page 2: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Results Based Accountability (RBA)

The Fiscal Policy Studies InstituteSanta Fe, New Mexico

Websitesresultsaccountability.com

raguide.org

Book - DVD Orders amazon.com

resultsleadership.org

Page 3: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Results Accountability

Made up of two parts

Performance Accountability about the well-being ofCLIENT POPULATIONS

For Programs – Agencies – and Service Systems

Population Accountability about the well-being ofWHOLE POPULATIONS

For Communities – Cities – Counties – States - Nations

Page 4: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

PERFORMANCE ACCOUNTABILITYFor Programs, Agencies and Service Systems

The Fiscal Policy Studies InstituteSanta Fe, New Mexico

resultsaccountability.comraguide.org

Page 5: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

1.  The first purpose of performance measurement is to improve performance.

2. Avoid the performance measurement equals punishment trap.

3. Build bottom-up and top-down use of PMs simultaneously.

A Leader’s Approach to Data

Page 6: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

How  Much  did  we  do?  

(  #  )  

How  Well  did  we  do  it?  (  %  )  

Quantity Quality

Performance Measures

Page 7: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Effort  How  hard  did  we  try?  

Effect  Is  anyone  be9er  off?  

Performance Measures

Page 8: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

How  much  did  we  do?  

How  well  did  we  do  it?  

Is  anyone  be=er  off?  

Quan?ty   Quality  

             Effe

ct                                                      Eff

ort  

#   %  

Program Performance Measures

Page 9: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

How  much  did  we  do?   How  well  did  we  do  it?  

Is  anyone  be=er  off?  

#  Clients/customers          served  

#  AcBviBes  (by  type          of  acBvity)  

%  Common  measures  e.g.  client  staff  raBo,  workload  raBo,  staff  turnover  rate,  staff  morale,  %  staff  fully  trained,  %  clients  seen  in  their  own  language,  worker  safety,  unit  cost  

%    Skills  /  Knowledge                                      (e.g.  parenBng  skills)  

#  

%    AItude  /  Opinion                                      (e.g.  toward  drugs)  

#  

%    Behavior                                      (e.g.school  a9endance)  

#  

%    Circumstance                                                                    (e.g.  working,  in  stable  housing)  

#  

%  AcBvity-­‐specific              measures  e.g.  %  Bmely,  %  clients  compleBng  

acBvity,        %  correct  and  complete,  %  meeBng  standard  

Point  in  Time    vs.  Point  to  Point  Improvement  

Separating the Wheat from the ChaffTypes of Measure Found in Each Quadrant

Page 10: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Quan?ty   Quality  

Efficiency,  Admin  overhead,  Unit  cost  Staffing  ra?os,  Staff  turnover  Staff  morale,  Access,  Wai?ng  ?me,  Wai?ng  lists,  Worker  safety  

Customer  Sa?sfac?on  (quality  service  delivery  &  customer  benefit)  Cost  /  Benefit  ra?o  Return  on  investment  

Client  results  or  client  outcomes  

Effec?veness  Value  added  Produc?vity  

Benefit  value  

Process            Input  

Effect  

Effort  

Cost  TQM  

1.  Did  we  treat  you  well?  

2.  Did  we  help  you  with  your  problems?  

*  

Product            Output                    Impact  

*  World’s  simplest  complete  customer  sa?sfac?on  survey  

RBA Categories Account forAll Performance Measures (in the history of the universe)

Page 11: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

1.  To Ourselves Can we do better than our own history?

2.  To Others When it is a fair apples/apples comparison.

3.  To Standards When we know what good performance is.

Comparing Performance

Page 12: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

1. Dataa. Population indicators Actual turned curves:

movement for the better away from the baseline.

b. Program performance measures: customer progress and better service:

How much did we do? How well did we do it? Is anyone better off?

2. Accomplishments: Positive activities, not included above.

3. Stories behind the statistics that show how individuals are better off.

Different Kinds of Progress

Page 13: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

LR  

UR  

Page 14: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Customer  Result:  _______________  Performance  Measure    (Lay  definiBon)  Performance  

Measure  Baseline  

Story  behind  the  baseline                  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐                      -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐    (List  as  many  as  needed)  

Partners                  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐                      -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐    (List  as  many  as  needed)  

Three  Best  Ideas  –  What  Works                1.    -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐                    2.    -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐                    3.    -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐No-­‐cost  /  low-­‐cost  

ONE  PAGE  Turn  the  Curve  Report:  Performance  

Sharp  Edges  

4.  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐  Off  the  Wall  

Page 15: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

POPULATION ACCOUNTABILITYFor Whole Populations in a Geographic Area

The Fiscal Policy Studies InstituteSanta Fe, New Mexico

resultsaccountability.comraguide.org

Page 16: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Core RBA Concepts

RESULTA condition of well-being for children, adults, families or communities.

Children born healthy • Children ready for school

INDICATORA measure which helps quantify the achievement of a result.

Rate of low-birthweight babies • Percent ready at K entry Crime rate • Air quality index • Unemployment rate

PERFORMANCE MEASUREA measure of how well a program, agency or service system is working.

How much did we do? How well did we do it? Is anyone better off? =

Customer Results

Popu

latio

nPe

rfor

man

ce

Page 17: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE?

1. Safe Community2. Crime Rate

3. Average Police Dept response time4. An educated workforce5. Adult literacy rate6. People have living wage jobs and income7. % of people with living wage jobs and income

8. % of participants in job training who get living wage jobs

RESULT

INDICATOR

PERF. MEASURE

RESULT

INDICATOR

RESULT

INDICATOR

PERF. MEASURE

Page 18: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Broward CountyPopulation Results for Children, Families and Communities

•  Children are Physically and Mentally Healthy•  Children are Ready to Succeed in School

•  Children Successfully Transition to Adulthood•  Children Live in Stable and Nurturing Families •  Communities are Safe and Supportive

Page 19: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

How    PopulaBon    

&  Performance  Accountability  

FIT  TOGETHER  

Page 20: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Contribu?on  rela?onship  

Alignment  of  measures  

Appropriate  responsibility  

THE  LINKAGE    Between  POPULATION  and  PERFORMANCE  

POPULATION  ACCOUNTABILITY  

Healthy  Births            Rate  of  low  birth-­‐weight  babies  Stable  Families            Rate  of  child  abuse  and  neglect  Children  Succeeding  in  School            Percent  graduaBng  from  high  school  on  Bme  

CUSTOMER  RESULTS  

#  of  inves?ga?ons  completed  

%  completed  within  24  hrs  of  report  

#  repeat  Abuse/Neglect  

%  repeat  Abuse/Neglect  

PERFORMANCE  ACCOUNTABILITY  Child  Welfare  Program  

POPULATION  RESULTS  

Child  Welfare  Program  

Page 21: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Page 22: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

Every  ?me  you  make  a  presenta?on  

use  a  two-­‐part  approach  

Result:  to  which  you  contribute  to  most  directly.  

Indicators:  

Story:  Partners:  What  would  it  take?:  Your  Role:  as  part  of  a  larger  strategy.  

Popula?on  Accountability  

Program:  Performance  measures:  

Story:  Partners:  Ac?on  plan  to  get  be=er:  

Performance  Accountability  

Your  Role  

Page 23: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

 3  -­‐  kinds  of  performance  measures.                            How  much  did  we  do?                            How  well  did  we  do  it?                            Is  anyone  be9er  off?    

RBA  in  a  Nutshell  2  –  3  -­‐  7  2  -­‐  kinds  of  accountability                      PopulaBon  accountability                    Performance  accountability  

7  -­‐  quesBons  from  ends  to  means  in  less  than                  an  hour.  

 plus  language  discipline                            Results  &  Indicators                        Performance  measures  

Page 24: Results’Based’Accountability’’cdn.trustedpartner.com/docs/library... · Results’Based’Accountability’’ Sue Gallagher, Director of Research, Planning and Analysis Children’s

www.cscbroward.org  

THANK  YOU  !  

WEBSITES: www.raguide.org www.resultsaccountability.com

BOOK ORDERS: www.trafford.com www.amazon.com