27
Crowdsourcing, Transparency and Results Based Charity Ratings – The Next Generation of Nonprofit Evaluation Presented by Ken Berger, President & CEO NextGen:Charity New York, NY November 19, 2010 *Prototype for purpose of illustration only and in no way represents the final product.

Crowdsourcing, Transparency and Results Based Charity Ratings

Embed Size (px)

DESCRIPTION

Charity Navigator's President & CEO, Ken Berger, presented on the topic of “Crowdsourcing, Transparency and Results Based Charity Ratings: The Next Generation of Nonprofit Evaluation” at Columbia University.

Citation preview

Page 1: Crowdsourcing, Transparency and Results Based Charity Ratings

Crowdsourcing, Transparency and Results Based Charity Ratings – The

Next Generation of Nonprofit Evaluation

Presented by Ken Berger, President & CEO

NextGen:CharityNew York, NY

November 19, 2010*Prototype for purpose of illustration only and in no way represents the final product.

Page 2: Crowdsourcing, Transparency and Results Based Charity Ratings

Your Guide to Intelligent Giving

Where the Heart

Meets the Mind

Page 3: Crowdsourcing, Transparency and Results Based Charity Ratings

America's premier

independent charity

evaluator providing timely, relevant,

unbiased information on the fiscal health

of nonprofit organizations.

Largest evaluator of charities: 5,500+

#1 Web Site for Rating Charities – “Your Guide to

Intelligent Giving”

Page 4: Crowdsourcing, Transparency and Results Based Charity Ratings

The Data Proves Impact Estimated 3 million

distinct visitors per year

92% say evaluations affected their decision to support individual public charities

CN ratings influence decisions on billions in donations annually

Page 5: Crowdsourcing, Transparency and Results Based Charity Ratings

(The Nonprofit Marketplace Hewlett Foundation, 2008)

*Includes Charity Navigator- evaluates nonprofits and provides meaningful information.** Includes individuals, foundations, corporations and government funders.

Page 6: Crowdsourcing, Transparency and Results Based Charity Ratings

The Explosive Growth of Nonprofits in the US

Page 7: Crowdsourcing, Transparency and Results Based Charity Ratings

The Problem

Page 8: Crowdsourcing, Transparency and Results Based Charity Ratings

The Solution!: A 3-D View

Page 9: Crowdsourcing, Transparency and Results Based Charity Ratings

QUALITIES OF A HIGH IMPACT ORGANIZATION

Accountability & Transparency

Financial Health

• Positive, sustainable change• Independently evaluatedHIGHER RISK

INVESTMENTLOWER RISK INVESTMENT

Page 10: Crowdsourcing, Transparency and Results Based Charity Ratings

Financial Health

Accountability/Transparency

Results More Comprehensive Rating System

Introducing CN 2.0

Page 11: Crowdsourcing, Transparency and Results Based Charity Ratings

THE EVOLUTION OF CHARITY NAVIGATOR2001 – FORMED WITH A MISSION TO BE A DONOR’S GUIDE TO INTELLIGENT GIVING.

2002 – 2007 - USED IRS DATA (990’S) BECAUSE MANY NONPROFITS DIDN’T LIKE US! IT WAS THE ONLY DATA AVAILABLE FOR META ANALYSIS.

2008 - ANNOUNCED PLANS TO REVAMP RATING SYSTEM TO MOVE TO 3-DIMENSIONAL

2009 - FORMED ADVISORY PANEL

2010 - RECEIVED HEWLETT GRANT TO LAUNCH VOLUNTEER STUDENT RATING PILOT PROJECT TO SCALE UP & FIDELITY CGF TRUSTEE’S PHILANTHROPY FUND FOR STRATEGIC PLANNING .

Page 12: Crowdsourcing, Transparency and Results Based Charity Ratings

CN 2.0 - From One Dimensional to 3-Dimensional

20

40

60

80

100

120

2002

to 201

020

11

2012

& B

eyon

d

% W

eig

ht o

f Rat

ing

Effectiveness/ Results

Accountability/ Transparency

Financial

100%Financial

33.3% Account-Ability/Trans-

parency

+66.6%

Financial

50%Results

+17%

Accountability/Transparency

+33%

Financial

Page 13: Crowdsourcing, Transparency and Results Based Charity Ratings

SCALING UP: 6 Steps to a 3-Dimensional Rating System

July 2010

Accountability &TransparencyMethodology

Launched (achieved)

Fall/Winter 2010

Financial Metrics

Revised (in process)

July 2011

Methodology to Measure Results

Launched (provided adequate funding is secured

to scale up)

Accountability & TransparencyNow Part of Star Rating

(in process)

July 2012

Results Dimension Now Part of Star Rating (assuming data has now been collected for all charities in CN’s database)

July 2013

Incorporation of reviews/data into Results Dimension (e.g.

beneficiary satisfaction, volunteer reviews,expert reviews and independent impact

evaluations.)

1

2

3

4

5

6

Page 14: Crowdsourcing, Transparency and Results Based Charity Ratings

FINANCIAL

(33 Points)

ACCOUNTABILITY/

TRANSPARENCY

(17 Points)

RESULTS

(50 Points)

EFFICIENCY

(10)

SUSTAINABILITY

(23)

Overhead

(3 yr. moving average)

•Working Capital•Current Ratio Web Site & 990s

Keystone/NPC

7 Questions &

3rd Party Reviews

Low

Risk

27 – 33 15 – 17 38 – 50

Moderate

Risk

22 – 26 13 – 14 26 – 37

Intermediate Risk

18 – 21 11 – 12 12 – 25

Significant Risk

13 – 17 9 – 10 8 – 11

0 Stars High Risk < 13 < 9 < 8

Page 15: Crowdsourcing, Transparency and Results Based Charity Ratings

FINANCIAL

0 – 4 STARS

33 Points Max

DCCK: 27 out of 33

ACCOUNTABILITY/

TRANSPARENCY

0 – 4 STARS

17 Points Max

DCCK: 14 out of 17

RESULTS

0 – 4 STARS

50 Points Max

DCCK: 41 out of 50

0VERALL SCORE: 0 – 4 STARS; 100 POINTS; RISK LEVELDCCK SCORECARD: 82/100 POINTS Low Risk

Page 16: Crowdsourcing, Transparency and Results Based Charity Ratings

TRANSPARENCY & ACCOUNTABILITY

Page 17: Crowdsourcing, Transparency and Results Based Charity Ratings

RESULTS7 Questions* - 50 Points Total Maximum

*For this prototype, we are using 7 questions devised by Keystone Accountability and New Philanthropy Capital.

QUESTION Max Points

1. What is the charity’s commitment to reporting results? 5

2. How does the charity demonstrate the demand for its services? 3

3. Does the charity report its activities (what it does)? 3

3. Does the charity report its outputs (short term results)? 3

Page 18: Crowdsourcing, Transparency and Results Based Charity Ratings

RESULTS7 Questions - 50 Points Total Maximum

QUESTION Max Points

5. Does the charity report its outcomes (defined as the identifiable differences that it makes through its work)?

10

6. What is the quality of evidence for reported results? 14

7. Does the charity adjust and improve in light of its results? 12

*Prototype for purpose of illustration only and in no way represents the final product.

Page 19: Crowdsourcing, Transparency and Results Based Charity Ratings

Sample Agency Dashboard

Page 20: Crowdsourcing, Transparency and Results Based Charity Ratings

EFFECTIVENESS/RESULTS3rd Party Evaluations/Reviews

Weighted score based on quality and rigor of data:

1. Volunteer Reviews2. Primary Constituents Feedback3. Independent Expert Reviews4. Independent In-depth Research and

Analysis

Page 21: Crowdsourcing, Transparency and Results Based Charity Ratings

Charity Navigator Soon to Launch Collaboration with GreatNonprofits

Charity Navigator users will now be able to write and read reviews by Donors, Clients Served, Volunteers, Former Staff, Board Members, General Public

Page 22: Crowdsourcing, Transparency and Results Based Charity Ratings

Donors Can Expand for More Details

GNP REVIEWS TO REPLACE COMMENTS TAB

Page 23: Crowdsourcing, Transparency and Results Based Charity Ratings

NO GOOD DEED GOES UNPUNISHED

Page 24: Crowdsourcing, Transparency and Results Based Charity Ratings

The Battle for the Soul of the Nonprofit Sector

Page 25: Crowdsourcing, Transparency and Results Based Charity Ratings

OUR BEST HOPE

• Educated and Engaged Stakeholders are our Best Hope!

Page 26: Crowdsourcing, Transparency and Results Based Charity Ratings

More Information• Article: “The Battle for the Soul of the Nonprofit

Sector” Berger, Penna and Goldberg, Philadelphia Social Innovation Journal of

• Books:1. Billions of Drops in Millions of Buckets by Steve

Goldberg2. Money Well Spent by Paul Brest, et. al3. The Nonprofit Outcome Toolbox by Dr. Robert

Penna (March 2011)• Web Sites1. www.alleffective .org2. www.keystoneaccountability.org3. www.WhatWorks.org• Video: www.savingphilanthropy.org

Page 27: Crowdsourcing, Transparency and Results Based Charity Ratings

Your Questions & Our Web Addresses

Website- www.charitynavigator.org

Blogs- www.kenscommentary.org

blog.charitynavigator.org

Twitter- kenscommentary