WELCOME to the webinar

“Evaluating Sustainable

Development”

This Live Webinar will start at 10:30 AM, New York time.

All microphones & webcams are disabled.

You will not hear any sound until the webinar begins.

Evaluating Sustainable

Development

Live Webinar

5th April 2011

Webinars on Emerging Practices on Development Evaluation: Speakers Title When

Zenda Ofir, Former President, African Evaluation

Association

Shiva Kumar, Independent Consultant from India

Developing Countries Perspective on Emerging

Practices in Development Evaluation

13 October 2010

Fred Carden, International Development

Research Center (IDRC)

Good Practices in Evaluating Policy Influence

16 November 2010

Jared Raynor, Consultant of TCC group

Evaluating Networks and Partnerships

7 December 2010

Peter Morgan, Independent Consultant

Evaluating Capacity Development

January 2011

Charles Lusthaus, Universalia, Associate

Professor in the Department of Administration

and Policy Studies, McGill University; & partner in

Universalia Management Group; Faculty Advisor

to the Centre for Educational Leadership, McGill

University

Evaluating Organizational Performance

February 2011

Steve Rochlin, Director and AccountAbility's US

Representative

Evaluating Innovation

March 2011

Alastair Bradstock, Business Development

Director of the International Institute for

Environment and Development (IIED) and

Steve Bass, Head of Sustainable Markets, also

of IIED

Evaluating Sustainable Development

April 2011

Webinars on National evaluation capacity development

Saraswathi Menon

Finbar O’Brien

The Role of the United Nations in Fostering

National Ownership and Capacities in

Evaluation

22nd June 2010

Michael Quinn Patton

Marco Segone

Future trends in evaluation.

Moving from policies to results by

developing national capacities for country-

led monitoring and evaluation systems

1st July 2010

Caroline Heider

Craig Russon

Evaluating policies and their results

The role of policy analysis in over-coming

the implementation challenge

16th September 2010

Belen Sanz Luque

Florence E. Etta

Human Rights and gender in evaluation

22nd October 2010

Linda G. Morra Imas

Robert Picciotto

Jean Quesnel

The professionalization of

evaluation

30th November 2010

Oscar A. Garcia

Angela Bester

Joint evaluation of the role and contribution

of the UN system in South Africa. Lessons

learned

14th December 2010

Michael Bamberger

Institutionalizing impact evaluation. A key

element in strengthening country-led

monitoring and evaluation systems

January 2011

Hallie Preskill

Alexey Kuzmin

Exploring effective strategies for facilitating

evaluation capacity development

Use of evaluation training in evaluation

capacity building

February 2011

Michael Quinn Patton

Utilization-focused evaluations

March 2011

David Fetterman

Rita O’Sullivan (TBC)

Empowerment evaluation

Collaborative evaluation. Creating

environments to engage stakeholders in

evaluation

April 2011

Indran Naidoo

The monitoring and evaluation in South

Africa. Many purposes, multiple system

May 2011

Manuel Fernando Castro

Diego Dorado (TBC)

Building a results-based management and

evaluation system in Colombia

June 2011

Velayuthan Sivagnanasothy

National monitoring and evaluation system

in Sri Lanka. Experiences, good practices,

challenges and the way forward

July 2011

David Rider Smith

Policies, institutions and personalities.

Lessons from Uganda’s experience in

monitoring and evaluation

September 2011

Webinars on National evaluation capacity development

The recording of the previous webinars are

available at www.mymande.org

1

2

The recording of the previous webinars are

available at www.mymande.org

The recording of the previous webinars are

available at www.mymande.org

Agenda 10h30 – 10h35 Welcome

Abigail Taylor Knowledge Management Specialist, UNICEF

Evaluation Office

10h35 – 10h40 Introduction

Stewart Donaldson, Dean & Chair of Psychology School of

Behavioral & Organizational Sciences, Claremont Graduate University

10h40 – 11h00 Evaluating Sustainable Development

Alastair Bradstock, Business Development Director,

International Institute for Environment and Development (IIED)

11h00 – 11h25 Questions and Answers

Moderated by Stewart Donaldson, Claremont Graduate University

11h20 – 11h30 Closing and Wrap-up

Stewart Donaldson

Steve Bass, Head, Sustainable Markets Group

Alastair Bradstock, Business Development Director,

IIED

Keynote Speakers

Evaluating Sustainable

Development:

capturing the challenges and

lessons

Rockefeller Foundation

April 2011

Alastair Bradstock and Steve Bass, IIED

www.iied.org

We have rapid economic growth …

…which is breaching ecological limits...

...yet many people do not benefit

The MDGs and their env foundations are insecure:

1: Eradicate poverty and hunger – sustainable NRM…

2: Universal primary education – sanitation / water / fuelwood

3: Gender equality and empower women – NR access / IAPoll

4: Reduce child mortality – sanitation / water / IAPollution

5: Improve maternal health – water / fuelwood / IAPollution

6: Combat major diseases – wat-san / biodiversity / climate

7: Ensure env sustainability – env info / rights / accountability

8: Global partnership – manage global public goods (BD, CC)

How to assess SD at country level?

SD institutional ‘products’ to date can be evaluated 1. SD conventions – Biodiversity, Climate, Desertification…

2. SD plans/strategies – national, local, sectoral

3. SD fora and councils – CSD, national, city, sector

4. SD legal principles – polluter pays, precaution, consent…

5. SD ‘triad’ partnerships – govt, civil society, business

6. SD codes of practice – esp in resource-intensive sectors

7. SD ‘wonk’ community – not yet mainstream

8. SD frameworks – are confusing…

Many micro-level SD ‘projects’ can also be

evaluated

Micro-finance for solar, Bangladesh

Organopónicos, Cuba

Plant Oil Stove, Indonesia

Eden Project, UK

Eco-sanitary pads, Rwanda

Some Challenges of Measuring

Overall Progress towards SD

SD’s complexity: it integrates (a) many objectives over (b)

multiple time scales and (c) local to global geographic levels –

but trade-offs rather than indivisible links are more apparent

(‘3 pillars’ rather than ‘3 interlinked strands – triple helix)

SD has not been a real policy priority in practice: thus

deficit of baselines, impact information, monitoring systems,

evaluation frameworks & accountability mechanisms

Much that we want to evaluate has no integral SD

process/targets/indicators e.g. ‘poverty programme’, ‘fiscal

reform’, industrialisation policy’...

Easier to identify what’s unsustainable than what’s

sustainable

Some SD metrics and frameworks

Metrics: Need to cover the three strands (soc, env,

econ) provide an overarching framework from

which to evaluate SD at macro & micro levels

Frameworks:

Reference frameworks at the input/process level

Indicator based frameworks at outcome and impact

level

Narrative approaches to explain multi-factor change

Reference Frameworks at the Input/Process Level

OECD-DAC (2001) has developed 12

principles of good practice for SD

processes

Indicators could be developed based on

these principles to assist SD process

evaluation

Indicator Based Assessments

Chapter 40 of Agenda 21 urged progress assessment of SD

UN Commission on SD – many SD indicators covering economic, environment, social, institutional

Indicator formulation flexible so they accurately reflect local context

Problems associated with aggregating indicators to gain a holistic view of SD performance

At national level, the SDS (often inspired by Agenda 21) usually provides the framework

Narrative Approaches

Good where quantitative data sporadic / unavailable

Complementary even when quantitative data exist. Can provide insights into different causal factors

Important to marshal the mix of indicators that summarises SD’s direction of travel for context

Some ways to conduct SD evaluations

1. Learning groups: IIED using this in 5 developing

countries – all activities that contributed to SD

outcomes over 20 y. Only as good as its members

2. Peer reviews: popular for specific SD initiatives.

Invites people from other countries to review.

France SDS a good example

3. Public expenditure reviews: to assess financial

allocations to SD in every sector. TZ example

Some ways...(cont) 4. Logical framework analysis

16 box matrix; outlines a causal logic that describes the

results chain

5. Theory based evaluation

Similar to LFA but more emphasis on describing the

results chain and the assumptions underpinning the logic

6. Public engagement

Interest is growing in the use of websites to chart the

performance of authorities towards SD. The Netherlands

is a good example

4-5 in particular can suffer from inability to capture spill-

over effects or impacts over longer time periods

Evaluation should support a new SD era: SD efforts should move on

from:

…and do more of:

Fig-leaf comprehensive SD

plans

Investment and accountability

Privileging economic growth Wellbeing of people and nature

SD led by wonks Society-led transformations

International SD conditionalities Local accountability systems

Separate, niche SD initiatives Mainstream SD/systems

Generalised pleading Specific economic/political

cases

Scattered, incomplete SD

assessments

Continuous integrated SD

assessment

Questions and Answers

1

3

2