Lessons Learned from the application of Outcome Mapping to an IDRC EcoHealth

project: a double-acting participatory process.

Tohtubtiang, K., Assé, R., Wisartsakul, W., and Gilbert , J.

Outcome Mapping Reflection of the Ecosystem Approaches to the Better Management of Zoonotic Emerging Infectious Diseases in the Southeast Asia Region (EcoZD) project

The 1st Pan Asia-Africa Monitoring & Evaluation Forum, Bangkok, Thailand 2012

Introduction

Presentation Overview

•  Outcome Mapping (OM) and its essence

•  Rationale of using of OM

•  The process of developing outcomes

•  Assessing outcomes

•  Outcomes: capacity building & organisational development

•  Conclusion

Outcome Mapping & Its Essence

A participatory planning, and M&E tool which emphasises 3 concepts:

•  Outcomes = Targeted changes in attitude, knowledge, practices, and behaviour at stakeholder levels.

Ø  Changes in personal and organisational levels

Ø  Targeted changes contribute to impact (not attribution)

•  Targeted stakeholders or Boundary Partners (BP)

3 Key Concepts of Outcome Mapping (OM)

Source: Outcome Mapping Learning Community http://www.outcomemapping.ca/

Outcome Mapping & Its Essence

•  Social and organisational learning.

Source: Outcome Mapping Learning Community http://www.outcomemapping.ca/

Goal outcome

I will change gradually in capability / behavior. All depend on my intention

BP  BP  

The goal is my

response, I want it

My goal is to increase BPs’ capability,

encourage BPs to change their behavior. I realize my

own limitation

Project  

3 Key Concepts of Outcome Mapping (OM)

Project Overview

Ecosystem Approaches to the Better Management of Zoonotic Emerging

Infectious Diseases in the Southeast Asia Region (EcoZD)

•  Funded by International Development Research Centre, Canada (IDRC)

•  5-year project implemented by International Livestock Research Institute (ILRI)

•  Goals: capacity building & evidence-based knowledge

•  8 Research & outreach teams in 6 countries.

Rationale for the use of OM

OM process compliments & reinforces:

•  EcoZD’s goal: capacity building

•  EcoHealth Concept.

ü  Non-linear, iterative process

ü  Systems Thinking ü  Transdisciplinary

collaboration ü  Participatory methods ü  Equity (social justice) ü  Knowledge to action ü  Sustainability

The Process of Developing Outcomes

Source: Outcome Mapping Learning Community http://www.outcomemapping.ca/

3 Stages of OM

The Process of Developing Outcomes

Layer 1: Relationship between EcoZD project & 8 teams to influence teams’ changes in knowledge, attitude, and practices (KAP).

A Two-layer process

CAM  CHI  

LAO  

 CMU  

JTV  

VTN  IND  

 UGM  

ILRI-­‐EcoZD   Slaughterhouse  

owners    

Students  

Para  professional  

Layer  1    Layer  2    

Layer 2: Relationship between teams & their Boundary Partners (BPs) to support BPs’ changes in KAP.

The Process of Developing Outcomes

PMs = a set of gradual development of Boundary Partners

(BPs) towards expected outcomes. PMs are collaboratively

developed and mutually agreed by the project & BPs.

PMs - not static & respond to project’s changing situation.

Progress Markers (PMs)

OM process in both layers accentuates ‘Cycle of Learning’

Internal  exchange  of  

info.  &    understanding  

ParBcipatory  Process  with  

BPs  

Adapt  &  Plan  interacBon  

•  Understanding  purposes  •  Analysing  Stakeholders  

•  Progress  Makers  development  &  confirmaIon  

•  Self-­‐assessment  •  Feedback  from  

Boundary  Partners  

•  Using  Progress  Markers  as  a  framework  

•  Improving  strategies  based  on  feedbacks  received    

The Process of Developing Outcomes

As a part of ‘Cycle of Learning’

Assessing Outcomes

ParBcipatory  Process  with  

BPs  

•  Progress Makers development & confirmation

•  Self-assessment & evidence given by Boundary Partners

•  Feedback from Boundary Partners

Organisational Learning

Capacity Building for BPs

Outcome Journal, Performance Journal

Assessing Outcomes

Information from self-assessment and feedback from BPs are used in strategic planning.

AdapBng  &  Planning  interacBon  

•  Using Progress Markers as a framework

•  Improving strategies based on feedbacks received

Assessing Outcomes

Layer 1 & Layer 2 Progress Markers (PMs)

Layer 1: EcoZD – Teams •  Understanding and applying

EcoHealth principles.

•  Communicating research findings.

•  Networking & policy engagement.

Key themes of PMs:

Layer 2: Teams – BPs •  BPs’ improved understanding/

specific knowledge.

•  BPs’ changes in practices.

•  BPs’ communication of particular knowledge/ practices to communities.

Assessing Outcomes

Layer 1: self assessment CHI Team

CAM Team

VTN Team

PM 1: Have an increased understanding of EcoHealth principles, goals, and cost-benefits compared with previous research

H H- M

PM 3: Strategically plan communication and dissemination of research findings to Boundary Partners

L L+ M-

Outcomes & capacity building

Attitude & Knowledge Changes

«  CAM: Toward t ransdisc ip l inary collaboration

«  CHI: Engaging in policy-making process, a do-able attempt.

Layer 1 Outcomes: changes in KAP of teams

Practice Changes

«  VTN: Intentional dissemination of research findings

Outcomes & capacity building

Organisational Learning:

«  Research management & the success of EcoHealth research: administration, communication, and time management.

«  An intentional knowledge transfer is a necessary step for capacity building.

Layer 1 Outcomes: what does EcoZD project learn?

Outcomes & capacity building

Attitude & Knowledge Changes

«  Indonesia Team and its interaction with BPs, Rabies Cadres

Layer 2 Outcomes: changes in KAP of BPs

Outcomes & capacity building

Practices Changes:

« Thailand – Vietnam team & better hygienic practices of slaughterhouse owners

Layer 2 Outcomes: changes in KAP of BPs

March 2012 August 2012

Outcomes & capacity building

Organisational Learning: what do teams learn from this process?

«  Integrate lessons learned into strategic planning & practical action plans: examples from Cambodia Team & China Team.

Layer 2 Outcomes

Conclusion

« OM is used as a framework for the process of developing outcomes and also a formative reflection which contributes to project management.

« Challenges faced by implementation of this process: 1) subjectivity of the tool, 2) seen as a seperate part of the project, 3) resources, especially time & skills of personnel in the teams.

Reference

•  Charron, D.F. (2012) (ed) EcoHealth Research in Practice: Innovative Applications of an EcoSystem Approach to Health, Ottawa, International Development Research Centre

•  Jones, H., Jones, N., Shaxson, L., and Walker, D. (2012) ‘Knowledge, Policy, and Power in International Development: a Practical Guide’, Bristol: The Policy Press.

•  Patton, M. (2010) Developmental evaluation: Applying complexity concepts to enhance innovation and use, New York, NY: Guildford Publications

•  Outcome Mapping Learning Community, www.outcomemapping.ca

EcoZD Project

For more information about the EcoZD project, please visit:���

���www.ilri.org/ecozd���

www.ilriasia.wordpress.com/tag/ecozd

Or contact:

Korapin Tohtubtiang

tkorapin@gmail.com