Upload
ids
View
1.928
Download
7
Embed Size (px)
DESCRIPTION
Presentation given by Anna Downie at a research communications capacity building workshop held at IDS April 2008.
Citation preview
Monitoring and evaluation of research communications- what’s it all about?
Anna Downie, Information Department, IDS
Objectives for the session
To think about the purpose of evaluating communication strategies
To develop some measurable indicators
To identify data collection methods and monitoring processes
7
Learning & Reporting(Info to users/events/audiences)
Clarifying Intent(Both interventions & outcomes)
M&E Planning(Choosing what to track)
M&E Implementation (Data collection & interpretation)
Useful M&E needs…
8
Boundary partners
those individuals, groups, and organisations with whom the program:
interacts directly to effect change
anticipates opportunities for influence
engages in mutual learning
9
Outcome mapping: Nested spheres
Research project
Partners
Beneficiaries
Adapted from: Steff Deprez VVOB-CEGO, Nov 2006
sphere of ‘control’
sphere of influence
sphere of interest
Outcomes and indicatorsWho has seen the wind?
Neither I nor you.
But when the leaves hang trembling,
The wind is passing through.
Who has seen the wind?
Neither you nor I.
But when the trees bow down their heads,
The wind is passing by.
By Christina Rossetti (1830-1894)
A graduated set of statements describing a progression of changed behaviours in the boundary partner
Describe changes in actions, activities and relationships leading to the ideal outcome
Articulate the complexity of the change process
11
Progress markers
12
Progress markersLadder of change
Expanding influence, helping others, sharing expertise
Actively engaged, learning, commitment
Early encouraging response to program, initial engagement
Love to see
Like to see
Expect to see
Some indicators (suggested by Hilary)
References to work of partners in policy and finance statements
Statements and position papers
Commitments in national plans and finance strategies
Changes in position or attitudes
Resources commitments of finance or health ministers
Expenditure on contraception
Changes in SRH spending
Changes in services delivery
Charting choices for M&EUses
Adjust Strategy
Improve Implementation
Report Performance
Risk Management
Build Capacity
Lobbying
EventsAnnual Team
meeting
Annual ReportQuarterly
Report to Donor
3 year Programme
Review
Project Review Management
UsersProgram Staff
Board
Donor
Project
Partner
Programme Management
InfoStrategies
implemented
Morbidity & mortality
Partner actions in community
Community responses to project
Partner collaboration with ministry
Community participation
Funding flows
Who, what, when and how of evaluation
What data will you need to collect?
Who will collect it?
When will you collect it?
How often will you collect it?
Finally
Expecting the unexpected
Think about baselines
Don’t just seek the positive – Most significant
change
Learn from your learning
Share your learning– Peer review
18
For more information on Outcome Mapping:
www.outcomemapping.ca www.idrc.ca/evaluation
For more information on the Most Significant Change:
www.mande.co.uk/MSC
Further reading