Embed Size (px)
DESCRIPTION
The key building blocks of "story" are understood, experienced, and then related to our day-to-day work in international aid by Jennifer Lentfer of how-matters.org.
Citation preview
Improving M&E – how to tell our story better
Jennifer Lentfer how-matters.org
July 2012
Monitoring & Evaluation:The International Aid Paradigm
Objectives
Statements
Performance
Indicator Statements
MeasurementMethods / Data
Sources
Goal
StrategicObjectives
IntermediateResults
Outputs
Activities
Critical Assumptions
Monitoring in the ‘Real’ World
Decisions are inevitably made with imperfect information.
M&E data helps to lessen, but not eliminate the information gap.
The quality of data and the timeliness of reporting is key.
We have to expect the unexpected – unanticipated events occur.
M&E?RESULTS?
The Weakest Links in Project M&E
Logframe, Activities & Budget Planning
How will the project’s objectives be achieved?
Objectives Statements Performance Indicator Statements
Measurement Methods / Data
Sources
Critical Assumptions
Goal Infant mortality rate reduced Mortality rates for under-1s & under-5s reduced from X to Y by 19xx
Dept of Health statistics, analysed ex-ante, mid-term & ex-post
Strategic Objective
Health status of infants and babies improved
Rate of re-infection in hospital reduced from X to Y by 19xx
Rates of successful treatment of infectious diseases (polio, measles, tetanus) among under-5s increased from X to Y by 19xx
Rates of successful treatment of birth complications increased from X to Y by 19xx
Hospital & clinic records, analysed ex-ante, mid-term & ex-post
UNICEF community healthcare programme succeeds in reducing rate of infection among babies & infants.
IRs 1. Access to, and utilization of, basic PHC services for infants & babies improved.
Proportion of under-5s vaccinated against polio, measles & tetanus increased from X to Y by 19xx
Rate of re-infection during hospitalisation reduced from X to Y by 19xx
Increased patient satisfaction with standards of care
Clinic vaccination records, analysed quarterly
Hospital records, analysed quarterly
Client satisfaction survey, conducted annually
UNICEF community healthcare programme improves awareness of good household nutrition & hygiene practices succeeds in improving nutritional status of babies & infants.
Outputs 1. Quality of secondary healthcare services enhanced.
Number of villages provided with mobile clinic services increased from X to Y by 19xx
Clinic attendance records, analysed quarterly
Activities 1.1 Design & implement staff training programme for patient care
1.2 Train staff in data collection & analysis
1.3 Improve procedures for drug procurement, storage & control
1.4 Replace vehicles & equipment.
1.5 Conduct awareness raising campaign
1.6 Hold monthly rural clinics.
Technical Assistance
Equipment
Medical supplies
(See activity schedule)
Fees
Expenses
(See budget)
Suitably qualified staff willing to work in rural areas.
Data Collection
Tools
Do our project’s or org’s forms give us the
information we need?
Data Analysis
Are we reflecting
critically on the data we
collected? Are we turning it
into information for project decision-making?
Reporting
Do reports include our analysis of
the data? Do reports
reflect our best thinking or are they just fulfilling
a requirement
by the donor?
1. What is the best story you have ever heard while working with your organization?
2. Why did you remember it?
Reflection Opportunity
Recognizing the Trade-offs in Data Collection
Cost
Complexity
Existing records (e.g. household
lists)
Routinestatistics
Focus groups
Specific samplesurveys
Methodology selection needs to consider the level of resources available for data collection and what the information needs to accomplish.
Key informantinterviews
The effort expended should match the improvement in decision-making.
Observation
Special or ’point’ studies
Reflection Opportunity
What kinds of stories
could provide key information about this situation?
Illustration from Trocaire's Leading Edge 2020 report. Read the report at: www.trocaire.org/leadingedge2020
Why storytelling?
When done right, a story “socks the eye, and the ear, and the solar plexus all at once.” ~Budd Schulberg, author and screenwriter
Our time is already so limited, why bother with stories?
1. Stories “stick.”
2. Our brains like stories.
Our time is already so limited, why bother with stories?
3. Stories cut through barriers.
Our time is already so limited, why bother with stories?
4. Stories…
Our time is already so limited, why bother with stories?
What happens in a story?
Beginning - The “scene” is set with vivid images.
Middle – The storyteller gives their account of a series of linked happenings.
End - These ultimately lead to the resolution of a problem or conflict.
The Story Line
Key elements of storytelling (as opposed to reporting)
1. Stories are comprised of scenes, never summary alone.
2. Readers/listeners experience the action in real time.
3. Readers/listeners want to stay up to the end of the story to learn what happens.
4. Characters speak to each other (not an unseen audience).
5. As we read/listen, we feel like we are inside the scene ourselves.
Key elements of storytelling (as opposed to reporting)
6. Good stories are concise but have enough details to paint a vivid picture.
7. Good stories engage our emotions.
Key elements of storytelling (as opposed to reporting)
1. Did your “best story you have ever heard while working with your organization” have all the elements of a compelling story?
2. Tell the story again with these missing elements.
Reflection Opportunity
Where might storytelling be useful in projects?
Getting people to talk - developing a culture that values rich, effective and meaningful dialogue
Enabling organizations to translate individual experiences into a shared resource (e.g. lessons learned)
Exploring risks and opportunities presented by an event, challenge, or situation.
Remember:“Not everything that counts can be counted.
And not everything that can be counted, counts.”~Albert Einstein
Good luck in your M&E and storytelling efforts!
THANK YOU
