M&E Training

7/29/2019 M&E Training

1/28

MONITORING AND EVALUATION

TRAINING

8-11th November, 2011

Byb


2/28

INTRODUCTION

AND LEVELLING OF

EXPECTATIONS


3/28

Breaking the Tide "The history of the human race is the history of

ordinary people who have overcome their fearsand accomplished extraordinary things." Brian Tracy

People who consider themselves victims of theircircumstances will always remain victims unless

they develop a greater vision for theirlives." Stedman Graham

I used to say, I sure hope things will change. Then I learnt that the

only way things are going to change for me is when I change.

Adding wings to a caterpillar does not make a butterfly, butterflies aremade through transformation -Tracy The 21st Century illiterates are not men and women who cannot read or

write, but those who cannot learn, unlearn and relearn .


4/28

Introduction to

Monitoring and Evaluation


5/28

Objectives of session

Definitions: Monitoring and Evaluation

Rationale for M&E Review elements of an M&E plan

Steps toward constructing the M&E plan

Implementing the M&E plan


6/28

Course Overview

In Pairs;What do you understand by the

term Project? Give examplesWhat is project management?

How do Projects differ from

regular work?


7/28

Monitoring - Evaluation

Monitoring is the

routine process of

data collection and

measurement ofprogress toward

program

objectives.

Evaluation is the use ofspecific study designs andspecial studies tomeasure the extent towhich changes in desiredoutcomes are attributableto a programsinterventions.

OutcomeInterventions


8/28

Rationale for M&E

M&E help to make informed decisionsregarding ongoing programs

They facilitate effective and efficient use of resources

They determine whether a program is right on trackand where changes need to be considered

M&E help stakeholders conclude whether

the program is a success M&E preserve institutional memory


9/28

Three Primary Uses of Evaluation Findings

Rendering judgments Summative evaluations of programs overall

effectiveness

e.g., audit, renewal, quality control, accreditation

Facilitating improvements Formative evaluation to improve program

e.g., programs strengths/weaknesses, progress

Generating knowledge Conceptual use of findings

e.g., generalization, theory building


10/28

What is an M&E Plan?

An M&E Plan is a document that describes

a system which links strategic information

obtained from various data collection

systems to decisions that will improve the

programs.

Fundamental document to ensure:Accountability

Measure of success


11/28

Functions of an M&E Plan

State how the program is going to measurewhat it has achieved (ensure accountability)

Document consensus (encourage

transparency and responsibility) Guide M&E implementation

(standardization and coordination)

Preserve institutional memory

M&E plan is a living document and needs to be

adjusted when a program is modified.


12/28

Functions of an M&E Plan:(e.g. Health System)

Facility (primary data collection): Manage patients/clients

Supervise providers

Manage logistics

Report to district HIS and vertical programs and community

District: Allocate resources

Report to provincial/national

National (Comprehensive vs. Vertical Programs) Allocate resources

Collect national data

Report to international donors and other stakeholders


13/28

In your organization;

Identify different phasesthat projects undergo

And how would youmonitor each phase?

Activity : GROUPWORK


14/28

A Projects Life Cycle

Conceptual Phase

Planning Phase: Implementation

Phase:

Closure Phase

Time

Project

Activity

Quality

Management

Monitoring and

Evaluation


15/28

Conceptualization Phase

Getting an ideaEstablishing a need

Determining feasibility

Searching for alternatives

Preparing proposals

Finding a sponsor

Developing a basic budget

with ballpark figures

Drafting a tentative schedule

Highlighting the need for a

project team

A Projects Life Cycle


16/28

Figure: Needs Analysis In Sequence

1 2 3

NEEDS NEEDS NEEDS

EMERGENCE RECOGNITION ARTICULATION*Problems/Opportunity *Forecasting the problem/ *In-depth analysis of the need

*Change emerges opportunity/change *Need definition

5 4BUSINESS REQUIREMENTS FUNCTIONAL & TECHNICAL(BUSINESS CASE) REQUIREMENETS*why is the project required? *Deliverable characteristic*what are we trying to achieve? *Deliverable specifications

*what are the deliverables? *Objectives

*what is the anticipated cost? *Expected results

*How long will it take to complete?

*what quality standard must be achieved?*What are the performance criteria?

*what are the key performances indicators (KPI)?

(Project concept paper)

PROJECT DEFINITION


17/28

Elements of M&E Plan

1. Brief project description2. Purpose(s) of M&E plan

3. Brief history of M&E plan development

4. Evaluation framework5. Indicator system

6. Information system (data sources)

7. Impact evaluation design

8. Dissemination and utilization plan

9. Adjustments to M&E plan


18/28

1. Brief project description

Include:

objectives/results

implementation responsibility dates/duration

geographic focus

resources


19/28

2. Purpose(s) of M&E plan

Specify purpose for:

performance (process) monitoring

impact evaluation


20/28

3. Brief history of M&E plan

developmentHelps to define:

shared vision (internal/external)

source and extent of interest/commitment


21/28

4. Develop Evaluation Framework

(Log Frame, Results, Conceptual)

Show:

Primary components Levels and units of action

Causal sequence

Component-related indicator(s)


22/28

5. Develop Indicator system

Organized by framework component

Attributes Name of indicator

Description/definition Unit of measurement

Data source (primary/secondary)

Baseline/target value(s) by year(s)

Frequency of data collection

Responsibility

Reporting plan and frequency


23/28

6. Information Systems(Data sources)

Develop:

Information systems for collecting data forindicators

Diagram data collection, processing,analysis, and reporting system

Data collection tools (routine vs. non-

routine) patient records

registers

survey instruments


24/28

7. Select impact evaluation design

Decide on design:

Experimental vs. observational

Quasi-experimental (post-test, pre- andpost-test with no control)

Implementation plan

Execution responsibility

(internal/external)


25/28

8. Dissemination and utilization plan

Decide on: Databases for information storage

Clearly defined users

Schedule and timeliness Dissemination methods

Reports (schedule and audience)

Media

Speaking events

Information-utilization models


26/28

9. Adjustments to M&E plan

Program changes can occur, affecting the

original M&E plan for both performance

monitoring and impact evaluation

M&E plan is a living document and needsto be adjusted when a program is modified.


27/28

Steps toward constructing the M&E plan

Preparing to build the plan

Constructing the evaluation framework

Identifying potential data sources

Selecting and defining indicators and their

values

Designing the impact evaluation

Developing a reporting schedule and system

Planning for mid-course adjustments


28/28

In implementing the M&E plan

Utility - serve practical information needs ofintended users

Feasibility - be realistic, prudent, diplomatic

and economical

Propriety - conducted legally, ethically, andwith regard to those involved in and affected by

the evaluation

Accuracy - reveal and convey technicallyaccurate information

Documents

M&E Training