Results and Impact Management System (RIMS)

Implementation WorkshopBamako

8-11 March 2005

Focus on results and impact of development interventions

General context

IFAD is committed towards achieving Millennium Development Goals (MDGs) and recognizes the need to better document the impact of its operations on the MDGs

General consensus on the need to improve accountability of donors’ funds, including IFAD’s

Managing for results and impact: articulation to the programmes and country performance evaluation system (PR and PBAS)

Development and approval of a “Framework for Results and Impact Management System for IFAD-Supported Country Programmes (RIMS) in December 2003

What is RIMS ?

A systematic methodology and set of common indicators across programmes and regions to measure and inform on the performance and impact of projects

It is based on a comprehensive system of concepts , definitions and indicators for results and impact

It provides flexibility in the monitoring of results and simplicity in the evaluation of impact

It allows to share information among various stakeholders

RIMS in the context of a Project/Programme

MISMISManagement

Information System

Management Information System

M&EM&EMonitoring & Evaluation

Monitoring & Evaluation RIMSRIMS

Results & Impact Management System

Results & Impact Management System

IMPACTIMPACT

Impact Measurement

Impact Measurement

N.B. the performance of RIMS will depend largely on that of the Monitoring and Evaluation Systems

Logical progression from results to impact

1st LEVEL RESULTS

[OUTPUTS]

2ND LEVEL RESULTS

[OUTCOMES]

IMPACT

Looking at RIMS indicators in light of Logical Framework matrix…

Narrative Summary

Objectively Verifiable Indicators*

Means of Verifications

Assumptions

Goal (impact) (incl. RIMS 3rd level results indicators)

Purpose (Outcomes)

(incl. RIMS 2nd level results indicators)

Outputs (incl. RIMS 1st level results indicators)

Activities

*OVIs are likely to include other indicators that are not specified under RIMS

RIMS implies a significant shift in focus from level 1 (physical and financial progress) to level 2 (changes in behaviour) and level 3 (impact) …..

Practically what it involves : The selection of common RIMS indicators is done jointly -IFAD

and project- those (from the RIMS list of about 50, by type of project and component) that are relevant to a particular project (in LF)

Data/information on selected indicators to be conveyed to IFAD, by project, annually – to be aggregated and reported to April Executive Board each year

The selection and reporting on a set of indicators including four mandatory indicators for all projects: # of households with improvement in HH assets Prevalence of child malnutrition # of Hs that have improved food security # of persons receiving project services

Reporting in the context of RIMS:What does it mean for project stakeholders?

On results indicators, information required: annual (AWPB targets and achievements); cumulative (project targets and achievements with reference to Appraisal )

Information on impact indicators to be captured through surveys three times during the project life: at start-up, mid-term and completion (methodology piloted in the framework of PRODAM II - Senegal in December 2004)

Reporting in the context of RIMS:What does it mean for project stakeholders?

Which projects are concerned by RIMS?

All projects approved since January 2004 have to fully incorporate RIMS (RIMS indicators are part of the LF and the 3 impact surveys are programmed)

Projects with the MTR taking place after January 2004 have to select RIMS indicators, including those of impact, and programme the impact surveys (midterm and completion)

Project which have already carried out the baseline survey will incorporate RIMS impact indicators at MTR

Project which were past midterm as of January 2004 will do there best to report on results and impact based on their LF indicators….

Where do we stand today in PA ?

18 out of the 20 concerned projects have agreed on list of indicators and reported on 1st level results in 2004

Country Project Acronym

Benin PDRT and PADPPA

Burkina Faso PAMER

Cameroon PPMF and PADC

Cape Verde PLPR

Ghana REP and RFSP

Chad PSANG

Guinea PPDR-HG

Mauritania PASK and PADCM

Niger PDSFR

Nigeria RTEP and CBARDP

Mali FODESA

Sao Tome & Principe PAPAFPA

Senegal PADV, POGV II and PRODAM II

Twenty projects have reported this year on 1st level indicators

Preliminary lessons learned

CPMs and project management teams of the targeted 20 first projects (out of some 50) were able to agree on a set of RIMS indicators (on average 14 out of the list of 50) to report in 2004

Projects did not appear to have particular difficulties with reporting on 1st-level results because enough RIMS indicators were among the indicators they already monitored

To a large extent, annual programme of work and budget targets were identified and, where possible, cumulative appraisal targets were estimated

However: Appraisal targets MAY NOT be the best measure of project performance

This year sample confirmed that AWPB targets tend to be overestimated in the early stages of implementation

Aggregation might not be so easy as there always remains rooms for interpretation of the indicators and possible double counting (e.g groups, training)

The way forward: work in progress…

Mainstreaming of RIMS as an integral part of project M&E systems for all new projects

Finalization of methodology for impact assessment surveys, including the completion of pilot impact surveys (standard survey questionnaire and software – June 2005) and of 2nd level indicators. Reporting on these starting in 2006

Clarify the role of CIs in the process (RIMS is an instrument for supervision or an object of supervision?)

Continued exchange of information with, and feedback from, projects and development of adapted training material

Stock taking exercise in 2006, including reviewing the list of indicators to better represent today’s projects/programmes, weed out inconsistencies, eliminate duplication, etc. and refine reporting methodology that better links project results to outcomes, objectives and goals

The way forward: next steps in PA…

The success of IFAD RIMS depends entirely upon the appropriateness and strength of project M&E, able to provide support for a results and impact oriented project management.

There is still plenty of room for improvement there and that is where PA wants to concentrate in the near future….

Regional TAG in preparation for 2005 to strengthen management for results and ME as management tool with project teams

Specific country initiatives (e.g. Senegal)