5
Terms of Reference for Assistance on Ex-Post Evaluation of Yen Loan Projects 1. BACKGROUND The Japan International Cooperation Agency (JICA) conducts the ex-post evaluation activities as part of evaluation and monitoring activities of yen loan projects in the second year after their completion. The main objectives of the ex-post evaluation are as follows. 1) To review the implementation of the project and assess the effectiveness and impact of the project, so that one may draw valuable lessons to be reflected in future yen loan projects to enhance the quality of JICA’s assistance. 2) To review the current situation, operation, maintenance and management of the completed projects, so that one may make recommendations, if necessary, to the Borrower/Executing Agency to ensure proper operation in the future. Ms.Yumiko Onishi of IC Net Limited has been selected to conduct ex-post evaluation. Ms. Onishi (“Japanese consultant”) will conduct the evaluation research with the assistance of national consultants. 2. OBJECTIVE OF THE RESEARCH The main responsibility of the national consultant is to provide necessary support to the Japanese consultant to conduct ex-post evaluation of JICA-financed projects effectively. Ex-post evaluation is exercised in view of the five evaluation criteria, i.e., (1) Relevance, (2) Efficiency, (3) Effectiveness, (4) Impact, and (5) Sustainability. See Attachment 1 for details. The following two projects are subject to evaluation. 1) Medium Small and Micro Enterprise and Energy Efficiency Project in India

TOR of ResearchAssociate 120921

Embed Size (px)

Citation preview

Page 1: TOR of ResearchAssociate 120921

Terms of Referencefor Assistance on Ex-Post Evaluation of

Yen Loan Projects

1. BACKGROUNDThe Japan International Cooperation Agency (JICA) conducts the ex-post evaluation activities as part of evaluation and monitoring activities of yen loan projects in the second year after their completion. The main objectives of the ex-post evaluation are as follows.

1) To review the implementation of the project and assess the effectiveness and impact of the project, so that one may draw valuable lessons to be reflected in future yen loan projects to enhance the quality of JICA’s assistance. 2) To review the current situation, operation, maintenance and management of the completed projects, so that one may make recommendations, if necessary, to the Borrower/Executing Agency to ensure proper operation in the future.

Ms.Yumiko Onishi of IC Net Limited has been selected to conduct ex-post evaluation. Ms. Onishi (“Japanese consultant”) will conduct the evaluation research with the assistance of national consultants.

2. OBJECTIVE OF THE RESEARCH

The main responsibility of the national consultant is to provide necessary support to the Japanese consultant to conduct ex-post evaluation of JICA-financed projects effectively. Ex-post evaluation is exercised in view of the five evaluation criteria, i.e., (1) Relevance, (2) Efficiency, (3) Effectiveness, (4) Impact, and (5) Sustainability. See Attachment 1 for details.

The following two projects are subject to evaluation.

1) Medium Small and Micro Enterprise and Energy Efficiency Project in India

In addition to the usual ex-post evaluation, the above mentioned project is subject to detail analysis (See attachment for the details of study tasks).

3. SCOPE OF WORK OF RESEARCH ASSOCIATEThe research associate shall perform the following services during the period from December 2012 to January 2013.

Page 2: TOR of ResearchAssociate 120921

3-1. Questionnaire survey:a. Make necessary appointments for questionnaire interviews.b. Based on the questionnaires prepared by the Japanese Consultants, conduct

questionnaire survey in selected project area. A portion of the questionnaires will be filled by interviewing the end users, BDS providers, intermediary financial institutions and other related agencies. The balance questionnaires will be couriered to the intended respondents.

c. Follow-up on the status of questionnaires with the respondents. d. Retrieve the questionnaires from the respondents.

3-2. Data input and compilation:a. Input data collected through the questionnaire to a database.b. Cross check the data input.c. Prepare the summary of data input results.

3-3. Brief analysis of supply chain:Based on the tasks performed under TOR 3 study tasks in attachment, prepare 5 cases of brief analysis for the current situation of supply chain of the end users.

*The Japanese consultant will visit the country two times. The first visit (Dec 2012) is for conducting the evaluation research. The second visit (Feb 2013) is for reporting the result of the evaluation to the executing agency.

4. EXPECTED OUTPUTSThe research associate shall submit the following outputs in a timely manner.

a. Data input fileb. Summary of data input resultsc. Five brief analysis of supply chain

5. NUMBER OF RESEARCH DAYSTen (10) days in total

6. CONTRACT PRICEUSD 2000

Page 3: TOR of ResearchAssociate 120921

Attachment 1: Evaluation Criteria

Evaluation Criteria

(1) RELEVANCE Question whether project objectives, overall goals, and project scope were/are in line with the priority needs and concerns of the recipient country at the time of the project appraisal as well as the ex-post evaluation. This criteria will focus on the recipient country’s development policy/plan, the needs of beneficiaries, and the donor’s policy.

(2) EFFICIENCY Measure how efficiently the various inputs are converted into outputs of the project during the implementation process (productivity of implementation process). These criteria will examine the appropriateness of inputs such as project cost and its volume, implementation schedule, timing, institutional/organizational function.

(3)EFFECTIVENESS Examine the extent to which the project objectives have been achieved in relation to the outputs. This criteria will include quantitative analysis based on operation and effect indicators of JICA, and will also include a re-calculation of the Internal Rate of Return (IRR).

(4) IMPACT Identify the extent to which the overall goal of the project has been achieved, and verify intended and unintended, direct and indirect, positive and negative changes in technical, social-economic, institutional and environmental aspects as a result of the project.

(5) SUSTAINABILITY

Question whether project benefits are likely to continue after completion of the project. These criteria will include a study of technical, institutional, and financial aspects in O&M agency/organization, condition and status of equipment/facilities procured by the project, technology transfer, and ownership of beneficiaries. It will also include an analysis of issues and constraints which may impede sustainability of the project.