Upload
khangminh22
View
2
Download
0
Embed Size (px)
Citation preview
IIIEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
FOREWORD
The Government of Sudan, represented by the Humanitarian Aid Commissioner Secretary Gen-eral (HAC) and UNICEF Representative in Sudan, are pleased to present and communicate a final and comprehensive report of an independent evaluation of the effectiveness and impact of the Humanitarian Action in North Darfur. The humanitarian action was a joint initiative between the Sudanese Government, UNICEF, other UN agencies and partners, with the financial support of various donors from 2010 through 2015. The report primarily focused on interventions for Child Survival (Health, Nutrition and Water, Sanitation and Hygiene) in Sudan.
This evaluation provides, for the first time in 13 years, evidence towards the learning of good practices, achieved results and explanatory factors for shortfalls. Subsequently, better informed developments of adequate policies, strategies, appropriate programmes as well as partnerships in improving humanitarian effectiveness and impact in Sudan, are then facilitated. The Government, Local Authorities, Communities, UNICEF and Partners, among other stakeholders, will find this report extremely beneficial.
The objective of UNICEF’s and the Government’s commitment to completing this first independent and transparent evaluation of the benefit to vulnerable children and families of the humanitarian interventions in North Darfur is part of UNICEF’s readiness and accountability to ensuring greater impact for saving the lives of vulnerable children affected by conflicts, natural disasters, poverty and inequalities in North Darfur. Several questions were also addressed such as:
� What did we learn from multi-sector interventions and multi partnerships?
� What could we do better to improve the lives of the lost generation of children who were born and raised in IDP camps since 2003 and amongst host communities?
� Are we addressing the needs and rights of children?
� What are some of the examples of strategic gaps?
� What are the key bottlenecks that hinder effective service delivery and impact to change the situation?
� How do we ensure the sustainability of gains for children’s wellbeing that aim to achieve the SDG 2030 in Sudan?
Under the leadership of the HAC Secretary General and UNICEF, Sudan’s EHA Country Team and a multi-sector Technical Committee of the evaluation was established. This evaluation process
IVEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
involved sector line Ministries of Health, WASH, Education and Social Welfare and 3 consultants recruited by UNICEF (one international team leader and two national consultants). The National Team has designed the evaluation ToR that has guided the design by the consultant team of the methodology, the field assessment and the reporting, benefiting from the timely adequate technical guidance and logistical support of UNICEF at all levels and the HAC including support of Line Ministries and State Governor at federal and state levels. We appreciate the technical support provided by the Central Bureau of Statistics (CBS) regarding the sampling and the field data collection. We are also grateful for the technical assistance provided by UNICEF Regional Office in Amman and UNICEF Headquarters in New York, particularly regarding quality assurance of technical tools, including the final report.
We thank all Sector Line Ministries, States, Local Authorities in North and South Darfur, and our wide range of partners for their roles during the implementation of this evaluation from March through July 2016.
We would also like to further acknowledge UNICEF for the technical and financial support provided for the completion of this evaluation. We are grateful to the financial support provided by DFID at global level. In the same vein, we thank the team of consultants for the quality assessment and analytical nature of the report they have delivered.
In light of the above, we encourage all policy makers and development partners, academic insti-tutions and indeed the people of Sudan to make effective use of this report to plan, monitor and evaluate relevant goals and objectives addressing the advancement and prosperity of the population and children affected by emergency in North Darfur and other areas.
Signed on …………………………31 March 2017, by:
For the Government of Sudan For the United Nations Children’s Fund (UNICEF)
Signature______________________
H.E. Mr Ahmed MohamedHumanitarian Aid Commissioner Secretary General
Signature______________________
Mr Abdullah FadilUNICEF Representative in Sudan
VEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
ACKNOWLEDGEMENTS
The Evaluation Team expresses its gratitude to Mr. Geert Cappelaere, former UNICEF Repre-sentative in Sudan, Mr Abdullah Fadil, current UNICEF Representative, and the Humanitarian Aid Commissioner Secretary General H.E. Mr Ahmed Mohamed, who approved this evalua-tion and provided strong support as part of the Government, UNICEF and partners’ mutual re-sponsibility towards child wellbeing in Sudan and accountability to Donors.
The team also extends its thanks to the UNICEF evaluation office in Khartoum head by Mr Rob-ert Ndamobissi, Chief of Planning, Monitoring and Evaluation assisted by Mrs Aala Mahmoud, Monitoring and Evaluation Specialist and Mr Tarig Mekkawi, Nutrition Officer, all of whom provided invaluable technical direction, guidance, management and quality assurance during the evaluation. The evaluation team is grateful to the multi variate statistical analysis that has been performed by Mr Robert Ndamobissi using the EHA Household survey raw data as key added value contribution to this evidence generation related to assessing the impact on child survival.
The evaluation team also worked in close col-laboration with the Emergency Chief Stephane Pichette, and the UNICEF Field Offices in North Darfur and South Darfur.
The team is extremely grateful to Mrs Mona, the Planning Officer at the HAC, and Imadeldin Abdel-rahim Mohamed, the Director of Programmes at Sudan’s Red Crescent, who worked tirelessly to provide adequate support towards the comple-tion of this evaluation. These officers also worked in close collaboration with UNICEF PME team,
Line Ministries and State Authorities taking lead in coordination, facilitating the acquisition of travel permits and mobilisation of communities and key informants. The officers also provided their ser-vices for the facilitation of access to information related to EHA and their assistance to the field data collection in selected communities.
The Evaluation team also wishes to highlight the efforts of all those who took part in this work in one way or another, and would like to acknowl-edge their invaluable contributions to its improve-ment. From the early days of the elaboration of the Terms of Reference by the Country Team, the methodological design fieldwork planning to the final evaluation report, many individuals were involved through a variety of approaches that made it possible to complete this assignment.
We would also like to highlight the contribution of the experts at the Central Bureau of Statis-tics (CBS), data collectors and enumerators from Sudan Red Crescent volunteers in North Darfur and South Darfur, who have played a critical role in the field data collection. This team reviewed the survey questionnaire making it compatible with the field language, helped in the selection of the sites within each locality and organised expert and qualified teams to collect, compile and summarise data.
We would further like to thank the UNICEF Regional Office M&E team in Amman and the Evaluation Office in New York (particularly Ms Laura Olsen coordinator of the global project of Evaluation of Humanitarian action in partnership DFID/UNICEF), for the timely technical support to all steps of the evaluation.
VIIEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
CONTENTS
FOREWORD ............................................................................................................................... III
ACKNOWLEDGEMENTS ...........................................................................................................V
TABLE OF CONTENTS .............................................................................................................VII
LIST OF FIGURES ...................................................................................................................... X
LIST OF TABLES ....................................................................................................................... XI
ACRONYMS ............................................................................................................................ XII
EXECUTIVE SUMMARY ........................................................................................................ XIII
INTRODUCTION AND BACKGROUND ................................................................................. XIII
Purpose of the Evaluation ..............................................................................................xiiiSpecific objectives of the Evaluation: ............................................................................xiiiKey evaluation questions: ..............................................................................................xivScope of the Evaluation .................................................................................................xiv
METHODOLOGY .....................................................................................................................XV
Evaluation Limitation and Challenges ............................................................................ xv
SUMMARY OF FINDINGS ....................................................................................................XVII
The summary of the findings on best practices (what worked) and for whom ............xviiThe summary of the findings on challenges (what did not work – shortfall in results) ...xviiiThe summary of the findings on the impact of Lifesaving Humanitarian Action for children ...................................................................xixRecommendations to UNICEF ....................................................................................... xxRecommendations to the Government of Sudan ..........................................................xxiRecommendations to Partners .....................................................................................xxii
VIIIEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
1. INTRODUCTION AND BACKGROUND .........................................................................1
1.1 HUMANITARIAN SITUATION IN NORTH DARFUR ..............................................21.2 UNICEF INTERVENTIONS IN NORTH DARFUR ..................................................4
1.2.1 Nutrition ....................................................................................................41.2.2 Health ........................................................................................................41.2.3 Water, Sanitation and Hygiene ..................................................................4
2. PURPOSE OF THE EVALUATION ...................................................................................6
2.1 OBJECTIVES OF THE EVALUATION ....................................................................72.2 KEY EVALUATION QUESTIONS ..........................................................................82.3 THEORY OF CHANGE AND CONCEPTUAL FRAMEWORK FOR THE EVALUATION ........................................................................................82.4 SCOPE OF THE EVALUATION .............................................................................9
3. METHODOLOGY .......................................................................................................... 11
3.1 DATA COLLECTION TOOLS ............................................................................... 133.1.1 Desk Review ........................................................................................... 133.1.2 Key informant interviews ........................................................................ 133.1.3 Focus group discussions ......................................................................... 143.1.4 Significant Stories of Change .................................................................. 143.1.5 Household questionnaire ........................................................................ 143.1.6 Observation of WASH, Nutrition and Health Facilities ............................. 15
3.2 SAMPLING AND DATA COLLECTION ............................................................... 153.2.1 Sampling for administration of household questionnaires ...................... 153.2.2 Quality assurance and ethical considerations ......................................... 163.2.2 Limitations of the evaluation ................................................................... 17
4. EVALUATION FINDINGS AND DISCUSSIONS ........................................................... 19
4.1 RELEVANCE AND APPROPRIATENESS ............................................................204.2 COORDINATION ................................................................................................234.3 EFFICIENCY .......................................................................................................24
4.3.1 Efficiency of WASH Programme .............................................................254.3.2 Efficiency of Nutrition Programme ..........................................................314.3.3 Efficiency of Health Programme .............................................................36
IXEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
4.4 EFFECTIVENESS ................................................................................................424.4.1 Effectiveness of WASH Programme ........................................................424.4.2 Effectiveness of Nutrition Programme ....................................................474.4.3 Effectiveness of Health Programme .......................................................49
4.5 IMPACT ..............................................................................................................524.5.1 Impact of WASH Programme ..................................................................524.5.2 Impact of Nutrition Programme...............................................................534.5.3 Impact of Health Programme ..................................................................574.5.4 Impact on Child Survival ..........................................................................59
4.6 SUSTAINABILITY ...............................................................................................66
4.7 LESSONS LEARNED .........................................................................................66
5. CONCLUSION AND RECOMMENDATIONS ...............................................................69
5.1 CONCLUSION ....................................................................................................70The summary of the findings on best practices (what worked) and for whom .... 70The summary of the findings on challenges (what did not work – shortfall in results) ..............................................................................................71The summary of the findings on the impact of Lifesaving Humanitarian Action for children .......................................................72
5.2 RECOMMENDATIONS TO UNICEF....................................................................72
5.3 RECOMMENDATIONS TO THE GOVERNMENT OF SUDAN ............................. 74
5.4. RECOMMENDATIONS TO PARTNERS .............................................................. 74
XEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
List of Figures
Figure 1: Administrative boundary of North DarfurFigure 2: Evaluation conceptual framework adapted from Tremolet et al.Figure 3: Comparison of funding for WASH programmes by UNICEF and other donorsFigure 4: Number of people reached through the provision of clean water in North Darfur Figure 5: Outputs of water in South Darfur Figure 6: Progress towards WASH in North Darfur schools Figure 7: Provision cost for water and sanitation service per person (household survey)Figure 8: Funding for nutrition humanitarian programmes for 2010–2015 Figure 9: Admission of children with SAMFigure 10: Children aged 6–59 months having received two doses of vitamin A Figure 11: Cost per life saved through UNICEF nutrition Interventions as calculated from UNICEF financial reports.Figure 12: Comparison of distributed Plumpy’Nut and the number of under-five children admitted for SAM treatment Figure 13: Funding of the health humanitarian programmeFigure 14: Number of children receiving BCG vaccine against the target Figure 15: Number of children receiving measles immunization in North DarfurFigure 16: Number of children receiving measles immunization in South Darfur Figure 17: Number of children receiving pentavalent immunization in North Darfur Figure 18: Number of children receiving pentavalent immunization in South DarfurFigure 19: Cost of delivering one dose of a vaccine Figure 20: Distance of the household to the nearest water sourceFigure 21: Presentation of the time taken at the water pointFigure 22: Presentation of household water treatment optionsFigure 23: Presentation of under-five children suffering from wasting Figure 24: Main source of household food Figure 25: Illustration of under-five children sleeping under a bed net Figure 26: Responses from caregivers on whether children under 5 suffered from malaria in the past six months Figure 27: Trends in the under-five mortality rate (per 1,000) in North DarfurFigure 28: Prevalence of wasting – MAM and SAM (%) by stateFigure 29: Presentation of trends of childhood diseases between 2006 and 2014 Figure 30: Visual diagram for factorial plans of determinants of under-five child deaths
XIEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
List of Tables
Table 1: Distribution of the sample size within the localitiesTable 2: Representation of the new cases from 2010–2015 by disaster type Table 3: Presentation of the cost of a 20-litre Jerry can of water Table 4: Source of household income for the internally displaced persons for households with under-five children Table 5: Presentation of child illness cases in North Darfur as reported by the State Ministry of Health Table 6: Presentation of child illness in South Darfur as reported by the State Ministry of Health
XIIEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
ACRONYMS
BCG Bacillus Calmette-Guérin
CMAM Community Management of Acute Malnutrition
EHA Evaluation of Humanitarian Action
EPI Expanded Programme on Immunization
GAM global acute malnutrition
HAC Humanitarian Aid Commission
IDP internally displaced person
IMCI Integrated Management of Childhood Illness
MAM moderate acute malnutrition
MICS Multiple Indicator Cluster Survey
NGO non-governmental organization
SAM severe acute malnutrition
WASH water, sanitation and hygiene
WES Water Environment and Sanitation
WFP World Food Programme
WHO World Health Organization
XIIIEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
EXECUTIVE SUMMARY
1 Annual Humanitarian Strategic Plans is a UN mechanism which pools resources for all UN agencies for humanitarian programming within North Darfur
2 Annual Humanitarian Strategic Plans is a UN mechanism which pools resources for all UN agencies for humanitarian programming within North Darfur
INTRODUCTION AND BACKGROUND
UNICEF’s humanitarian interventions in North Darfur focused on supporting the affected people with immediate lifesaving assistance and pro-tection crucial to their survival, in a sustainable manner. UNICEF targeted more than 517,000 IDPs , (including 180,950 men, 232,650 women, and 103,400 children) between 2010 and 2015, for provision of water and sanitation services under its WASH Humanitarian Programming. The goal was to contribute to a reduction of diarrheal cases through provisions of safe drinking water and sanitation facilities. The Nutrition Humanitar-ian Programme focused on the integration of the new CMAM services into the existing Primary Health Care facilities targeting up to 163,420 chil-dren with Severe Acute Malnutrition. Regarding the Health Humanitarian Programming, UNICEF targeted the strengthening of the IMCI program reaching some 628,566 individuals, representing 33 percent of children under five in North Dar-fur, and capacity building state level health care workers.
Purpose of the EvaluationThe Government of Sudan, represented by Hu-manitarian Aid Commission (HAC) and UNICEF, agreed to undertake an independent evaluation to assess the effectiveness of UNICEF human-
itarian interventions from 2010 through 2015 in North Darfur. One of the primary targets was to learn from the outcome and impact of the interventions in promoting child survival. Evi-dence generated on the intervention strengths and weakness will be used by the Government of Sudan (Federal, State and Locality level), UNICEF, Donors, and other UN agencies to im-prove humanitarian programming for the greater wellbeing of children.
Specific objectives of the Evaluation: To measure the achievement of expected chain of results (efficiency/coverage, effectiveness and impacts) of the implementation of the Annual Humanitarian Strategic Plans1 funded through emergency funds and implemented in North Darfur from 2010 to 2015. Furthermore:
1. Measure the achievement of expected chain of results (efficiency/coverage, effec-tiveness and impacts) of the implementa-tion of the Annual Humanitarian Strategic Plans2 funded through emergency funds and implemented in North Darfur from 2010 to 2015.
2. To document the relevance, coordination, and sustainability of the UNICEF Humani-tarian Programme in North Darfur.
3. To generate explanations to the possible
XIVEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
reasons for the increased under five mortal-ity despite all efforts exhausted in the state.
4. To assess how well humanitarian pro-grammes address host community needs in the same way they address humanitarian needs to the affected population.
5. To assess the institutional, financial and op-erational capacities for better coordination, planning, implementation, management and M&E of Humanitarian Action at national level, state, locality and community levels, both from Government and UN Agencies (UNICEF).
6. To develop a Theory of Change of the inter-ventions implemented in North Darfur and identify the gaps.
7. To document good practices, intervention challenges, bottlenecks and solutions ap-plied to overcome the intervention challeng-es by documenting lessons learnt on what works for whom, what does not work for whom, and why.
Key evaluation questions:1. Relevance/Appropriateness: To what extent
is UNICEF’s humanitarian programmes aligned with National humanitarian policies and the needs of the affected population?
2. Coordination: To what extent has adequate humanitarian programme coordination been implemented among various actors/sectors in order to avoid gaps or duplications at community level?
3. Efficiency: To what extent did UNICEF mo-bilise for adequate financial and operational capacities to offer rapid delivery of services to the affected under 5 children in compli-ance with UNICEF’s Core Commitment to Children (CCC).
4. Effectiveness: What were the achievements of expected outcomes of the implementa-tion of the Annual Humanitarian Strategic Plans?
5. Impact: What significant changes (positive and negative) happened to children lifesav-ing and communities as a result of UNICEF and partners interventions? What are the main determinant factors of increasing child mortality observed in North Darfur during the last five years 2010-2015?
6. Sustainability: To what extent are the inter-ventions and their impact likely to contin-ue when UNICEF and Partners’ support is withdrawn?
Scope of the EvaluationThe evaluation focused on UNICEF child survival programming (Health, Nutrition, Water, Sanita-tion and Hygiene humanitarian programmes) between 2010 and 2015 in addressing the main question related to the effectiveness and impact of humanitarian service delivery. The focus on multi-sectoral responses in North Darfur also included the analysis of conflict effects, promo-tion of social cohesion and building resilience (empowerment of communities and families). The evaluation applied the universal criteria of OECD/DAC, adapted for the particularity of evaluation of humanitarian action: i) relevance (appropriateness), (ii) coordination/coherence (iii) effectiveness, (iv) efficiency/cost-effective-ness/value for money/coverage, (v) impact and (vii) sustainability/ connectedness (as it con-cerns protracted emergency) of humanitarian responses in North Darfur.
The Geographical focus of the evaluation of humanitarian action was on North Darfur, with targeted six localities including Elfasher, Kabk-abia, Kutum, Mellit, Saraf Omra and Tawila, in North Darfur state.
XVEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
METHODOLOGY
3 DFID Approach to Value for Money, July 2011.
The evaluation was an ex-post outcomes and impact evaluation of the humanitarian action delivered by UNICEF and partners in addressing the needs of the population affected by emer-gencies in North Darfur. The evaluation used the utilization- focused approach where the intend-ed users of the evaluation were identified and engaged in the design of the evaluation TOR and tools from the onset. This was enhanced by putting in place a technical committee from the ministry of education, Health, Nutrition, water and social services from the Government side. While from UNICEF there was engagement of UNICEF PME and Senior management team in the evaluation process. The quantitative analy-sis is built on the already existing reports from previous Household Surveys conducted during the period under review (2010 – 2015) mainly MICS 2014, S3M 2013, SHHS 2010, Routine Statistics of Sector MIS (for example, routine data related to health services) and Community Village Survey Data. Data on programme imple-mentation related to Services Delivery (Supply and Cash) and achieved Outputs were extracted from UNICEF internal financial reports. Trends Analysis was conducted in order to assess progress made vis-à-vis base line indicators as captured in UNICEF annual work plans. Quali-tative data was collected from various project stakeholders through individual interviews, Fo-cus Group Discussions with key beneficiaries (children aged 8 - 12, parents, caregivers and service providers), and community members. The cost effectiveness analysis focused on the cost of achieving the intended programme ac-tual outcomes. The analysis of financial data,
including budget allocation, utilisation by out-comes and sector result area was initiated to compute the cost effective analysis as outlined in the DFID value for money framework3.
Evaluation Limitation and Challenges1. The initial scope of the evaluation included
education and child protection program-ming, but this was excluded from the evaluation in a revised TOR. The new TOR focused mainly on child survival and cau-sality of under 5 child mortality rather than on overall humanitarian programming of UNICEF in North Darfur.
2. Since this was a multi-stakeholder pro-gramme in a high-risk area, politically sen-sitive and a complex operating context, it was at times challenging to get a consen-sus on the evaluation from all stakeholders, both at federal and state levels. However, an agreement was finally reached in moving forward with this independent evaluation for the purpose of learning.
3. With the change of the UNICEF financial management system from “PROMS” to “VISION”, the performance data both finan-cial and programmatic in terms of reports, could not be accessed easily. Therefore, the assessment of progress between 2011 and 2012, were completed with difficulty. UNICEF should link the old IT system and the new IT system to ensure that future analysis more focused on financial audits against programmes can be undertaken effectively.
XVIEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
4. The consultant had envisaged availability of routine data at locality level, but the rele-vant Government and UNICEF offices in El Fasher were unable to provide the data at locality level. Most routine data collected are at state level, hence the team analysed data generated from both the household questionnaire and the Focus Group Discus-sions (FGDs) in the different localities.
5. The prevailing circumstances of the emer-gency in these regions are characterised by conflict, hence respondents and FGD par-ticipants required the utmost confidentiality. The team found it prudent not to take the names of the some community members
who participated in the FGDs, but kept the cumulative number of the participants for accountability purposes only.
6. During the data collection exercise mainly for FGD and household (HH) questionnaire, some households which experienced the death of a child before the exercise and therefore did not have an under 5 child present, were excluded. The risk of this ex-clusion is a potential underestimation of the number of child deaths during the five years covered by the evaluation – however 14% of HH have experienced at least one case of U5 child death within the HH during the last five years.
XVIIEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
SUMMARY OF FINDINGS
The details of findings presented for each uni-versal evaluation’s criteria are well developed within the content of the report. The following are the important points highlighted around those criteria, for easier learning about strength-ens and weakness (shortfalls) of the Humanitar-ian Action for child survival during the last five years (2010-2015).
The summary of the findings on best practices (what worked) and for whom 1. UNICEF WASH, Nutrition and Health hu-
manitarian programmes are relevant and ap-propriate to the needs of targeted displaced and affected population. The programmes contributed to the Sudan Government’s poli-cies in humanitarian programming, focusing on Health, Nutrition, Water and Sanitation at sub national level (state and community).
2. In terms of coordination, UNICEF ensured that it effectively met its obligation as a clus-ter lead for WASH and Nutrition by ensuring that there were strategic engagements in planning at the North Darfur state level. This ensured that there was no duplication of activities among the humanitarian actors. UNICEF led and coordinated inter-agency needs assessment mainly for WASH, while for Nutrition there were periodic nutrition-al status assessments to inform program-ming. UNICEF led the contingency planning process, which is a key preparedness tool for the WASH and Nutrition Clusters at the state level.
3. Regarding efficiency, UNICEF demonstrated the comparative advantage of being pres-ent on the ground through the existence of a fully functional field office (staff and logistics), the pre-positioning of supplies at state level within the warehouses of line ministries and UNAMID team sites, strong partnership with Government counterparts and existing signed agreements with NGOs/implementing partners.
4. UNICEF in 2016 strengthened its capacity for programme field monitoring at the field office (FO) level, through the establishment of Third Party Monitoring. This ensured in-dependent assessment of the effectiveness of service delivery, due diligence and im-plementation of financial risk management through HACT at state level, while capaci-ties for information management in support to sector cluster coordination was strength-ened in Khartoum. However, there is a gap in North Darfur.
5. Efficiency of the UNICEF humanitarian programme between 2010 and 2015 was achieved for vaccination and nutrition treat-ment services for acute malnutrition - re-sulting in about 85 percent achievement of the planned outputs.
6. On effectiveness, UNICEF has been able to ensure increased coverage of nutrition services for treatment of SAM over the last five years, including screening and referral of cases to nutrition services centers.
XVIIIEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
7. The effectiveness of UNICEF’s humanitarian programming in terms of ensuring a sus-tained outcome was observed in health services for preventable diseases, mainly in urban and peri-urban areas, as well as in the increased number of children admitted for the treatment of SAM.
8. Concerning impact, health programming contributed to the reduction of vaccine pre-ventable diseases by ensuring increased immunization coverage of up to 90 percent in North Darfur. Nutrition programming con-tributed to the stabilization of the Global Acute Malnutrition and Severe Acute Mal-nutrition rates, though the malnutrition bur-den remains at double the 15 percent WHO emergency threshold.
The summary of the findings on challenges (what did not work – shortfall in results)1. In terms of relevance, UNICEF’s interven-
tions in the state focused mostly on IDPs, refugees and populations affected by disas-ters and did not cover the needs of host communities, which represents an equity gap for children living in the poorest and most vulnerable communities.
2. The inter-cluster coordination (for example, WASH and Nutrition) was found to be weak at state and community levels. Joint plan-ning for these clusters were carried out on a quarterly basis in North Darfur while in South Darfur, joint planning was implement-ed on a monthly basis. At the community level, there was no evidence of contingency planning processes or a joint inter-cluster implementation plan in North Darfur. In ad-dition, the situation monitoring and infor-mation management is weak at state level. If strengthened, it could potentially ensure
adequate sector cluster coordination and multi-sector integrations as seen in Khar-toum.
3. UNICEF was found to be efficient in supply delivery. However, partners, both Govern-ment and NGOs expressed concern about UNICEF’s delay in the finalization of part-nerships and cash disbursement, especially within the context of the agility of response required within 72 hours after the occur-rence of an emergency.
4. The leakage of humanitarian supplies due to the lack of an effective supply chain man-agement and end-user monitoring, the low coverage of basic services to all the affected areas, poor cold chain management prac-tices, and low involvement of the affected population in programming to promote ownership, constitute high risk barriers to achieve expected outcomes and impact for children. The continuous leak of UNICEF’s plumpy nut into the local market has affect-ed the efficiency and effectiveness of the Nutrition programme’s ability to reduce mal-nutrition cases in a cost effective manner. The evaluation also recorded the leakage of WASH supply items based on the ben-eficiaries and partners’ comments. Part of the distributed soap, water jerry cans and tarpaulins were being sold in the local mar-kets in North Darfur.
5. High administrative costs of up to 48.5 per cent (including operating cost of partner-ships with NGOs) has challenged value for money and results for children within the health and nutrition programmes in North Darfur, as compared to the improved child health indicators in South Darfur with less investment, due to a number of factors in-cluding lower administrative costs.
XIXEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
6. Due to the lack of funding for capital invest-ments in new WASH facilities, the planned expectation with WASH and preventive Nu-trition programming recorded low perfor-mance, (less than 50 percent), in terms of translating the planned supply-based inputs into outputs. There is more investment in South Darfur in term of WASH programming (but WASH interventions are weak in North Darfur) however, investment in health and nutrition are higher in North Darfur. WASH humanitarian programming between 2010 to 2015 were largely below expectations in terms of ensuring adequate coverage and sustained access to water and sanitation services both in schools and among the af-fected population. UNICEF staffing for the effective delivery of Nutrition and WASH in North Darfur was low. For instance, one in-ternational staff supported Nutrition, Health and WASH programming, resulting in poor supervision of the implementing partners.
7. Low coverage and poor quality of health ser-vices in rural areas resulted in the outbreak of measles within hard to reach commu-nities and localities in 2014 and 2015. The poor cold chain management practices at the peri-urban and rural areas affected the sustained control of vaccine preventable diseases.
8. The weak linkage between the programme management of child severe acute malnutri-tion and moderate acute malnutrition, high open defecation practices and high number of diarrhea cases and malaria, contributed to continued high prevalence of child mal-nutrition in North Darfur.
9. The humanitarian action did not show any contribution in terms of the reduction of malaria cases and the uptake of the use of
long lasting insecticide treated nets among children under the age of five. Weak pro-cesses for the provision of quality vaccines and enhancement systems, particularly cold chain equipment that were substandard in rural areas of North Darfur, contributed to concerns about the effectiveness of the vaccines being used in those areas against diseases.
The summary of the findings on the impact of Lifesaving Humanitarian Action for children1. On the impact of lifesaving Humanitarian
Action on children, persistent insecurity, high levels of wasting prevalence among under-five children in North Darfur, high prevalence of diarrhea and increasing cases of childhood illnesses, provided evidence of high mortality risk for children over the last five years.
2. Despite efforts by UNICEF to achieve sup-ply-based outputs, the increase of under-five mortality in North Darfur over the last five years (2010-2015) represents a result gap in humanitarian action to improve the situ-ation of children in the state. Key contrib-uting factors include protracted conflicts/insecurity, weak health systems and inade-quate adoption of family practices for child care. The current strategies and narrow scale emergency focused supply-based in-vestment from Government, UNICEF and partners are inadequate to ensure tangible life-saving impact for children because of the sheer magnitude of displacements, food insecurity, child morbidity caused by persistent conflicts, increased child mal-nutrition, outbreak of diarrhea (due to poor hygiene practices), pneumonia, drought or other public health-related hazard.
XXEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
3. Concerning sustainability, due to limited human and financial resource capacity of UNICEF, inadequate technical capacity of implementing partners to effectively ensure the delivery of quality services to the affect-ed population, declining donor funding and the poor involvement of the affected popula-tion, UNICEF’s current humanitarian actions within the protracted emergency crisis (13 years) in North Darfur, are not sustainable.
Recommendations for UNICEF 1. The current administrative cost of up to 48.5
percent is on the high side and UNICEF should institute innovative strategies of partnerships in order to minimize the ad-ministrative/ overheads costs.
2. Institute an independent audit to examine and document the extent of the leakage of plumpy nut, water jerry can and soap, and UNICEF must take immediate measures closely with the Government to eliminate the leakage of supplies and commodities in order to increase the effects of outcomes for children.
3. Strengthen and extend the supply chain management system beyond the state lev-el by ensuring the delivery of commodity to beneficiaries at community and locality level complemented with an effective recording and documentation system.
a. UNICEF needs to explore the engage-ment with private shop owners as av-enues for distribution of therapeutic plumpy nut, mainly in the hard to reach areas where the shops are the first point of reference for assistance at the com-munity level.
b. Branding and visibility of relief items mainly water jerry cans and plumpy nut
should be explored to minimize the leak-age of such items.
c. c. As noted in South Darfur where there is an elaborate policy framework in han-dling humanitarian leakage, UNICEF should lobby North Darfur state Govern-ment and the national Government to enact policies criminalizing the sale of therapeutic relief items.
4. Promote a multi-sector integrated pack-age of interventions at the community lev-el starting from the programme planning stage. UNICEF should promote equity in delivering basic services (Health, Nutrition and WASH) to affected populations and host communities.
5. Revise the supply-based strategy focus of humanitarian actions and explore the introduction of cash-based programming (safety nets) and the strengthening of so-cial protection systems, in order to enable the affected population effective use of Health, Water and Nutritional Services and assure the sustainability of gains of results. UNICEF must also clearly outline its roles of evidence-based policy advocacy to leverage adequate Government investments to scale up the equitable coverage/access and the quality of social services.
6. Strengthen the State Ministry of Health’s capacity to ensure effective and efficient management of vaccine cold chain at the locality level in order to secure the preven-tive strategy.
7. Strengthen the capacities of communities to ensure the maintenance and sustainabil-ity of basic services with a clear capacity building strategy.
XXIEVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
8. Strengthen the primary health preventive and care systems through adequate tech-nical and financial support to scaling up MNCH and IMCI, which could contribute to improving the quality and demand of health services and reduce child morbidity and deaths – beyond humanitarian or emer-gency response.
9. Enhance inter-sector/cluster coordination within UNICEF, mainly at implementation level, focusing on the community/locality level. UNICEF should also strengthen the situation monitoring and information man-agement at state level to better prioritise the agility of response to emerging vulnerable situations.
10. Strengthen Communication for Develop-ment in order to address the magnitude of inadequate practices of sanitations and hy-giene; UNICEF should sensitize the affect-ed population, specifically the mothers and caregivers on not referring to plumpy nuts as “Biscuit”, but as a therapeutic product for treating Severe Acute Malnutrition.
11. Strengthen the documentation and infor-mation management within UNICEF key Sections.
Recommendations to the Government of Sudan1. The Government is recommended to accel-
erate the recruitment of medical doctors, nurses and midwifes or clinical officers for community level health facilities that will en-sure the quality and use of health services.
2. The Federal and State Ministry of Health should improve the health early warning system for North Darfur to reduce disease detection time and establish a robust anal-ysis mechanism.
3. The Federal and State Ministry of Health should assess and improve on cold chain management in North Darfur.
4. State Government officials should establish a legislation that criminalises any sale of hu-manitarian supplies and commodities, par-ticularly those used for therapeutic needs of the children (Plumpy nut) using the best legal practices in place in South Darfur;
5. The Federal and State Ministry of Health should explore ways to improve access to the vulnerable population by humanitarian agencies mainly for the hard to reach areas where the humanitarian need is high.
6. Government and all other parties in conflict should continue with the ongoing efforts to end conflicts, establish a final peace agree-ment for the restoration of hope for human well-being and dignity of the deprived pop-ulation and vulnerable children of North Darfur, and break down the vicious circle of violence.
7. The Government of Sudan and state Gov-ernment, as well as other stakeholders in-cluding UNICEF, should develop a mecha-nism for the establishment of a safe corridor for delivery of humanitarian services and goods to the affected population in crisis prone regions and areas.
8. The engagement of Government and stake-holders in favour of durable solutions for peaceful social cohesion, recovery and de-velopment, represents the hopes of the population of North Darfur and the gen-eration of children that have had to live in camps for many years without any perspec-tive (unfortunately, many cases of suicides are recorded).
XXIIEVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Recommendations to Partners1. The achievement of the global transforma-
tive agenda of SDG 2030 n Sudan “no one left behind prosperity; dignity and access to basic human needs” requires an increase of financial investments for scaling up multi-sector interventions. Donors should reverse the decline curb of financial assis-tance to humanitarian action in Sudan to avoid any additional loss of children’s lives as observed during the last five years in North Darfur, for reasons such as child malnutrition and preventable diseases.
2. The establishment of durable solutions to ensure sustainable gains in the context of protracted emergency, represent the new direction of strategic reflection and invest-ments of partners to ensure the continuum of Humanitarian to Development (building resilience, recovery and development).
3. Donor support for ending conflicts and achieving the Peace agreement in Sudan is the ultimate hope for the vulnerable popu-lation affected by a protracted 13 year con-flict, which represents a source of external emigrations and persistent violence.
1EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
1. INTRODUCTION AND BACKGROUND
© U
NIC
EF/U
NI1
6579
8
2EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
1. INTRODUCTION AND BACKGROUND
4 Food and Agriculture Organization, Land Cover Atlas of Sudan, FAO, Rome, 2012.
5 The National Council for Strategic Planning General Secretariat, ‘The Twenty-Five-Year National Strategy 2007-2031’.
6 United Nations Office for Disaster Risk Reduction, ‘Sudan: Basic Country Statistics and Indicators (2014)’, PreventionWeb, UNISDR, <www.preventionweb.net/countries/sdn/data/>, accessed 8 March 2017.
The Sudan is a semi-arid country situated in the Sahel region that is characterized by low precip-itation, water scarcity and a short agricultural season (three to four months). It is one of the largest economies and most populous coun-tries in Africa, with 37,964,306 million people. However, drought in the country is a recursive phenomenon, with frequent cycles that extend over two to three year periods. Out of the coun-try’s total area (1.87 million square kilometres), 1.13 million square kilometres (60.2 per cent) is desert and semi-desert, while the remain-ing 0.687 million square kilometres (39.8 per cent) is divided between low-rainfall savannah (300–500 millimetres of annual rainfall) and rich savannah (more than 500 millimetres of annual rainfall).4
The impacts of climate change are evident throughout the Sudan. Rainfall records from El Fasher, North Darfur, show a marked drop be-ginning with the 1972 drought. This is a more compelling indication that droughts have be-come more frequent, with 16 of the 20 driest years recorded in the region occurring since 1972. Various climate change models also pre-dict a reduction of more than 20 per cent in the length of the growing period between 2000 and 2020.
Apart from the drought, the Sudan continues to experience humanitarian challenges due to armed conflict that has led to displacement and food insecurity. The country also grapples with an influx of refugees from neighbouring and regional countries, and international economic sanctions have hindered the achievement of the 25-year National Development Plan.5 Addi-tional hazards that have increased disaster risk within the Sudan include flooding (73.2 per cent frequency of occurrence), earthquakes (4.9 per cent) and storms (4.9 per cent).6 Outbreaks of animal and human diseases are also among the key natural hazards affecting the Sudan.
1.1 Humanitarian situation in North Darfur
Darfur is a region affected by conflict and secu-rity concerns. Simmering tensions throughout the 1990s exploded into conflict in 2003, as self-defence groups militarized into armed re-sistance and initiated a significant conflict that affected Darfur for more than 12 years. This re-sulted not only in the internal displacement of some 1.7 million people, but also caused the influx of 280,000 refugees from western Darfur into Chad. The entire population of Darfur—ap-proximately 8 million people—were affected
3EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
l
l
l
l
!!!
!!!!
!!!!
!!!!
!!!!
!!!!
!!!!
!!!
!!!
!!!
!!!!
!!
EL TINA
EL MALHA
KUTUM
MELLIT
EL FASHER
EL TAWEISHA
EL KUMA
UMM KEDDADA
KALIMENDO
EL SIREAF
KEBKABIYA
DAR EL SALAM
SARAF OMRA
Anka
Gabir
Tabit
Sabun
Galgi
Bahia
Khamis
Kulkul
MuzbatBamina
Wakhaim
El Lait
Um Lyon
Um Sidir
Sarafaya
Furawiya
Ana Bagi
Abu Delek
Um Eshera
Abu Sakin
Saq AlnyamAbu Zerega
Sani Karaw
Abu Sufyan
Ed Al Beada
Tarny North
Shegeg Karo
Baashim/tina
Abdel Shakur
Um Gullah Haj
Sigeir Umm Sa Shaqq Al Huja
Hashaba North
Kuma
Tina
Malha
Korma
Kutum
Tawila
Saiyah
Mellit
Karnoi
Umm Baru
El Sireaf
Kebkabiya
Fata Borno
Saraf Omra
Umm Keddada
El Taweisha
Ed Al Nagab
Dar El Salam
Birkat Seira
Kafod
Burush
Wada`ah
Shangil Tobay
El FasherOm
Ogr
Ali
Mou
Kur
Kom
Kil
Ali
UruUru
Ini
Sir
Dus
Zur
Eijo
Argi
Jaur
Asad Gaal
DifaTulu
Fado
Geri
Kosa
Juma
Debs
Dady
Saby
Tora
Tina
Tega
Mara
DugoDali
Kona
Tega
DaliNima
Madu
Fazi
Uama
Wiza
Sita
Meli
Madu
Gawa
Elwi
Ebni
Atri
Arid
Idda
Deen
Mado
NairSaya
Fonu
Dawa
Buly
Amou
Sole
Neni
Disa
Naro
Miki
Jaco
Fazy
Wama
Golo
Kamu
Tuji
Treh
AmboLill
Eima
Luti
Kuri
Jung
Boba
Dade
Hara
Wadi
Dibl
OwryNumu
Bouo
Kury
Giri
Eima
Auro
Maya
Zonar
Surgi
Da Ud
Hatan
Tulul
Adrur
Lugdi
Alhja
Magun
Imeka
BeeizGaour
Turug
Tahir
Usban
Zirug
Godat
Kadja
Gragf
Finga
Timoa
Katur
Jense
Habir
Nijou
AraraDally
Abiat
Dalil
Dirma
MaralUtashKullu
Toftu
Grida
Ashab
Tosal
Warta
Sersa
LabdaKraty
FasorEkibo
Deldi
Amara
SindyHasan
Birto
Malet
Kenin
Janga
Kursi
Karka
Jabir
Hamra
Eldah
Durum
Dobbe
Bumyu
Kuron
MadelBiery
Wedja
Dekly
Elong
Masri
Bauri
YunisTurdi
Kunga
Irgie
Gerfu
Ahmar
Yonka
TurraGanbu
Jafal
Nimra
Miski
Laban
DarmaDabai
Arnap
Basao
Turba
Oriri
Murha
Matar
Lukka
Lauda
Kolbe
Harun
HajarGirbu
Gedil
Ebbei
AmmarMaylo
Shoba
Farik
Kingo
Fajaj
Dadee
Conya
Souko
Birmo
Affia
Talha
Gelli
BerdySenjo
KaiguFaggu
Ghetis
Tindil
Kenana
Angero
Marega
Mugran
Sereif
Batran
Bulgar
Zarafa YafilaSheiga
Satiha
Safaye
Tagali
Hafara
EfeeinKorbat
Shadad HafaraUm Dul
Martei
Hazama
DubakhLayuna
Karkur
Humayr
Hazeil
Hazama
Daqqaq
MonjarSa`dan
Fagarg
Bonsor
BasigaKabire
Faguri
KurulaKegilo
Khalil
Bashem
Lakadi
Katkoq
Harmal
Bashum
Watoto
Umraha
Selibo
MinnerMellit
Bomadi
Hariga
Bakhit
Baabai
DeremaOstani
KumbudKhitir
Insuru
Deleba
Jeffom
Birdik Diyori
Gadara
Um Rai
KuwaynGibsra
Al Dor
Dirrah
Bilala
Djenge
Jakoha
Fyresh
Alf Mr
Lwabit
Zamzam
Um DamKasanm
Shagra
Djenge
Mirkan
Kornoi
Naeima
Tululu
Azawia Karzwa
Tamaru
Kobbai
Kutuba
HamrahSangor
Kurbia
Qumqum
Orschi
Nagoba
Komora
Hajjak
Geidri
Gabera
Kalkal
Aramba
Kallah
Kaoura
Taurei
Morgeh
Konjar
Bisaron
Hdadyat
El Hara
Kendira
Marsoos
El Foda
Dogeshi
Al Biri
Sheshat
Um Gafa
Kharlif
Kerfees
El Naim
Saffaha
Um Kuda Kharrat
Farshah
Dardaqa
Alawana
Layon E
Keybeir
Kalmena
Monguri
Fingyar
Khamsat
Gambara
Um Atam
Firaiwa
Al Alim
ShalkhaHarhasa
Umsiyal ShekaraMassala
Laskeny
Gadarib
Jawahir
Siladop Masimbo
Marmedi
Bakhita
Wertiba
Wargean
Umbella
Markisi
Elnusub
MartagoMajetti
Siladop
Gosappa
Birmaza
Bakaore
Serreih
MukhtarGerasam
Manzula
AbuzaraShagera
Jakho I
Majdoub
Um Lyun
Manzula
Helelia
Shabaki
GasimbaKerwagi
Kaorika
Kirinik
Furawia
Juktora
SibiggaShigaibLobbodo
Gurbura
Golabai
Gassana
Gantura
Tombare
Deley 1
Tuilliu
Heijliej
Shahakha
El Helif
Bandarbi
Al Atrun
Abu Giri
Um Ridim
Um Araba
Um Freha
Um Kitra
Abu Odam
Wad Kota
HulaylahDubaybah
Taweisha
Umm Hosh
Abu Doma
Um Hawsh
Meshawar
Umm UrufUmm Gola
Um Laota
Taradona
Markassa
KerkarelKarkersa
Barakara
Tebeldia
Qawz Nai
Al Arais
Jakho Ii
Moubabel
Um Dalil
Munyiner
Al Dirra
Al Kiber
Kabkabia
Khudayra
Abu-liha
HilaliyaJurajeew
JarbokeyKirekise
Hirikula MatbettiBetbethi
Hamar Fa
Abu Leha
Ternowda
Um Haraz
Shibarni
Musteria
Kaidebba
Tilingue
Fiabuggu
Wadigarad
HainassurElnazehin
Targambot
Jam Bagly
Tamoleika
Dar Deifa
Um Bayada
Umm SidraEl Abyiad
Um KereinUm Habila
Um Gafala
Um EreidaSadenahamHegeir Fo
Um Muherr
Um Hashab
Umm DarbaUm Tartar
Ghannamah
At Tulayh
Um Daraba
Haskanita
Um Fanato Um DarabaGhubeisha
Um Kafall
Hilla Que
Abu Tango
Sari Town
Um Silelo
Um Haglig
Al Jazera
Sany Haya
Um HegligAbu Kuraa
Sangerfut
Boshareia
Garrah Za
Um Kitoro
Abu Gamra
Niarshige
Misteriya
Birijango
Ein Bessar
Helif Sany
Jabel Eisa
Wadi Osher
Wadi Hadid
El Mashura
Um Shanqah
Widn BaridUm Higeina
Umm Katkut
Eiyal Amin
Umm Shawir
Um Qantura
Um Hijarah
Um Gurraba
Dar Hammad
Umm Kagaya
El Mashrot
Hillet AliWad Balila
Um Qawzayn
Korma Bier
Amushadiga
Abu Shakor
Daym Qarad
Abu Sikkin
Um SumeimaUm Marahik
Al Sheriff
Dangulolbe
Gubarshige
Bi'r Sindi
Adam Bawsh
Amar Gedit
Jebel Hilla
Sag El Naam
Um Burayrah
Fadl Es Sid
Wadi Gellab
Abu Gileiha
Jebel Banat
Hillet Omar
Um Khutayla
Deleba Bowa
Bowa Turmes
Debus Weiki
Ed El Kheir Um Mahareik
Tui Village
Karoya LabanUm Ghabeisha
Abu Kulaywat
Zarqa Hadida
Unknown Name
Kahsab Donky
Donki Shatta
Terh (miski)
Unknown Name
Unknown Name
Damra Siriba
Wahat An Nukh
Shag El SimiaShag El SimiaShaqq An Nimr
Qawz Adh Dhi'
Bahar Um DurmTebeldiya Wan
Tawm Bisharah
Shaqq El Khad
Birish Malyan
Al Higair AliHashaba South
Umm El Hussie
Shaq El Gamous
Jajuor (aluna)
Bobayi Tawiesha
Ali Shams Eldin
Abu Gau Al Hillet
Serief Ben Hussein
Nyala
Zalingei
El Geneina
Dei
Arid
Duma
Limo
Kalu Dilu
Arga
Suni
Silo
Tono
Dago
Murr
Diri
Kuka
Madi
Luma
Agra
Dauro
Qubba
Tumbo
Dashi
Seilo
Tumko
Buddu
Kaira
Kurgo
Seyeh
Korei
GudaiNureiGuldo
Kurbi Gyaga
Gulli
Balla
Oubbe
Nyama
Kulme
Djiri
Dalia
Kagko
Kurto
Lerwa
Gafalu
SineitBuhera
Karbab
Zulata
Tangya
Shurab
Labado
Taisha
Baddal
Ludung
Ballah
Seingo
Keikei Baraka
Saheib
Mogara
KubbumNurlei
Sigiba
Dankud
Djedid
Kourro
Korare
Dogoum
Godoba
DeleigBurburTanako
ArtalaDeimboAmbara
Tetene
Shearia
Um Boim
Gulobei
Garoula
Solwong
Shuwayy
Girgira
Bardani
Gosmino
Kondobe
Derjeil
Korgusa
KirarowBuronga
Lasirei
Gartaga
Gertobak
Beringil
Kalamboa
Mabrouka
Bajouggi
Um Sarir
Goldober Singeiwa
Falankei
Taziriba
Mingyeir
MargibbaDuraysah
DeirirroFongfong
Kasoleri
Uraydimah
Tebeldina
Gostoweir
Abu Gheid
Manawashi
Qawz Baya
Um Kurdus
Damba Agi
Istereina
Abd Allah
Asandalou
Futajiggi
Wad Hassib
Muhajiriya
Tandubayah
Abu Rumayl
Gami Filli
Burbu Basi
Amar Gedid
Wad Bandah
Umm Shalkha
Kazanjedeed
Al Muturwed
Nyangadoula
Zulumingtong
Hagar Jembuh
Shaqq Al Gawa
Abd Allah Bas
Ghubaysh
Abou Adid
Hamrat El Sheikh
Wadi How
ar
Wadi el-Ku
Wadi Azum
Wadi Barei
W
adi Simdu
Wadi Al Khadari
Wadi S a lih
Wad
i Tarai
Wadi Gimri
Wadi Bulbul
Wadi el-Qubbah
Wadi Kej
Wadi Samir
Wad
i Mur
raya
Wadi Hawar
Wad i Fug
ama
Wadi Gweira
Wad
i alG
halla
h
Wad i Mah
ba
s
Wadi Derrion
Wadi Aradeib
W
adi Kolongei
Wadi U
mmSaqqat
Wadi Bugbug
Wadi Bahai
Wad i Abu Sant
Wadi E
l Malik
Bah
r Azoum
Wadi Debarei
Ouadi Kadja
Wadi Hawar
Wadi Bulbul
Wad i Bulbul
Wad
i How
ar
Wad
i Fug
ama
Um
Tuu Aya
Nur
Bom
UmaOda
Mob
Aro
Umu
UluKia
Aja
Tay
Dur
Sow
Tulu
SumoSebi
MoroKude
Kara
KairBoga
King
TaluLugi Jawa
Gubu
Doal
Kuka
Arto
AtulBadi
Kuma
DumaYara
Adwa
Uyer
YoyoAmer
Alda
Ehda
DulaMila
Dugu
Yara
MusiMora
Madu
Firo
Erli
Dami
Bori
Dugo
Guba
TuwaLuko
Kebe
NimaDogi
BuliMaow
Aybo
Fidi
Tiru Nari
Miro
Kudu
Juba
Muku
Diri
Arwa
AdarAabu
Sani
Ieta
Giya Buri
LimaAtro
FogiSisi
Krow
JetaHabi
Atia
Kure
Ryad
Oyur
Lita
Gale
Buli
MariMari
Daya
Wara
Towa
OlowDayaSisi
Abun
Saga
Kuda
Thur
Kuja
DomoMali
TuluToraTolo
KosaDalw
UrdiSuluMara
Gara
Fufu
SobaMisa
DodoMali
Gara
Fura
Uyur
Sala
Gobe
Zare
SojaSede
Kulo
Firi
Fere
Faya Baja
AndiOrdoBela
Beja
Gusa
Fosa
Komo
Amar
YuyuYoya
Buru
Dasa
Buru
Bala
Dina
LulaKure
KoreFado
Tama
TiroSigi
Roto
Saka
ManaMamo
Holi
Eina
Buta
DomiAris
Foga
TumboTolly
Tabla
Norma
Golol
DueruBarri
AbbasSarra
Kutee
Koyee
Auwla YiodiRodotMerla
Dumay
RhyllDerar
DomaiHalaf
OtashZawia
TaggaKurru
SuraaKarko
Dubah
Agara
Baide
Telua
Wanjo
Sulba
Manga
Ganjo
Tangi
Sarah
Endur
SlethHeger
BagerChawa
TarriNango
Jukka
GideiGhula
Debla
Ishma
Anoor
Dibis
Sulil
Fedwa
Kalmo
Abrum
Turri
Terta
Tarli
Sulli
Meija
Komda
Tebol
Kirwa
Nyama
Daura
Turba
MortoBeldo
Leiba
Teiga
MalamKeila
Hijer
Galdi
Kalma
Yuruf
Tomat
Domia
Afona
Mayok
Hajer
DwanaCookaRahma
SeleaKasib
Barka
Jibal
Mansi
JogarKerli
Wadmi
Kosti
Misig
Shano
Murer
Gandy
Mukku
Buddu
Gandi
SaniaTawil
BardiBatro
Birdi
Ma`unChref
AtmurAbaka
Selea
Agara
KorniJeruf
Diiba
Falko
Arafa
SirbaKouta
Kosti
Zeina
Kongi
Dadei
Borta
Adarr
TirtoLiria
Gokar
KalgoAmara
FassiDuana
Tella
Kurra
KulaiTurra
Kurra
Kongi
Mandi
Arkis
Rouko
FunduGorne
Dungo
Senga
Kibli
Bokoj
Bardo
TulusTulus
KoukeKolmeKarti
Morai
TerejLulan
Dorty
Fohab
Salca
Iriji
Jakok
AmedaAmara
Targo
Sunga
OmeriNyima
Borda
Niesa
Barda
Korun
TouroMindo
Zelou
IuourDebee
BarsaTamorDelli
Sirri
Tamer
Soujo
Kenyo
JagniWeigoDeiro
Darsa
Nurly
Bogog
FortoDenow
Sarow
TendyMorol
Balda
Kubuk
Geger
Tulil
Enene
Karbi
Erbee
Kirbi
Babel
Wadaa
Hamar
Barud
AmaraAdila
Gamal
Dagma
Lingu
Sagha
KanklyFuguli
Torray
Faluja
Negeha
Salama
MusaliJiddie
DapkarWasata
Warral
Sereif
Gabrok
El QozDangia
BarangYa`qub
Breiga
Um Rab
KornukBakrem
Kilkil
Ardeba
Futaha
Hamada
Tululu
Morgei
Halouf
Tibrei
BulbulMoraya
LabadoKudmel
Kalajo
Mujabi
Ashaba
Arbaha
Al Moj
SuneitQardud
OmareiKhummi
Fudulu Ereida
Daraba
Barkaz
Zaiafa
Kalagi
Bashom
Dukali
Barkaz
LajeitSeegayKidada
Zaleda
TawangLagaro
TergamLabada
Kalaha
Diyeir
Konjar
Edermi
Bumuye
BobajaDahaba
BielelYogoga
Hasaba
ZalataAmburu
Araok_
Kalkaf
Sakali
Tambra
Takaro
Dwonky
JogoteSeleahZerafa
Madany
Tutuma
Teirab
SakiniSakini
Moumou
Garess
Hereiz
Amasho
Bulbul
Talila
Loeiya
Merrih
Erenda
HabobaHaboba
Sinsin
Ambalu
Kasita
Shagug
Kurnye HarazaAdarib
Sangir
Daraba
Dankis
HarubaArafar
Ushara
Habila
HabilaDressaGafura
Artega
Rufeid
Karrak
GreidaKubuki
Fajara
Gadeir
Kafani
AgouraKakari
Celila
Aramta
Kirkir Andrew
Ballas
Ruvata
GurmulUrtula GreasaJaboun
Duroti
Ardebe Boldon
Talama
Tululu
Sauria
Tululu
Abinay
Kongye
Atomor
RevinaTaweng
Kabira
Nyango
Kolnge
Kirila
Brungo
Sambat
Durmei Boubou
Korney
Forsah
Fagora
Kordul
Keylis
Gangar
Jingev
Arumba
Gambra
Safary
Kajang
Denger
Ma'mun
Bonbol Sondol
Anbara
Bookoj
Dangai
Iseina Ardiba
Tundur
Bornal
Rosoli
Juguma
Kododo
En Nur
FaiyukMajrur
Kulayl
Hugeir
Humayr
Hamdan
Fofaya
Fanyer
El Ait
Dardog
DirrahTuwayr
Maarka
Galusa
Zankor
Shaluf
Tuluba
Kulwat
Kortula
Guilibi
Kurunji
SheariaKindiwa
Kilikil
GarnayaKamirah Bwaytel
KunjariHamouda
Ta'albaEl Nair
Shadidi
Korgati
Rimella
Khataba
ManansaGashtir
Dul Dul
Tergung
Taringa
Nyaldir
Wastani
KoronliDouggou
ShawaraHashaba
Banyala
Um Drua
Karonia
Durduma
Shadani Amabila
Touboum
Seldiro
Nyerlei
Aradeib
FigengaMabruka
SambalaSirsira
Dagrase
Tartura
Kafandu
Umm Jod
Ereredi
Gimmeza
Mastura
SitteibQanatir
Manjura MalalisKernoya
JucutumMourkou
Mararit
Habilah
Goronei
MukjajaKagolei
Khirban
Wastani
Girleli
Burunga
MardugaRumalia Waranga
Debenga
KabareiMurundu
Bugulay
Selenyi
Masmaja
Ambleng
Kafunga
Megatya
Korenga
Balbaso
El Daba
WustaniDamirge
ArdannaTuktuka
EldroutEl Umda
Tebeldi
SheheitManasraMaaglia
GhabishEl Amin
Abu Dik
Bernawi
Serambe
Khashum
Zakfero
Sharafa
Shalluf
Hanatir
Umm Bel
Kinyeir
Baldanga
Shanabla
Babu Nou
Um Luwai
El Erada
El Bobai
El Sahab
Morafata
Mershing
Tabajour
FergulliBurusini
El Melem
Um Gasum
Abardana
TokomayaAmranamaUm Ganah
Ed Debba
Rangatos
Qaradaya
Assibeit
Al Mairl
Sheigiba
Kushkush
Amrikena
KhashabaDar Zubi
Faragene
Majmeray Melmelli
Fujungur
Tongfuka
Fogadiko
Semongha Kammbuna
GaradaiaTirkeldi
Qawz Fil
Birganga
GallabatGallabatKolongei
Amjemena
Kaskeidi
Owha Awo
KosokaraQuarangaKorofata
Taykanga
Namatala
Jalkasim
Tigilden
Humaydan
Hujaylij
Duwaynah
Abbasiya
Umm Busa
Wad Bahr
Kileigau
GamaniyaUmm Sunt
Sarariya
Sakramoj
Umm Badr
Idd Agha
Kolo Bari
Khorsilla
Yourtobek
Dabanaira
Hela Dabl
Um Burins
Umm SerirWad Belal
Helakenin
Umm Ushar
Um Hojane
Ali Shumu
Tebeldina
DimlalaliDeleibiya
Kidingeer
Birkatuli
Fulenwara
Kusu West
El Kebiuo
Karo Karo
Muhajryia
Um Dursoh
Dar Marra
Koukoudja
Mouhaggir
Tougougou
Sina Sine
Baril Fur
Masteriha
Twil Dajo El HamariEd Dereis
Wad Murdi
As Samhat
Umm Shiba
Umm Ginah
Umm Dobia
Ritreirit
Eshangyei
Abu Dazza
Dam Gamad
Wad Salim
Umm Eidam
Umm Sunta
Umm Gerfa
Jubeil Tin
Abu Dangal
Sheq Jorab
Hillet ZumSheq Albur
Amarjadeed
Tingilanei
Gassa Sail
Shagabashi
Taha Tahan
Sheq Ahmed
Hila Beida
Dor Waning
Amarjadeed
Nyangadulo
Kaja-bagol
Bata Nasim
KeregkeregBurbur Fur
Ahmad Badw
Ingliterra
Ahmad Jabr
Abu Shatat
Umm Lebana
Umm Sayyal
Wad Ashqar
Foga Wells
Abu Gezira
Junga Jura
Abu Shawag
Ermil Post
Abu Shanab
Umm Leyuna
Umm HabilaAbu Kabisa
Umm Sughra
Umm Berbit
Tung Kittir
Surrmanjago
Taua Duldul
Um CardoussDangur Gebi
Idd As Sami
Kosormungia
Hillet Nuga
Nur Elsalam
Hajar Bagar
Abu Fawaghi
Umm Sagaaun
Umm Geleima
Wad An Naim
Ummat Arifa
Idd Al Arat
Zalat Jalil
Abou Shibeid
Domaya Temed
Saidah Aisha
Alban Jadeed
Hajar Jenadi
Idd Al Khala
Fatima Karol
Helat Hissen
Fag El Halla
Umm Aradeiba
Humayr Sibil
Tuleih Wells
Qawz Ar Rayy
Habisa Hills
Shaqq Hamura
Umm Inderaba
Bakkit En Nur
Kafran Kaulah Shaqq Al Bash
Dobo Madrassa
Debba En Nair
El Assir WestEl Assir East
Noor El-salam
Humayr Dirrah
Suqa El Gamal
Qoz El Merakh
Burg El Hizam El Bereigwiat
Qalat Al Wish
Zalat Al Hadd
Dalso( Kabeer)
Saraf El Saada
Sugat Al Jamal
Umm Gernanchok
Shaqq Al Qalti
Idd Abu Sufyan
Burg Er Riyasa
Qalti Al Adusa
Laqiya Arba'in
Talila Village1
Borbor Kajakssa
Humayr Ar Ru'us
Qurun El Ugeimi
Rahad Al Humrat
Qalat Al Hamra'
Ruhud Al Maykah
Sheinat Al Agha
Yaganang Musalit
Hamir Ath Thiran
Shabakati Ireida
Quraynat An Nimr
Hamrat El Sheikh
El Heitan Plateau
Ibrahim Wad Arabi
Qalti Umm Tasawir
Zarqa Gamal Ed Din
Qalti Al Khudayra'
Barqat Walad Hawal
Quraynat Umm Inderab
28°E27°E26°E25°E24°E23°E
20°N
19°N
18°N
17°N
16°N
15°N
14°N
13°N
12°N
SUDAN:September 2012
North Darfur State - Administrative Map
CHAD
NORTH KORDOFAN
SOUTHDARFUR
EAST DARFUR
CENTRALDARFUR
WESTDARFUR
NORTHERN
Disclaimer: The designations employed and the presentation of material on this map do notimply the expression of any opinion whatsoever on the part of the Secretariat of the UnitedNations concerning the legal status of any country, territory, city or area or of its authorities,or concerning the delimitation of its frontiers or boundaries.Final boundary between Sudan and South Sudan has not yet been determined.Final status of Abyei area is not yet determined.Production date: 16 September 2012 (VU,CIS, KRT).
State Capital
Principal Town
Administrative Center
Secondary Town
Village
Airf eld
Airport
River
Gully (Wadi)
Operational Railway
Non-Operational Railway
Primary Road
Secondary Road
Locality Boundary
State Boundary
International Boundary
Undetermined Boundary
N
Legend
SOUTH SUDAN
ETHIOPIA
ERITREA
CENTRALAFRICANREPUBLIC
CHAD
LIBYAEGYPT
SAUDIARABIA
Northern
Nile
North Darfur
Red Sea
North Kordofan
SouthDarfur
South Kordofan
Gedaref
Kassala
Sennar
Blue Nile
WestDarfur
WhiteNile
Khartoum
El Gezira
Red Sea
CentralDarfur
EastDarfur
AbyeiArea
Data Sources: Locality boundaries 2012 (Work in progress)Bureau of Local Government, El Fashir & Nyala, State Ministry of Physical Planningand Survey, El Geneina.State boundaries, 2012: Census 2009, www.sudan.gov.sd. Unverifed betweenWest-Central and South-East Darfur states.International boundaries 2007: Sudan Information Management Group IMWG.Settlements: OCHA, UNMIS, CBS. Hydrology: UNMIS. Transportation Network: UNJLC.
0 30 6015
Kilometers
Figure 1: Administrative boundary of North DarfurSource: Office for the Coordination of Humanitarian Affairs (OCHA)
4EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
by the conflict. Eighty per cent of refugees lost nearly everything they owned, and the liveli-hoods and social cohesion of other community members such as sedentary rural farmers, no-madic pastoralists, public sector workers and urban dwellers, were affected. Approximately 38 per cent of the total population of Darfur (3 million people) have received some form of monthly food aid in the past decade.7
1.2 UNICEF interventions in North Darfur
UNICEF has been working in North Darfur for the past 12 years, with a specific focus on pro-viding technical and financial assistance to the affected populations in six locations. Through the United Nations common humanitarian ap-proach, UNICEF has conducted its operations in close collaboration with other United Nations agencies, state officials, local authorities and host communities.
1.2.1 NutritionUNICEF nutrition management in North Darfur focuses on the integration of community-based management of acute malnutrition (CMAM) ser-vices into existing primary health care facilities to provide a full package of health and nutrition services (outpatient therapeutic feeding, sta-bilization centres and targeted supplementary feeding programmes) in one centre. This allows all beneficiaries, including those with severe acute malnutrition (SAM) and moderate acute malnutrition (MAM), to receive services in one place. To ensure an effective implementation process that will improve the quality of services for malnourished children at facility and commu-
7 2013-2019-Developping Darfur: A recovery and reconstruction Strategy; UNDP, Sudan 2013.
nity levels, the programme has enrolled State Ministry of Health staff, implementing partners and community-based workers in various skills enhancement efforts.
1.2.2 HealthUNICEF’s health interventions focus on tackling under-five mortality and morbidity by supporting the Government to adopt new implementation models designed to reach all vulnerable chil-dren, including those in inaccessible areas. The primary focus is on sustaining and monitoring interventions. In North Darfur, UNICEF provided financial and technical support to 97 health facil-ities (34 per cent) to implement the Integrated Management of Childhood Illness (IMCI) pro-gramme, which reached 33 per cent of children under 5. UNICEF supported the training of 240 health workers from 20 health facilities, includ-ing five from rural hospitals who were selected across the 18 localities. Through the training of community health workers in community IMCI, 42 per cent of selected communities in targeted localities initiated integrated community case management. UNICEF also supported the im-munization of 68,624 children (68 per cent), with each child receiving three doses of pentavalent vaccine and 59,542 children (59 per cent) re-ceiving the first dose of the measles vaccine. To strengthen Expanded Programme on Immu-nization (EPI) coverage, UNICEF supported six rounds of acceleration campaigns and two polio campaigns targeting 546,432 children.
1.2.3 Water, sanitation and hygieneWorking through implementing partners, UNICEF provided water, sanitation and hygiene (WASH) support to 422,650 internally displaced persons (IDPs) (82 per cent of the 517,000
5EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
people targeted, which includes 180,950 men, 232,650 women and 103,400 children). UNICEF support incorporates the construction of new water sources, the rehabilitation of dysfunction-al sources, and the operation and maintenance of motorized schemes and water trucking in emergency-affected hotspot areas. UNICEF also provided safe water supply sources to basic schools. WASH sector partners provided access to safe drinking water supply to 111,400 internally displaced persons (50,130 women, 38,990 men and 22,280 children). To prevent outbreaks of diarrhoea, in 2015, UNICEF assis-tance enabled the construction of 3,036 new la-trines and the replacement of damaged latrines (including the rehabilitation of 803 latrines) for displaced populations of North Darfur. With UNICEF support, 591,475 people (50 per cent women) in vulnerable areas, more than 100 per cent of the 270,000 people targeted, benefited from hygiene promotion messages.
6EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
2. PURPOSE OF THE EVALUATION
© U
NIC
EF/U
NI1
6585
3
7EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
2. PURPOSE OF THE EVALUATION
8 ‘Annual humanitarian strategic plans’ refers to a United Nations mechanism that pools resources for all United Nations agencies for humanitarian programming in North Darfur
The protracted nature of humanitarian program-ming in North Darfur, which spans more than 13 years, calls for more attention to the structural causes of malnutrition and ill-health. Underly-ing causes such as the ongoing conflict lead to continuous crises since they determine the amount, control and use of human, econom-ic and organizational resources that are avail-able to households and communities. As such, this evaluation of humanitarian action provides evidence-based results on the effectiveness, efficiency, impact and sustainability of WASH, health and nutrition interventions. The evalua-tion aims to contribute to an understanding of the root causes of child survival in North Darfur in the context of integrated malnutrition man-agement.
The purpose of the evaluation was to take stock of UNICEF humanitarian interventions from 2010 through 2015 to learn from the outcomes and impact and highlight the strengths and weaknesses of its contribution to reducing child mortality in North and South Darfur. The evalua-tion will contribute to evidence-based judgment and explanations for the met and unmet needs, as well as lessons learned from multi-sector interventions implemented in North Darfur and South Darfur between 2010 and 2015 in regards to saving children’s lives.
2.1 Objectives of the evaluation
1. Measure the achievement of the expected chain of results (efficiency/coverage, effec-tiveness and impacts) of the implementa-tion of the annual humanitarian strategic plans8 funded through emergency funds and implemented in North Darfur from 2010 to 2015.
2. Document the relevance, coordination and sustainability of the UNICEF humanitarian programme in North Darfur.
3. Generate explanations for the possible reasons for the sustained increased of un-der-five mortality, despite all efforts exhaust-ed in the state.
4. Assess how humanitarian programmes ad-dress the needs of host communities and internally displaced populations.
5. Assess the institutional, financial and op-erational capacities for better coordination, planning, implementation, management and monitoring and evaluation of humani-tarian action at national, state, locality and community levels, both of the Government and United Nations agencies (UNICEF).
6. Develop a theory of change of the inter-ventions implemented in North Darfur and identify the gaps.
2. PURPOSE OF THE EVALUATION
8EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
7. Document good practices, intervention chal-lenges, bottlenecks and solutions applied to overcome the intervention challenges by documenting lessons learned on what works for whom, what does not work for whom and why.
2.2 Key evaluation questions
Relevance/appropriateness
1. To what extent are UNICEF’s humanitarian programmes aligned to national humanitar-ian policies and the humanitarian response strategic plan?
2. To what extent does UNICEF’s humanitar-ian programme address the needs of the affected population?
Coordination
1. What is the extent of humanitarian pro-gramme coordination among various actors/sectors to avoid gaps or duplications at the community level?
Efficiency and coverage
1. Did UNICEF and partners have adequate financial and operational capacities to offer rapid delivery of services to affected un-der-five children in compliance to UNICEF’s Core Commitments for Children in Human-itarian Action?
2. Are the actions being undertaken cost effec-tively (best approach economically)?
Effectiveness
1. What were the achievements against the expected outcomes of the implementation of the annual humanitarian strategic plans
funded through emergency funds and im-plemented in North Darfur from 2010 to 2015?
2. What were the good practices, challenges, bottlenecks and solutions that contributed to the achievements or that hindered the realization of the expected outcomes?
Impact
1. What are the significant changes (positive and negative) that happened to children and communities because of UNICEF interven-tions?
Sustainability
1. To what extent are the interventions and their impact likely to continue when UNICEF and partners’ support is withdrawn?
2.3 Theory of change and conceptual framework for the evaluation
The evaluation of humanitarian action in North and South Darfur was based on the theory of change (see Annexes 1–3), which was devel-oped after review of UNICEF partnership agree-ments, UNICEF rolling work plans and UNICEF annual work plans, which are the key account-ability tools for humanitarian programming. Due to the integrated nature of WASH, health and nutrition programming, the theory of change had a common impact level indicator of reduc-ing child mortality to improve child survival in North and South Darfur.
The development of this theory of change also took note of the nutrition conception pro-gramme developed by UNICEF in 1990. This
9EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
concept outlined the key programmatic link-ages of sectors contributing to the manage-ment of malnutrition at the community level. The analysis of the continuum of progress and the UNICEF humanitarian delivery system, is
9 This conceptual framework was adapted from a value for money analysis for WASH programming is available at: <http://vfm-wash.org/wp-content/uploads/2015/08/OPM-2015-Synthesis-report-of-6-VFM-WASH-studies.pdf>, accessed 8 March 2017. Key definitions are as follows: a) cost: the financial costs of inputs as captured in the annual UNICEF financial estimations; b) input: the resources used, in terms of finance and staff time (capital and labour); c) process: the process by which inputs are transformed into results; d) output: the direct deliverables of the programme (number of water and sanitation facilities built, number of activities implemented such as borehole construction, etc; e) assumed outcome: resulting from the outputs, for example, the number of beneficiaries assumed to have gained access to WASH services because of the outputs of the programme’s interventions; f) sustained actual outcome: the actual change in the affected population’s lives over time, such as the number of new people moving from using an unimproved water point to an improved one. The key difference with ‘assumed outcomes’ is that ‘sustained actual outcomes’ was measured based on household survey data; g) impact: the impact of the WASH programme, including the impact on health and education, for example, reduced cases of diarrhoea, malnutrition and vaccine-preventable diseases over the past five years, as presented by the UNICEF Strategic Plan for the Sudan; h) equity: although equity was not a major area of focus, it was considered during various levels of the results chain, including at the level of inputs, outputs, outcomes and impacts. The affected population groups vary in many ways, depending on how inequity manifests itself, such as through differences in income, gender or social groups (e.g. agro pastoralist, pastoralist, urban dwellers, rural dwellers, children, etc.).
aligned to the United Kingdom Department for International Development value for money con-ceptual framework presented in Figure 2.
Figure 2: Evaluation conceptual framework adapted from Tremolet et al.9
2.4 Scope of the evaluation
The evaluation focused on UNICEF child survival programming (health, nutrition and WASH hu-
manitarian programmes) to address the main question related to the effectiveness of human-itarian service delivery in the 2010 and 2015 humanitarian programme cycle. The focus on
COST (US$)
• Amount allocated
INPUT
• WASH supplies• Nutrition
supplies• Health supplies• Labour
PROCESS
• Drilling boreholes
• Latrine construction
• Establishing a stabilization center
• Orgnizing immunization campaigns
OUTPUT
• Water facilities constructed
• Sanitation facilities constructed
• Stabilization centers initiated
• Health facilities offering immunization services
SUSTAINED ACTUAL OUTCOME
• Number of people receving water
• Number of people with safe excretal disposal option
• Number of children immunized
• Number of children treated of SAM
IMPACT
• Rreduced child mortality, reduced child wasting and stunting
• Reduce water related diseases
• Reduced malnutrition cases
• Reduced vaccine preventable illness cases among children
10EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
multi-sectoral responses in North Darfur also included the analysis of conflict effects, promo-tion of social cohesion and building resilience (empowerment of communities and families). The evaluation applied the Organisation for Economic Co-operation and Development-De-velopment Assistance Committee criteria, adapted for humanitarian action: 1) relevance (appropriateness); 2) coordination/coherence; 3) effectiveness; 4) efficiency/cost-effectiveness/value for money/coverage; 5) impact; and 6) sustainability/connectedness of humanitarian responses in North Darfur (as it relates to pro-tracted emergencies).
The geographic focus of the evaluation was on North Darfur state, targeting six localities (El Fasher, Kabkabiya, Kutum, Mellit, Saraf Omra and Tawila).
11EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
3. METHODOLOGY
© U
NIC
EF/U
NI1
6657
0
12EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
3. METHODOLOGY
10 The Development Assistance Committee criteria is available at: <www.oecd.org/dac/evaluation/daccriteriaforevaluatingdevelopment assistance.htm>, accessed 8 March 2017.
The evaluation was an ex-post outcomes and impact evaluation of the humanitarian action delivered by UNICEF and partners to address the needs of the population affected by emer-gencies in North Darfur. Thus, a retrospective evaluative design involving both qualitative and quantitative analysis was adopted. The evalu-ation employed both qualitative and quantita-tive methodologies to collect data from the stakeholders and communities targeted in the programme. It also took account of the Devel-opment Assistance Committee criteria10 and the United Nations Evaluation Group/UNICEF standards for evaluation. This approach focused on the relevance, effectiveness, efficiency, sus-tainability and impact of the programme, includ-ing its latent effects. It used a participatory eval-uation design, which involved a comparison of various groups drawn from localities that were not part of the UNICEF intervention in North Darfur (Umkadada locality) and South Darfur (Kass locality), to ensure the reliability and va-lidity of the evaluation data. In so doing, the consultants analysed the inter-locality dynamics on targeting at the community/village levels.
To test the contribution of the inputs to the impacts of the programme, the consultants developed a theory of change to provide a log-ical analysis of causality and the effects of the programmes that UNICEF supported. The basis for the application of the theory was the consul-
tants’ understanding of UNICEF’s results-based framework for its operation in the Sudan, with emphasis on the factors contributing to the reduction of child mortality at the community level, as presented in the UNICEF nutritional framework (1990). The indicators used in the theory of change were derived from UNICEF partnership agreements and its annual work plan for humanitarian interventions in North Darfur.
The quantitative analysis is built on existing re-ports from household surveys conducted during the period under review (2010–2015), mainly the Multiple Indicator Cluster Survey (MICS) 2014, the Simple Spatial Sampling Survey 2013, the Sudan Household Health Survey 2010, routine statistics of sector management information systems (e.g. routine data related to health services) and community village survey data. Data on programme implementation related to service delivery (supply and cash) and achieved outputs were generated from UNICEF internal financial reports. Trends analysis was conducted to assess the progress made vis-à-vis baseline indicators, as captured in UNICEF annual work plans.
Qualitative analysis on the opinions of the var-ious project stakeholders was applied through individual interview and focus group discussions with key beneficiaries (adolescents, parents and
13EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
service providers), implementing partners, Unit-ed Nations and non-governmental organization (NGO) stakeholders and community members.
The cost-effectiveness analysis focused on the cost of achieving the intended programme out-comes. The analysis of financial data, including budget allocation and utilization by outcomes and sector results areas was initiated to com-pute the cost-effective analysis as outlined in the Department for International Development value for money framework.11 The WASH pro-gramme analysis was based on cost per ac-tual sustainable water and sanitation service beneficiary, both at the community level and in schools. The nutrition programme analysis was based on the cost per life saved in terms of children admitted and cured of SAM. Finally, the health programme cost-effective analysis was based on the cost per under-five child saved through the administration of vaccines. The computation of the ratio was done using the financial resources that were mobilized within the year of review against the outcomes, as per the UNICEF thematic sector.
The evaluation employed a utilization-focused approach, whereby the intended users of the evaluation were identified and engaged from the outset in the development of the evaluation terms of reference (see Annex 22) and tools. This was enhanced by establishing a techni-cal committee with representatives from the Ministry of Education, health, nutrition, water and social services from the Government. From UNICEF, the Planning, Monitoring and Evalua-tion (PME) and senior management team en-gaged in the evaluation process.
11 Department for International Development, ‘DFID’s Approach to Value for Money’, DFID, July 2011.
3.1 Data collection tools
3.1.1 Desk reviewThe evaluation involved a desk review of key documents related to humanitarian interven-tions in North Darfur (analysis of the Strate-gic Response Plan Document for 2010–2015), including partner annual work plans; project proposals; studies/reviews; project agreement documents; partner, donor and annual reports; UNICEF and partner financial records; and field monitoring reports (see Annex 13). Analysis was carried out using the routine data analysis tool, which provided a framework for the systematic analysis of the progress made by UNICEF, as recorded by UNICEF and the Government of the Sudan, which is the major implementing partner.
3.1.2 Key informant interviewsThe evaluator conducted 82 key informant inter-views with staff from UNICEF, the Government of the Sudan and United Nations agencies in North and South Darfur who had registered a considerable presence in the programme since 2010 or earlier (see Annex 14). The selection of these organizations was made based on a list captured during the coordination meetings, as well as the UNICEF partner database for pro-grammes in North and South Darfur. The main objective of the interviews was to document the progress made so far and issues related to humanitarian action in North and South Darfur. The interviews were conducted based on an elaborate interview guide (see Annex 18) that ensured the consistency and reliability of feed-back received from interviewees. The analysis involved mapping of feedback based on related themes.
14EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
3.1.3 Focus group discussionsUsing a systematic approach, the team gath-ered information from community members through group discussions, using a discussion guide. The consulting team held such conver-sations with 22 groups that were purposively sampled for the evaluation within the eight lo-calities from which a total of 252 respondents (90 male and 162 female) were consulted. The selection of the communities was based on a random selection of the administrative units within the eight localities. Both the internally displaced communities living in camps and host communities were involved in the development of the selection criteria. The key criterion for the selection of the participants in the focus group discussions was their stay or residence in the selected areas for at least five years (see Annex 16).
The discussion process was four-fold. First, the team initiated discussions with primary health-care personnel to formulate a basic understand-ing of the primary healthcare situation in the locality, as well as challenges and priorities. Second, the team held mixed and represen-tative discussions with community develop-ment committees to explore prospects, verify answers and reach a common consensus on the health, WASH and nutrition situations within the areas of intervention. Third, the team con-ducted group discussions with mothers and caregivers at health facility waiting rooms, wa-ter points and markets. Fourth, the team held a series of discussions with children at various water points. Up to two focus group discus-sions targeted groups of children aged 8–12 years in Kass Camp and Zam Zam Camp. The
12 The calculation of the sample size was done using the UNICEF MICS formula, available at: <www.childinfo.org/files/MICS3_Chapter_4_-_Designing_and_Selecting_the_Sample_060219.pdf>, accessed 8 March 2017.
focus group discussion analysis, however, in-volved the identification of related themes or sub-themes based on the discussions’ basic guidelines and findings, but with a bias for the WASH, child health and nutrition programmes.
3.1.4 Significant stories of change The consultants collected significant stories of change from 22 community members that documented the progress of the programme in regards to the quality of life of the target popula-tion. The process followed a prescribed format, while the selection of community members de-pended on the community member having a child under age 5 and a resident in the area for the past five years (see Annex 15). The most successful aspect of this approach was the ability to document and capture real changes, as well as the programme’s contributions to ad-dressing the needs of the affected population. During this process, information was exchanged in Arabic and national consultants later translat-ed the transcripts into English.
3.1.5 Household questionnaireThe consulting team tasked local enumerators with administering the household question-naire to 764 households.12 The main criterion for household selection was the presence of a child aged 5 years or younger and the presence of the household in that locality before 2010 (see Annex 20). The consultants had previously developed a criterion for sampling households, including randomization at household level, which involved listing all households within the locality. In addition, the team developed a lot criterion, in which all administrative units within El Fasher, Saraf Omra, Mellit, Kutum, Kabkabiya,
15EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Umkadada and Kass were listed on a roster. Pa-pers with the name of the administrative units written on them were then folded, after which the equivalent number of the administrative unit based on the sample size above were picked randomly from the folded papers.
In the subsequent selection of villages and households, the consultants repeated the above randomization process. During the actual administration of the household questionnaire, the determination of the first household was based on its location (the first on the right-hand side of the enumerator upon their arrival at a village) and having a child who was 5 years old. The subsequent households were selected by ensuring a sampling interval of nine13 between the former and the next household with a child who is 5 years old. In the absence of a five-year-old child in the next household, the enumerator was required to get to the household with a five-year-old child or below.
3.1.6 Observation of WASH, nutrition and health facilitiesObservation played a complementary role, es-pecially observation of practices and core areas
13 The questionnaire used for the household survey is attached as Appendix 20.
14 The formula used for the sample size calculation was adapted from: <www.childinfo.org/files/MICS3_Chapter_4_-_Designing_and_Selecting_the_Sample_060219.pdf>, accessed 8 March 2017. In the formula, n is the required sample size, expressed as number of households, for the key indicator (see following section on determining the key indicator); 4 is a factor to achieve the 95 per cent level of confidence; r is the predicted or anticipated prevalence (coverage rate) for the indicator being estimated (rate of 44.9 per cent is the underweight prevalence rate as reported in the MICS 2014 report for North Darfur) is the factor necessary to raise the sample size by 10 per cent for non-response; f is the shortened symbol for deff which as 1.5; 0.12r is the margin of error to be tolerated at the 95 per cent level of confidence, defined as 12 per cent of r (12 per cent thus represents the relative sampling error of r); p is the proportion of the total population upon which the indicator, r, is based which has been taken as 0.15; nh is the average household size taken as 5.9 (as reported in MICS 2014 report).
of intervention (WASH, health and nutrition). At-tention was paid to how community members and target groups (e.g. children and caregivers) practice or use the trainings and knowledge they acquired from the trainers. The team also closely observed the health facilities, including payment of services, functionality, manage-ment and physical accessibility. They also ob-served under-five children accessing services at the nutritional centres (see Annex 17).
3.2 Sampling and data collection
3.2.1 Sampling for administration of household questionnairesThe calculation of sample size for the admin-istration of the household questionnaire used the formula proposed by the MICS sample size calculation shown below.14
([4 (r)(1-r)(f)(1.1)])
([(0.12r)2 (p) (nh)])
This translates into 763 households after includ-ing 20 per cent non-responsive. Table 1 elabo-rates on the target populations per locality.
n =
16EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Table 1: Distribution of the sample size within the localities
LocalityTarget population
Number of households
Households to be sampled
Focus group discussions
El Fasher, North Darfur 220,297 44,059 232 6
Umkadada, North Darfur 105,846 17,641 93 4
Kass, South Darfur 292,548 48,758 257 5
Other localities* 171691 34,338 181 7
Total 790,382 144,796 763 22
15 Focus group discussion leaders led discussions in line with: Graham, A. et al., ‘Ethical Research Involving Children’, UNICEF Office of Research – Innocenti, Florence, 2013.
The enumerators recorded impressive high response rates with all targeted households responding to the questionnaire. Considerations were made to not collect data on information that was considered sensitive based on the situation.
3.2.2 Quality assurance and ethical considerations This evaluation upheld the respect and protec-tion of the rights and welfare of the affected population. While many of the quality stan-dards relating to aspects of evaluation design and management were under the control of the evaluation team, some of the key focus issues aimed at ensuring the quality and accountabil-ity of the evaluation process are listed below. The confidentiality of information collected from communities, households, children’s groups (aged 8–12) and key informants was observed. While collecting information from children, spe-cial emphasis was placed on ensuring that the children, guardians and parents had consent-ed to the process.15 A briefing was prepared for the children to explain the purpose of the
discussions and how the information collect-ed from them would be used. In addition, the female national consultants who were tasked with collecting information and all enumerators were fully vetted against having any records of child exploitation or any other abuses in regards to children.
a. Humanitarian action principles: The con-sultant ensured that the evaluation process adhered to the following principles for ac-countability to affected populations:
� Humanity: The process ensured the protection of life, health and respect for human beings.
� Neutrality: The evaluation consultants did not take sides in hostilities or en-gage in controversies of a political, ra-cial, religious or ideological nature.
� Impartiality: The evaluation was carried out taking into account the needs of the affected population and made no distinc-tions on the basis of race, gender, reli-gious belief, class or political opinions.
* Other localities where sampling was done include Kabkabiya, Saraf Omra, Tawila and Kutum localities
17EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
� Independence: The evaluation process was autonomous of the political, eco-nomic, military or other objectives of the client or any other interested party.
b. Evaluation ethics: The consultants were fully cognizant of the principles and chal-lenges of conducting evaluations in an eth-ical and respectful manner. The consultant ensured that team members adhered to the ethical protocols as highlighted in the data collection tools during the evaluation process. Informed consent was collect-ed through signed consent forms for the household interviews and individual stories of significant change, while verbal consent was accepted for the focus group discus-sions and key informant interviews.
c. Timeliness and relevance: The consultant proposed a utilization-focused approach to the evaluation, starting with a detailed stakeholder analysis and continuing with the participatory involvement of stakeholders in the validation and sharing of evaluation findings.
d. Process quality: The methodology de-signed for the evaluation ensured that quality was embedded in the evaluation pro-cess. This included the use of Development Assistance Committee quality criteria for evaluation design; an evaluation framework, which lists the main evaluation questions, based on the criteria, and clearly describes the methodology for data collection, trian-gulation and analysis; detailed questions, tools and reporting formats based on the evaluation framework; and standard check-lists and reporting forms.
e. Timely delivery: The methods and tools used fit within the scope of the evaluation
and the resources available, as well as the deadlines for the deliverables.
f. Do no harm: The evaluation ensured that the process of data collection, interviews with key informants and with the affected population did not contribute to any mis-understandings of the main objectives and outcomes of the evaluation process.
Limitations of the evaluationThe initial scope of the evaluation included ed-ucation and child protection programming, but excluded this from the evaluation in a revised terms of reference. The new terms of reference focused mainly on child survival and causality of under-five child mortality rather than on overall UNICEF humanitarian programming in North Darfur.
Since this was a multi-stakeholder programme in a high-risk area, politically sensitive and taking place in a complex operating context, it was at times challenging to get a consensus on the evaluation from all stakeholders, both at federal and state levels. However, an agreement was finally reached to move forward with this inde-pendent evaluation for the purpose of learning.
The lack of reliable and accurate data for 2010–2011 contributed to weaknesses in the analy-sis of value for money and the effectiveness of the humanitarian programme during the period 2010–2011.
The consultant had envisaged the availability of routine data at the locality level, but the relevant government and UNICEF offices in El Fasher were unavailable. Given that most routine data are collected at the state level, the team an-alysed data generated from both household questionnaires from different localities and the
18EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
findings of the focus group discussions.
Given that the prevailing emergency contexts in the target regions are characterized by conflict, respondents and focus group discussions par-ticipants required the utmost confidentiality. The team found it prudent not to take the names of some community members who participat-ed in the focus group discussions, but tracked
the cumulative number of the participants for accountability purposes only.
Due to the focus on surviving under-five children during the data collection exercise (primarily the focus group discussions and household ques-tionnaire), some households without children under 5, in which children had died before the exercise, were excluded.
19EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
4. EVALUATION FINDINGS AND DISCUSSION
©UN
ICEF
Sud
an/N
orth
Dar
fur F
O
20EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
4. EVALUATION FINDINGS AND DISCUSSIONS
16 Details of the Sudan’s Humanitarian Response Plan are available at: <www.humanitarianresponse.info/en/operations/sudan>, accessed 8 March 2017.
17 ‘United Nations Development Assistance Framework for the Republic of Sudan’, Khartoum, May 2012.
The presentation of the evaluation results is based on the UNICEF nutrition conceptual framework, which outlined the association be-tween food security, health, nutrition, water and sanitation, as the key factors contributing to un-der-five child mortality in North Darfur. This chap-ter discusses key related areas, including the relevance, impact, effectiveness and efficiency of humanitarian action, as well as coordination, sustainability and recommendations.
4.1 Relevance and appropriateness
At the policy level, UNICEF humanitarian pro-grammes are aligned with various international, national and state policy documents that aim to improve quality of life in North and South Darfur. As a result, these interventions contributed to the Government’s policy on disaster manage-ment by responding to the needs of its citizens in North Darfur, as outlined in the annual Su-dan humanitarian response plans (2010–2015).16 Moreover, UNICEF’s focus on basic emergen-cy service delivery (i.e. water, health, nutrition and sanitation) contributed to the Sudan United Nations Development Assistance Framework 2013–2016,17 specifically to Pillar 2, Outcome 4, which states, “People in Sudan [sic], with special emphasis on populations in need, have access to equitable and sustainable quality ba-
sic services.” UNICEF also supported the en-hancement of the Humanitarian Aid Commis-sion (HAC) mandate through sector and cluster coordination systems, while its design relied on inter-agency needs assessment conducted after community members reported these emergen-cies (i.e. conflict, floods and drought).
The following is a quote from a mother in Al-salam Camp in North Darfur that illustrates the relevance of UNICEF interventions and the impact that these interventions have had on her life: “I have arrived to Alsalam Camp from Korma on 2006. At that time, it was the raining season, I have used clothes in order to build a shelter in order to protect us from the rain. The number of the people was very high, people help each other and shared together the food and the shelters. The organizations available was Oxfam America and UNICEF, who partici-pated in distributing mosquito net, Jerry cans, soaps, chlorine and bed covers. In 2015, I par-ticipated in health awareness for the mothers at their houses in addition to covering the water pots and cleaning practices.”
At the programme level, UNICEF humanitarian interventions succeeded in specific programme areas. Under the health programme, UNICEF humanitarian interventions adhered to two of the five commitments made on health. UNICEF
21EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
personnel attended to and supported links for other cluster/sector coordination mechanisms on critical and inter-sectoral issues evident in the EPI. This created a strong inter-agency co-ordination mechanism in line with Commitment 1 (“Inter-agency coordination mechanisms in the health sector are supported and enhanced with links to other cluster coordination mech-anisms”). Similarly, children and women ac-cessed life-saving interventions through popu-lation- and community-based activities such as campaigns and child health days, in line with Commitment 2 (“Children and women access life-saving interventions through population and community-based activities”).
After a hard work I arrived to the camp after 28 days of giving birth by a cae-sarean operation. But I thank God that by the time we arrived to the Camp the services provided by UNICEF, whether for the mothers or for our children at schools. And in addition to the aware-ness programmes, workshops and health services provided at the hospi-tals. Furthermore, UNICEF has distribut-ed free treatment, built a kindergarten, provided notebooks for schools and tents for the displaced people. I per-sonally thank UNICEF for helping and rescuing people and guiding the people by distributing health awareness post-ers and brochures that was very easy to understand because it has photos and pictures. Now I am working as a health-care awareness provider in the Camp. I disseminate awareness pictures and photos to the people in the camp ‘Moth-ers, at the water points’ and this to teach them with the basics to preserve food and water from getting contaminated.
What I have learned from UNICEF I was able to deliver to other people especially the mothers about health and hygiene and how to prevent our children from getting infected and if they got ill, how would they manage to control the situ-ation not to get worse and this can give the mother enough time to get to the hospital.— Samira Mohammed Yousif, Community Health Worker Zam Zam Camp, North Darfur
Under the WASH programme, UNICEF humani-tarian interventions adhered to three of the five commitments made previously on WASH, in-cluding effective leadership for WASH cluster/inter-agency coordination under Commitment 1 (“Effective leadership is established for WASH cluster / interagency coordination”). It also ensured that children and women access sufficient volumes of safe drinking water for cooking and maintaining personal hygiene un-der Commitment 2 (“Children and women ac-cess sufficient water of appropriate quality and quantity for drinking, cooking and maintaining personal hygiene”). In addition, it ensured that children and women access secure, sanitary, user-friendly and culturally and gender-appro-priate toilets and washing facilities under the Commitment 3.
Under the nutrition programme, UNCEF’s hu-manitarian commitment was evident through its contribution to the affected women and children who were able to access the programme as part of Commitment 3, “Support for appropriate infant and young child feeding is accessed by affected women and children”, and Commitment 4, “Children and women with acute malnutrition access appropriate management services”.
22EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
In terms of targeting affected populations, UNICEF designed the humanitarian interven-tions after conducting a community level needs assessment with the State Ministry of Health, United Nations agencies and National NGOs. This resulted in some 1,004,840 people in North Darfur and 864,416 people in South Darfur, in-cluding 153,338 children under 5, being priori-tized for humanitarian assistance between 2010 and 2015. Cumulatively, humanitarian action tar-geted 1,333,700 people in 2011, 1,430,000 in 2012, 1,759,155 in 2013, 2,500,000 in 2014, and 2,733,000 in 2015,18 illustrating the protracted nature of the crisis in North and South Darfur, as reflected in Table 2.
UNICEF and its humanitarian partners provid-ed much-needed life-saving services to affect-ed populations. Feedback from community members during the focus group discussions confirmed that the WASH interventions—the provision of water and sanitation facilities and hygiene promotion—contributed to addressing their needs. Immunization and nutrition pro-grammes also contributed immensely to the improvement and sustainability of the health
18 OCHA weekly humanitarian bulletins 2010–2015.
statuses of children under 5 within affected communities in North and South Darfur, as captured in routine data collected by the State Ministry of Health and discussions with care-givers at the community level.
The changes that was done by UNICEF was very good at the beginning regard-ing education and water supply resourc-es, since UNICEF with coordination with Oxfam America participated in estab-lishing wells, pumps and this was the major benefit we have received from UNICEF since the clean drinking water has become available. We also had train-
ing courses in education; UNICEF has also provided us with books, teaching equipment and has implemented toilets. I would like to thank UNICEF for what they have provided us with awareness programme we all came from differ-ent places most of us don’t have basic knowledge about health and hygiene practices, but UNICEF has taught us about these issues. We would like to re-
Table 2: Representation of the new cases from 2010–2015 by disaster type
Shock/hazard New number of people displaced ( 2010–2015)
North Darfur South Darfur
Dry spell 500,051 489,080
Conflict 454,084 328,236
Floods 44,735 47,000
Health shocks (measles, dengue fever, yellow fever)
422 100
Source: OCHA weekly humanitarian bulletins 2010–2015
23EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
quest UNICEF to be the one who imple-ment the activities and not let the NGOs take the lead on this.— Community leader, Alsalam Camp, North Darfur
Feedback from community members, key in-formant interviews and review of assessment reports show that the time it took for humani-tarian services to be delivered far exceeded the stipulated 72 hours after an emergency strikes. For a period of two to three months, between 2013 and 2015, UNICEF delayed actual delivery of humanitarian relief due to security concerns and slow clearance of humanitarian action by the Government of the Sudan, even after an emergency needs assessment was conducted within 24 hours. Despite the delay, the Gov-ernment and communities responded to the crisis quickly. Though the contingency planning process was designed to mitigate this, lack of pre-positioned stocks at the locality level com-bined with access challenges, further delayed humanitarian assistance.
The appropriateness of capacity building was another major area of concern for the evalua-tion. After the sudden 2009 withdrawal of inter-national NGOs from North Darfur which led to the destabilization of services, UNICEF humani-tarian action fell short of filling the gap left by hu-manitarian agencies by providing capacity to line ministries, mainly the Ministry of Health and The Ministry of Water, Resources, Irrigation and Electricity. The humanitarian agencies focused mainly on delivering humanitarian programmes through local community-based organizations, which ensured that the capacities of various organizations to deliver humanitarian services were enhanced in line with agreed global stan-dards, for example the Sphere standards.
4.2 Coordination
In regards to coordination, UNICEF efforts de-pend on the organization’s ability to support ser-vice delivery internally and externally with other humanitarian agencies. Such coordination en-sures that the platform functions under agreed strategic priorities to eliminate duplication of ser-vice delivery, and supports the management of needs assessment, stakeholder gap analysis, joint contingency planning processes and ac-countability to affected populations.
Based on the key informant interviews and review of minutes, the evaluation established that an active coordination system existed in North Darfur and South Darfur, at both internal and external levels, between 2010 and 2015. UNICEF’s internal coordination involved regular monthly programme and emergency coordina-tion meetings to ensure that the WASH, health and nutrition sections addressed humanitarian service delivery, contingency planning and needs assessment at both North and South Darfur state levels. In some instances, however, WASH-spe-cific activities were implemented by the edu-cation section, which did not fully achieve the targeted outputs such as delivering sanitation and water facilities without the technical support of the WASH section.
In contrast, while OCHA leads the external coordination of 11 United Nations clusters in a number of humanitarian intervention areas, UNICEF’s mandate focuses on WASH, nutrition, child protection and education programmes that operate under the sectoral coordination forum. The respective line ministries chair these forums, including health, WASH and education.
The HAC also made considerable effort to ensure
24EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
smooth humanitarian programme operations in both North and South Darfur, though this was affected by late and delayed approvals. Between 2010 and 2015, although the coordination of humanitarian action registered considerable success with active sectors/clusters at the state level, its applicability at the camp level continued to experience targeting challenges. This area therefore requires strengthening in the future. Its applicability at the camp level was measured based on sector-specific coordination verses an integrated coordination forum, where clusters are grouped together for easier admin-istration of humanitarian action and promotion of inter-cluster harmony.
In practice, clusters and inter-cluster meetings occur interchangeably. In North Darfur, the for-mer occurs on a weekly basis and the latter occurs on a quarterly basis. In South Darfur, however, the former occurs weekly and the latter occurs biweekly. At the state level, such meetings have enhanced inter-cluster coordina-tion among humanitarian agencies, though this is more the case in South Darfur than in North Darfur. State level coordination forums effec-tively brought together agencies and minimized duplication, though inter-sectoral coordination was weak. Such inherent weakness led to the duplication of nutrition, health and sanitation programming activities at the State Ministry of Health in North Darfur. In contrast, South Dar-fur inter-sectoral and intra-sectoral coordination highlighted clear roles and activity planning.
At the community level, coordination efforts weakened in most affected communities. For example, feedback from community members in Zam Zam Camp, Dar es Salaam camp and Kass Camp indicated that UNICEF’s coordina-tion was disjointed. Unlike at the state level,
coordination at the community level is largely ad hoc with limited engagement of the different sectors/clusters. Each cluster/sector is focusing on their respective sector/cluster-specific activ-ities even though all have a common focus on affected communities.
The HAC Planning Unit, the Ministry of Finance and National Economy, the Ministry of Welfare and Social Security and the Ministry of Interna-tional Cooperation were barely involved in the integration of early recovery into emergency programming. The HAC Planning Unit neither integrated nor mainstreamed early recovery processes into humanitarian programming, though the Ministry of Finance and National Economy Planning Division has recognized this gap. Though this division was not significant-ly involved in the humanitarian programme, it should have initiated early recovery program-ming focusing on the sustainability of humani-tarian programming. However, at the state and locality levels, it is difficult to identify the inte-gration of early recovery programming initia-tives in the context of the protracted emergency situations in North and South Darfur, which have lasted for more than 13 years.
4.3 Efficiency
The analysis of efficiency focused on how well UNICEF humanitarian inputs were converted into their respective outputs; that is, whether the planned outputs were achieved and wheth-er implementation challenges such as program-matic, logistical and financial challenges were documented. The efficiency analysis reviewed the operation of the monitoring systems, while the cost-effective analysis for key output indica-tors examined the representativeness of each
25EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
thematic area vis-à-vis the financial allocation. The financial allocation relied on the mone-tary resources that UNICEF had mobilized for humanitarian action for 2010 through 2015. It should be noted, however, that the design of the UNICEF monitoring and reporting system fo-cused mainly on the results/outcome level indi-cators, but not on input/output indicators. Thus, the efficiency analysis (presented below) was derived from indicators taken from the UNICEF annual work plans and partnership agreements and reflected in the theory of change developed by the evaluation team.
4.3.1 WASH programme efficiency UNICEF invested US$16,166,439 in North Darfur and US$19,834,180 in South Darfur, with varying annual allocations. For North Darfur, US$4,055,887 was allocated in 2010, US$2,953,351 was allocated in 2014 and US$4,430,423 was allocated in 2015. For South Darfur, US$3,780,394 was allocated in 2010, US$6,356,210 was allocated in 2013 and US$2,224,899 was allocated in 2015, as shown in Figure 3 (see Annex 4). These investments in new water sources translated into access to safe water for 38 per cent of the affected
0
5,000,000
Amou
nt (U
S$)
10,000,000
15,000,000
20,000,000
25,000,000
30,000,000
2010 2011 2012 2013 2014 2015
UNICEF Allocated Budget, USD, (South Darfur
3,780,394 4,041,421 2,638,367 1,726,000
UNICEF Allocated Budget, USD (North Darfur)
4,055,887 801,617 1,289,118 3,787,784
SHRP Planned, USD, (South Darfur)
27,288,247 22,857,330 12,373,975 13,845,914
SHRP Planned Budget, USD (North Darfur)
25,852,024 20,486,688 11,371,005 11,215,430
SHRP Allocated funds, USD, (South Darfur)
12,202,064 11,101,892 5,779,351 4,725,225 5,607,465 5,464,461
SHRP Allocated funds, USD, (North Darfur)
11,559,850 7,550,614 6,695,032 5,016,272 2,884,213 4,736,211
Figure 3: Comparison of funding for WASH programmes by UNICEF and other donors
Source: UNICEF financial records 2010–2015 and OCHA financial records 2010–2015
26EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
population in North Darfur and 36 per cent of the affected population in South Darfur. Through the rehabilitation of water sources, 55 per cent of the affected population in North Darfur and 76 per cent of the affected population in South Darfur gained access to safe water.
UNICEF spent US$588,003 and US$468,561 on the procurement of generators in North Darfur and South Darfur, respectively. An additional US$545,992 and US$1,118,244 was spent to procure soap between 2010 and 2015 in North Darfur and South Darfur, respectively. UNICEF used US$472,152 and US$344,410 to procure chlorine tablets in North Darfur and South Dar-fur, respectively. Expenditure on hand pump spare kits was US$312,574 and US$347,415 for North Darfur and South Darfur, respectively, while US$4,570 and US$82,717 was used for the procurement of complete hand pump equip-ment in North Darfur and South Darfur, respec-tively. An additional US$83,984 and US$44,343 was spent on vent pipe valves in North Darfur and South Darfur, respectively, as presented in Figures 4 and 5.
UNICEF spent US$420,450 and US$298,240 on latrine plastic slabs in North Darfur and South Darfur, respectively. An additional US$256, 678 and US$124,192 was used to purchase plastic sheets/tarpaulins in North Darfur and South Darfur, respectively. For water quali-ty enhancement, UNICEF spent US$137,593 and US$68,199 on pool testing equipment and US$25,272 and US$11,640 on bacteriological test equipment in North Darfur and South Dar-fur, respectively. UNICEF spent US$178,655 on water trucking in South Darfur, compared with US$67,701 on water trucking in North Darfur. UNICEF spent 10 times more on water blad-ders in South Darfur (US$109,073) than it did
in North Darfur (US$13,164). The expenditure on water Jerry cans was unusually low in North Darfur (US$4,848) compared with South Darfur (US$196,950), a nearly 15-fold difference.
During this period, UNICEF focused on devel-oping a functional community management of operation and maintenance system that re-vamped 89 per cent and 84 per cent of water facilities that had broken down in North Darfur and South Darfur, respectively. The organiza-tion also trained 63 per cent and 34 per cent of water yard operators in North Darfur and South Darfur, respectively. As a result, UNICEF ser-viced 63 per cent and 60 per cent of hand pump operated boreholes in North Darfur and South Darfur, respectively, while increasing access to water for the affected population in the same proportion. UNICEF also trained a number of chlorinators across North and South Darfur, but there is no available data on the chlorination of various water sources in North Darfur. Available data from UNICEF shows that the organization last chlorinated 74 per cent of planned water sources in South Darfur in 2010.
UNICEF made a significant effort to strength-en the capacities of the affected population through Community Approaches to Total Sanita-tion trainings targeting WASH sector members, natural leaders and village health committees, but the achievement was ultimately minimal—only 45 per cent and 15 per cent of the targeted cadre were trained in North Darfur and South Darfur, respectively. However, UNICEF didn’t build capacity of Water Environment and Sani-tation (WES) Department to conduct state-wide water quality assessment, since there are no records documenting this undertaking. Rou-tine water quality assessment at various water points show that this programme tested 97 per
27EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
0
100000
200000
300000
400000
500000
Num
ber o
f Peo
ple
2010 2011 2012 2013 2014 2015
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
Planned Target Achieved Output
1475
00
8660
0
1947
50
1732
00 2000
00
1469
54
2000
00
1395
00
3500
00
1800
0
2385
00
1400
00
1000
00
2750
0
4000
00
2028
41
1200
00
2700
0
4390
00
1745
00
1350
00
5650
0
2700
00
6450
0
0
100000
200000
300000
400000
500000
600000
700000
800000
Num
ber o
f Peo
ple
2010 2011 2012 2013 2014 2015
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
New
Wat
erSo
urce
Reha
bilit
ated
Wat
er S
ourc
e
Planned Target Achieved Output
2315
00
1768
00
1305
00
1130
00
1220
00 7200
0
1460
00
2247
93
2385
00
3275
0 2120
00
1320
00
1500
00
8000
0
6000
00 6400
00
4000
00 4550
00
4000
00
1215
00 7125
0
3120
2600
00
4975
0
Figure 4: Number of people reached through the provision of clean water in North Darfur
Source: Routine data from UNICEF annual reports 2010–2015
Figure 5: Outputs of water in South Darfur
Source: Routine data from UNICEF annual reports 2010–2015
28EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
cent of the water sources in North Darfur and 44 per cent in South Darfur, though it is yet to deliver urban water assessment at IDP-host-ing centres. Key informant interviews with the State Water Corporation in North and South Darfur confirmed these routine assessments. Although the WASH sector registered consid-erable progress in regards to preparedness by developing a WASH contingency plan and en-suring the availability of emergency WASH sup-plies for up to 20,000 people for all years under review, feedback from community members and key informant interviews confirmed that the activation of the contingency plan within 72 Hours was largely not achieved.
WES in coordination with UNICEF has implemented a number of water pumps, most of them are not working now due to the dryness of the seasons, because they mostly depend on the rains and groundwater. And another reasons is that they have also broke and aren’t working anymore.—Focus group discussion participant, Zam Zam Camp, North Darfur
To contribute to the promotion of personal hygiene and the reduction of diarrheal cases, UNICEF distributed soap to 43 per cent of the targeted affected population in North Darfur and 51 per cent in South Darfur. In addition, though UNICEF planned to distribute garbage collec-tion equipment to the affected population, only 13 per cent in North Darfur and 31 per cent in South Darfur were reached. Hygiene promotion activities supported by UNICEF reached 43 per cent of the targeted affected population in North Darfur and 47 per cent in South Darfur.
Although the WASH and education sections have a cordial intra-relationship at the state level, these sections were unable to achieve WASH programming outputs in schools. As a result, UNICEF WASH programmes ensured access to clean and safe water for 43 per cent of targeted schoolchildren and the provision of sanitation and handwashing facilities in 39 per cent of the schools in North Darfur, as shown in the figure below. In North Darfur, however, WASH programmes ensured access to clean and safe water for 47 per cent of targeted schoolchildren and the provision of sanitation and handwashing facilities in 43 per cent and 56 per cent of school, respectively, as shown in Figure 6.
Regarding monitoring, UNICEF developed a functional WASH monitoring system for track-ing achievement against the targets. However, there is a disconnect between the WASH mon-itoring system and the implementing partner monitoring system with different indicators and activities being undertaken by UNICEF, under-scoring the utility of the system. For example, critical process indicators showed the number of people targeted for specific activities was largely missing, hence tracking of achievement against actual versus planned results was not possible. This was also evident through the ab-sence of harmonized indicators in school pro-gramming for water in 2013–2014 and for WASH in 2014–2015.
In regards to programme planning and budgeting, the UNICEF/WASH procurement policy outlines appropriate quality and prices for humanitarian supplies to ensure compliance with UNICEF’s quality standards. However, the evaluation ver-ified that the WASH planning and budgeting
29EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
process has poor bookkeeping practices, and that as a result, WASH inputs, including physical supplies for water point construction (e.g. soap, water Jerry can and hand pumps) and staff in-puts, did not have any itemized breakdown for how the WASH supplies were procured, though the UNICEF supply system captures all of this information for other sections.
The delineation of the WASH supply chain from the UNICEF central supply system created an opaque operating system. UNICEF cannot au-thoritatively confirm the quantities and the cost of the supplies that were distributed to North Darfur and South Darfur without going through an external WES Department supply chain sys-
tem. This affected the accountability mecha-nisms by the implementing partner (WES) to UNICEF.
UNICEF’s cost-effective analysis focused on the WASH programme costs per actual beneficiary in terms of both water and sanitation services accessed between 2010 and 2015. This analysis considered the amount of funds that UNICEF al-located for WASH programming within UNICEF and to implementing partners, as shown in An-nex 4. Figure 7 shows that the per-person cost of providing clean water and sanitation to one person varied from US$14 (in 2010) to US$25 (in 2015) in North Darfur, and from US$13 (in 2010) to US$34 (in 2015) in South Darfur.
0
5000
10000
15000
20000
25000
30000
Num
ber o
f Peo
ple
2010 2011 2012 2013 2014 2015
Scho
ol W
ater
Scho
ol L
atrin
e
Hand
Was
hing
Faci
lity
Scho
ol W
ater
Scho
ol L
atrin
e
Hand
Was
hing
Faci
lity
Scho
ol W
ater
Scho
ol L
atrin
e
Hand
Was
hing
Faci
lity
Scho
ol W
ater
Scho
ol L
atrin
e
Hand
Was
hing
Faci
lity
Scho
ol W
ater
Scho
ol L
atrin
e
Hand
Was
hing
Faci
lity
Scho
ol W
ater
Scho
ol L
atrin
e
Hand
Was
hing
Faci
lity
Planned Target Achieved Output
3000
0
3000
0
3000
0
6800
6800
6800
6400
6400
6400
1000
0
1000
0
1000
0
7500
7500
7500
7500
7500
3000
3000
300014
85
1485
1485 25
00
2500
2500
0 0 0
6000 74
70
7470
7470
6000
6000
Figure 6: Progress towards WASH in North Darfur schools
Source: UNICEF 2010–2015 annual reports
30EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Figure 7: Provision cost for water and sanitation service per person (household survey)
Financial analysis and feedback from the key informant interviews at both the national and state levels showed a variation in administrative and overhead costs in terms of percentages deducted from the mobilized WASH humani-tarian funds. At the global level, the fund ad-ministrative agent deducts 1 per cent of the total amount mobilized before the funds are transferred to UNICEF. At UNICEF Headquar-ters in New York, between 7 and 8 per cent is deducted as overhead costs, while at UNICEF Sudan, 15 per cent of the mobilized funds are deducted as overhead costs before implement-ing partners deduct an additional 7 per cent. At the state level, however, the overhead costs range from 20 to 30 per cent, depending on the implementing partner. In total, these administra-tive or overhead costs range from 50 to 61 per cent of allocated humanitarian funds. Further computations reduce the total overhead cost to
48.5 per cent, which is broken down as follows:
� Fund administrative agent: 1 per cent
� UNICEF Headquarters in New York: 15 per cent
� UNICEF Sudan (Khartoum): 7.5 per cent
� Implementing partners at Khartoum level: 7 per cent
� Implementing partners at state level: 25 per cent
Despite the considerable progress mentioned above, WASH programming was encumbered by numerous challenges. Feedback from com-munity members who participated in the focus group discussion confirmed the lack of an ac-countability mechanism for the distribution of WASH supplies at the community level. They also confirmed an apparent selling of UNICEF/
0
20
40
60
80
100
North Darfur
Num
ber o
f Peo
ple
2010 2011 2012 2013 2014 2015
South Darfur
B
14 13
4 7
4235 34
84
58
25
63
5
31EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
WASH supplies, mainly water Jerry cans and soap supplies, for the targeted affected popula-tion. Records from the WES Department show the amount of WASH supplies distributed to North and South Darfur, but there is no docu-mentation at the UNICEF level of whether the beneficiaries received the supplies.
The other evident challenge is in the use of var-ious forms of indicators, as presented in the UNICEF rolling work plan and the WASH section annual work plans. For example, in 2013–2014 annual work plans, the water and sanitation targets referred to communities (e.g. 15 com-munities) whereas in 2015–2016 annual work plans, the targets referred to the actual number of people reached.
The relatively high administrative and operation costs of the WASH programme have increased the focus on physical water and sanitation struc-tures than software components, mainly train-ings. This has led to low outputs; that is, the programme achieved 43 percent and 17 percent of planned trainings in North Darfur and South Darfur, respectively.
The available human resources (one staff mem-ber in North Darfur and three staff members in South Darfur) is not commensurate with the demand for WASH humanitarian programming at the state and community levels. Hence, ad-ditional focus is placed on the coordination and procurement of WASH supplies and minimal effort is made to ensure the implementation of the programmes at the community level. UNICEF staff serve more supervisory and mon-itoring roles.
4.3.2 Nutrition programme efficiency The efficiency analysis for nutrition program-ming was based on the translation of the inputs outlined in the theory of change (see Annex 1) to the planned outputs. The key outputs anal-ysed included the number of children who re-ceived therapeutic feeding (Plumpy’Nut, F-100 and F-75) and vitamin A supplementation; the number of children who adopted the infant and young child feeding plan; and the capacity build-ing activities conducted, particularly training for the State Ministry of Health and implementing partner staff on SAM treatment and logistics management.
UNICEF mobilized resources to ensure that the planned nutrition activities and outputs were achieved. It increased funding for nutri-tion programming from US$651,000 in 2012 to US$5,991,555 in 2015 in North Darfur, and from US$2,412,464 in 2013 to US$2,850,899 in 2015 in South Darfur. The variation of these allo-cations was due to the difference in needs be-tween North and South Darfur, in terms of the susceptibility of under-five children to SAM. The Sudan Humanitarian Fund also reduced its fund-ing significantly from US$12,159,449 in 2010 to US$8,872,444 in 2015 for North Darfur and from US$12,834,974 in 2010 to US$8,214,029 in 2015 for South Darfur. Figure 8 highlights the variation in funding from 2010 to 2015 (additional figures are captured in Annex 5).
32EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
According to routine data analysis from the State Ministry of Health and UNICEF, the num-ber of children cured of SAM increased signifi-cantly from 12,838 in 2010 to 35,485 in 2015 in North Darfur, corresponding to increased SAM rates in that region. In South Darfur, the num-ber of under-five children treated for SAM in-
creased from 15,788 in 2010 to 21,275 in 2015. The procurement of therapeutic foods, mainly Plumpy’Nut correspond to the increased num-ber of children who were admitted with SAM. The conversion rate against the children’s ad-mission increased from 25 per cent in 2012 to 150 per cent in 2015 for Plumpy’Nut, while for
Amou
nt (U
S$)
20,000,000
18,000,000
16,000,000
14,000,000
12,000,000
10,000,000
8,000,000
6,000,000
4,000,000
2,000,000
2010 2011 2012 2013 2014 20150
2010 2011 2012 2013 2014 2015
UNICEF Allocated Budget, USD, (South Darfur)
2,412,464 3,469,287 2,850,899
UNICEF Allocated Budget, USD (North Darfur)
651,000 3,686,184 4,143,548 5,991,555
SHRP Planned, USD, (South Darfur)
17,340,300 12,782,227 11,886,844 18,689,390
SHRP Planned Budget, USD (North Darfur)
16,427,652 11,456,622 10,923,359 15,138,728
SHRP Allocated funds, USD, (South Darfur)
12,159,449 2,142,853 5,948,750 5,799,981 9,637,746 8,872,444
SHRP Allocated funds, USD, (North Darfur)
12,834,974 3,720,280 5,313,843 5,463,463 12,417,706
Figure 8: Funding for nutrition humanitarian programmes for 2010–2015
Source: UNICEF and OCHA financial reports 2010–2015
33EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
F-75, the rate increased from 222 per cent to 300 per cent for North Darfur. In South Darfur, the rate for Plumpy’Nut increased from 96 per cent to 113 per cent, while for F-75, the rate in-creased from 6 per cent to 257 per cent. Based on planning and programming logic, the conver-sion rate for Plumpy’Nut vis-à-vis the number of children admitted for SAM should be in a ratio of 1:1 and thus a 100 per cent score should re-flect high efficiency in UNICEF’s contribution to SAM management. Given that the rates exceed 100 per cent, it’s clear that UNICEF is spending more resources on purchasing Plumpy’Nut and other therapeutic food for SAM management, which indicates inefficiency. This is illustrated in Figure 9.
The purchase of therapeutic food was carried out using a competitive process to ensure the procurement of high quality products at a rea-sonable price in line with UNICEF procurement guidelines. The UNICEF supply system regis-tered variations in the price of 150 sachets that ranged from US$49 to US$51. There was also a disparity in the actual number of procured nu-trition items by the UNICEF supply unit and the nutrition section. The absence of a reconciliation report of the therapeutic supplements sent to the state level made it impossible to make an authoritative conclusion as to whether the un-der-five children suffering from SAM were the sole recipients of Plumpy’Nut.
0
5000
10000
15000
20000
25000
30000
35000
40000
Num
ber o
f Chi
ldre
n
2010 2011 2012 2013 2014 2015
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Planned Target Achieved Output
2293
0
2365
4
2293
0
2440
2
1800
0
2517
3
1800
0
3363
1
3363
1
2293
0
2293
0
18000251731800033631229303363122930
2293
0
1505
2
1654
0
1610
8
2024
1
1651
1 1956
1
2109
7
2136
8
2937
2
2207
5
3987
1
2437
0
Figure 9: Admission of children with SAM
34EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
UNICEF’s key implementing partners—the fed-eral and state ministries of health—adopted the Infant and Young Child Feeding Plan at the na-tional level, though the plan was not adopted at the locality level. As a result, there was no data consolidation due to the absence of a nutrition database for CMAM, vitamin A supplementa-tion and infant and young child feeding. In this regard, UNICEF contributed to the realization of 84 per cent and 99 per cent of children aged 6–59 months in North and South Darfur respec-tively receiving two annual doses of vitamin A supplementation, as shown in Figure 10.
The cost-effectiveness analysis relied on the analysis of the financial cost of the UNICEF CMAM programme. It pegged the unit of ef-fectiveness as the number of children cured of SAM. However, the absence of financial records for 2010–2011 made it impossible to calculate the cost-effective ratio for the UNICEF human-itarian nutrition programme. The cost-effective ratio for North Darfur decreased from US$206 per life saved in 2014 to US$169 per life saved in 2015. In South Darfur the cost per life saved was US$138 in 2014 and US$134 in 2015, as presented in Figure 11.
0
100000
200000
300000
400000
500000
600000
700000
800000
4144
96
7242
87
4397
01
6151
07
4636
88
6487
20
4636
88
6523
87
4917
89
6523
87
3897
43
6949
44
4597
01
6311
85
4787
45
6148
15
4767
02
6562
06
4932
94
6749
46
Num
ber o
f Chi
ldre
n
2010 2011 2012 2013 2014 2015
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Sout
h Da
rfur
Nor
th D
arfu
r
Nor
th D
arfu
r
Sout
h Da
rfur
Planned Target Achieved Output
Figure 10: Children aged 6–59 months having received two doses of vitamin A
Source: UNICEF routine data
35EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Regarding the UNICEF Core Commitments of Children operational commitment for human resources, the posting of competent UNICEF nutrition staff to support implementing partners for both nutrition programming and supervision was inadequate. In the North Darfur office, for example, only one international staff member supported both nutrition and health program-ming, which is below the cluster role require-ment for UNICEF. This led to poor supervision of implementing partners.
Feedback from the key informant interviews with State Ministry of Health officials and the community-based organizations depicted high logistical costs for the delivery of nutrition-re-lated supplies (mainly Plumpy’Nut), and as a result, low performance in the coverage of
children at risk for MAM and SAM. Nutrition treatment centres are not an integral part of health facilities due to the nature of their design. Access to the most vulnerable children in villag-es far from the nutrition treatment centres has also led to missing output targets since not all vulnerable children were met within the period of evaluation (2010–2015).
The continuous leakage of UNICEF’s Plumpy’Nut into the local market affected the efficiency and effectiveness of the nutrition programme’s abil-ity to reduce malnutrition cases in a cost-ef-fective manner. There are no records to verify whether the procured Plumpy’Nut reached the affected children, but it was possible to verify the sale of Plumpy’Nut in the market.
Figure 11: Cost per life saved through UNICEF nutrition Interventions as calculated from UNICEF financial reports.
0
50
100
150
200
250
CER (UNICEF) – SAM ADMISSION CER (UNICEF) – SAM CURED
US$
2010 2011 2012 2013 2014 2015
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Sout
h Da
rfur
Nor
th D
arfu
r
Nor
th D
arfu
r
Sout
h Da
rfur
$39$48
$141
$157$150
$117
$175
$113
$138
$162
$189
$169
$134
$206
36EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
In South Darfur, the HAC issued a directive to immediately halt NGO peacebuilding activities19
after verifying the diversion of nutrition items to markets in 2011. In North Darfur, however, there was no action from the HAC or a similar author-ity on the reports of the leakage of Plumpy’Nut into the local market. As presented in Figure 12, there is a significant difference in the number of under-five children admitted for SAM and the amount of Plumpy’Nut distributed.
19 Office for the Coordination of Humanitarian Affairs, ‘Sudan Weekly Humanitarian Bulletin 12-18 August 2011’, OCHA, 18 August 2011, available at: <http://reliefweb.int/sites/reliefweb.int/files/resources/Full_Report_2189.pdf>, accessed 9 March 2017.
4.3.3 Health programme efficiency The health efficiency analysis was also based on the theory of change, developed from the UNICEF rolling work plan and UNICEF partner-ship agreements. The cost of the humanitarian health programme was computed based on UNICEF financial reports. From these reports, funding for humanitarian health programmes declined significantly for both UNICEF-fund-ed programmes and the Sudan Humanitarian
0
10000
20000
30000
40000
50000
60000
SAM (Admission) Plumpy Nut (Distributed)
Num
ber o
f ite
ms
2010 2011 2012 2013 2014 2015
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Sout
h Da
rfur
Nor
th D
arfu
r
Nor
th D
arfu
r
Sout
h Da
rfur
1505
2
1654
0
1610
8 2024
1
1651
1
1956
1
2109
7
2136
8
2937
2
2207
5
2328
2
3987
1
2437
0
6193
2460
4
1732
4
3329
1
2509
6
5040
2
000 00
Figure 12: Comparison of distributed Plumpy’Nut and the number of under-five children admitted for SAM treatment
Source: UNICEF nutrition and supply reports
37EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Response Plan funding system. In the latter programme, the planned budget decreased be-tween 2010 and 2015 in both states, while allo-cation decreased from US$13,320,139 in 2010 to US$9,482, 975 in 2015 for South Darfur and from US$12,619, 079 in 2010 to US$8671,075
in 2015 for North Darfur. In the former, there was slight variation between funds allocated to both states over the five-year period. In South Darfur, UNICEF allocation decreased between
2010 and 2015, but there was a significant drop in 2011. In North Darfur, funds dropped sharply in 2011 and 2012, increased with a major allo-cation of US$5,389,317 in 2013 and dropped again in subsequent years, as shown in Figure 13 and Annex 6.
The vaccine procurement process, mainly for Bacillus Calmette-Guérin (BCG), measles and pentavalent vaccines, adhered to UNICEF pro-curement regulations. The unit cost for the
2010 2011 2012 2013 2014 2015
UNICEF Allocated Budget, USD, (South Darfur
4,246,068 121,698 265,584 1,588,174 1,629,613 1,537,962
UNICEF Allocated Budget, USD (North Darfur)
4,238,290 104,833 235,839 5,389,317 2,597,897 1,877,249
SHRP Planned, USD, (South Darfur)
24,417,510 19,615,241 14,040,608 11,485,685
SHRP Planned Budget, USD (North Darfur)
23,132,378 17,580,851 12,902,549 9,303,603
SHRP Allocated funds, USD, (South Darfur)
13,320,139 9,935,480 7,230,137 5,712,529 6,861,466 9,482,975
SHRP Allocated funds, USD, (North Darfur)
12,619,079 5,578,939 8,377,332 6,066,041 3,685,805 8,671,075
2010 2011 2012 2013 2014 20150
5,000,000
10,000,000
15,000,000
20,000,000
25,000,000
30,000,000
Figure 13: Funding of the health humanitarian programme
Source: UNICEF financial Reports and OCHA financial reports
38EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
BCG vaccine was US$0.1134, for measles was US$0.3069 and for pentavalent was US$0.1733, including their delivery in state level capitals in South and North Darfur. In general, immuniza-tion procurement achieved between 85 per cent and 101 per cent of the planned targets for both North Darfur and South Darfur, respectively. The UNICEF immunization programme contributed to an increase in the uptake of the BCG vaccine in North Darfur from 82 per cent in 2010 to 87 per cent in 2015, while in South Darfur uptake increased from 79 per cent to 87 per cent over the same period, as shown in Figure 14. In addi-tion, UNICEF procured various medical supplies to strengthen health service delivery. This in-cluded a total of 536,400 doses of 500-millilitre ringers lactate, 1,135,000 sachets of oral rehy-dration salts, 372,100 tablets of zinc sulphate, 17,893 bed nets and 874 primary health care kits for North Darfur. In South Darfur, 65,000 doses of 500-millilitre ringers lactate, 715,000 sachets
of oral rehydration salt, 511,000 zinc sulphate tablets, 7,000 bed nets and 10 primary health kits were distributed.
The uptake of the first dose of measles vaccine decreased from 78 per cent to 72 per cent in North Darfur and from 74 per cent to 80 per cent in South Darfur. There was low uptake of the second dose of measles in both North and South Darfur compared with the uptake of the first dose. However, UNICEF contributed to the increase in uptake of the second dose through sustained community mobilization to create awareness of the need for children under 5 re-ceiving the second dose of measles as shown in Figure 15 and Figure 16 below. This saw the uptake increase from 26 per cent in 2012 to 63 per cent in 2015 for North Darfur. While in South Darfur, the uptake increased from 26 per cent in 2012 to 65 per cent in 2015.
Figure 14: Number of children receiving BCG vaccine against the target
0
50000
100000
150000
200000
Num
ber o
f Chi
ldre
n
2010 2011 2012 2013 2014 2015
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Nor
th D
arfu
r
Sout
h Da
rfur
Sout
h Da
rfur
Nor
th D
arfu
r
Nor
th D
arfu
r
Sout
h Da
rfur
Planned Target Achieved Output
9222
2
1786
54
9513
6
1105
07
1028
24
1429
18
1060
75
1477
92
1194
25
1528
31
1128
84
1580
43
7594
3
1402
57
7581
9 1023
71
8503
0
1323
85
9450
1
1436
59
9177
4
1503
30
9859
4
1373
09
Source: UNICEF immunization reports
39EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Figure 15: Number of children receiving measles immunization in North Darfur
0
20000
40000
60000
80000
100000
120000
Num
ber o
f Chi
ldre
n
2010 2011 2012 2013 2014 2015
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Planned Target Achieved Output
8244
6
8505
2 9192
5
9192
5
9482
9
9482
9
9782
7
9782
7
1009
18
1009
18
6418
3 7223
9
6773
2
2367
5
6911
8
4768
2
6339
8
4464
3
7311
5
6343
2
0
50000
100000
150000
200000
Num
ber o
f Chi
ldre
n
2010 2011 2012 2013 2014 2015
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Firs
t Dos
e
Seco
nd D
ose
Planned Target Achieved Output
1587
34
9818
6 1269
83
1269
83
1313
13
1313
13
1359
71
1359
71
4041
2
4041
2
1173
11
8260
4 1036
56
3313
0
1203
41
8606
8
1199
51
9479
4 1121
93
9112
6
Source: UNICEF immunization reports
Figure 16: Number of children receiving measles immunization in South Darfur
Source: UNICEF immunization reports
40EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Between 2010 and 2015, the targets for pen-tavalent immunization were higher; and in South Darfur, the targets were nearly double what they were in North Darfur. However, in both states, these targets were neither surpassed nor met, save for a few cases in the administra-
tion of first doses. In North Darfur, targets were surpassed for the administration of first doses in 2011, 2012 and 2013, while in South Darfur targets were surpassed for the administration of first doses in 2012, 2013 and 2014, as show in Figures 17 and 18.
Figure 17: Number of children receiving pentavalent immunization in North Darfur
Figure 18: Number of children receiving pentavalent immunization in South Darfur
Source: UNICEF immunization reports
0
20000
40000
60000
80000
100000
120000
Planned Target Achieved Output
Num
ber o
f Chi
ldre
n
2010 2011 2012 2013 2014 2015
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
8244
6
8244
6
8244
6
8505
2
8505
2
8505
2
9192
5
9192
5
9192
5
9482
9
9482
9
9482
9
9728
7
9728
7
9728
7
1009
18
1009
18
1009
18
8161
5
7696
3
7152
4
8910
9
8371
4
8142
6 9430
9
8807
7
8462
0 9746
2
9395
9
9162
5
9318
0
8760
9
8362
0 9344
0
8979
0
8924
7
0
20000
40000
60000
80000
100000
120000
Planned Target Achieved Output
Num
ber o
f Chi
ldre
n
2010 2011 2012 2013 2014 2015
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
Firs
t Dos
e
Seco
nd D
ose
Third
Dos
e
8244
6
8244
6
8244
6
8505
2
8505
2
8505
2
9192
5
9192
5
9192
5
9482
9
9482
9
9482
9
9728
7
9728
7
9728
7
1009
18
1009
18
1009
18
8161
5
7696
3
7152
4
8910
9
8371
4
8142
6 9430
9
8807
7
8462
0 9746
2
9395
9
9162
5
9318
0
8760
9
8362
0 9344
0
8979
0
8924
7
Source: UNICEF immunization reports
41EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
In regards to cost-effective analysis, and in ref-erence to the UNICEF nutritional framework, the humanitarian health programmes contribut-ed to improving the health status of under-five children and mitigated risks of malnourish-ment. As a result, UNICEF achieved its goal of reducing vaccine-preventable diseases. The cost-effective analysis therefore examined the number of vaccine shots administered to un-der-five children. Based on the calculations, the cost-effective ration for the health programme was US$6.91 in 2010 and US$1.04 in 2015, per vaccine administered to a child in North Darfur, while in South Darfur the cost per vaccine ad-ministered was US$6.19 in 2010 and US$0.88 in 2015 as shown in Figure 19.
20 The WHO Health Resource Availability Monitoring System is a rapid online system for monitoring health facilities, services and resource availability in emergencies. More details available at: <www.who.int/hac/herams/en/>, accessed 9 March 2017.
After the withdrawal of international NGO ser-vices in 2010, most health facilities became dys-functional due to the limited resources of the Government of the Sudan to facilitate and sup-port various health operations. Such funding gaps led to intermittent procurement and distribution of essential drugs as well as administrative costs for health personnel. This also affected the provi-sion of quality vaccines and the enhancement of systems, particularly cold chain equipment, which were substandard in rural areas in North Darfur.
Although the World Health Organization (WHO) Health Resource Availability Monitoring Sys-tem20 highlights a progressive increase in the number of health facilities providing IMCI, this
Figure 19: Cost of delivering one dose of a vaccine
Source: UNICEF financial reports
$0.00
$1.00
$2.00
$3.00
$4.00
$5.00
$6.00
$7.00
$8.00
North Darfur
Amou
nt (U
S$)
2010 2011 2012 2013 2014 2015
South Darfur
$6.91
$4.77
$0.18 $0.20
$3.18
$1.21
$2.04
$0.88
$0.21$0.15
$6.19
$1.04
42EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
is not evident in the coverage of under-five dis-eases, particularly the management of diarrheal and vaccine-preventable diseases in North and South Darfur. As such, this signalled additional challenges in regards to the quality of service provisions in rural/locality level health facilities. In addition, the unavailability of qualified health workers in health facilities continued to contrib-ute to this disparity, as confirmed during the key informant interviews with health personnel.
Though there are weekly coordination forums chaired by the State Ministry of Health, feed-back from health personnel confirm cases of duplication of activities that focus on the EPI activities in North Darfur. South Darfur has, however, outlined, the roles and responsibil-ities of all stakeholders, with WHO playing a distinct role in ensuring the quality of vaccines and related services in terms of EPI.
UNICEF contributed by fighting against harmful habits such as for measles. In the past, people didn’t know that im-munization is important; organizations have raised the awareness of the people about the importance of immunization and vaccination. UNICEF has also im-plemented awareness campaigns and awareness programmes, such as for female genital mutilation, health and sanitation and the malaria campaign. When the awareness campaign have started and it is usually done by the health committee assigned by what-ever organization, people who attend usually bring what they have learned to the other people in the camp who didn’t have the chance to attend; they raise the awareness of the other people. It’s youth who usually do this activity.
— Community leader, Zam Zam Camp, North Darfur
The leakage of long-lasting insecticide-treated nets, as reported during the focus group dis-cussions and the key informant interviews, led to the low coverage of under-five children, thus increasing their risk of malaria.
4.4 Effectiveness
The assessment of the effectiveness of humani-tarian action between 2010 and 2015 was based on UNICEF’s monitoring and evaluation frame-work indicators (Country Programme Document/Country Programme Action Plan Result Matrix, the Annual Work Plan and the theory of change) against the achievements made at the state level. Thus, the analysis was based on how the humanitarian programmes translated outputs into sustained outcomes at the community level.
4.4.1 WASH programme effectiveness UNICEF’s WASH programme focused on the af-fected population, schools and the sustained de-velopment of the operation and maintenance of water and sanitation facilities. In this regard, the evaluation established that the UNICEF WASH section set an ambitious target of 50 per cent, although only 6.19 per cent of the population had access to an improved drinking water source in North Darfur and 4.92 per cent had access in South Darfur. From the sampled households, the respondents indicated that they obtained water that was piped into their yard/plot/compound (5.2 per cent) or through public taps (21.4 per cent), an open public well (23.5 per cent) or boreholes (34.7 per cent). A small proportion of these wa-ter sources (7.1 per cent) only provide water for a maximum of six months, while another 10.6
43EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
per cent of water sources have water for up to nine months and the other 70.4 per cent of water sources have water throughout the year (see Annex 7). This was further confirmed through the focus group discussions.
WES, in coordination with UNICEF, has implemented a number of water pumps in our area, though most of them are not working in the dry season. In our Zam Zam Camp, only 15 out of the 72 water pumps are working. — Community leader, Zam Zam Camp
Water facilities supported by UNICEF in North Darfur. Operation time for the water facility is between 8 a.m. and 11 a.m.
A man drawing water from the commercial water vendors in Zam Zam Camp
One of the key Sphere standards in the pro-vision of water is ensuring that the maximum distance from any household to the nearest water point is no more than 500 meters. From the sampled household respondents, it was observed that:
� 26 per cent of the target population ac-cessed water within a 500-metre radius
� 31.3 per cent walked up to 1 kilometre to access water
� 20.9 per cent walked 2 kilometres to access water
� 17.5 per cent walked for more than 3 kilo-metres to access water
These distances have not changed significantly since 2010. Only 12.8 per cent reported some changes in the distance to and from the water sources. In addition, 69 per cent of the sampled households reported that they wait for more than 31 minutes at the water point, which is above the recommended 30 minutes in Sphere standards. The analysis of distances to various water sources was corroborated through the community mapping tool during the focus group discussion, which confirmed the community walked up to five kilometres to access water, as illustrated in Figure 20.
©UN
ICEF
Sud
an/E
valu
atio
n Te
am©
UNIC
EF S
udan
/Eva
luat
ion
Team
44EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Although a significant number of people could access water within a 1-kilometre radius, they also spent more than 31 minutes queuing at the water sources, as presented in Figure 21. This shows that either more people are using the same water facility or the discharge rate of the water facilities is slow. The slow discharge,
primarily during dry seasons, is one of the ma-jor causes of delay at the water sources. As a result, most water providers dispense water only for a few hours per a day to manage the recharge of the water levels in the various bore-holes in North and South Darfur.
0
3
6
9
12
15
Perc
ent o
f Hou
seho
lds
Less than500 m
501m – Lessthan 1 km
1.1 km – Lessthan 2 km
2.1 km – Lessthan 3 km
More than3.1 km
Don’t know
9.4%
3.4%
9.9%
11.1%
1.0%1.4%
0.5%
8.9%
6.0%
4.5%
1.8%
2.9%
5.5%
3.3% 3.3%
1.8%2.2%1.3%
0.7%
13.6%
1.6% 1.7%
3.9%
0.1%
El Fasher Umkadada Kass Other
0
5
10
15
20
25
30
35
El Fasher
Perc
ent o
f Hou
seho
lds
Under 5min
6-10 mins Over 11-20mins
21-30 mins Over 31 mins
Umkadada Kass Other
0.5%
3.0%
5.7%3.2%
13.0%
0.5% 1.3% 1.3%3.5%
21.3%
0.2% 0.3% 0.8% 1.2%
7.3%
0.3% 0.7% 0.5%
4.8%
30.6%
Figure 20: Distance of the household to the nearest water source
Source: Evaluation of Humanitarian Action (EHA) 2016 Household Survey
Figure 21: Presentation of the time taken at the water point
Source: EHA 2016 Household Survey
45EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
As confirmed during the focus group discus-sions, in stressed areas, the majority of rural and poor urban communities use surface holes from streambeds, open wells and hand pumps if available, given that these sources are free (however, the price is at least 12 to 15 Sudanese Pounds21 for one barrel per day per household from commercial wells). From the sampled household respondents, 92.1 per cent spend less than 1 Sudanese Pound to purchase a 20-li-tre Jerry can; 6.5 per cent spend between 2 and 5 Sudanese Pounds; 1 per cent spend between 6 and 10 Sudanese Pounds; and 0.5 per cent get water for free, as shown in Table 3.
21 US$1 = 6.5 Sudanese Pounds
A review of UNICEF WASH supply indicated that it contributed to ensuring the continuity of water treatment using chlorinators who chlo-rinated water in camps and within host com-munities. However, feedback from the sample household showed that there is a weakness in household water treatment, with only 13.9 per cent (in 2015) and 18.8 per cent (in 2010) of households having treated their drinking water. As shown in Figure 22, 12 per cent of house-holds use chlorine-based compounds, 0.1 per cent use sunlight, 3 per cent use alum stones, 4 per cent use all treatment options, and 6 per cent prefer to boil water.
Table 3: Presentation of the cost of a 20-litre Jerry can of water
El Fasher Umkadada Kass Others Total
Less than 1 Sudanese Pound 50.0% 21.9% 5.3% 14.9% 92.1%
2–5 Sudanese Pound 1.9% 1.2% 0.5% 2.9% 6.5%
6–10 Sudanese Pound 0.0% 0.0% 0.0% 1.0% 1.0%
No payment 0.0% 0.0% 0.0% 0.5% 0.5%
Total 51.9% 23.1% 5.8% 19.2% 100.0%
Source: EHA 2016 Household Survey
0
5
10
15
20
25
30
35
Perc
ent o
f Hou
seho
lds
Boiling Addingchlorine/PUR
Alumstones
Traditionalleaves
Ash Sunlight Don’t treat
El Fasher Umkadada Kass Other
1.9%3.7%
0%1.0% 0.2% 0.2%
24.1%
5.9% 5.4%
0.3%2.4%
0% 0%
28.5%
0% 0% 0% 0.8% 0% 0%
15.3%
0.3%
6.2%
0% 0.2% 0.2% 0%
32.2%
Figure 22: Presentation of household water treatment options
Source: EHA 2016 Household Survey
46EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Key informant interviews with laboratory ana-lysts in North and South Darfur confirmed that up to 85 per cent of the water from various sources is polluted.
What we need is instead of UNICEF and its partners digging and implementing wells and after a few months it be-comes dry, it’s better for us that they dig wells that mostly depends on the groundwater. As you see here in Zam Zam Camp, we only have two ground-water wells. We have already request-ed this from UNICEF before, ‘we need wells’; at least six or seven wells in Zam Zam will be enough for us. Generally pumps dry due to sand.—Community leader, Zam Zam Camp
The provision of safe excreta disposal was a key activity for UNICEF during the evaluation period. UNICEF reached 67 per cent of the tar-geted affected population in North Darfur and 64 per cent of the targeted affected popula-tion in South Darfur with safe excreta disposal. However, the number of community members within the population that is open defecation free and using improved sanitation facilities was 33 per cent in North Darfur and 60 per cent in South Darfur, within UNICEF-targeted areas. From sampled household respondents in North and South Darfur, 50 per cent (n=381) of the af-fected population use traditional pit latrines,22 2 per cent (n=16) use an open pit that is dug some distance away from their households, 1 per cent (n=4) use ventilated improved pit latrines, 1 per cent (n=4) use flush toilets, and the remaining 46 per cent (n=360) practice open defecation.
22 The traditional pit latrine refers to a structure that collects human faeces in a hole covered with a slab. The structure is then surrounded by a shelter with no ventilation pipe.
The toilets are shared between all peo-ple in this area, women, men, boys and girls. These toilets were built by Oxfam America and they used to dig a big hole to empty these toilets and then bury this hole. Now it is the people who do this job and they rarely do it since it is not hygienic and comfortable anymore.—Community member
Temporary sanitation facilities erected by UNICEF in Zam Zam Camp
UNICEF has made significant contributions to hygiene behaviour change. The number of peo-ple sampled from households who confirmed that they wash their hands after visiting the toilet, before feeding a child and before eating has increased over the past five years. Among those who wash their hands after visiting the toilet, 89 per cent (n= 678) in the last five years and 98 per cent (n=751) in the last six months, while those who occasionally and did not wash their hands declined by 11 per cent (n=86) and 0.2 per cent (n=13), respectively. Before feed-ing a child, 92 per cent (n=702) in the last five years and 98 per cent (n=752) in the last six months washed their hands with soap, while those who occasionally and did not wash their
©UN
ICEF
Sud
an/E
valu
atio
n Te
am
47EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
hands before feeding a child declined by 3.1 per cent (n=24) and 2 per cent (n=6), respectively. Before eating, 94 per cent (n=715) in the last five years and 99.6 per cent (n=761) in the last six months washed their hands, while those who occasionally and did not wash their hands declined by 6.4 per cent (n=49) and 0.3 per cent (n=3), respectively.
Based on the focus group discussion analysis and the key informant interviews, lack of ad-equate implementation and enforcement of environmental health laws and protocols was due to poor resource allocation for sanitation activities by the Ministry of Health, local au-thorities and the community. Discussion with children’s groups confirmed that hygiene educa-tion was put into practice in Grade 6, while for the lower grades, parents and caregivers orient the children on personal hygiene practices. The children, who doubled up as caregivers for chil-dren under 5, were not targeted with sanitation messages early enough.
In conflict areas of the western part of North Darfur, UNICEF supported the implementation sanitation and vector control activities to limit disease transfer in urban and peri-urban areas, as confirmed by communities during the focus group discussions. Rural populations, however, especially nomads, have poor environmental health education due to their continuous relo-cation in search of pasture and water.
WASH programming in schools is a key UNICEF strategy aimed at controlling diarrheal diseases among affected populations. UNICEF has en-abled 39 per cent of targeted school children to benefit of access to safe drinking water in North Darfur and 43 per cent in South Darfur. Seventy-six per cent of children interviewed in
focus group discussions confirmed that they accessed water from taps and perceived the water to be clean.
In addition, 39 per cent and 56 per cent of schoolchildren targeted by UNICEF were pro-vided with adequate sanitary latrines in North Darfur and South Darfur, respectively. Focus group discussions with children confirmed that they wash their hands with soap. This assertion was further corroborated through observation of children washing their hands with soap.
In terms of challenges, heavy investment in the operation and maintenance of water sources due to water drawdown led to already drilled water sources drying up, and high operation costs for drilling new water sources to provide water to affected populations. In addition, fol-lowing the departure of international NGOs in 2010, target local communities and local author-ities could not continue with operations and maintenance due to the lack of a clear hando-ver process, lack of spare parts, lack of main-tenance skills, and the absence of dedicated entrepreneurs in the community. In all five local-ities, however, the local community’s capacity to manage water supply continued to improve through assigned water committees, though the quality of leadership and coordination of efforts was lacking.
4.4.2 Nutrition programme effectiveness The main UNICEF nutritional programme out-come envisaged in the theory of change was the management of Severe Acute Malnutrition (SAM). The performance indicators of manage-ment of SAM targeted a cure rate of at least 75 per cent of admitted severe acute malnourished children. But the default rate and death rate are high: i) around 15 per cent of children admitted
48EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
for SAM management default from treatment, ii) 5 per cent of the children admitted do not respond to treatment and iii) about 5 per cent of the admitted children die due to SAM (see Annex 9 and Annex 10).
The number of children under 5 admitted for SAM treatment increased from 66 per cent in 2010 to 119 per cent in 2015 in North Darfur. Admissions in South Darfur increased from 72 per cent in 2010 to 106 per cent in 2015 against planned targets. The share of primary health care facilities providing SAM treatment was 40 per cent in North Darfur and 24 per cent in South Darfur. Thus, most admissions by UNICEF for SAM treatment were at stabilization centres. The analysis of the UNICEF and State Ministry of Health reports recorded an increase in the percentage of under-five children cured of SAM between 2011 and 2015, from 79.7 per cent to 89 per cent in North Darfur and from 78 per cent to 87 per cent in South Darfur. The default rate declined over that same period, from 12.3 per cent to 8 per cent in North Darfur and from 6 per cent to 4 per cent in South Darfur. The non-response rate decreased from 7 per cent to 2.5 per cent in North Darfur, while in South Darfur the rate decreased from 6 per cent to 4 per cent. The death rate for both North Darfur and South Darfur remained below 1 per cent.
In an effort to prevent MAM, the World Food Programme (WFP) supported the Blanket Sup-plementary Feeding Programme for four to five months during the lean season for all children under 5. This was followed by strong collab-oration between UNICEF and WFP targeting the most vulnerable children at risk of malnu-trition—a priority for the intervention as high-lighted in the Nutrition Cluster minutes in El Fasher for the periods under review. Similarly,
there was significant action on the Integrated Blanket Supplementary Feeding Programme initiated in 2011 for MAM prevention, targeting children under 3 years and in response to rising malnutrition rates among children under 5 years in both North and South Darfur.
The number of children who were covered with two annual doses of vitamin A increased from 94 to 100 per cent in North Darfur and from 96 to 103 per cent in South Darfur. The achieve-ment of the vitamin A target was closely tied to the immunization programmes at the communi-ty level, thus corresponding to high EPI cover-age, and illustrating an example of inter-section collaboration at the community level. Feedback from the sampled households shows a higher uptake of breastfeeding practices by mothers and caregivers as a result of UNICEF’s continu-ous promotion of breastfeeding practices at the community level. Within the first three months after the child is born, up to 87 per cent of the sampled respondents breastfed their children. This decreased to 80 per cent for those who breastfed for up to six months and 77 per cent for those who breastfed for up to 12 months.
Bottleneck analysis (factor analysis) for nutrition programmeFrom the key informant interviews with the State Ministry of Health officials and commu-nity-based organizations, the high logistical cost for the delivery of nutrition-related supplies, mainly Plumpy’Nut, contributed to low perfor-mance in regards to covering children at risk for MAM and SAM.
The supplementary food of flour mix provided by WFP in the past has par-ticipated mainly in supporting the child health but now it has stopped; there
49EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
were available drugs for treatments of diseases, now the situation has changed.”—Mother from El Fasher IDP Camp
In the design of the nutrition programme, how-ever, nutrition treatment centres were not an integral part of health facilities. As such, there are health facilities that provided other curative services for the under-five children alongside nutritional services, while others did not.
Limited access to the most vulnerable children residing in villages far away from the nutrition treatment centres undermined achievement against the targets, since not all vulnerable chil-dren were met within the period of evaluation (2010–2015). This also arose from an inadequate number of functional nutrition centres within affected communities, since only 42 per cent of functional health facilities (288 health facili-ties out of 422 health facilities in North Darfur) offer the IMCI services that include nutritional services or packages. The nutrition and health education also did not cover some hard-to-reach areas where the vulnerable population is found; innovative ways to reach these areas should be devised.
4.4.3 Health programme effectiveness UNICEF’s health programme endeavoured to increase oral rehydration salt uptake among children with diarrhoea by 65 per cent; the per-centage uptake of recommended vaccines at stipulated ages; the number of newborns ben-efiting from essential newborn and postnatal care at the community level; and the number of births attended by skilled birth attendants .
UNICEF health interventions contributed to the treatment of 40 per cent of children with diar-
rhoea in North Darfur, and up to 66 per cent in South Darfur. Routine data from the State Ministry of Health and UNICEF show that ap-propriate management of diarrhoea using oral rehydration salts is unavailable; hence monitor-ing report figures are missing from the years 2012 and 2013 (see Annex 11 and Annex 12).
The UNICEF vaccine programme recorded am-bivalent results during the period under review. UNICEF contributed to an increase in the uptake of the BCG vaccine in North Darfur from 82 per cent in 2010 to 87 per cent in 2015, and in South Darfur from 79 per cent to 87 per cent. The uptake of the first dose of measles decreased from 78 per cent to 72 per cent in North Darfur, and increased from 74 per cent to 80 per cent in South Darfur. There was low uptake of the sec-ond dose of measles in both North and South Darfur compared with uptake of the first dose. However, uptake of the second dose increased tremendously from 26 per cent in 2012 to 63 per cent in 2015 for North Darfur and from 26 per cent in 2012 to 65 per cent in 2015 for South Darfur. These changes resulted from sustained community mobilization to create awareness of the need for children under 5 to receive the second dose of measles vaccination.
Both the measles and pentavalent vaccine re-gimes illustrated interesting trends in access to routine immunization programmes and ser-vice utilization. A significant variation is evident in regards to coverage of measles vaccination among the one-year-old children in North Darfur compared with South Darfur. Coverage of the first dose of measles vaccination is lower than coverage of the second dose in North Darfur, though the administration of these two doses were on par in 2015. Thus, UNICEF and partners made impressive efforts to increase the second
50EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
dose coverage through accelerated immuniza-tion exercises.
Uptake of the first dose of pentavalent vaccine in North Darfur decreased from 99 per cent in 2010 to 93 per cent in 2015. The UNICEF inter-vention realized an increased uptake of up to 105 per cent between 2011 and 2013 due to a rise in demand at the community level. In South Darfur, however, uptake decreased from 97 per cent to 94 per cent, showing a decline in the demand from community members.
The uptake of vaccines differs between the states. In North Darfur, the uptake of the first dose of oral polio vaccine was 66 per cent, for the second dose was 62 per cent and for the third dose was 75 per cent. The disparity be-tween the first and third doses points to the accuracy of the data in North Darfur. In South Darfur, however, the uptake of the first dose was 78 per cent, the second dose was 73 per cent and the third dose was 71 per cent. It was evident through key informant interviews and observations that the investments in immuni-zation services in North Darfur are weak com-pared with in South Darfur, which had a reliable and functional EPI information management system.
UNICEF investment in maternal and neonatal health programmes contributed to up to 81 per cent of skilled attendants supporting births in North Darfur, but except for 2010, data are un-available for South Darfur from 2011 through 2015. In 2010, only 46 per cent of births involved skilled attendants. UNICEF’s IMCI in primary health facilities increased from 13 per cent to 67 per cent in North Darfur and from 28 per cent to 40 per cent in South Darfur, but this fell short of its 60 per cent targets, with an overall
achievement of 38 per cent and 34 per cent in North Darfur and South Darfur, respectively. This programme also supplied midwifery kits to health centres in South Darfur, but did not deliver any to North Darfur.
Bottleneck analysis (factor analysis) for the health programmeAlthough UNICEF’s IMCI strategy is in line with the Ministry of Health’s commitment to improve child health, it failed to realize set objectives due lack of technical and logistical capacity. The strategy promoted health activities, mainly at the health facility level, as well as at the com-munity/village levels. Challenges included poor child identification, irregular child referrals and low adherence to children’s various treatment regimens. Information recording and report-ing mechanisms are available for IMCI within community component reporting—including for reporting on the causes of under-five deaths, neonatal deaths and maternal deaths—but have remained fragile and non-informative.
The inconsistent functionality of the cold chain management system, which is primarily due to the absence of reliable power sources in rural-based health facilities, impedes vaccine quality assurance.
The cultural reliance of Darfurian households on women’s income, despite the limited liveli-hood opportunities for women, has led caregiv-ers to spend most of the day outside of their households for daily earning. This has a major impact on maternal health, child health and the level of care practice provided to children at the household level. However, poor environmental and health conditions, especially in rural areas, have considerably worsened children’s health after the departure of international NGOs. These
51EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
challenges have dramatically affected utiliza-tion rates of health services and increased the popularity of preliminary management by tradi-tional healers with their aggressive treatment approaches (curettage, superficial skin cutting, etc.), which has aggravated children’s condi-tions, delayed their treatment and made them more prone to death.
The annual review does not recognize the par-ticipation of health technical expertise from Lo-cality Level, including in planning activities with partners (UNICEF and implementing partners) at the state level to raise specific issues per locality. These representatives participate only in annual meetings with the Ministry of Health in El Fasher.
The majority of the affected population, includ-ing children with multiple sicknesses, cannot access health services due to security issues, high transportation fees and health facility
fees. Moreover, the limited financial, human and physical capacity of the Ministry of Health, communities and local authorities, makes them unable to run an adequate health service in ur-ban and rural areas. The complicated delivery of health services has continued to raise concerns from various audiences.
Feedback from community members and key informant interviews with health staff highlight-ed challenges such as the inadequacy and stock outs of essential drugs, mosquito nets—and sometimes vaccines—for several months; com-plex drug/supply delivery from El Fasher due to the long distance; lack of budget for drug trans-portation; and insecurity. Drugs are available in commercial drug stores but are too expensive for beneficiaries and in some cases do not meet safety and quality standards. The presence of commercial drug stores has encouraged some caregivers to buy drugs directly without ade-quate medical management.
Mothers and caregivers wait to receive treatment from a community dispensary in Saraf Omra locality.
©UN
ICEF
Sud
an/N
orth
Dar
fur F
O
©UN
ICEF
Sud
an/N
orth
Dar
fur F
O
52EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
UNICEF used to spray pesticides and distributes mosquito nets for eradica-tion of malaria in the area in addition of distribution of Jerry cans, this was done in 2010; However, since that time in 2010, there is no Mosquito nets dis-tributed.—Community leader, Alsalam Camp
4.5 Impact
The impact analysis was based on documenta-tion of the positive and negative changes evi-dent at the community level, specifically on im-pact indicators for WASH, nutrition and health, to which UNICEF humanitarian programmes contributed. The WASH analysis focused on the changes in regards to diarrheal diseases as an indicator of the quality of water and san-itation services. It also analysed changes in global acute malnutrition (GAM) rates and the accompanying factors that contributed to the reduction or increase in GAM rates, mainly liveli-hood options and access to food by the affected population, as presented in the UNICEF nutri-tion conceptual framework. The responses from the caregivers, sampled households and focus group discussion participants on whether the child had suffered from marasmus were proxy indicators for wasting. The health impact analy-sis was based on the reduction of vaccine-pre-ventable diseases and the prevalence of malaria among children under 5, but also documented responses on the number of children who had died of those diseases.
4.5.1 Impact of the WASH programme The WASH impact analysis was based on the reduction of diarrheal disease incidence due to the provision of safe water and sanitation op-
Community Voice:
“I arrived in Kabkabiya in 2007 when Médecins Sans Frontières and Oxfam GB were operational. Water was available but we were asked to dig a toilet hole and we received cement platform. Our house and toilet clean were without flies. There were women who taught my mother how to breastfeed my little brother and when my sister got married they came to examine her during her pregnancy. They taught us how to triage garbage and dig a hole to burn it at home.
I fill five Jerry cans a day and if I have laundry I fill eight ones. The hand pump is slow and people are a lot.
I have two kids at 3 and 5 years old who always fall sick with chest infections and diarrhoea. Drugs are expensive but I give them water with salt and sugar for diarrhoea and I’ve never taken them to nutrition centre. Once some people came to our neighbourhood and measure their arms and said they are okay.”
Halima from Kabkabiya Locality
tions in accordance with the WASH Sphere stan-dards. The changes documented included the adoption of personal hygiene practices, noted through observation of the affected population washing their hands after using a toilet, before eating, before preparing food and after clean-ing a baby. The responses from the sampled households indicated that 37 per cent believed that UNICEF WASH programming is contribut-
53EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
ing to improved hygiene, sanitation and health status among the affected population. About 70 per cent of the focus group discussion partici-pants also confirmed that water and sanitation standards have deteriorated immediately after the withdrawal of the international NGOs from North and South Darfur.
Community members among the sampled re-spondents reported their previous experience of fewer diarrhoea cases in 2010 (33 per cent) than in 2015 (36 per cent). Up to 6 per cent of sampled respondents from El Fasher reported suffering from diarrhoea, while 18 per cent re-ported similar cases in Kass locality in 2015. This difference between the 2010 scenario, where up to 12 per cent reported cases of diarrhoea in El Fasher and 10 per cent reported cases of diarrhea in Kass locality, is consistent with UNICEF’s investment in WASH programming in North Darfur compared with South Darfur.
In line with UNICEF’s hygiene promotion strate-gies, there are a considerable number of house-holds that sought professional medical services mainly at the health facilities for the manage-ment of diarrheal cases among children under 5 years. However, a significant number sought no treatment due to lack of money to pay for the recovery costs at various health facilities and unreliable transport to dispensaries located far away from their area.
23 The 10 per cent WHO GAM emergency threshold is outlined in the Sphere standards published on 2014.
4.5.2 Impact of the nutrition programmeThe GAM rate for North Darfur increased from 22 per cent in 2010 to 28 per cent in 2014, and in South Darfur, decreased from 15 per cent in 2010 to 14 per cent in 2015, as captured in the routine statistics reports conducted by UNICEF in collaboration with the State Ministry of Health for North Darfur and South Darfur. These fig-ures are relatively high compared with the WHO emergency threshold of 10 per cent GAM.23 Feedback from key informant interviews with State Ministry of Agriculture officials in both states confirmed that access to food among the affected population contributed to increased GAM rates in North and South Darfur.
A mother in El Salam Camp, North Darfur passing a dry water tap in search of water
©UN
ICEF
Sud
an/E
valu
atio
n Te
am
54EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
0
5
10
15
20
25
30
35
Yes
Perc
ent o
f Chi
ldre
n
El Fasher Umkadada Kass Others
No Don’t know
0%
12.3%
0%
21.9%21.6%
10.7%
31.4%
18.7%
8.8%
1.3% 1.6% 2.2%
Figure 23: Presentation of under-five children suffering from wasting
Source: EHA 2016 Household Survey
0
5
10
15
20
25
Purchase from market From the family farmland Kitchen garden
Food ration from WFP Donation food from community members
Perc
ent o
f hou
seho
lds
2010 2015 2010 2015 2010 2015 2010 2015
El Fasher Umkadada Kass Others
7%
25%
5%
10%
6%
10%9%
13%
5%
3%
7%
2%
19%
15%
7%
5%
0% 0%0% 0% 0% 0% 0%0% 0% 0% 0% 0% 0% 0% 0% 0%1%
0%
18%
2%
8%7%
9%
6%
Figure 24: Main source of household food
Source: EHA 2016 Household Survey
55EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Fourteen per cent (n=106) of households sam-pled reported a child suffered from marasmus (an indicator of wasting). More cases of child wasting were reported in El Fasher (9 per cent) compared with other localities, as presented in Figure 23.
Wasting in North and South Darfur occurred due to varied food insecurities and dietary diversity weaknesses in these two states, as confirmed by the focus group discussions with the com-munity in Kass locality. The frequent displace-ments in North Darfur compared with South Darfur due to the conflict continued to affect the major food sources among the affected, signalling an over-dependence on relief food, which declined between the review years of 2010 and 2015.
Responses from households sampled in the community indicated that in 2015, purchase from the market is the main source of food for 59 per cent of households (n=447), followed by family farmland at 25 per cent (n=194) and WFP food rations at 14 per cent (n=109). Kitchen gar-den and community food donations constituted the lowest sources. Five years ago, however, family farmland (38 per cent) was the main source of food for most households, followed by WFP food rations (34 per cent), purchase from the market (27 per cent), NGOs (0.7 per cent) and kitchen gardens (0.1 per cent).
The availability of food rations and sources have declined. For example, the WFP food ration de-creased significantly from 34 per cent (n=261) in 2010 to 14 per cent in 2015. Similarly, food from family farmland declined from 38 per cent (n=288) in 2010 to 25 per cent (n=194) in 2015. Feedback from key informant interviews and focus group discussions with the affected
community corroborated the changes in the WFP food ration and the increased demand for food among the affected population. WFP has therefore begun profiling the affected popula-tion in terms of their capacity and ability to buy food depending on their economic situation, in order to develop a more sustainable food distribution strategy. Despite the reduction of WFP food rations, up to 86.5 per cent of the sampled households consume between two and three meals in one day. Feedback from the focus group discussion supported this eating pattern, with tea and porridge being the main types of food given to children under 5.
WFP stopped supporting 63 per cent of the population. Of the 40 per cent of the population who have the food vouchers, this support will stop in the next one year. Out of 237,000 people in the camp, 107,000 have the WFP food vouchers. From this number, 37,000 have stopped getting the food vouch-ers, 23,000 will be phased out after six months and 40,000 will stop getting the food voucher in the next 12 months—Community member, Zam Zam IDP Camp
Since the purchase of food from the market is the most preferred option for food acquisition, it formed the basis for conducting an analysis of the livelihood options of targeted household. The main economic activities in these regions over the past five years are casual labour (19 per cent), agriculture (19 per cent), small-scale projects (19 per cent), and selling dried farmed produce (18 per cent). The minor activities constituting less than 5 per cent include shop keeping, livestock keeping, formal employment, livestock trade and teaching religious books.
56EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Respondents from the household survey in El Fasher are predominantly small-scale project executers (12 per cent), agriculturalists (8 per cent) and casual labourers (5 per cent), com-pared with Umkadada and Kass residents. Kass has more sellers of dried farm produce (6 per cent) than Umkadada (5 per cent) and El Fash-er (0.4 per cent). These residents sell fresher farm products (2.4 per cent) than El Fasher (0.5 per cent) and other localities (2 per cent). Sentiments from the community focus group discussions corroborated these data as the community member notes in the quote below.
The UNICEF nutrition programme did not take into consideration the livelihood component to enhance access to food for the affected popu-lation. Feedback from the sampled households indicated that the average household income per month varied between 1 and 800 Sudanese Pounds, while in the majority of localities, aver-age household income was between 201 and 400 Sudanese Pounds. Within the 201 and 400 Pounds income cluster, the most households came from El Fasher (12 per cent), followed
by Kass (7.8 per cent), Umkadada (4 per cent) and other localities (7.8 per cent). Within the 1 and 200 Pound income cluster, the most households came from El Fasher (5 per cent), followed by Kass (4 per cent) and Umkadada (2 per cent), but not other localities put together (6.5 per cent). Most of the residents of inter-nally displaced persons had no income (35 per cent), while 12 per cent depended on farming, small-scale projects, casual labour, trade and organizational support. Among the residents of IDP camps without income, there were more residents of El Fasher without income (18 per cent) than Kass (12.7 per cent) and other lo-calities (4.3 per cent); Umkadada did not have residents in camps.
“Local farming outputs and crops exchange with neighbouring localities are the main food sources. The main crops we trade for include millet, okra, dark green vegetables, groundnuts, mangoes, pigeon peas and other fruits. Livestock and poultry were one of the main food sources in the locality but for the past five years they became threats for the household by attracting violent livestock thieves.”
El Fashir-Rural, Community Member
Community Voice:
“Asil is my daughter’s baby, she is always sick since her mother weaned her after she got pregnant. Her feeding is poor and we don’t have milk to give her. When she gets sick I bring her to the hospital and stay with her. She lives with her mother in Umkdada but I live in Zarafa. Her mother did not bring her to the nutrition clinic before and after she got admitted by the doctor the first time she followed up at the clinic but never received the food ration after because her mother could not bring her. Now her mother has delivered and Asil got sick again. We brought her drugs from the pharmacy with no improvement. Now she has been admitted for two weeks and takes only hospital milk but she doesn’t eat because of her oral sores.”
Halima from Umkadada Locality
57EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
This low-level income and change in food distri-bution modalities contributed to affected pop-ulations accessing less nutritious food due to minimal buying capacity, which played a role in the increase in GAM rates in North Darfur. The increased number of displaced people due to conflict further exacerbated the cases of wasting with more IDPs in El Fasher reporting more wasting among children under 5.
The economy of the target population relies entirely on agricultural and livestock production, while dietary diversity varies among many urban and rural communities. Millet grain, pulses and dark green vegetables are available for most of the population. Meat, fresh milk, poultry and eggs, however, are considered luxury commodi-ties. Over the past five years, livestock and poul-try keeping have precipitated threats and violent robberies. In Umkadada, for example, food is available but at a higher price due to poor crop production over the years and limited range-lands for animals, which lead to threats similar to those seen in conflict zones.
4.5.3 Impact of the health programme Although the evaluation recognizes that the UNICEF health programming goes beyond EPI and IMCI, the evaluation focuses on key health areas that contribute to reducing child mortality in North and South Darfur, within the humani-tarian context and as captured in UNICEF roll-ing work plans. Fourteen per cent of sampled households confirmed that a child under age 5 from that household had died between 2010 and 2015. More deaths were reported in 2015 compared with other years. In El Fasher, 5 per cent of sampled households confirmed a child death, in Kass, 4 per cent confirmed a child death, and in Umkadada, 2 per cent confirmed a child death. The distribution of these deaths shows that children aged 0–12 months were the ones who died in higher numbers, overall accounting for 69 per cent of all child deaths. On the other hand, children aged 0–24 months accounted for 83 per cent of all deaths.
From the routine data analysis, the affected population’s compliance with EPI services in-
Table 4: Source of household income for the internally displaced persons for households with under-five children
Source of income El Fasher (%) Umkadada (%) Kass (%) Others (%) Total (%)
Farmer 2.09 0.00 0.26 1.05 3.40
Small-scale projects 2.23 0.00 0.39 0.26 2.88
Trade 0.65 0.00 0.13 1.18 1.96
No income 17.93 0.00 12.70 4.32 34.95
Full-time employment 0.00 0.00 0.00 0.13 0.13
Casual labour 0.13 0.00 0.00 3.14 3.27
Cash transfers from organizations 0.00 0.00 0.00 0.39 0.39
Not IDPs 7.33 12.57 19.50 13.61 53.01
Total 30.37 12.57 32.98 24.08 100.00 Source: EHA 2016 Household survey
58EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
creased between 2010 and 2015 within the immunization regimes for BCG, measles, polio and pentavalent. However, there were cases of measles that were reported by community members from sample households and during focus group discussions. Regarding the utili-zation of long-lasting insecticide treated nets by children under 5, 49 per cent (n=377) slept under a treated bed net the night before the survey and 41 per cent (n=315) did not sleep under a treated bed net the night before the
survey (see Figure 25). Feedback from 85 per cent (n=282) of the sampled households shows that most children under 5 did not sleep under a bed net because they did not have one.
Reported cases of malaria among children un-der 5 was proportionate to the number of un-der-five children who had never slept under a bed net. A total of 53 per cent (n=407) of sam-ple households reported malaria cases within the past six months (see Figure 26).
0
5
10
15
20
Yes
Perc
ent o
f Chi
ldre
n
El Fasher Umkadada Kass Others
No Don’t know
17%
7%
15%
9%
13%
3%
17%
9%
1%3%
1%
5%
0
5
10
15
20
Perc
ent o
f Car
egiv
ers
18%
4%
18%
13%13%
7%
14%
8%
0%2%
1%3%
Yes
El Fasher Umkadada Kass Others
No Don’t know
Figure 25: Illustration of under-five children sleeping under a bed net
Figure 26: Responses from caregivers on whether children under 5 suffered from malaria in the past six months
Source: EHA 2016 Household Survey
Source: EHA 2016 Household Survey
59EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
4.5.4 Impact on child survival
Trend of under-five mortality in North Darfur from 2006–2014 The trend analysis of under-five mortality rates, performed using the last four nationwide house-hold surveys (MICS), reveals an increase in un-der-five mortality in North Darfur from 69 deaths per 1,000 live births in 2006–2009 to 91 deaths per 1,000 live births in 2010–2014. This is further illustrated in Figure 27.
Potential explanation of the increase in under-five mortality in North Darfur based on MICS dataAlthough in-depth research or a study is required to provide an explanation of the possible increase in under-five mortality over the last five years, possible explanations include unimproved sanita-tion facilities, queuing too long at water collection points and not being able to benefit from WFP food distribution. It also appears that the prev-alence of wasting is very high in North Darfur compared with other states.
100 95
69
90.3
1995-2000
ND-U5MR
2001-2005 2006-2009 2010-20140
20
40
60
80
100
Figure 27: Trends in the under-five mortality rate (per 1,000) in North Darfur
Source: Sudan Household Survey 2000 and MICS 2014
Source: MICS 2014
Figure 28: Prevalence of wasting – MAM and SAM (%) by state
0
5
10
15
20
25
30
Nor
th D
arfu
r
Rive
r Nile
Wes
t Dar
fur
Sout
h Ko
rdof
an
Kass
ala
Cent
ral D
arfu
r
Suda
n
Wes
t Kor
dofa
n
Sinn
ar
Sout
h Da
rfur
Gada
rif
East
Dar
fur
Nor
th K
ordo
fan
Khar
toum
Whi
te N
ile
Gezir
a
Red
Sea
Nor
ther
n
Blue
Nile
27.9
20.1 19.1 18.7 18.5 17.8 16.3 16.3 16.0 15.9 15.4 15.3 14.8 14.5 14.4 14.0 14.011.4 11.1
60EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
A trend analysis of data from the MICS (2006–2014) (see Figure 29) confirmed the deteriora-tion in health outcome indicators in North Dar-fur over the past 10 years, as captured in the following charts. The increase in the prevalence of diarrhoea was accompanied by a decrease in children’s access to oral rehydration salts for
treatment, and the decrease in the treatment of pneumonia was accompanied by an increase in the prevalence of Acute Respiratory Infec-tion. These trends are consistent with UNICEF’s weak focus on providing health facilities with medical supplies (see Figure 29).
68.4
82.6
69.473.4
65.2 65.4
39.9
55.3
43.4
65.259.5
6.1 6.410.5
66.1
24 24.2
37.328.2
24.1
11.4 1115.9
30.9
80.3
65.3
18.3
0
10
20
30
40
50
60
70
80
90
100
0
10
20
30
40
50
60
70
80
90
100
0
10
20
30
40
50
60
70
80
90
100
0
10
20
30
40
50
60
70
80
90
100
ANC once assisted by skilled staff
Assisted ANC & Birth Delivery (%) Immunization Coverage (%)
MICS 2006 MICS 2010 MICS 2014 MICS 2006 MICS 2010 MICS 2014
MICS 2006 MICS 2010 MICS 2014 MICS 2006 MICS 2010 MICS 2014
Delivery in Health Facility
Measles
Full immunization
Birth delivery assisted by skilled staff
Preval Diarrhea
Trend of Prevalence & Treatment of Child Diarrhea-Use of ORS Packet in North Darfur (%)
Trend of Prevalence & Treatment of Child Pneumonia-Use of Antibiotic in North Darfur (%)
Use of ORS Packet
Preval of ARI-Pneumonia
Antibiotic Treatment
Figure 29: Presentation of trends of childhood diseases between 2006 and 2014
Source: UNICEF
61EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Potential explanations of the increase in under-five mortality based on routine data from the Ministry of HealthTables 5 and 6 present trends in child illness at the state level between 2010 and 2014, using routine statistics compiled by the Ministry of Health. The number of malaria cases reported by health facilities decreased by 60 per cent and the number of reported deaths dropped by 53 per cent, largely due to the increased availability and use of insecticide-treated nets (available for free) and the use of the Artemisia combi-nation treatment. Antenatal care attendance, including one attendance by skilled personnel, improved from 74.3 per cent in 2010 to 79 per cent in 2014, while skilled assistance at delivery increased from 73 per cent in 2010 to 78 per cent in 2014.24
24 Ministry of Cabinet Central Bureau of Statistics, ‘Sudan Multiple Indicator Cluster Survey 2014: Key findings’, April 2015.
In South Darfur, there was a gradual reduction in the number of diarrheal cases between 2010 and 2015, from 6,796 cases to 3,467. The same trend applies to malaria and pneumonia cases as shown Table 6.
Multivariate statistical in-depth causal analysis of determinant factors of under-five mortality
Using the Statistical Package for the Social Sci-ences (SPSS) raw database of the household survey completed in the eight localities, the evaluation team performed a multivariate sta-tistical analysis to determine the factors that explain under-five child deaths over the last five years in the conflict-affected areas of North and South Darfur. This in-depth analysis intends to provide additional evidence to respond to the
Table 5: Presentation of child illness cases in North Darfur as reported by the State Ministry of Health.
Cases of child illness 2010 2011 2012 2013 2014 2015
Measles cases 32 3 15 70 16
Diarrheal cases 643 335 6,773 18,945 14,448 18,928
Malaria cases 1,992 525 6,310 8,448 6,969 10,723
Pneumonia cases 1,813 1,022 3,434 4,862 6,135 7,639
Table 6: Presentation of child illness in South Darfur as reported by the State Ministry of Health
Cases of child illness 2010 2011 2012 2013 2014 2015
Measles cases 1 4 19 5 13 5
Diarrheal cases 6,796 2,222 1,601 4,514 3,974 3,467
Malaria cases 3,259 1,301 759 2,163 3,869 2,539
Pneumonia cases 7,489 1,650 2,256 3,231 2,319 3,369
62EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
evaluation question: “What are the main causes of the increasing under-five mortality observed during the last five years based on the two MICS surveys?”
During the household survey, the head of the household has been asked to respond ‘yes’ or ‘no’ to whether a case of child death has occurred in the household during the last five years. In total, 14 per cent of the interviewed households confirmed a case of child death. The hypothesis is that the current contextual factors of household access (or no access) to basic services probably contributed to the level of risk of child death. This means that children who are living in the current situation are exposed to the same risk of death if there is no improved change that happened in their environment or life. This assumption is limited, however, due to the evolving environment of conflict and di-saster.
This causal analysis is undertaken based on the conceptual model elaborated by Mosley and Chen for the explanation of under-five mortali-ty.25 The information available in the database was limited, however. This model considers communities/systems, households and indi-vidual level determinants of child survival.
Three methods of analysis were performed: 1) the bivariate analysis of test of correlation using the chi-squared test and Cramer’s V test, which enabled the identification of relevant indepen-dent variables; 2) the analysis of multiple com-ponents, which established the associations of relations between the dependant variable (death of child recorded in the household) and
25 W. Henry Mosley et Lincoln C. Chen: ‘’An analytical framework for the study of child survival in developing countries”, Population and Development Reviews, 1984 (25-45).
independent explicative factors shown through the figure number 30 named (factorial plan); and 3) the logistic regression which determined the effective explicative factors using the odd ratios (the probability or degree of risk for a child to die taking many factors into consideration).
Analysis in Multiple Components (AMC) – factorial schematic plans of household profiles at high-risk of child deathsFigure 30 indicates two categories of household profiles at risk or at less risk of child death:
1. Profile of households at risk of child death: Over the past five years, frequent cases of child deaths occurred in the El Fasher IDP Camp in North Darfur. Those households had low monthly income of under 200 Sudanese Pounds or between 200-399 Sudanese Pounds; they did not benefit from WFP food distribution (they purchased their food at the market or re-ceived food donations from the communi-ty); they could not afford water payments; they had to queue for a long time to collect water; they lacked an improved sanitation facility (latrine); children of these house-holds did not benefit from child protection services; and children had been affected by child illnesses such as malaria and diarrhoea. This profile of households in North Darfur at risk of child death is presented on the left axis of the graph in Figure 30.
2. Profile of households at low risk of child death: These households were located in Umkadada in North Darfur, as well as Mellit, Kutum, Kabkabiya, Tawila and Saraf Omra
63EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
in rural North Darfur and Kass IDP Camp in South Darfur. Their financial situations were good (monthly income above 400 Su-danese Pounds); they benefited from WFP food distribution; they had family land and a kitchen garden as a food source; they could afford water payments; time was not spent queuing to collect water; they had access
to an improved sanitation facility (latrine); household children were benefiting from child protection services; and children had not been affected by child illnesses such as malaria and diarrhoea. This profile of a household with low risk of child death in North and South Darfur is presented on the right axis of the graph in Figure 30.
Source: Multivariate statistical analysis generated using SPSS and household survey raw data
Figure 30: Visual diagram for factorial plans of determinants of under-five child deaths
Umkadada in North Darfur
Yes water afford
Yes Latrine No Child DiarrheaNo Child Malaria
No water queueNo Child Death
Food NGOsNot Benefit CP Services200-399 SDG
Donate Community
Yes Child Death
Yes water queueAt least 600 SDG per month
Food WFP
400-599 SDG
Benefit CP Services
Kitchen GardenFamily Farm Land
KASS Camp-Comparison Locality in South Darfur
No latrineYes Child Diarrhea
Yes Child Malaria
Less than 200 SDG
1.5
1.0
0.5
0.0
-0.5
-1.0
-1.5-1.5 -1.0 -0.5 0.0
Dimension 1
HH at high risk of child death
HH at low risk of child death
Dim
ensi
on 2
0.5 1.0 1.5
Water not afford
El Fasher in North DarfurOther localities Mellit-Kutum-Kabkabiya- Tawila-Saraf Omra in North Darfur
Purchase Market
Recent Cases of Children Death in the HH
Grouping 8 Localities into 4 Comparable Zones
Household Monthly Income in SDG
Yes queue before access to water
Yes water price affordable
Yes HH has Latrine
Yes Case of Child Diarrhea
Current source of HH food supply
Yes Case of Child Malaria
Yes Beneficiary of CP Services
64EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Statistical logistic regression of determinant factors of child deaths in North DarfurThe multivariate statistical logistic regression causal analysis performed by the evaluation team identified the following high-risk determi-nant factors of child death that occurred during the past five years in North Darfur compared with South Darfur in the surveyed 764 house-holds using the odds ratios. Findings reveal that households living in Umkadada locality in North Darfur had a two-times higher risk of death (odds ratio of 2.15) than children living in other localities in North Darfur that are considered as reference for the analysis (Mellit, Kutum, Kab-kabiya, Tawila, Saraf Omra) and compared with the low risk of death (0.99) for children living in Kass Camp in South Darfur.
The inequity of household income also impact-ed the risk of child death: Households with a monthly income under 200 Sudanese Pounds had a high risk of child death (1.5) compared with children living in households earning more than 600 Sudanese Pounds per month (1.00). The time it took to collect water was also a risk factor of child death: children living in house-holds that spent a long time queuing for water collection had a two-time higher risk of death (odds ratio of 2.02) compared with children in households that do not queue to collect wa-ter. The unavailability of improved latrines for a household caused a higher risk of child death (odds ratio of 1.34) than for children living in households with improved latrines.
Households for which children did not benefit from child protection services had a 2.5-time higher risk (odds ratio of 2.52) of under-five child deaths than households for which children had access to child protection services. Regarding the impact of child illness on child deaths in North and South Darfur, malaria represented a high risk of child death: households that had reported cases of malaria among children had an odds ratio of 1.93 for child death compared with households that did not experience recent cases of malaria among children. Finally, house-holds that reported cases of diarrhoea among children were exposed to a 3 per cent greater risk of child death compared with households for which there were no cases of diarrhoea among children.
The multivariate statistical causal analysis of risk of child death provided solid evidence for child survival in the protracted emergency sit-uation in North Darfur by revealing a number of risk factors such as: i) living in Umkadada in North Darfur; ii) living in the poorest families; iii) facing long queues for collecting water; iv) lacking access to adequate sanitation facilities; v) not benefiting from access to child protection services; vi) exposure to malaria; vii) and not benefiting from WFP food distribution.
65EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Independent variables/factorsOdds ratio
risksP value
(significance)
Geographic area
�� El Fasher camp in North Darfur 0.9936 0.988
�� Umkadada in North Darfur 2.1455 0.071 (7%)
�� Kass Camp – comparison locality in South Darfur 0.9377 0.871
�� Other localities (reference) 1.0000 -
Household monthly income
�� Less than 200 Sudanese Pounds 1.4573 0.705
�� 200–399 Sudanese Pounds 0.8339 0.461
�� 400–599 Sudanese Pounds 0.59961 0.299
�� 600 Sudanese Pounds + (reference) 1.0000 -
Quantity of water drinking
�� Sufficient quantity of water (reference) 1.0000 -
�� Insufficient quantity of water 0.999 0.998
Long time in queue for collecting water
�� Yes – queue for water 2.0220 0.021 (2%)
�� No queue for water (reference) 1.0000 -
Financial payment of water
�� Yes – household is paying water 0.9993 0.998
�� Do not pay – free access to water as reference (reference) 1.0000 -
Access to improved sanitation
�� Yes – household has improved latrine as (reference) 1.0000 -
�� No – household does not have improved latrine 1.3450 0.238
Children have benefited from child protection services
�� Yes – children have benefited from child protection services (reference.) 1.0000 -
�� No – children have not benefited from child protection services 2.528 0.000 (0%)
Household children are affected by diarrhoea
�� Yes – children suffered from diarrhoea 1.0264 0.620
�� No cases of diarrhoea affecting children (reference) 1.0000 -
Household children are affected by malaria
�� Yes – children suffered from malaria 1.9256 0.009 (0%)
�� No cases of malaria affecting children (reference) 1.0000 -
Table 7: Net risk effects on child deaths of household living conditions and access to social services in North Darfur vs. South Darfur using the logistic regression statistical analysis (Stata software)
Number of observations = 715; LR Chi2 (13) = 0.0001; Pseudo R2 = 0.0736
Source: Statistical logistic regression analysis performed using the EHA household survey raw data
66EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
4.6 Sustainability
For continued sustainability, the Government of the Sudan and development partners em-barked on the long-term development of Darfur through the improvement of the Darfur Devel-opment Strategy and the Intergovernmental Authority on Development Drought Disaster Resilience and Sustainability Initiative. Howev-er, there is still weak and lack of integration of early recovery26 programming within the emer-gency phase of the crisis, which has affected the already meagre infrastructure within host communities, even though the integration of early recovery and emergencies are key pillars of the Darfur Development Strategy and the Development Drought Disaster Resilience and Sustainability Initiative.
The current aid delivery system based on blan-ket targeting of beneficiaries is unsustainable; a more systematic classification of the bene-ficiary is required. All of the newly arriving in-ternally displaced persons might be in need of life-saving assistance, but this should cover an initial period of between 3–6 months after the agreed emergency phase cycle. Subsequent programming, should examine vulnerability assessment of the affected population and ca-pacity assessment the programming based on real needs at the household level. The use of the voucher system or targeted unconditional cash will ensure that the most vulnerable population is reached.
The leakage of therapeutic foods (Plumpy’Nut), WASH supplies (water Jerry cans and soap) and
26 The UNICEF Core Commitments for Children state: “Early recovery actions in the Core Commitments for Children are actions and approaches that should be applied immediately and in parallel with immediate response.”
mosquito nets has meant that UNICEF human-itarian programming—mainly the reduction of malnutrition, malaria and diarrheal cases among affected populations—is unsustainable.
Poor participation and involvement of affected populations in programming will lead to lack of ownership and community contributions to the humanitarian programme in North Darfur. There-fore, implementing partners will be tasked with key activities on WASH operations and mainte-nance, since it is a perceived responsibility of the humanitarian agencies, thereby increasing the financial requirements for UNICEF program-ming. This weak involvement of the community was evident in the collapse of service delivery after the withdrawal of humanitarian agencies in 2009.
WES, in coordination with UNICEF has implemented a number of water pumps; most of them are not working now due to the dryness of the seasons because they mostly depend on the rains and groundwater. And another reason is that they have also broke and aren’t working any more.—Focus group discussion participant, Zam Zam Camp, North Darfur.
4.7 Lessons learned
1. Multi-sectoral interventions at both state and community levels contributed signifi-cantly to addressing the immediate needs to the affected population. This approach ensured that there was no duplication of
67EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
activities, that efforts were complementary and leveraged the various technical, logis-tic and financial capacities of organizations within the target areas.
2. UNICEF’s presence in operations and in the field, as well as the availability of human resources and emergency financing, en-sured a response within the recommend-ed 72 hours, after supporting stakeholders to develop actionable contingency plans in both North and South Darfur.
3. Investment in multi-hazard contingency planning has improved emergency services and timely responses in both slow onset emergencies (floods) and rapid onset emer-gencies that involve targeting displaced communities due to conflict.
4. The focus on humanitarian intervention in the context of protracted crisis led to weak emphasis on investment in long-term strengthening of primary health care services, water service provision and liveli-hood programming at the community level to improve resilience among the affected population.
5. Long-term, supply-based humanitarian ser-vice delivery in a protracted emergency has limitations in regards to transforming out-puts into impact in the context of recurrent insecurity due to ongoing conflict, tribal ten-sions, household poverty and vulnerability, food insecurity and poor quality of basic services. New and innovative programme strategies such as the introduction of cash transfers for income generation and comple-mentary roles of actors are required.
6. Investment by the Government of the Su-dan is key to ensuring the availability of hu-man resources for basic service provisions,
mainly the absence of primary health care services, which increases dependence on volunteers for service provision.
7. Improved preparedness of emergency re-sponses and the low cost of immunization supplies contributed to the reduction of the cost of emergency response without elimi-nating preventable diseases outbreak (e.g. the 2014 measles outbreak in North Darfur).
8. The concept of early recovery needs to be more nuanced within emergency response programmingas reflected in disaster man-agement policies. Strong progress was made in regards to capacity building for early recovery programming and outlining early recovery in UNICEF humanitarian pro-gramming, but the lack of an enabling envi-ronment has undermined the realization of this programming in practice.
9. Although UNICEF has invested significantly in humanitarian programmes in both North and South Darfur, community members did not clearly recognize UNICEF support ver-sus implementing partner support. On the one hand, this will make it easy to imple-ment an exit strategy for UNICEF; on the other hand, it will undermine the realization of UNICEF’s communications / visibility ob-jectives.
10. The enactment of South Darfur state justice policy and criminalization measures regard-ing the management of leaked humanitarian items is a good practice that should be repli-cated not only in North Darfur, but also in all major humanitarian operations in the Sudan. Branding of the relief items as a strategy for minimizing leakage is a key lesson learned from other humanitarian operations (e.g. Somalia, Kenya and Ethiopia) and should
68EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
be explored.
11. Coordination among stakeholders (i.e. the HAC, UNICEF and federal and state min-istries) at both the state and community levels is a prerequisite for timely and ef-fective humanitarian response. Clear roles and responsibilities should be captured in contingency plans to avoid confusion and duplication of programming during the hu-manitarian response.
12. Strengthening water and sanitation systems as part of a long-term development strategy ensures that the affected population has access to a sustainable water supply. Cost recovery strategies with balanced vulnera-bility mappings of the affected population on the affordability of water services should be explored further.
13. For effectiveness and efficiency monitor-ing, a good financial and programme level monitoring system needs to be in place. In addition, UNICEF’s focus on results, a system is needed to capture outputs and in-puts in respective humanitarian programme areas that the organization is supporting. The achievement of results depends on several external factors that might not be in UNICEF’s control, thus measurements of effectiveness and efficiency might be skewed.
14. UNICEF investment since October 2015 in establishing an independent third-party monitoring and verification system of ser-vice delivery through long-term agreements with a consulting firm and strengthening the human capacity of eight field offices for reg-ular field programme monitoring within the recruitment of 23 national United Nations Volunteer monitoring officers and six Na-
tional Fixed Term professional programme monitoring officers represents good prac-tice in regards to managing humanitarian action for equity and results. These ef-forts must be capitalized on through the establishment of adequate accountability management responses to the volume of information generated on bottlenecks and persistent challenges for children on the ground.
15. Strong Information management and docu-mentation of data among the stakeholders is a key factor that ensures the validity of progress indicators from various stakehold-ers who are involved in humanitarian action. The current information management and documentation system needs should be harmonized among all stakeholders, which can be done by developing a robust cluster information management and documenta-tion system.
16. The end of conflicts and the realization of a sustainable peace agreement for devel-opment are the only long-term sustainable solutions that will facilitate human well-be-ing and dignity for vulnerable children in North Darfur.
69EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
5. CONCLUSIONS AND RECOMMENDATIONS
© U
NIC
EF/U
NI1
6580
0
70EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
5. CONCLUSIONS AND RECOMENDATIONS
5.1 Conclusions
The summary of the findings on best practices (what worked) and for whom 1. UNICEF WASH, Nutrition and Health hu-
manitarian programmes are relevant and ap-propriate to the needs of targeted displaced and affected population. The programmes contributed to the Sudan Government’s poli-cies in humanitarian programming, focusing on Health, Nutrition, Water and Sanitation at sub national level (state and community).
2. In terms of coordination, UNICEF ensured that it effectively met its obligation as a clus-ter lead for WASH and Nutrition by ensuring that there were strategic engagements in planning at the North Darfur state level. This ensured that there was no duplication of activities among the humanitarian actors. UNICEF led and coordinated inter-agency needs assessment mainly for WASH, while for Nutrition there were periodic nutrition-al status assessments to inform program-ming. UNICEF led the contingency planning process, which is a key preparedness tool for the WASH and Nutrition Clusters at the state level.
3. Regarding efficiency, UNICEF demonstrated the comparative advantage of being pres-ent on the ground through the existence of a fully functional field office (staff and logistics), the pre-positioning of supplies at state level within the warehouses of line ministries and UNAMID team sites, strong
partnership with Government counterparts and existing signed agreements with NGOs/implementing partners.
4. UNICEF in 2016 strengthened its capacity for programme field monitoring at the field office (FO) level, through the establishment of Third Party Monitoring. This ensured in-dependent assessment of the effectiveness of service delivery, due diligence and im-plementation of financial risk management through HACT at state level, while capaci-ties for information management in support to sector cluster coordination was strength-ened in Khartoum. However, there is a gap in North Darfur.
5. Efficiency of the UNICEF humanitarian programme between 2010 and 2015 was achieved for vaccination and nutrition treat-ment services for acute malnutrition - re-sulting in about 85 percent achievement of the planned outputs.
6. On effectiveness, UNICEF has been able to ensure increased coverage of nutrition services for treatment of SAM over the last five years, including screening and referral of cases to nutrition services centers.
7. The effectiveness of UNICEF’s humanitarian programming in terms of ensuring a sus-tained outcome was observed in health services for preventable diseases, mainly in urban and peri-urban areas, as well as in the increased number of children admitted for the treatment of SAM.
71EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
8. Concerning impact, health programming con-tributed to the reduction of vaccine prevent-able diseases by ensuring increased immuni-zation coverage of up to 90 percent in North Darfur. Nutrition programming contributed to the stabilization of the Global Acute Malnu-trition and Severe Acute Malnutrition rates, though the malnutrition burden remains at double the 15 percent WHO emergency threshold.
The summary of the findings on challenges (what did not work – shortfall in results)1. In terms of relevance, UNICEF’s interven-
tions in the state focused mostly on IDPs, refugees and populations affected by disas-ters and did not cover the needs of host com-munities, which represents an equity gap for children living in the poorest and most vulnerable communities.
2. The inter-cluster coordination (for example, WASH and Nutrition) was found to be weak at state and community levels. Joint plan-ning for these clusters were carried out on a quarterly basis in North Darfur while in South Darfur, joint planning was implemented on a monthly basis. At the community level, there was no evidence of contingency planning processes or a joint inter-cluster implemen-tation plan in North Darfur. In addition, the situation monitoring and information man-agement is weak at state level. If strength-ened, it could potentially ensure adequate sector cluster coordination and multi-sector integrations as seen in Khartoum.
3. UNICEF was found to be efficient in supply delivery. However, partners, both Govern-ment and NGOs expressed concern about UNICEF’s delay in the finalization of part-nerships and cash disbursement, especially within the context of the agility of response
required within 72 hours after the occurrence of an emergency.
4. The leakage of humanitarian supplies due to the lack of an effective supply chain man-agement and end-user monitoring, the low coverage of basic services to all the affected areas, poor cold chain management prac-tices, and low involvement of the affected population in programming to promote own-ership, constitute high risk barriers to achieve expected outcomes and impact for children. The continuous leak of UNICEF’s plumpy nut into the local market has affected the efficiency and effectiveness of the Nutrition programme’s ability to reduce malnutrition cases in a cost effective manner. The eval-uation also recorded the leakage of WASH supply items based on the beneficiaries and partners’ comments. Part of the distributed soap, water jerry cans and tarpaulins were being sold in the local markets in North Dar-fur.
5. High administrative costs of up to 48.5 per cent (including operating cost of partnerships with NGOs) has challenged value for mon-ey and results for children within the health and nutrition programmes in North Darfur, as compared to the improved child health indi-cators in South Darfur with less investment, due to a number of factors including lower administrative costs.
6. Due to the lack of funding for capital invest-ments in new WASH facilities, the planned expectation with WASH and preventive Nu-trition programming recorded low perfor-mance, (less than 50 percent), in terms of translating the planned supply-based inputs into outputs. There is more investment in South Darfur in term of WASH programming (but WASH interventions are weak in North
72EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
Darfur) however, investment in health and nutrition are higher in North Darfur. WASH humanitarian programming between 2010 to 2015 were largely below expectations in terms of ensuring adequate coverage and sustained access to water and sanitation ser-vices both in schools and among the affected population. UNICEF staffing for the effective delivery of Nutrition and WASH in North Dar-fur was low. For instance, one international staff supported Nutrition, Health and WASH programming, resulting in poor supervision of the implementing partners.
7. Low coverage and poor quality of health ser-vices in rural areas resulted in the outbreak of measles within hard to reach communities and localities in 2014 and 2015. The poor cold chain management practices at the peri-ur-ban and rural areas affected the sustained control of vaccine preventable diseases.
8. The weak linkage between the programme management of child severe acute malnutri-tion and moderate acute malnutrition, high open defecation practices and high number of diarrhea cases and malaria, contributed to continued high prevalence of child malnutri-tion in North Darfur.
9. The humanitarian action did not show any contribution in terms of the reduction of ma-laria cases and the uptake of the use of long lasting insecticide treated nets among chil-dren under the age of five. Weak processes for the provision of quality vaccines and en-hancement systems, particularly cold chain equipment that were substandard in rural areas of North Darfur, contributed to con-cerns about the effectiveness of the vaccines being used in those areas against diseases.
The summary of the findings on the impact of Lifesaving Humanitarian Action for children1. On the impact of lifesaving Humanitarian
Action on children, persistent insecurity, high levels of wasting prevalence among under-five children in North Darfur, high prevalence of diarrhea and increasing cases of childhood illnesses, provided evidence of high mortality risk for children over the last five years.
2. Despite efforts by UNICEF to achieve sup-ply-based outputs, the increase of under-five mortality in North Darfur over the last five years (2010-2015) represents a result gap in humanitarian action to improve the situation of children in the state. Key contributing fac-tors include protracted conflicts/insecurity, weak health systems and inadequate adop-tion of family practices for child care. The current strategies and narrow scale emer-gency focused supply-based investment from Government, UNICEF and partners are inadequate to ensure tangible life-sav-ing impact for children because of the sheer magnitude of displacements, food insecuri-ty, child morbidity caused by persistent con-flicts, increased child malnutrition, outbreak of diarrhea (due to poor hygiene practices), pneumonia, drought or other public health-re-lated hazard.
3. Concerning sustainability, due to limited human and financial resource capacity of UNICEF, inadequate technical capacity of im-plementing partners to effectively ensure the delivery of quality services to the affected population, declining donor funding and the poor involvement of the affected population, UNICEF’s current humanitarian actions with-in the protracted emergency crisis (13 years) in North Darfur, are not sustainable.
73EVALUATION OF HUMANITARIAN ACTION: CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
5.2 Recommendations for UNICEF
1. The current administrative cost of up to 48.5 percent is on the high side and UNICEF should institute innovative strategies of part-nerships in order to minimize the administra-tive/ overheads costs.
2. Institute an independent audit to examine and document the extent of the leakage of plumpy nut, water jerry can and soap, and UNICEF must take immediate measures closely with the Government to eliminate the leakage of supplies and commodities in order to increase the effects of outcomes for children.
3. Strengthen and extend the supply chain management system beyond the state lev-el by ensuring the delivery of commodity to beneficiaries at community and locality level complemented with an effective recording and documentation system.
a. UNICEF needs to explore the engage-ment with private shop owners as av-enues for distribution of therapeutic plumpy nut, mainly in the hard to reach areas where the shops are the first point of reference for assistance at the com-munity level.
b. Branding and visibility of relief items mainly water jerry cans and plumpy nut should be explored to minimize the leak-age of such items.
c. c. As noted in South Darfur where there is an elaborate policy framework in han-dling humanitarian leakage, UNICEF should lobby North Darfur state Govern-ment and the national Government to enact policies criminalizing the sale of therapeutic relief items.
4. Promote a multi-sector integrated package of
interventions at the community level start-ing from the programme planning stage. UNICEF should promote equity in delivering basic services (Health, Nutrition and WASH) to affected populations and host communi-ties.
5. Revise the supply-based strategy focus of humanitarian actions and explore the intro-duction of cash-based programming (safety nets) and the strengthening of social protec-tion systems, in order to enable the affected population effective use of Health, Water and Nutritional Services and assure the sustain-ability of gains of results. UNICEF must also clearly outline its roles of evidence-based policy advocacy to leverage adequate Gov-ernment investments to scale up the equita-ble coverage/access and the quality of social services.
6. Strengthen the State Ministry of Health’s capacity to ensure effective and efficient management of vaccine cold chain at the locality level in order to secure the preventive strategy.
7. Strengthen the capacities of communities to ensure the maintenance and sustainability of basic services with a clear capacity building strategy.
8. Strengthen the primary health preventive and care systems through adequate techni-cal and financial support to scaling up MNCH and IMCI, which could contribute to improv-ing the quality and demand of health services and reduce child morbidity and deaths – be-yond humanitarian or emergency response.
9. Enhance inter-sector/cluster coordination within UNICEF, mainly at implementation lev-el, focusing on the community/locality level. UNICEF should also strengthen the situation monitoring and information management at
74EVALUATION OF HUMANITARIAN ACTION:
CHILD SURVIVAL IN NORTH DARFUR, SUDAN 2010-2015
state level to better prioritise the agility of response to emerging vulnerable situations.
10. Strengthen Communication for Develop-ment in order to address the magnitude of inadequate practices of sanitations and hy-giene; UNICEF should sensitize the affect-ed population, specifically the mothers and caregivers on not referring to plumpy nuts as “Biscuit”, but as a therapeutic product for treating Severe Acute Malnutrition.
11. Strengthen the documentation and infor-mation management within UNICEF key Sections.
5.3 Recommendations to the Government of the Sudan
1. The Government should accelerate the re-cruitment of medical doctors or clinical of-ficers for community level health facilities.
2. The federal and state ministries of health should improve the health early warning system for North Darfur to reduce disease detection time and establish robust analysis mechanisms.
3. The federal and state ministries of health should assess and improve on cold chain management in North Darfur.
4. State Government officials should establish legislation that criminalizes the sale of hu-manitarian supplies and commodities, partic-ularly those used for the therapeutic needs of children (i.e. Plumpy’Nut) using the best legal practices in place in South Darfur.
5. The federal and state ministries of health should explore ways of improving the access of humanitarian agencies to vulnerable popu-lations, mainly for hard-to-reach areas where humanitarian needs are high.
6. The Government and all other parties to con-flict should continue with ongoing efforts to end conflicts, establish a final peace agree-ment for the restoration of hope for human well-being and dignity of the deprived popu-lation and vulnerable children of North Darfur, and break down the vicious cycle of violence.
7. The federal and state governments, as well as other stakeholders, including UNICEF, should develop a mechanism for the establishment of a safe corridor for the delivery of human-itarian services and goods to the affected population in crisis-prone regions and areas.
5.4. Recommendations to partners
1. The achievement of the 2030 transformative agenda for sustainable development in the Sudan (“no one left behind prosperity; dignity and access to basic human needs”) requires an increase in financial investments in scaling up multi-sector interventions. Donors should reverse the decline in financial assistance to humanitarian action in the Sudan to avoid any additional loss of children’s lives, as observed over the last five years in North Darfur, for reasons such as child malnutrition and pre-ventable diseases.
2. The establishment of durable solutions to en-sure sustainable gains in the context of pro-tracted emergency represent the new direc-tion of strategic reflection and investments by partners in ensuring work across the human-itarian to development continuum (building resilience, recovery and development).
3. Donor support for ending conflicts and achieving the peace agreement in the Su-dan represents the ultimate hope for the vul-nerable population affected by a protracted 13-year conflict, which has led to external emigration and persistent violence.