Adra mongolia cfgb frp evaluation report 2010

ADRA MONGOLIA FOOD SECURITY PROGRAM “HOUSEHOLD GARDENING INITIATIVE PROJECT” Page 1

EXTERNAL EVALUATION REPORT “Household Gardening Initiative” project

FOOD SECURITY PROGRAM Bayankhongor province, Mongolia

2005 - 2010

Tuvshinjargal Perenlei ASM Consulting Company

9/15/2010

ADRA MONGOLIA FOOD SECURITY PROGRAM “HOUSEHOLD GARDENING INITIATIVE PROJECT”

Page | 2

Table of Contents 1. Acknowledgements ............................................................................................................................................. 3

2. Executive summary ............................................................................................................................................. 4

3. Introduction .............................................................................................................................................................. 4

Geographical setting……………………………………………………………………………………………………… 4-5 Project background .................................................................................................................................................. 5 ADRA Mongolia ……………………………………………………………………………………………………………..5-6 Project description ................................................................................................................................................... 6 Purpose of the project evaluation……………………………………………………………………………………6-7

4. Methodology ...................................................................................................................................................... 7

Tool .................................................................................................................................................... 7 Sampling ................................................................................................................................................................... 7-8 Data collection and analysis ................................................................................................................................. 8

5. Framework for analysis ............................................................................................................................... 9

6. Project evaluation .......................................................................................................................................... 9

Project purpose ........................................................................................................................................... 9 Target group, direct and indirect beneficiaries .................................................................................. 10-11 Project objectives and outcomes .................................................................................................................... 11 Food availability: Improved access to vegetables for the poor households in the four soums and the

provincial capital ................................................................................................................................... .11-15

Food access: Diversification of household income sources through selling vegetables ……….……......15-18 Use of Food: Diversification agricultural products including vegetables, grains and berries………..19-20 Asset creation: Target families were assisted to retain and develop assets to run small scale farming

and water management techniques ..................................................................................................................... 20-23 Matrix .................................................................................................................................................................. 24-25

7. Findings ........................................................................................................................................................... 26

8. Recommendations ............................................................................................................................... 27-29

Project planning .............................................................................................................................................. 27 Risk mitigation ................................................................................................................................................. 27 Project intervention ................................................................................................................................ 27-29

9. Conclusion ...................................................................................................................................................... 29

10. List of Tables ...................................................................................................................... 30


Page | 3

1. Acknowledgements Taking this opportunity, we would like to thank those, especially the field project officers including agronomists and project staff who were so helpful to collect all necessary data for the project external evaluators. Also, sincere thanks go to all the survey participants who welcomed us and provided valuable insights for the project evaluation.

• Data collection: Tuvshinjargal. P • Quantitative analysis: Tuvshinjargal. P and Gantsetseg. A • Qualitative analysis: Tuvshinjargal . P and Amarmurun. A • Report written by: Tuvshinjargal. P • Report Author: Tsolmon. D

The ASM’s evaluation team also acknowledges the support of the Food Security Program “Household Gardening Initiative” project team of ADRA Mongolia for providing endless support and patience in finding key information and opening the doors to meet with a wide-range of key informants and participants. .

• ADRA Mongolia Food Security Program Coordinator: Tilyeubyek Yeltai • ADRA Mongolia Food Security Program Manager: Mendbaatar. O • ADRA Mongolia Food Security Program officer: Uranchimeg. Lh • ADRA Mongolia Food Security Program officer: Dorjsuren. Kh

The findings, interpretations, and conclusions expressed in this report are entirely those of the authors. Every effort was made to ensure the accuracy and validity of the findings and conclusions contained in this report. However, errors and gaps in the analysis are possible. We take responsibility for any and all such omissions or inaccuracies. Any comments, questions or clarifications should be directed to Tuvshinjargal Perenlei, [email protected]


Page | 4

2. Executive summary

Programme/ Project:

Food Security Program “Household Gardening Initiative” project in Bayanknongor province, Mongolia. Within the framework of the project, the following soums were targeted;

- Bogd soum - Jinst soum - Galuut soum - Ulziit soum - Bayankhongor soum

Programme/Project phase: Phase I (2005-2007) and Phase II (2008-2010) Evaluation purpose: Implement the project evaluation to measure achievements of

the following main goals; I. Alternative food sources

II. Rebuild livelihood Evaluation date: Aug 20- Sep 2, 2010: Data collection

Sep 6- Sep 10, 2010: Qualitative and Quantitative data analysis Sep 12 – Sep 15, 2010: Draft report Sep 16, 2010: Final report

3. Introduction

Geographical setting Bayankhongor province (aimag) is situated approximately 630 km west of Ulaanbaatar. The terrain in Bayankhongor ranges in altitude from 990 to 1,926 meters above sea level, and has two distinct ecosystems and climates. The northern half of the province consists of mountain ranges suitable for yak herding, with extreme temperature fluctuations over the course of the year. In the south, the Gobi desert, consisting primarily of semi-arid steppe and arid plains, with high winds, and barren, rocky land is suitable for camel and goats. Average daytime temperatures range from –30C to 35C. Total annual precipitation averages 95-210 mm, with 90% of this occurring in the summer and autumn. The area is too arid for field crop and there is almost no history on crop production so most of the population depends on herding for their livelihood.

The province has a population of 83,800, of which 24,0001

1 Annual Report 2009 “Greater Resilience to Disaster Producing Element through Extending Food Security to the Poorest” ADRA Mongolia

live in the capital of Bayankhongor province. The rural area is divided into 20 administrative units called soums (districts). The


Page | 5

soums have an average population of approximate 2,500, with a majority of those scattered across the countryside tending their herds. Each soum has an administrative center with a hospital, school and other government services. Business is very limited, and most of those who are employed work in the government. The Bayankhongor province is considered one of poorest provinces in Mongolia and the poverty rate is approximately 45%2

Project background

. However, the territory of Bayankhongor is very rich with natural resources including gold and coals.

In 1999 – 2002 the time of reckoning arrived for the Bayankhongor province. Droughts in the summer of 1999 – 2002 resulted in low vegetative growth. Livestock had inadequate pasture to gain weight, and were in poor condition as they entered the long winter. The drought also meant that no fodder was prepared, though small herders normally do not prepare hay anyway. Then in September, the first of 24 snowstorms struck and sealed the fate of a large number of livestock, destroying the livelihood of thousands of small herders. Over the course of the winter, livestock died from starvation, dehydration, and exposure. As a result of the Dzud3

ADRA Mongolia, in partnership with Canadian Foodgrain Bank and ADRA Canada, was initiated to implement the Food Security project in Bayankhongor province, Mongolia from 2005 to 2010 with 2 phases.

, many households lost its coping mechanisms and livelihood. By the spring of 2000 many herders who lost their livestock migrated to the soum centres, which normally have a population of approximately 500 – 600 permanent residents. With no job opportunities and lacking well developed skills, these people face chronic unemployment or migration to urban areas already experiencing high unemployment. Those herders who still have livestock will have to slaughter some to meet essential expenses. For many, the coping mechanisms include eating one meal a day or having a very poor diet.

ADRA Mongolia ADRA Mongolia is one of the largest humanitarian relief and development agencies in Mongolia. It has implemented various development and relief programs within communities in the fields of food security, disaster management, economic development, health, education, and community organization.

ADRA Mongolia works with people in poverty and distress to create just and positive changes through empowering partnership and responsible action.

2 Poverty Map, UNDP and NSO, 2009 3 “Dzud” is a Mongolian term for an extremely cold winter in which livestock are unable to find fodder the snow or ice cover, and large numbers of animals die due to starvation and the cold.


Page | 6

In order to achieve lasting change in the communities, ADRA Mongolia is making food security one of the major objectives of its long-term program. According to the World Bank, “Food security is achieved when all people at all times have both physical and economic access to sufficient food to meet their daily needs for an active and healthy life.” ADRA Mongolia’s program focuses on the following four components necessary to achieve food security:

• Production and Availability of Food: Food is produced by households themselves or is obtainable in local markets ensuring an adequate supply throughout the year. Key themes are agriculture production and functioning markets.

• Access to Food: Households are able to purchase their food needs. Key themes are income generation and micro-enterprise development in order to have cash to purchase food.

• Use of Food: Food is stored, prepared and consumed in a sanitary, nutritionally balanced

and equitable manner within a household. Key themes are water and sanitation, and food within a household.

• Asset Creation: Households have resources and reserves they can rely on in times of emergency. Key themes are savings and investments, and appropriate assets.

Project description In the framework of The Food Security Program of ADRA Mongolia a “Household Gardening Initiative” project has been implemented in Bayankhongor province from 2005 to 2010 with 2 phases. This project is funded by Canadian Foodgrains Bank (CFGB). The project’s ultimate target is poor households, especially former herders who lost their livestock which were their main income source and livelihood during natural disaster “Dzud”. The overall intention of the project is to support the efforts of households and communities to feed themselves for the long-term through effective involvement of the gardening activities. The project has targeted the most affected 5 soums in Bayankhongor province by Dzud such as 1) Bayankhongor soum 2) Bodg soum 3) Galuut soum 4) Jinst soum and 5)Ulzit soum.

Purpose of the project evaluation The purpose of the evaluation for Food Security Program, particularly, Household Garden Initiative project which has been implemented in Bayankhongor provice from 2005 to 2010 is to measure achievements of the project objectives. In order to achieve the purpose, the following objectives were set:


Page | 7

To evaluate access to vegetables for the poor households in the four soums and the provincial capital.

To assess diversification of household income sources through selling vegetables To evaluate improved household food economy through diversified food sources To evaluate diversified agricultural produce including vegetables, grains and berries To assess target families assisted to retain and develop assets to run small scale farming and

water management techniques 4. Methodology

Tool Four data collection tools were designed to gather both project beneficiary and community-level data. Household survey: Focus Group Discussion (FGD): Key Information Interviews (KIIs): Secondary data: Project documents’ review Sampling The sample size was calculated using the following equation: n = deff(Z/standard error)² (p) (1-p) The design effect (deff) was estimated at 1.25. The value of Z was fixed at 1.96 (corresponding to 97.5% power) while a standard error of 8 percent was used. Household survey data was collected, cleaned and analyzed using the Statistical Package for Social Scientists (SPSS). The results were presented in the report as frequencies, proportions Of the 155 target households out of the 600 target households that participated in the survey Table 1 of which 36.8% were men and 63.2% were women Table 2 in order to collect all necessary data to evaluate the project including achievement of goals and objectives, selection of the target beneficiaries according to the criteria, sustainability and further recommendation etc. As illustrated in Figure 3 and Table 3. 63.2% survey participants were head of households.

Table 1: Soum name and # of beneficiaries of the project 1 bag 2 bag 3 bag 4 bag 5 bag 6 bag 7 bag 8 bag 9 bag Total Bayankhongor 1 14 15 12 19 9 11 22 7 110 Galuut 0 1 0 3 0 10 1 0 0 15


Page | 8

Ulziit 4 6 0 0 0 4 0 0 0 14 Jinst 0 2 0 0 6 0 0 0 0 8 Bogd 1 0 1 0 0 6 0 0 0 8 Total 6 23 16 15 25 29 12 22 7 155

Table 2: Gender Frequency Percent Valid Male 57 36.8

Female 98 63.2 Total 155 100.0

Table 3: Head of household Frequency Percent Valid Yes 97 62.6

No 58 37.4 Total 155 100.0

Data collection and analysis 1. Aug 17 – Aug 19, 2010, researchers did desk reviews on the

project documents including project concept paper, reports, action plan, distribution lists and on – going monitoring reports and developed a questionnaire to be asked of the beneficiaries.

2. From Aug 20 to Sep 2, researcher collected qualitative and quantitative data from the project beneficiaries, and shop owners in the target soums, Bayankhongor province

3. Sep 5 to Sep 10, researchers did data analysis 4. Sep 12 – Sep 15, The Report was written and submitted by

researchers to the ADRA Mongolia.

Male 37%

Female 63%

Figure 1: Gender

Yes 63%

No 37%

Figure 3 : Head of Household


Page | 9

5. Framework for analysis

Within the framework of the Food Security program, particularly, “Household gardening initiative project which has been implemented in Bayankhongor province between 2005 and 2010, the evaluation focused on measurement of the above 5 main objectives of the food security concept. Food availability depends on local production systems (agricultural, pastoral or fisheries) which products are possible to grow and which products can be found in the local market. Thus, a household’s proximity to centers of production and supply are important availability factors, as well as how it is influenced by market forces. Access is the ability to acquire food that exists in the market or the ability to grow crops (through the purchase of inputs and management of the crop) or livestock. Thus, access can be production based (crop and livestock production) or labour based (wage labour and professionals that generate income to purchase food) Access to food can be also based on trade (trading products for food). When households do not have adequate availability and access to food, their food security is threatened. Households can become food insecure when they experience a significant reduction in or disruption to their major resource of food and are unable to substitute other resources to make up the difference. This can happen when for example crops fail due to drought or livestock herds die off due to natural disaster such as “Dzud”. Food Security also can be threatened when market conditions change, resulting in food price increases that force a household to adjust the types and amounts of its food purchases. When availability and access factors change, households must make adjustments to maintain their current level of food security. These adjustments are often referred to as coping strategies, and an analysis of coping strategies and livelihood factors can help in understanding the current food security status of a household. The data collected from household beneficiaries’ interviews and focus group discussions are based on availability and access indicators along with indicators of household resiliency. Availability indicators include food resource and diet quality 6. Project Evaluation Project purpose


Page | 10

Improve food and income security amongst poor rural residents of Bayankhongor province, western Mongolia Target group, direct and indirect beneficiaries

The project team coordinated with local government and community leaders to select the most needy 600 households for the “Household Gardening Initiative” project. Following are the main criteria that were used to select the beneficiary families:

• Families affected by “Dzud” and who have lost their livestock, or had less than 1004

• Poor families whose monthly income did not exceed more than 120,000 MNT livestock

5. Average family size 4.6 members, so, per person a monthly income will be 26,087MNT and each person’s daily income will be 870MNT(US$0.65)6

• Families who have access to land, manpower and an interest in gardening .

• Vulnerable families with disability, single parents and elderly.

The project team has set the right criteria to select the beneficiary families for the project. If a person lives on less than US$ 2 a day they will be considered poor. The primary cause of poverty in Bayankhongor province is a lack of employment or job opportunity and is exacerbated by severe weather conditions. Table 4 shows that 45% of surveyed beneficiaries were unemployed.

Table 5 shows that 75% of surveyed beneficiaries have never grown any vegetable before the “Household Gardening Initiative” project. Table 6 shows that one of the main income sources for surveyed beneficiaries was crop production. 66.2% of target beneficiaries’ income depended very much on vegetables they harvest. 21.6% of surveyed beneficiaries’ life is depended on assistance from their friends and relatives.

4 According to UN estimates, herder families with fewer than 200 animals cannot generate income enough to cover their basic household needs 5 MNT = Mongolian Tugrik. Exchange rate at time of survey. 1,330MNT= 1USD 6 The latest data available for the Mongolian Poverty Line is US$0.73 per capita per day (FAO/UNICEF/ UNDP April 2007)

12%

24%

3% 8% 6%

44%

3% Figure 4: Employment Herder

Pension

Self employed

Government organization Company

Unemployed

Student

Table 4: Employment Frequency Percent Valid Herder 18 11.6

Pension 38 24.5 Self employed 4 2.6 Government organization 12 7.7

Company 10 6.5 Unemployed 69 44.5 Student 4 2.6 Total 155 100.0


Page | 11

The above tables indicate that the project’s beneficiaries met the project selection criteria. Table 7 shows that there were 600 direct and 2,746 indirect beneficiaries who have been benefited from the project. Table 7: Direct and Indirect beneficiaries of the project

No Soum name Number of households

Number of direct and indirect beneficiaries Number of disabled people

Single headed

households Total Male Female Children 1 Bayankongor 400 1886 498 554 834 43 123 2 Bodg 50 216 43 47 126 10 12 3 Galuut 50 207 36 59 112 9 22 4 Jinst 50 239 62 67 91 5 14 5 Ulziit 50 198 54 55 89 4 16

Total 600 2746 693 782 1252 71 187 Project objectives/outcomes: • Food availability Food is produced by households themselves or is obtainable in local markets ensuring an adequate supply throughout the year. Key themes are agriculture production and functioning markets. 1. Improved access to vegetables for the poor households in the four soums and the

provincial capital

Table 6: Main income sources Frequency Percent Salary, pension, government allowance 94 63.5%

Illegal gold digging 39 26.4% Animals 40 27.0% Vegetable 98 66.2% Others including assistance from relatives and friends 32 21.6%

Total 148 100.0%

Table 5: Vegetable gardening experience Frequency Percent Valid Yes 35 22.6

No 117 75.5 Total 152 98.1

Missing System 3 1.9 Total 155 100.0


Page | 12

Activities/Inputs For the activities related to the training series program and gardening, please see below for details: Within the framework of the project, 600 households were trained concerning the following topics: • The importance of food and proper

nutrition; • How to use available space

economically, in a backyard (hasha); • How to run a small farm successfully; • Importance of growing your own

vegetable garden; • Importance of soil and climatic factors

on vegetables; • Field and seed bed (hotbed)

preparation; • Measures to protect vegetables from

natural catastrophes;

• Vegetables needing special attention • Growing vegetables in green houses; • How to determine maturity in

vegetables; • Harvesting methods for different

vegetables; • Methods of preserving vegetables; • Vegetable processing; • Recent or latest methods in vegetable

technology; • Seed production for some vegetables

Table 8 shows that 90.8% of surveyed beneficiaries said that their food types and amounts

have increased favorably after planting a garden.

Table 8: Food types and amounts increase Frequency Percent Valid Percent

Valid Increased very well 51 32.9 33.8 Increased well 86 55.5 57.0 Normal 12 7.7 7.9 Do not know 2 1.3 1.3 Total 151 97.4 100.0

Missing System 4 2.6 Total 155 100.0

Table 9 shows that 70% (109) of surveyed households consume their harvest for

approximately 6 - 8 months. However, during the interviews and group discussions, some of surveyed beneficiaries expressed that they consume 50% of their harvest and sell the remaining 50% or exchange it for animals.

Table 9: Duration of vegetable consumption

1-3

Month 1-6

Month 1-9

Moth 1-12

Month Other Total

Potatoes 34 62 31 16 2 145 Cabbages 27 50 25 16 2 120 Carrots 25 52 28 15 2 122 Turnips 26 55 28 15 2 126 Beet root 20 34 22 14 2 92


Table 10 and Figure 5 show that households consume mostly potatoes, onions, carrots, turnips, and cabbage over 6 months because they express that they are able to grow and like those vegetables especially potatoes very much. Also, these vegetables are able to be kept longer without much deterioration.

Table 11 and Figure 6 show that 56.7% of surveyed households plant their vegetables in the community plots and 38% in their hashaa (back yard). Most of beneficiaries who have been participating in the project more than 3 years plant at the community plots with larger scale. The beneficiaries who have been involved in the gardening for 5 - 6 years consume their vegetables over 12 months. There are seasonal factors to be considered during the evaluation and almost all beneficiaries had not had any storage, and vegetables were not usually preserved due to lack of storage. Thus, the project team was able to raise additional funding for small scale storage. Now, 52% of all surveyed target

0 10 20 30 40 50 60 70

1-3 Month

1-6 Month

1-9 Moth

1-12 Month

Other

Figure 5: Vegetable consumption and duration

Others Tomatoes Cucumbers Onions Beet root Turnips Carrots Cabbages Potatoes

Onions 32 58 28 15 2 135 Cucumbers 11 21 13 11 2 58 Tomatoes 6 14 10 8 2 40 Others 5 8 2 3 1 19

Total 35 62 31 16 2 146

Table 10: Most consumed vegetable in a daily consumption

Frequency Percent Potatoes 151 99.3% Cabbages 125 82.2% Carrots 125 82.2% Turnips 130 85.5% Beet root 94 61.8% Onions 140 92.1% Cucumbers 58 38.2% Tomatoes 40 26.3% Others (leafy) 10 6.6%

Total 152


households were able to own small storage facilities both underground and containerized home storage. This improved condition for having storage to allow beneficiaries to store their vegetable and food to consume it over time. Also, food, including vegetable storage is important to overcome seasonal fluctuations and to preserve seeds until the next planting season as well as to extend vegetable consumption up to between 9 and 12 months and also generate income through selling the vegetables during the entire year. It may be a viable strategy for improving locally available vegetables.

Table 11: Backyard plot and Community plot and numbers of years in the project # of years in the project Hashaa Community plot Other Total

1 year Count 7 9 1 17 % 41.2% 52.9% 5.9% 100.0%

2 year Count 38 34 5 77 % 49.4% 44.2% 6.5% 100.0%

3 year Count 4 21 1 26 % 15.4% 80.8% 3.8% 100.0%

4 year Count 5 10 0 15 % 33.3% 66.7% .0% 100.0%

5 year Count 3 8 0 11 % 27.3% 72.7% .0% 100.0%

6 year Count 0 3 1 4 % .0% 75.0% 25.0% 100.0%

Total Count 57 85 8 150 % 38.0% 56.7% 5.3% 100.0%

My family consumes our bottled cucumbers and tomatoes for nine month until Tsagaan sar in February. *** Vegetable preservation including bottling skill enables beneficiaries to consume their vegetables for longer periods of time.

0

5

10

15

20

25

30

35

40

1 year 2 year 3 year 4 year 5 year 6 year

Figure 6: Vegetable gardening plots

Hashaa

Community plot

Other


Table 5 shows that 76% of all surveyed households were able to learn totally new skills for vegetable planting, preservation and usage.

Table 10 shows that 100% of surveyed households were able to grow at least 10 different vegetables for their daily food consumption.

Food distribution: 600 targeted poor households have received 50 kg of flour, 25 kg of rice and 1 l of vegetable oil. This provided enough food for these families’ daily needs to enable them to complete the initial difficult tasks associated with starting a garden.

Food availability at the local market: Most goods in shops are obtained from vendors who bring products from Ulaanbaatar and sometimes from China directly. There are many types of foods available at the local market but, food safety (out-dated food, spoilage in transit, and inadequate storage) is an issue. Local shop owners and surveyed participants. *** Most vegetables are transported from Ulaanbaatar to sell at the local market. So, if beneficiaries are able to produce large quantity of vegetables to sell, there will be plenty of market opportunity to make a profit and able to supply the local market. At least 600 poor households in Bayankhongor province are able to grow their vegetable in order to improve their food shortage and able to create sustainable food availability for their families and local markets. Skills they obtained about vegetable farming will last long to improve their livelihood through their hard work and effort.

• Food access Households are able to purchase their food needs. Key themes are income generation and micro-enterprise development in order to have cash to purchase food.

2. Diversification of household income sources through selling vegetables 3. Improved household food economy through diversified food sources.

Activities/ Inputs • Create market opportunity to sell vegetables through harvest celebration days. This will

give the farmers an opportunity to exchange the best practices and successes among the project beneficiaries and local communities.

Household income Table 12 shows that the most common primary source of income for surveyed households is vegetable gardening (66.2%) and fixed income such as pension, salary and disability allowance (63.5%). 99% of surveyed beneficiaries expressed that growing vegetables help the household to save money for the purchase of food. This is important since they have little or no cash available most of the time. 45% of surveyed beneficiaries were unemployed; the provincial unemployment rate is 40%.


Table 12: Income source. Frequency Percent Salary, pension, allowance 94 63.5% Gold digging 39 26.4% Livestock 40 27.0% Vegetable farming 98 66.2% Others ( families assistance) 32 21.6% Total 148

Household expenditures As expected, food constitutes the largest monthly expenditure for the majority (68%) of surveyed households. The second highest expenditure was education, followed by fuel and health. During the survey, target beneficiaries were asked if they had sold their livestock or any other asset in order to improve the household’s food supply. Table 13 shows that 90% of surveyed households answered no and 10% of households answered “yes”. 10% of the households who answered “yes”, they actually spent their money not for improvement of their household’s food supply but, primarily for their children’s higher education (43.3%) such as for college tuition fees, and household improvement such as purchase a new Ger 7

(26.7%).

Table 13: Have you sold your livestock to improve your household’s food supply if yes, how did you spend your money

Food Education Health House improvement Clothes Total Frequency Percent Frequency Percent Frequency Percent Frequency Percent Frequency Percent

Yes 3 10.0% 13 43.3% 3 10.0% 8 26.7% 4 13.3% 30 Total 3 13 3 8 4 30

Food diversity is an important indicator of household food security and provides information on both access and availability of food. Table 12 indicates that vegetable gardening became an income and food source for the target households

During the field work evaluation, in response to the question of how to improve household income, 92.6% of surveyed target households indicated they would undertake vegetable gardening in addition to gold digging.

As an agricultural consultant, this unexpected response in an area which has no historic evidence of crop production, proves that this project has been implemented successfully in Bayankhongor.

Bayankhongor province is rich with gold and most communities are involved in illegal and small gold digging activity to generate income. It was expected that beneficiaries would favor gold digging, since gold is easily converted into cash but as beneficiaries responded in favor of 7 Ger is the Mongolian traditional house made by wooden frame and covered by felt and cotton which is suitable for nomadic life style and most residents and herders in country side live in the ger


vegetable gardening as a preferred extra source of income this is evident enough that the project has met the expected criteria.

Table 14: In order to improve your household’s income what steps can you take to change your household income Frequency Percent Plant vegetable 137 92.6% Gold digging 36 24.3% Herd livestock 25 16.9% Seek an employment opportunity 28 18.9% Micro enterprise 26 17.6% Other 1 0.7% Total 148

In the frame of the project “Household Gardening Initiative”, 600 targeted households were able to harvest substantial amounts of vegetables which were able to be consumed for a minimum of 6 months as well as become one of their main sources of income through sale or barter for animals. Table 15 shows that per target household’s average harvest is approx 468 kg which is

equivalent to 702,000MNT8

44.1% of surveyed households sell 50% of their harvest or exchange it for animals.

(US$527.82) and the average monthly household income increased by 46% (55,000 MNT which is US$41.3).

Table 15: Harvest per household (kg)

I sell a track of hay for 45,000 MNT or exchange it for 1 goat. Man, Ulziit soum Exchange 1 sack of potatoes for one goat or sheep. I exchanged my 11 sacks of potatoes for 11 animals including goats and sheep during the last 3 years. Female beneficiary, Bayankhongor soum

8 MNT = Mongolian Tugrik. Exchange rate at time of survey. 1,330MNT= 1USD

- 100.00 200.00 300.00 400.00 500.00 600.00

2007 2008 2009

Total harvest per household

Total harvest per household


Since the Household Gardening initiative project, target households were able to diversify their income through gardening and vegetable production sales. They were also able to improve food diversity through exchanging their vegetables for animals. Mongolian households’ main food is meat and flour but, the households diversified these with vegetables and income sources. Before the project, beneficiaries were highly dependent on cash income for food purchases, but, now beneficiaries are able to diversify their income sources by gardening as well as having small numbers of livestock that they purchased or exchanged their vegetables for animals. Overall, some of the more successful beneficiaries were able to make a profit from selling vegetables and all beneficiaries were able to diversify and improve their diet with nutritious vegetables. Former herders who are beneficiaries of the project had their main income source from livestock and had zero skill in gardening. During the interview process, many former or poor herders expressed their happiness that they are having this unique opportunity to learn new skills in gardening and are able to have a totally new diet and eat their meals with different vegetables which were not part of their daily food consumption. At least 99% of target households were able to increase one or more new sources of

income by growing vegetables. The second most common income source is salary, pension and any government allowance (Table 12) and virtually, all surveyed beneficiaries depend on cash income to meet their food. However, because of the gardening project, beneficiaries now have less at risk to have access to food.

We start to eat our vegetable in July. By that time, salads leafy, and reddish were ready for consumption. At least 3 months from Sep to Nov, we do not spend any cash to purchase vegetables. Women of Bayankhongor soum. We sell our vegetables to get cash or exchange it for animals to have our own small herd or for meat. Table 16 shows that 11.8% of surveyed beneficiaries consume all their vegetables, they do not sell or exchange it, and 88.2% of surveyed beneficiaries sell and exchange 50% of their vegetables.

Table 16: What do you do with your harvest Frequency Valid Percent

Valid 100% sell 12 70.6 but 50% for their food, 50% for sell 3 17.6 100% not sell at all 2 11.8 Total 17 100.0

Missing System 138 Total 155


• Use of Food Food is stored, prepared and consumed in a sanitary, nutritionally balanced and equitable manner within a household. Key themes are water and sanitation, and food within a household. 4. Diversified agricultural products including vegetables, grains and berries

Activities/Inputs • The importance of food and proper nutrition; • How to store vegetables; • Methods of preserving vegetables; • Vegetable processing and cooking

Within the framework of the project “House Gardening Initiative” various training on vegetable preservation including bottling and cooking without losing valuable vitamins etc.., each beneficiary was able to be trained in vegetable preservation and processing. Due to that 99% of the beneficiaries are able to preserve their vegetables including cucumbers and tomatoes and salad bottling. During the field visit, beneficiaries, especially women were proudly showing their bottled vegetables and were excited to share and instruct how to bottle their vegetables etc. Table 17 shows that potatoes, carrots, beet roots and cucumbers harvest yields have been

increased in 2009 compared with the previous year and more than 10 different vegetable were planted.

Table 18 shows that per target household’s average harvest yields have increased by 120 kg in 2009.

Table 17: Harvest by vegetable (tn)

Table 18: Harvest by per household

0 50 100 150

Potatoes Cabbage

Turnip Carrot

Beet root Onion

Cucumber Tomato

Barley Other (beans, spinach

1 2

3 4

5 6

7 8

9 10

2009

2008

2007


Table 18 and Annual reports9

of the project indicate that the harvest per household increases from 233 kg to 547 kg between 2005 and 2009. It is important to recognize the increase in yield among the beneficiaries during the project life span. However, in 2008, surveyed beneficiaries’ harvest was declined slightly because of incidences of early frost in July, 2008.

A major lesson learnt is that circumstances beyond the control of the project or the communities (e.g. early frost, droughts and floods) may lead to failure of some livelihood interventions in providing the desired outcome and food supply. We prepare our vegetable hotbed from mid March, then, plant seeds in the hotbed for seedlings in the beginning of April. Then, some of the seedlings are transplanted into a greenhouse and some of them are transplanted directly to the field. This occurs from May to June. 94% of the surveyed beneficiaries.

• Asset Creation Households have resources and reserves they can rely on in times of emergency. Key themes are savings and investments, and appropriate assets. 5. Target families were assisted to retain and develop assets to run small scale farming

and water management techniques. Activities/Inputs • Subsidize purchase of food for vulnerable families (Flour, vegetable oil and rice)quarterly • Distribute Gardening tools, greenhouses, hot beds, drip irrigation sets and training

materials such as books and DVD on vegetable garden • Construction of small storage for families;

Table 19 shows that only 8.1% of the surveyed target households have some type of cash savings. 12.8% of surveyed target households said their livestock increased. However, during the implementation of the project, target families were provided some assets. Examples are: 58.8% of surveyed target households were able to reserve seeds, 23% of them have their own greenhouse, 52% of them have a small storage area and 9 Annual reports from 2005 to 2009 “Greater Resilience to Disaster Producing Elements Through Extending Food Security to the Poorest”, ADRA Mongolia

Year 2007 2008 2009 Total harvest per household 430 427 547


45% of them received agricultural tools and equipment etc. Only 8.1% of surveyed target households said they had no savings at all.

Table 19: Savings and Assets

Frequency Percent Cash savings 9 6.1% Increased # of livestock 19 12.8% Seed reserve 87 58.8% Has own greenhouse 34 23.0% Has own storage 77 52.0% Agricultural tools and equipments 67 45.3% Savings 12 8.1% Other such as water well in own hasha 6 4.1% Total 148

Also, beneficiaries expressed that food distribution from the project helped them very much to generate some reserve cash, or to be able to invest their cash in their children’s education. Assets including cash savings are an important proxy indicator and are also indicative of resilience which can be divested in difficult times. Also, it indicates a coping strategy of families to overcome crisis. The Coping Strategies Index (CSI) is a tool to measure the different strategies households employ when they cannot get adequate food. CSI is appropriate to be used as a food security and early warning indicator, as well as an indicator of longer term changes in food security status. The CSI attempts to answer the following question: “What would you do in order to improve your household income or to have enough food? In order to measure the target households’ coping strategy for inadequate income. The following question was asked of 155 Households (Table 22). “What would you do in order to improve your household’s income?” 137 (88%) said, “Run a vegetable farm”. It should be noted that 87% of the surveyed households have their own agricultural tools. Although 88% of those families participating in the survey expressed a desire to have their own vegetable garden, external material inputs such as convenient, quality, and less expensive access to seeds and agricultural equipments and know- how are very important for all beneficiaries. Therefore, if the project team focuses on creating the above access in a sustainable manner, it would be very beneficial for all communities participating in the vegetable gardening activity. An excellent attitude of self reliance among the beneficiaries was created. This is one of key qualitative indicators for a successful and sustainable project implementation.


Table 22: What would you do in order to improve your household income and # of years of beneficiaries in the project

Plant vegetable Dig Gold

Herd livestock Seek a job Business Other Total

1 year 15 4 3 7 4 1 17 2 year 69 21 14 11 14 0 76 3 year 24 5 4 6 5 0 26 4 year 15 2 1 2 2 0 15 5 year 10 4 2 2 0 0 10 6 year 4 0 1 0 1 0 4 Total 137 36 25 28 26 1 148

75% (Table 5) of surveyed households had no experience in vegetable gardening before the project was implemented in Bayankhongor province. Figure 7 shows that 78% of surveyed beneficiaries were able to be trained in vegetable gardening by ADRA Mongolia and approximately 58% of them were able to share their vegetable gardening knowledge and skills with their neighbors and children.

Also, Table 23 shows that 63% of survyed beneficiaries expressed that they prefer to be in vegetable farming cooperatives in which they can plant larger quantities of vegetables for income generations. However, they prefer to set up cooperatives or groups with their own extended family members, because they said that they can easily understand each other and have less conflict among themselves. From all the above facts, target beneficiaries have a desire to run vegetable farming cooperatives with their extended family members. Also, they have the means such as greenhouses, agriculure tools, storage and an average of 3 years gardening experience and the knowledege to scale up their home based gardening to more commercial based gardening. Also, some of the beneficieries expressed that they want to run a vegetable bottling farm to sell bottled vegetables at local markets. The materials to build storage units were given to them this year in August. So, next year, they were hoping that they could consume their vegetables until the next harvest season and sell some vegetables for additional household income.

78%

13%

8%

1%

Figure 7: Who tought you in vegetable gardening

ADRA Mongolia

Friends

World Vision Mongolia

Other

Table 23: Cooperatives, groups and individual gardening Cooperatives/groups Individual Other Total Yes 90 36 8 134 No 2 2 2 6 Total 92 38 10 140


During the interveiws, some beneficiaries expressed that they would like to run a chicken farm to produce eggs both for home consumption and sales. I am in the project for 6 years now, I grow only potatoes on my 1 hictare with my children and sell it during winter time when the price is high. I have also storage to keep them. Man, Bayankhongor soum Some very successful beneficiaries plant their vegetables a larger land and start making sufficient income. 56.7% (Table 11) of beneficiaries plant their vegetables at the community plot for several reasons, but, a water source is one of the key factors for those who want to plant on a larger scale for both income generation and sufficient food supply. Table 21 shows that 47% surveyed beneficiers water their vegetable through canals from the river. Climate and water issues is a challenge especially in Galuut soum, Bold soum and Jinst soum. However, the project implemented drip irrigation technologies at the community plots.

Table 21: How do you water your garden Frequency Valid Percent Valid Have hand well in our hasha 27 18.1

Expect rain 3 2.0 Well 44 29.5 Through canal from river 70 47.0 Others 5 3.4 Total 149 100.0

Missing System 6 Total 155

After I attended in Water quality management training, I have a better understand of water quality. Now, I prefer to drink a boiled water or bottled water. Man in Bodg soum


Matrix on achievement of project indicators in order to measure the objectives

10 Ger is the Mongolian traditional house made by wooden frame and covered by felt and cotton which is suitable for nomadic life style and most residents and herders in country side live in the ger

Objectives/Outcomes Indicator Remark/Achievement 1

Food availability Improved access to vegetables for the poor households in four soums and the provincial centre.

1.1 Increased volume of locally grown produce available in four soums and the provincial centre markets.

1.2 Decrease in prices of locally grown produce as volume increase

1.3 Higher Incidence of locally grown produce included in household consumption.

• 90.8% of surveyed beneficiaries said that their food types and amounts have increased very well after planting a garden.

• Less achievable indicator (increased food price volatility is expected to continue, with high prices predicated to remain through to 2015.)

• 99% of surveyed households have grown at least 10 different vegetables and able to consume them at least for 3 months

2 Food access Diversification of household income sources through sales of produce.

2.1 Improved household revenue streams from sales/barter of vegetable produce

2.2 Increased overall household revenue 2.3 Reduced % of sales of animal products in

share of overall household income (no baseline percentage available)

• 44.1% of surveyed households sell 50% of their harvest or exchange it for animals.

• Monthly household income has increased by 46% (55,000 MNT which is US$41.3).

• 10% of the households who answered “yes” sold their annimals; they actually spent their money not for improvement of their household’s food supply but, primarily for their children’s higher education (43.3%) such as for college tuition fees, and household improvement such as purchase a new Ger 10

• At least 75.5% of target households were able to increase income by growing vegetables

(26.7%).

3 Food access

Improved household food economy through diversified food sources; food expenditure savings resulting from households producing their own food,

3.1 Improved food availability at target households

3.2 Season variation in food availability reduced as food sources, storage methods and food varieties multiplied.

• 70% (109) of surveyed households consume their harvest for approximately 6 -8 months

• 52% of target households were able to own small storage facilities which underground and containerized home storage.


decreased dependency on animal products

3.3 Lower overall household expenditure as alternative food sources reduce need to spend money to buy food.

3.4 Households demonstrating lower susceptibility to external shock such as adverse weather conditions

• Exchange 1 sack of potatoes for one goat or sheep. I exchanged my 11 sacks of potatoes for 11 animals including goats and sheep during last 3 years. Female beneficiary, Bayankhongor soum

• At least 3 months from Sep to Nov, we do not spend any cash to purchase vegetables. Women of Bayankhongor soum.

• ….

4 Use of food Diversified agricultural produce including vegetables, grains and berries.

4.1 Early season activities including the initial planting, hotbed and transplanting including seeds and seedling from a wide selection of crops.

4.2 Harvest yields indicate broad variety of crops

• At least 94% surveyed beneficiaries have sufficient knowledge about early plantation including preparation of seedlings in the hotbed.

• Potatoes, carrots, beet roots and cucumbers harvest yields have been increased in 2009 compared with previous year and more than 10 different vegetable were planted.

• 99% of beneficiaries were able to preserve their vegetables including cucumbers and tomatoes and salad bottling.

5 Correlations with asset creation and food availability

Target families assisted to retain and develop assets to run small scale farming and water management techniques

5.1 Increased harvest volume over the project lifespan.

5.2 Increased numbers of household members participating in food security activities.

5.3 Decreasing reliance on external inputs for continued agricultural activities over project lifespan.

5.4 80% of project households declaring their commitment to share skills gained in the course of the project with community members, and act as support to new gardeners.

5.5 Improved understanding of water management issues of agriculture and livestock

• Increased per household’ harvest from 233 kg to 547 kg during the project lifespan from 2005 to 2009.

• Per target household’s average harvest yield has increased by 120 kg in 2009

• 600 poor households participated in the Food security program “Household Gardening Initiative” project.

• 155 Households (Table 22) were asked what they would do in order to improve their household’s income. 137 (88%) said, run a vegetable farm

• 58% of them were able to share their vegetable gardening knowledge and skills with their neighbors and children.

• All community plots, particularly, 56.7% of target households’ plots have drip irrigation system in order to improve water supply and water management.


7. Findings

Efficiency of project implementation This section analyses the efficiency with which inputs (financial, manpower and other resources) were used to carry out activities and achieve outputs and outcomes. Overall, the implementation of the Household Gardening Initiative project proceeded according to the project plan. Inputs were efficiently used and all of the expected outputs and some outcomes achieved.

Human resource The project implementation staff had adequate academic qualifications to carry out their responsibilities. However, regular training, coaching and mentoring for the project staff are still required. Project planning and reporting Project Annual Detailed Implementation plans (DIP) were collectively developed at the beginning of each year. The quality of the plans improved as implementation progressed. However, the project documents were well written but, indicators were not clear. The Project Manager made up for this by frequently visiting each target soum. Project staff reported that management promptly responded to any problems they experienced during implementation. The evaluation was satisfied with the quality and content of the reports for the last two years. The most recent annual report was highly informative.

Project approach Food for work: Target beneficiaries have received food during the project implementation period; food distribution was conducted based on the food for work concept. All most all surveyed beneficiaries expressed that food distribution was very helpful during a harsh time of food insecurity. Food for work concept is able to mitigate possible negative effects in the lives of some poor people who otherwise could become dependent on the project to sustain their livelihood needs. Moreover, this concept also promotes a culture that the beneficiary worked hard to earn his or her food him or herself.

Phase out strategy: The project needs to define a clear phase out strategy either by components or as a whole project. As the communities are not yet ready for the project to be phased out the project team needs to design a phase out plan. This can be either a step by step component to component strategy that will support a more practical hands-on approach or an integrated approach with the MED project which will offer successful beneficiaries a more comprehensive service in the field of commercial gardening. This will improve income generation and provide further employment opportunities for the community.


8. Recommendation

The evaluation findings reveal some key considerations for the Food Security program related projects of ADRA Mongolia in the future program implementation.

Project planning The project’s indicators in the log-frame need to be specific, measurable, achievable, relevant, and time bound, and also better not to use externally effected indicators for the project planning.

Risk mitigation Circumstances beyond the control of the project or the communities (e.g. droughts and windstorm) may lead to failure of livelihood interventions in providing the desired outcome. Climate and water supply in Bayankhongor is a challenge, so extension of new technologies is constantly important. Project intervention Implement gardening project with commercial application: Most successful beneficiaries, those primarily in Bayankhongor soum, should be encouraged to expand their gardens with the intention of selling their surplus commercially. They should be encouraged to form cooperatives to assist in their commercial ventures. Approximately 63 % of the target beneficiaries surveyed expressed an interest in forming such cooperatives. These beneficiaries should expand their agricultural success even more. The ultimate goal is to make the beneficiaries self-sufficient, and thus end the need for intervention and intense hands-on work by the Project. Of course, there will continue to be a need for a high level of technical assistance, and ongoing evaluation. ADRA Mongolia has valuable experience in micro enterprise development and creation of access to micro credit. Thus, the project needs to promote successful beneficiaries to graduate from hand-outs to hands-on services. The following activities shall be recommended for this group: • Technical assistance (TA) in commercial ventures, including how to start and structure a

micro enterprise, accounting methods, management, agricultural products and service development and marketing techniques.

• Create access to micro credit with low interest rates, and approximately two year pay offs. Successful beneficiaries will be able to purchase tractors, and water tank and other required items.

• Train in marketing strategies, such as packaging, pricing, and distribution of products • Provide training and information on how to create self sufficient farming cooperatives,

business planning and business management • Subsidize necessary expenses of farming cooperatives for only the first year


• Create access to the best practices, technology, and efficient and effective agriculture techniques

Implement gardening project in small soums: The project should expand to include all the people in the soum who are interested in participating in the Food Security Program, particularly gardening activities. There are two reasons for this: 1) Even those not considered very poor are still at risk to slide into poverty if outside events such as less economic opportunity, loss of employment, and natural disaster. 2) It is more cost effective for the project to include services to larger numbers of people. During the field work of the evaluation, soum people expressed their interest in to be part of the gardening project in the future. If the project is to be able to implement early warning strategies in the project planning, it will be beneficial for the non – poor to prevent shifting into poverty. This phase should emphasize rewarding the more productive beneficiaries. In an effort to wean all project participants from this program, beneficiaries should be encouraged to grow more vegetables in order to create more sufficient vegetables for consumption and generate income from either the sale of surplus produce within the soum, barter for animals among the local herders, or possibly small commercial ventures to preserve the surplus for later consumption. The following potential activities can be implemented: • Training in agricultural technology and techniques such as how to prepare fertilizers for

locally available materials, drip irrigation methods, preservation techniques and nutrition • Increase amount harvest yield of the 1 square meter • Expansion into other agricultural endeavors, such as adding chickens for egg consumption • Subsidize some of the seeds and other costs for gardening including some agriculture

equipments Very poor gardeners who are not yet successful in a garden: The project still needs to work with those poor, who are willing to work hard to grow vegetables, and provide continued support. The very poor must focus on producing enough food by themselves for at least 6 months of consumption. The following some potential activities will be able to be implemented: • Plant a plot of approximately 250 square meter • Provide seeds and greenhouses • Training in vegetable gardening, processing, and use • Ongoing monitoring

Each group will need particular assistance geared to their own needs, but in general, more knowledge of commercial ventures will be provided to all beneficiaries. Particular emphasis should be placed on teaching how to produce and market vegetables and other produce. Also, reliance on technology and the use of local resources is necessary. The project need not provide any resource that can be attained nearby.


For the more successful participants, expansion of their gardens for venturing into small businesses, within a limited geographic area, addition of other agriculture, such as chickens, and techniques for preserving surplus produce are attainable. The most successful beneficiaries are those that will have the greatest chance of succeeding in larger commercial ventures, aimed at a larger geographic area such as Bayankhongor soum. Proposed project duration for the next phase should be 2 to 3 years which is sufficient to promote sustainability and continued success.

9. Conclusion

The “Household Gardening Initiative” project of the Food Security program of ADRA Mongolia has been implemented in Bayankhongor province from 2005 to 2010 successfully. The project had 2 phases, from 2005 to 2007; and 2008-2010. The six year program, and the ability to work with individual beneficiaries made a great difference in the project. Overall, the project was implemented successfully and achieved 14 out of 16 indicators of the objectives.

Bayankhongor province is a territory of semi-gobi and had no history or experience in crop productions. But, this project made a tremendous improvement in agricultural development in the province as well as in individual households. Now, at least 600 poor households have skills and resources to run a sustainable gardening farm in order to improve their food consumption. The result of the project implementation, those households have alternative food source.

The evaluation recommends that the project needs to be extended for a further two to three years. This will allow the project sufficient time to promote the sustainability of the project impact.

Finally, it can be stated that this project has been very successful in achieving its goals, that further assistance for this population will be fruitful, but that the possibility of creating a welfare community must be avoided. If the project is to be successful in the end, it must produce individuals who are self-sustaining, and productive members of their communities and country.


10. List of Tables

Table 1: Soum name and # of beneficiaries of the project Table 2: Gender Table 3: Head of household Table 4: Employment Table 5: Vegetable gardening experience Table 6: Main income sources Table 7: Direct and Indirect beneficiaries Table 8: Food types and amounts increase Table 9: Duration of vegetable consumption Table 10: Most consumed vegetable in a daily consumption Table 11: Backyard plot and community plot and numbers of years in the project Table 12: Income source Table 13: Have you sold your livestock to improve your household’s food supply if yes, how did you spend your money Table 14: In order to improve your household’s income what steps can you take to change your household income Table 16: What to do with your vegetables Table 17: Harvest by vegetable (tn) Table 18: Harvest by per household Table 19: Savings and Assets Table 23: Cooperatives, groups and individual gardening Table 22: What would you do in order to improve your household income and # of years of beneficiaries in the project Table 21: How do you water your garden