17
Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF)

Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

Integrating Big Data in Evaluation

Dr. Juha Uitto, Director, Independent Evaluation Office

Global Environment Facility (GEF)

Page 2: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Takeaway

Participants will learn the potential applications of big data and geospatial analysis in evaluating environmental and socio-economic impacts of development interventions

Page 3: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

What is Big Data?

VelocityVolume ValueVariety

Page 4: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Why use Big Data in evaluation?

Global environmental issuesScarcer financial resources

Page 5: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Sustainable Development Goals and Geospatial Data

Page 6: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

TOOLS for evaluators to operationalize large quantities of data

Flowminder Foundation

United Nations Global Pulseunglobalpulse.org

UN FAO Collect Earthopenforis.org

Page 7: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

Climate change

Chemicals and waste

Forests

International waters

Biodiversity

Land degradation

18 AGENCIES

Page 8: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Uses of geospatial data

Visualization and mapping

Statistical modelling

Machine learning

Continuous monitoring

Fragile and crisis context

Page 9: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

Practical examples from GEF evaluations

Page 10: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Impact evaluation of GEF support to protected areas and protected area systems

Page 11: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

{insert bullet points}

Page 12: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Forest change analysis using satellite dataGEF protected areas compared with non-GEF and adjoining buffer zone

Page 13: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Value for money analysis in land degradation projects in the GEFEconomic valuation of carbon sequestered (USD) at GEF project sitesPositive carbon sequestration outcomes in most projects

Economic valuation of carbon sequestered (USD) at GEF project sites

Page 14: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Factors driving positive impactsValue for money analysis in land degradation projects in the GEF

Higher impact observed in areas with poor initial conditions

Access to electricity associated withhigher impact

Lag time of4.5 to 5.5 years for

impacts to beobserved

Page 15: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

Time series analysis using satellite dataBeneficiary survey

Village

Bamboo Forest

TRIANGULATION ACROSS METHODS

Qualitative methods• Case study• Field visits• Focused group interview• Stakeholders interview

April 2009 April 2015

Page 16: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

2018 Asian Evaluation Week Making Evaluation Work at the Country Level 10-14 September 2018 Chengdu, People’s Republic of China

LESSONS from the use of geospatial data in evaluations

Approach evaluation as a dynamic learning process

Use mixed approaches and methods

Continue exploringnew methodologiesand data sources

Partner with global institutions

Page 17: Integrating Big Data in Evaluation · Integrating Big Data in Evaluation Dr. Juha Uitto, Director, Independent Evaluation Office Global Environment Facility (GEF) 2018 Asian Evaluation

Geospatial data can

Answer new and complex evaluation questionsHelp overcome traditional data-related constraints