Carina van Rooyen, Natalie Rebelo Da Silva & Ruth Stewart

Preparing to produce an online evidence map of empirical social sciences studies about changing

climate in South Africa

Presentation at the First International CEE Conference in Stockholm, Sweden on 27-29 August 2016

Research synthesis

Photo source: http://ww

w.evicorporation.com

/images/divisions.gif

Research synthesis is about...

Masekela et al 2012

Ibrahim 2009Masuka et al 2007

Ngema et al 2016Baloi et al 2014

Gwangwa et al 2013

Nwazas et al 2013

Dube et al 2010

Makeba et al 2007

Kimani 2008

Slide source: Africa Evidence Centre 2016

…different ways to collect & organise research evidence

Rapid Evidence Assessments

Literature reviews

Systematic reviews

Evidence maps

Slide source: Africa Evidence Centre 2016

What is evidence mapping?Photo source: https://thegoodistablog.files.w

ordpress.com/2013/10/w

orldmap-in-

grains.jpg

Map Included evidence Systematic search

Critical appraisal

Analysis Visualisation Access to user friendly summaries

SRs IEs Other

3ie’s evidence-gap map

Yes Can do No Yes Yes (SR) Yes Yes Yes

Evidence map Yes Yes Yes Yes No Yes No YesScoping review (Arksey & O’Malley 2005)

Can do Can do Can do May be limited

No Yes No No

Systematic map Can do Can do Can do Yes Limited Yes No NoPolicy-relevant evidence map

Yes Yes Yes Yes Yes Yes Yes Yes

Source: Snilstveit et al 2013:6; Langer et al 2016

Various kinds of maps

Purposes of evidence maps

Slide source: Africa Evidence Centre 2016

Mapping the evidence: why?

BIG QUESTION MAP OF THE EVIDENCE

Interventions in place, but no

evidence

Consider stopping the intervention

Consider starting the intervention

Pilot and research

No intervention, good evidence

No intervention, no research

Stop doing research on this, summarise

it

Saturation – don’t need more evidence

Slide source: Africa Evidence Centre 2016

Main steps in a systematic review1. Publish title registration and then full protocol, often including pilot

searches2. Full searches3. Screening4. Coding and critical appraisal5. Data extraction of findings6. Synthesis7. Writing up full review

9

Slide source: Stewart

2016

1. Publish title registration and then full protocol, often including pilot searches Develop the scope (can include published protocol)

2. Full searches3. Screening 4. Coding and critical appraisal (and categorisation for map)5. Data extraction of findings6. Synthesis7. Writing up full review Visualisation (including user-friendly

summaries)

Main steps in this evidence map

Photo source: http://19mvm

v3yn2qc2bdb912o1t2n.wpengine.netdna-

cdn.com/science/files/2015/12/evidencem

apgraphic-1260x708.png

Anticipated challenges of EM of social sciences studies on changing climate in South Africa

Conceptual diversities re climate change

Photo source: http://www.mdpi.com/nutrients/nutrients-06-00546/article_deploy/html/images/nutrients-06-00546-g003-1024.png

Diverse natures of primary researchPhoto source: http://grainlegum

es.cgiar.org/wp-content/uploads/2013/01/13-

CIAT-bean-gene-bean-diversity-CIAT-bank-from-Flicker.jpg

Methodological comfortPhoto source: http://elvengates.com

/wp-content/uploads/2015/09/M

oon-Gate-House.View

-East-480px-Comp.jpg

Epistemological conversations

Photo source: https://www.royalholloway.ac.uk/CachedImage.axd?ImageName=%2Faboutus%2Fnewsandevents%2Fevents%2Feventsimages%2Fapplesandoranges.jpg&ImageWidth=400&ImageHeight=400

Purpose of this evidence

map

Photo source: http://ww

w.deshow

.net/d/file/funny/2009-11/the-harvest-season-800-4.jpg

Photo sources: http://ww

w.foundshit.com

/pictures/food/harvest-delivery-02.jpg

Vehicle for visualisation

Concluding

Carina van RooyenCEE Johannesburg

Africa Centre for EvidenceUniversity of Johannesburg

cvanrooyen@uj.ac.za | @carinavr | www.africaevidencenetwork.org

ceejoburg@uj.ac.za | @ceejoburg | www.ceejoburg.com

References Africa Evidence Centre 2016 Evidence mapping: Exploring capability and use of the map for Human Settlements. Presentation by Laurenz Langer on 23 June

Arskey, H. & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1):19-32.

Armstrong R, Hall, BJ, Doyle J & Waters E 2011 ‘Scoping the scope’ of a Cochrane review. Journal of Public Health, 33(1): 147-150

Bates S, Clapton J & Coren E 2007 Systematic maps to support the evidence base in social care. Evidence and Policy: A Journal of Research, Debate and Practice 3(4): 339-351

Clapton J, Rutter D & Sharif N 2009 SCIE systematic mapping guidance, April 2009 [draft]. Using knowledge in social care, research resource 03. Social Care Institute for Excellence

Daudt HML, van Mossel C & Scott SJ 2013 Enhancing the scoping study methodology: A large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Medical Research Methodology 13:48

Haddaway NR, Bernes C, Jonsson B & Hedlund K 2016 The benefits of systematic mapping to evidence-based environmental management. Ambio DOI 10.1007/s13280-016-0773-x

Jones K 2004 Mission drift in qualitative research, or moving toward a systematic review of qualitative studies, moving back to a more systematic narrative review. The Qualitative Report 9(1): 95-112

Mays, Arksey H, O’Malley L, … 2005 Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology: Theory & Practice 8:5

Miake-Lye IM, Hempel S, Shanman R & Shekelle PG 2016 What is an evidence map? A systematic review of published evidence maps and their definitions, methods and products. Systematic Reviews 5: 28

Raymond CM, Fazey I, Reed MS, Stringer LC, Robinson GM & Evely AC 2010 Integrating local and scientific knowledge for environmental management. Journal of environmental management 97(8): 1766-1777

Snilstveit B, Vojtkova M, Bhavsar A, Gaarde M 2013 Evidence gap maps: A tool for promoting evidence-Informed policy and prioritizing future research. World Bank Policy Research Working Paper 6725. Washington: World Bank

Stewart R 2016 Reflecting on range of ways in which we have adapted full systematic review methods to meet demands of different stakeholders. Presentation at the 1st International CEE conference, 25-27 August in Stockholm.