How to navigate the maze of evaluation methods and approaches

Preview:

Citation preview

Sharing information to improve evaluation

How to navigate the maze of evaluation methods and

approaches

Simon Hearn & Ron Mackay

A BetterEvaluation Podcast

BetterEvaluation.org

The Challenge: Overwhelming number and diversity of PME tools

Wikipedia page for Evaluation Methods

Steps Taken: Tools are just too many, focus on Log Frame and Outcome Mapping

Image: Michael Heilemann. http://www.flickr.com/photos/heilemann

Image: 8lettersuk. http://www.flickr.com/photos/8lettersuk/

Image: Lottery Monkey. http://www.flickr.com/photos/lotterymonkey/

Image: Simon Kneebone. http://simonkneebone.com/

Image: Susan Kistler. http://aea365.org

Image: Reven. http://www.flickr.com/photos/reven/

Image: russelldavies. http://www.flickr.com/photos/russelldavies//

Image: nickherber. http://www.flickr.com/photos/nickherber/

Simple organisational cycle

Plan

Act

Assess

CIPP Model

Inputs Process Product

Context

Image: meg_riordan. http://www.flickr.com/photos/meg_riordan/

Evaluation is the activity of systematically collecting, analyzing and reporting information so that it can be used by appropriate people to answer their questions so that they can make decisions about the future of a project or program.

• Who carries out the ‘activity’?

• Who or what is an evaluator?

• How does an activity become ‘systematic’?

• What activites and skills do ‘collecting, analysing and reporting’ involve?

• How do you go about ‘collecting, analysing and reporting’?

• Is that an exhaustive list of ‘the activity’ that is called ‘evaluation’

• What kind of ‘information’ is being referred to?

• What is the thing or things you collect information about?

• Who should be involved in an evaluation?

• Who are the ‘appropriate people’ who ‘use’ the ‘information’ supplied by an evaluation?

• And for what purposes can they ‘use’ this information?

• What kinds of questions can they ask?

Rainbow Framework

Over 200 methods/options

related to 35 tasks

in 7 clusters

Rainbow Framework

Over 200 methods/options

related to 35 tasks

in 7 clusters

BetterEvaluation.org

See IOCE.net for a list of national evaluation societies

Evaluation Competencies

1.Reflective Practice 2.Technical Practice 3.Situational Practice 4.Management Practice 5.Interpersonal Practice

Competencies for Canadian Evaluation Practice, Canadian Evaluation Society

Evaluation Standards

1.Utility Standard2.Feasibility Standards 3.Propriety Standards 4.Accuracy Standards 5.Evaluation Accountability

Standards

The Program Evaluation Standards developed by the JCSEE

How to navigate the maze of evaluation methods and

approaches

Simon Hearn & Ron Mackay

A BetterEvaluation Podcast

BetterEvaluation.org

Recommended