The Program The Program Evaluation CycleEvaluation Cycle

Module 3Module 3

22

OverviewOverview

Overview of the evaluation cycle

Major components of the cycle

Main products of an evaluation

The evaluation process in context

33

The Program CycleThe Program CycleReview Existing

Programs

Identify New Program Needs

Design a Program

Confirm Resources

Develop Program

Examine Future Program Needs

Implementation

Fine Tuning the Program

Evaluate Program

44

Is there a legitimate need for Is there a legitimate need for an evaluation?an evaluation?

Is there an interest in: Accountability? Decision-Making ? Learning?

What information could an evaluation produce that we don’t have now?

Are there faster, better, more cost-effective ways of improving a program than conducting an evaluation?

55

Plan an EvaluationPlan an Evaluation

Assess stakeholder’s needs Prepare terms of reference to state

• Issues• Methodology/Approach• Schedule and cost

Prepare workplan to clarify• Questions/Issues• Evaluation methodology

66

Collect DataCollect Data

Understand the potential data sources: people; documents; data bases; settings

Determine efficient and effective ways to collect the data - e.g.: interviews; checklists; questionnaires; focus groups; performance tests; observation; technical measurement

Collect quantitative and qualitative data

77

Analyze DataAnalyze Data

Using qualitative approaches - e.g.: determining the important themes and messages

Using quantitative approaches - e.g.: counts; statistics

Integrating qualitative and quantitative approaches

88

Interpret Data & Formulate Interpret Data & Formulate FindingsFindings

Weigh the evidence

Attribute effects or results: Formulate plausible cause-effect relationships

Formulate findings: Articulate what the data says so that everyone understands

99

Recommend ActionRecommend Action

What are the big messages of the evaluation?

What would be helpful to recommend?

1010

Communicate Evaluation Communicate Evaluation ResultsResults

Decide:• When to share information• What to share• Who to share it with• How it should be presented

1111

Use ResultsUse Results

Ownership:Who cares about follow-up?

Accountability:Who is responsible for follow-

up?

1212

When to invest in program When to invest in program evaluation evaluation

Program

BeforeDuring

At the end In the future

To improv

eprogra

m design

To improveprogram

implementation

Foraccountability

To assessimpact

1313

Key Timing for EvaluationKey Timing for Evaluation

Program

BeforeDuring

At the end In the future

EvaluationFramewor

ks Mid-Term Evaluations

End of Program

Evaluation

Impact Evaluation

1414

Evaluation ProductsEvaluation Products

Scope of Work/Terms of Reference (TOR)

Work Plan

Evaluation Framework

Briefings/Progress Reports

Summary of Results/Evaluation Report

1515

The Evaluation Process in The Evaluation Process in ContextContext

Resources

Values Ethics

Politics

1616

Questions for DiscussionQuestions for Discussion

Does the program evaluation cycle

always coincide with program

milestones?

What issues can emerge?