28
Logic Model Primer UH Title III Evaluation Core Team 29 August 2016

Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Logic Model Primer

UH Title III Evaluation Core Team29 August 2016

© Nolan Malone
Page 2: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Agenda (of sorts)►What Is a Logic Model?

� Definition� Examples� Components

►Benefits & Uses� Benefits� Uses� Tips

►Some Resources2

© Nolan Malone
Page 3: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

WHAT IS A LOGIC MODEL?

3

© Nolan Malone
Page 4: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Definitions

A tool for visually representing the structure, process, and goals (the “logic”) of a program. (REL Pacific)

A picture of how your program works. (Kellogg Foundation)

4

© Nolan Malone
Page 5: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Examples

5

© Nolan Malone
Page 6: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

6

© Nolan Malone
Page 7: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components

In simple terms, it’s nothing more than:• Activities: What you are doing• Outcomes: What you expect to happen

7

Activities Outcomes

© Nolan Malone
Page 8: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components

8

Activities Outcomes

Inputs

Outputs

Short-term

Mid-term

Long-term

© Nolan Malone
Page 9: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components:

Processes, events, actions

9

© Nolan Malone
Page 10: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components:

a.k.a. Resources: Materials, funding, personnel, knowledge, skills, time, community support

10

© Nolan Malone
Page 11: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components:

Tangible or observable results(How you know the activities actually occurred)

11

© Nolan Malone
Page 12: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components:

Changes to participants’ behavior, knowledge, or skills or organizational practices or system designCommon divided into three categories:

o Short-termoMid-termo Long-term

12

© Nolan Malone
Page 13: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components:

• Changes occur during or immediately after participation in or completion of program activities

• Usually a change in Attitudes, Skills, or Knowledge (ASK)

• Not necessarily time-dependent• Among the three Ts: Touch

13

© Nolan Malone
Page 14: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components:

• Changes generally occur after participation in or completion of a program

• Usually signaled by a change in Behaviors• Again, not necessarily time-dependent• Among the three Ts: Transaction

14

© Nolan Malone
Page 15: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components:

• Changes are typically only observable well after participation in a program

• Usually signaled by a change in Worldviews or Incorporation into Daily Living/Habits

• Again, not necessarily time-dependent• Among the three Ts: Transformation

15

© Nolan Malone
Page 16: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Components: Others

16

Activities Outcomes

Inputs

Outputs

Short-term

Mid-term

Long-term

Mission

Vision

Goals

Assump-tions

Values

© Nolan Malone
Page 17: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

BENEFITS & USES

17

© Nolan Malone
Page 18: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Benefits of Logic Models

• Provides a basic framework to guide program development and evaluation

• Has simple components that show how a program is organized

• Encourages collaboration by providing a common language and helping teams organize and share their thinking

• Shows how each component influences another to achieve the intended outcomes

18

© Nolan Malone
Page 19: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Uses of Logic Models

• Visually describe the sequence of change that you hope to see in participants

• Continually learn about & improve your program

• Facilitate sharing what works in your program and why

19

© Nolan Malone
Page 20: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Abuses of Logic Models

Not to be used for:• Tormenting staff• Creating a doorstop• Auditing program operations• Making judgments of your work• Writing a college thesis never to be looked

at again

20

© Nolan Malone
Page 21: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Uses: TimingPhases Uses

New programsCreating,

planning

Existing

programs

Documenting,

sharing

Redesigning

existing programs

Reinventing,

rethinking,

expanding

21

© Nolan Malone
Page 22: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

22

© Nolan Malone
Page 23: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

More Tips

• Logic models do not need to be linear. (Logic rarely is, so why should the models?)

• No graphic design experience needed!• Most useful when done in collaboration

with others!• For large programs, start with individual

parts, then reconcile with other parts to determine any contingencies.

• Find ways to highlight primary activities in the program, which will otherwise have equal weight with all others.

23

© Nolan Malone
Page 24: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

RESOURCES

24

© Nolan Malone
Page 25: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Quick Reference Guides

Logic Models (in general)

Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific)

Logic Models: A Tool for Effective Program Planning (REL Pacific)

Outcomes (specifically)

Understanding Program Monitoring: The Relationships Among Outcomes, Indicators, Measures, and Targets (REL Pacific)

Program Monitoring: The Role of Leadership in Planning, Assessment, and Communication(REL Pacific)

25

© Nolan Malone
Page 26: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Education Logic Model (ELM) Tool

• Local web application• Not internet-dependent• Uses Google Chrome browser• Runs on Macs & PCs• Data is stored locally on computer• Quick Reference Guides included• Step-by-step instructions

26

http://relpacific.mcrel.org/resources/elm-app/

© Nolan Malone
Page 27: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

Program Outcomes Measures & Targets (POMT) Tool• Supplement to the ELM, with same

benefits• Allows you to flesh out outcomes by:

– Assigning indicators for each outcome– Assigning baselines, benchmarks, &

targets– Monitoring progress toward targets– Reporting in dynamic graphics

27

http://relpacific.mcrel.org/resources/pomt-app/

© Nolan Malone
Page 28: Logic Model Primer - University of Hawaii · 2017-05-02 · Logic Models: A Tool for Designing and Monitoring Program Evaluations (REL Pacific) Logic Models: A Tool for Effective

QUESTIONS & FEEDBACK?

28

© Nolan Malone