Learning to Love Logic Models Kathryn L. Braun, DrPH [email protected]

Learning to Love Learning to Love Logic ModelsLogic Models

Kathryn L. Braun, DrPHKathryn L. Braun, DrPH

[email protected]@hawaii.edu

What is Logic Model?What is Logic Model?

A “boxy” graphicA “boxy” graphic It summarizes…It summarizes…

A whole picture of the programA whole picture of the program What it providesWhat it provides What it aims to accomplishWhat it aims to accomplish

Logic Model Logic Model Senior Walking ProgramSenior Walking Program

OutputsOutputsActivitiesActivities ImpactImpactInputsInputs OutcomesOutcomesNumber of Number of sites that sites that participate participate (10)(10)

Number of Number of seniors that seniors that enroll (120)enroll (120)

Number that Number that complete the complete the program (100)program (100)

Number that Number that join in, even join in, even though they though they didn’t enroll didn’t enroll (20)(20)

Number that Number that meet goals (70)meet goals (70)

Number that Number that exceed goals exceed goals (20)(20)

Hire staffHire staff

Get incentives and Get incentives and pedometerspedometers

Train site leaders Train site leaders (10)(10)

Recruit seniors Recruit seniors (120)(120)

Get baseline data.Get baseline data.

Help seniors set Help seniors set goals for walking goals for walking and fruit/veg and fruit/veg consumption, and consumption, and train them to use train them to use pedometer and pedometer and logbooks.logbooks.

Lead 10-week Lead 10-week program of program of walking and nutri walking and nutri ed ed

Collect followup Collect followup datadata

To improve To improve the health of the health of older adults older adults (60+) in (60+) in Honolulu by Honolulu by increasing increasing their level of their level of physical physical activity and activity and consumption consumption of fruits and of fruits and vegetablesvegetables

AARP AARP (pedometers, (pedometers, incentives)incentives)

Lanakila Lanakila nutrition nutrition support staff, support staff, meal site meal site leaders, and leaders, and the new staff the new staff personperson

Experience of Experience of the successful the successful pilot site, pilot site, Pohulani, and Pohulani, and Joyce, the Joyce, the managermanager

Inkind support Inkind support from Honolulu from Honolulu County and County and Hawaii State Hawaii State offices on offices on agingaging

HMSA HMSA Foundation Foundation fundsfunds

Increase from baseline Increase from baseline in number of steps in number of steps walked per week and walked per week and number of F/V number of F/V consumed (70)consumed (70)

Increase from baseline Increase from baseline in feelings of energy, in feelings of energy, endurance, strength, endurance, strength, and sound sleep (70)and sound sleep (70)

Improvements from Improvements from baseline in attitude baseline in attitude toward exercise (50)toward exercise (50)

Number of seniors that Number of seniors that commit to continue commit to continue walking after the walking after the program is over (30)program is over (30)

Components of a Logic Components of a Logic ModelModel

The components of Logic Model The components of Logic Model (column titles)(column titles)

InputsInputs ActivitiesActivities OutputsOutputs OutcomesOutcomes ImpactImpact

Components of Logic ModelComponents of Logic Modelcompared to grant proposalcompared to grant proposal

Logic ModelLogic Model

InputsInputs

ActivitiesActivities

OutputsOutputs

OutcomesOutcomes

ImpactImpact

Grant ProposalGrant Proposal

GoalGoal

ObjectivesObjectives

Process objectivesProcess objectives

Outcome Outcome

objectivesobjectives


ResourcesResources

Logic ModelLogic ModelOutputsOutputsActivitiesActivities ImpactImpactInputsInputs OutcomesOutcomes

PROCESS PROCESS OBJECTIVEOBJECTIVE

SS

ACTIVITIES, ACTIVITIES, PROCESSES, PROCESSES,

TASKSTASKS

GOAL(S)GOAL(S)RESOURCERESOURCESS

OUTCOME OUTCOME OBJECTIVESOBJECTIVES

Inputs – Inputs – aka Resourcesaka Resources

Resources, such asResources, such as Funding Funding FacilitiesFacilities StaffStaff VolunteersVolunteers

Inputs - ResourcesInputs - ResourcesOutputOutputActivitiesActivities ImpactImpactOutcomeOutcome

The needs for needs The needs for needs assessment/listening assessment/listening session’s training are session’s training are identifiedidentified

Number of partners, Number of partners, trainees, sessions, trainees, sessions, materials, and participantsmaterials, and participants

Number of conducted Number of conducted needs needs assessment/listening assessment/listening sessions, hours of sessions, hours of sessions, and hours of sessions, and hours of conducting need conducting need assessment /listening assessment /listening sessionssessions

Listed the activities that Listed the activities that older adults can share, older adults can share, and want to learnand want to learn

Number of activities that Number of activities that older adults can share, older adults can share, and want to learnand want to learn

Identified role model for Identified role model for needs needs assessment/listening assessment/listening sessionssessions

Number of partners Number of partners complete program designcomplete program design

Number of partners Number of partners implement program action implement program action planplan

Number of partners Number of partners complete evaluation plancomplete evaluation plan

Number of program still Number of program still existing by 2007existing by 2007

Conduct statewide training Conduct statewide training onon

conducting needsconducting needs

assessment /listeningassessment /listening

sessionssessionsDetermine training needsDetermine training needsIdentify partners/traineesIdentify partners/traineesPlan training sessionPlan training sessionDevelop training materialsDevelop training materialsConduct and evaluate Conduct and evaluate trainingtraining

Conduct needs Conduct needs assessment /listening assessment /listening sessionssessionsLearn what activities olderLearn what activities older

adults can share (teach adults can share (teach themselves)themselves)Learn what older adults want Learn what older adults want toto

learnlearnIdentify role models for Identify role models for futurefuture

project implementationsproject implementations

Set up, implement, and Set up, implement, and evaluate programevaluate programDesign program Design program incorporating perspectivesincorporating perspectives Implement programImplement programEvaluateEvaluateSustainSustain

..75% of partners will gain knowledge75% of partners will gain knowledge

about needs assessment approaches.about needs assessment approaches.

By December 2004By December 2004

75% of partners will be able to apply75% of partners will be able to apply

knowledge gained by conductingknowledge gained by conducting

needs assessment/listening sessionsneeds assessment/listening sessions

with various groups.with various groups.

By March 2005By March 2005

75% of partners will be able to75% of partners will be able to

incorporate appropriate practices inincorporate appropriate practices in

the healthy aging project.the healthy aging project.

By May 2005By May 2005

75% of partners complete program75% of partners complete program

designdesign

75% of partners implement program75% of partners implement program

action planaction plan

50% of partners complete evaluation50% of partners complete evaluation

planplan

By May, June, August 2005By May, June, August 2005

25% of partners continue to conduct25% of partners continue to conduct

the programthe program


Senior CentersSenior Centers

FundsFunds

Staff (new and Staff (new and existing)existing)

EquipmentEquipment

InputsTo improve To improve the health the health of older of older adults (60+) adults (60+) in Honolulu in Honolulu by by increasing increasing their level their level of physical of physical activity and activity and consumptioconsumption of fruits n of fruits and and vegetablesvegetables

Activities Activities aka Processes aka Processes or Tasksor Tasks

Events or actions of the program, Events or actions of the program, such assuch as Recruiting seniors Recruiting seniors Running the programRunning the program Collecting dataCollecting data

Activities - ProcessesActivities - ProcessesOutputOutput ImpactImpactOutcomeOutcome












75% of partners will gain knowledge75% of partners will gain knowledge













designdesign




planplan





InputInput

Partnership; Partnership;

Hawaii Hawaii Department ofDepartment of

Health Health (Community(Community

Health Division, Health Division, ExecutiveExecutive

Office on Aging, Office on Aging, HawaiiHawaii

District Health District Health Office, etc.)Office, etc.)

County County agenciesagencies

Other public Other public and private and private agenciesagencies

Funding; Funding;

State State

($ 10,000 per ($ 10,000 per year)year)

ActivitiesActivitiesRecruit seniors (120)Recruit seniors (120)Lead 10-week Lead 10-week walking programwalking programCollect dataCollect data

Outputs Outputs aka Process aka Process ObjectivesObjectives

Direct products of the program, such Direct products of the program, such asas Number of seniors recruitedNumber of seniors recruited Number of seniors retainedNumber of seniors retained

OutputsOutputsImpactImpactOutcomeOutcome















designdesign




planplan









sessionssessionsDetermine training needsDetermine training needsIdentify partners/traineesIdentify partners/traineesPlan training sessionPlan training sessionDevelop training materialsDevelop training materialsConduct and evaluate trainingConduct and evaluate training

Conduct needs assessment Conduct needs assessment /listening sessions/listening sessionsLearn what activities olderLearn what activities older


learnlearnIdentify role models for futureIdentify role models for future


Set up, implement, and Set up, implement, and evaluate programevaluate programDesign program incorporating Design program incorporating perspectivesperspectives Implement programImplement programEvaluateEvaluateSustainSustain

InputsInputs

AARPAARP

Lanakila Lanakila NutritionNutrition

ProgramProgram

Pohulani Site andPohulani Site and

JoyceJoyce

Honolulu County Honolulu County andand

Hawaii State Hawaii State offices onoffices on

agingaging

HMSA HMSA FoundationFoundation

fundsfunds

OutputsOutputs•Number of seniors that enroll (120)

•Number that complete the program (100 out of 120)

OutputsOutputsActivitiesActivities OutputsOutputs

Recruit seniors (120) Number of seniors that enroll (120)

Number that complete program (100 out of 120)

Outcomes Outcomes aka Outcome aka Outcome ObjectivesObjectives

Desired effects of the program, such Desired effects of the program, such asas Increase in physical activityIncrease in physical activity Increase in benefits of physical activityIncrease in benefits of physical activity


OutcomesOutcomes

ResourcesResources

AARPAARP


ProgramProgram

Pohulani Site andPohulani Site and

JoyceJoyce



agingaging


fundsfunds





Conduct needs Conduct needs assessment /listening assessment /listening sessionssessionsLearn what activities olderLearn what activities older





ImpactImpact

ShareShare

AppropriateAppropriate

healthy aginghealthy aging

practices withpractices with

older adults.older adults.

In the future:In the future:

Improve healthImprove health

status of olderstatus of older

adults by adults by startingstarting

or continuing or continuing toto

exercise andexercise and

eating fruits eating fruits andand

vegetables.vegetables.

OutputOutput











OutcomesOutcomes

•Increase from baseline in number of steps walked per week (70 out of 100)

•Increase from baseline in feelings of energy, endurance, strength, and sound sleep (70 out of 100)

OutcomesOutcomesOutcomesOutcomesActivitiesActivities

Lead program for 10 weeks.

Collect data.

Increase from baseline in number of steps walked per week.

Impact Impact aka Goal(s)aka Goal(s)

Mission or purpose of the programMission or purpose of the program Such asSuch as

Improved conditions, Improved conditions, Increased capacity, andIncreased capacity, and Reduce mortality.Reduce mortality.

ImpactImpactOutputOutputActivitiesActivities OutcomeOutcome


Number of partners, Number of partners, trainees, sessions, trainees, sessions, materials, and materials, and participantsparticipants





Number of partners Number of partners complete program complete program designdesign

Number of partners Number of partners implement program implement program action planaction plan

Number of partners Number of partners complete evaluation complete evaluation planplan


Conduct statewide Conduct statewide training ontraining on




Conduct needs assessment Conduct needs assessment /listening sessions/listening sessionsLearn what activities olderLearn what activities older

adults can share (teach adults can share (teach themselves)themselves)Learn what older adults Learn what older adults want towant to

















designdesign




planplan





InputsInputs

AARPAARP


ProgramProgram

Pohulani Site Pohulani Site andand

JoyceJoyce



agingaging


fundsfunds

ImpactImpactTo improve the health of older adults (60+) in Honolulu by increasing their level of physical activity.

What’s New? – What’s New? – Federal funding agencies nowFederal funding agencies now

Requiring applicants to provide Requiring applicants to provide Logic Model with their proposalLogic Model with their proposal

Requiring awardees in multi-site Requiring awardees in multi-site programs to adhere to the same programs to adhere to the same Logic Model Logic Model

Examples on HandoutsExamples on Handouts

Hawaii Youth Services NetworkHawaii Youth Services Network Funded by CDC initiative: Funded by CDC initiative: COALITION COALITION

CAPACITY BUILDING TO REDUCE CAPACITY BUILDING TO REDUCE TEEN PREGNANCYTEEN PREGNANCY

Imi Hale Native Hawaiian Cancer Imi Hale Native Hawaiian Cancer NetworkNetwork Funded through National Cancer Institute Funded through National Cancer Institute

initiative: initiative: COMMUNITY NETWORK COMMUNITY NETWORK PARTNERSPARTNERS

CDC NATIONAL ORGS

STATE ORGS & REGIONAL TRAINING CENTERS

NATIONAL & STATE ORGS & REGIONAL TRAINING CENTERS

.

State orgs will have increased capacity to

help others

Local orgs with intensive training demonstrate:

•Increased knowledge & skill

•Greater motivation

•Strengthened org structures & processes

ActivitiesShort-TermOutcomes

IntermediateOutcomes

Orgs offering science-based programs

Youth exposed to science-based programs

Long-TermOutcomes

Teen Preg rates

STD & HIV rates

Not evalu-ated!

CDC’s Capacity Building Initiative

Antecedent Goals and Objectives

Inputs Activities OutcomesOutputs

Contextual Variables

• Colors help you track across the page, so you see which outputs and outcomes should result from each goal

• This is just Phase II. There are other Logic Models for Phases I and III.

NCI’s Community Network Partners

DiscussionDiscussion

Lots of variation in logic modelsLots of variation in logic models Time consuming to prepareTime consuming to prepare BUTBUT

Can standardize activities and outcomesCan standardize activities and outcomes Great guide for evaluation (just develop Great guide for evaluation (just develop

data collection around the outputs and data collection around the outputs and outcomes)outcomes)

ConclusionsConclusions If the feds like logic models, you should too.If the feds like logic models, you should too. Learn them Learn them

Online tutorialsOnline tutorials Kellogg Foundation book Kellogg Foundation book

http://www.wkkf.org/Pubs/Tools/Evaluation/Pub366http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf9.pdf

Half-day workshopsHalf-day workshops PH 765 – Spring 2007 - Outreach CollegePH 765 – Spring 2007 - Outreach College

Kathryn L. Braun, DrPHKathryn L. Braun, DrPH

kbraunkbraun@@hawaiihawaii..eduedu

Documents

Learning to Love Logic Models Kathryn L. Braun, DrPH [email protected]