National Capital Area Technical Assistance Training …...stepping stones on the path towards the...

National Capital AreaNational Capital AreaNational Capital AreaNational Capital Area

Technical Assistance Technical Assistance Technical Assistance Technical Assistance

TrainingTrainingTrainingTraining

July 14, 2010July 14, 2010July 14, 2010July 14, 2010

Meeting Agenda• Welcome

• Introductions

• Training objectives

• Logic Models

• SMART goals/objectives

• Lunch/Networking

• Project Plans

• Program Evaluation

• Wrap-up

IntroductionsIntroductionsIntroductionsIntroductions

• Your name

• Organization you represent

• Current grantee yes/no

TRAINING OBJECTIVES

• Participants will understand

– Logic models fundamentals– How to write SMART goals/objectives– Basics of project plans and how to

use them– Evaluation Fundamentals

� Founded in 1982 by Nancy G. Brinker

� World's largest grassroots network of breast cancer survivors and activists

� Invested $1.5B, and pledge to invest another $2B in the next 10 years

� Our promise: to save lives and end breast cancer forever.

Susan G. Komen for the Cure ®

122 Domestic Affiliates and Three International – Germany, Italy and Puerto Rico

Our Work: Fighting breast cancer on all fronts

RURAL AREAS

LOCALLY

LABORATORY

GLOBALLY

GOVERNMENT POLICY

URBAN AREAS

Hospitals

Online Champions

RECRUIT

ENGAGE

Grantmaking in the National Capital Area

25% to the Global Promise Fund

75% to fund local programs

Profile Provides Direction

Continuum of Care

Application Process and Grant Program Overview

• Overview of the Process

–Important dates–Review–Notification

Logic Models

What is a logic model?

• A logic model is a systematic and visual way to present and share information

Inputs Activities Outputs Outcomes

Benefits of using logic models• Points out areas of strengths and/or weaknesses

• Provides a clearer understanding of the methods being used to bring about change

• Serves as a planning tool

• Strengthens program design and evaluation

– Helps match evaluation to program– Know what to measure

• Tool that helps organizations to consider and prioritize activities/programs

• Can strengthen the case for program investment

Logic model basics

• Underlying a logic model is a series of if-then statements

• If I have access to certain resources needed for this project then I can use them to accomplish this project

Logic model basics

• Inputs/Resources– Staff time– Money– Location– Equipment– Partnerships– Other funding– Technology

Logic model basics

• Activities

– Processes• Client reminders-example

– Tools– Events

• Provider Education Conference -example

– Actions

Logic model basics

• Outputs- can be described as of the size and/or scope of the services and products delivered or produced by the program. (Kellogg Foundation)– A program output, for example, might be the

number of classes taught, meetings held, or materials produced and distributed

Logic Model Activity

Logic model basics

• Outcomes-specific changes in behavior, knowledge, skill, attitude, and motivation

• Short-term outcomes

– Individual and organizational change

• Long-term outcomes

– Large changes have taken place within the community

Logic model basics

• Hierarchy of effects Social

Change

Actions

Learning

Reactions

Participation

Don’t forget the arrows!

• Arrows on a logic model show the “relationship” and links between the different columns (inputs/activities, outputs, outcomes)

• The arrows are important in depicting the underlying causal connections

Logic Model ActivityINPUTS ACTIVITIES OUTPUTS EVALUATION

CRITERIAOUTCOMES

Knowledge Actions Conditions

Goals/Objectives

• Goals relate to aspirations, purpose and vision.

• Objectives are the battle plan, the stepping stones on the path towards the achievement of goals

SMART GOALS/OBJECTIVES

• SPECIFIC

• MEASURABLE

• ATTAINABLE

• REALISTIC

• TIME-BOUND

Goals/Objectives

• Specific– Well defined– Clear to anyone that has a basic

knowledge of the project

• Measurable– Know if the goal is obtainable

and how far away completion is– Know when it has been achieved

Goals/Objectives• Attainable

– Agreed upon- all stakeholders

• Time-Bound– Enough time to achieve the goal

• Realistic– Within the availability of resources,

knowledge and time

Goals/Objectives

• Tips for Success– Sort out the difference between objectives and

aims, goals and/or targets before you start– Measurable is a very important consideration. – Make sure you state how you will record your

success.– Achievable is linked to measurable. Usually,

there’s no point in starting a job you know you can’t finish, or one where you can’t tell if/when you’ve finished it

Goals/Objectives

• Tips for Success– The devil is in the specific detail. – Timely means setting deadlines. You

must include one, otherwise your objective isn’t measurable. But your deadlines must be realistic, or the task isn’t achievable.

Goals/Objectives Activity

Goals/Objective Examples

• Vague goal – I want to be rich in three months.

– SMART Goal?

• Vague goal – We want to reduce breast cancer mortality.

– SMART Goal?

Goals/Objective ExamplesObjective Examples– Increase by x% the proportion of women who

participated in an educational or outreach intervention who get a mammogram within 90 days

– Decrease the average wait time for a symptomatic women seeking a mammogram

– Decrease by x% the proportion of patients with a confirmed diagnosis of breast cancer who are “lost to follow-up.”

– Decrease by x% the proportion of patients with an abnormal mammogram who are “lost to follow-up.”

Project Plans

• What are they?

• Why use them?

Benefits of Project Plans• Identify all of the phases,

activities and tasks

• Sum up the effort needed to complete those tasks

• Document all of the project inter-dependencies

• List the planning assumptions and constraints

• Create a detailed project planning schedule

• Define the project scope & milestones

• Identify the Work Breakdown Structure

• Set and agree the target delivery dates

• Monitor and control the allocation of resources

• Report on the progress of the project, to the sponsor

Project Plan Detail

• Goals

• Objectives

• Activities

• Timetable

• Evaluation methods

Project Plan Q & A

Evaluation

• What is evaluation and what does it mean?

Logic Model and Evaluation• Process Evaluation – evaluates:

– Activities delivered as intended– Participants reached as

intended

– Participant Reactions

• Outcome Evaluation – evaluates:

– Extent desired changes are occurring– Who is benefitting– What works/does not work– Unintended outcomes

• Impact Evaluation –

evaluates:

– What extent can changes be attributed to program/project?

– Program worth the resources invested?

Why Evaluate Anything?

• Gain greater understanding

• Improve performance

• Accountability

• Other reasons?

What should we evaluate?

There are some questions to answer first

– Who will be using the evaluation– What do they want to know– How will the information be used

What questions will the evaluation answer?

• What do people do differently as a result of the program?

• Are the participants satisfied with what they have learned or gained from the program?

• What are the strengths and weaknesses of the program?

• What amount of time and money were invested?

• Were all the sessions delivered? How well?

• To what extent did knowledge increase? For whom?

What information is needed to answer the questions?

• Indicators answer the questions–How will I know it –What will be the evidence–How else might you know there

was change?• Indicators can be qualitative as

well quantitative

Example of evaluation question and indicators

• What amount of time and money were invested?

Evaluation Activity

• Provide indicators for the following questions

1. Who and how many attended/did not

attend?

2. To what extent did knowledge and skills increase?

3. How many sessions were held and how effectively?

Data Collection• Sources

– Program Participants– Key Informants– Program records– Attendance logs

• Methods– Survey– Interview– Group Interviews– Testimonials– Observation– Document Review– Test– Case Study

Other Factors to Consider

• Who will be involved in data analysis?

• How will the information be share?

• Who will the information be shared with?

• What is the budget for evaluation?

• Who will be responsible for managing the evaluation process?

Evaluation Q & A

Resources• Logic Model and Evaluation Sites

– University of Wisconsin-Extension: http://www.uwex.edu/ces/lmcourse/

– Kellogg Foundation Logic Model Development Guide: www.wkkf.org

– W.K. Kellogg Foundation Evaluation Resources: http://www.wkkf.org/programming/overview.aspx?CID=281

– Intro to Program Evaluation for PH Programs—A Self-Study Guide: http://www.cdc.gov/eval/whatsnew.htm

Bringing It All Together

• Logic Models

• SMART goals/objectives

• Project Plans

• Evaluation

• Application Due Date

• Technical Assistance Meeting Reminder

Contact Information

Heather Patrickhpatrick@komen.org972-855-4359