National Capital AreaNational Capital AreaNational Capital AreaNational Capital Area
Technical Assistance Technical Assistance Technical Assistance Technical Assistance
TrainingTrainingTrainingTraining
July 14, 2010July 14, 2010July 14, 2010July 14, 2010
Meeting Agenda• Welcome
• Introductions
• Training objectives
• Logic Models
• SMART goals/objectives
• Lunch/Networking
• Project Plans
• Program Evaluation
• Wrap-up
IntroductionsIntroductionsIntroductionsIntroductions
• Your name
• Organization you represent
• Current grantee yes/no
TRAINING OBJECTIVES
• Participants will understand
– Logic models fundamentals– How to write SMART goals/objectives– Basics of project plans and how to
use them– Evaluation Fundamentals
� Founded in 1982 by Nancy G. Brinker
� World's largest grassroots network of breast cancer survivors and activists
� Invested $1.5B, and pledge to invest another $2B in the next 10 years
� Our promise: to save lives and end breast cancer forever.
Susan G. Komen for the Cure ®
122 Domestic Affiliates and Three International – Germany, Italy and Puerto Rico
Our Work: Fighting breast cancer on all fronts
RURAL AREAS
LOCALLY
LABORATORY
GLOBALLY
GOVERNMENT POLICY
URBAN AREAS
Hospitals
Online Champions
RECRUIT
ENGAGE
Grantmaking in the National Capital Area
25% to the Global Promise Fund
75% to fund local programs
Profile Provides Direction
Continuum of Care
Application Process and Grant Program Overview
• Overview of the Process
–Important dates–Review–Notification
Logic Models
What is a logic model?
• A logic model is a systematic and visual way to present and share information
Inputs Activities Outputs Outcomes
Benefits of using logic models• Points out areas of strengths and/or weaknesses
• Provides a clearer understanding of the methods being used to bring about change
• Serves as a planning tool
• Strengthens program design and evaluation
– Helps match evaluation to program– Know what to measure
• Tool that helps organizations to consider and prioritize activities/programs
• Can strengthen the case for program investment
Logic model basics
• Underlying a logic model is a series of if-then statements
• If I have access to certain resources needed for this project then I can use them to accomplish this project
Logic model basics
• Inputs/Resources– Staff time– Money– Location– Equipment– Partnerships– Other funding– Technology
Logic model basics
• Activities
– Processes• Client reminders-example
– Tools– Events
• Provider Education Conference -example
– Actions
Logic model basics
• Outputs- can be described as of the size and/or scope of the services and products delivered or produced by the program. (Kellogg Foundation)– A program output, for example, might be the
number of classes taught, meetings held, or materials produced and distributed
Logic Model Activity
Logic model basics
• Outcomes-specific changes in behavior, knowledge, skill, attitude, and motivation
• Short-term outcomes
– Individual and organizational change
• Long-term outcomes
– Large changes have taken place within the community
Logic model basics
• Hierarchy of effects Social
Change
Actions
Learning
Reactions
Participation
Don’t forget the arrows!
• Arrows on a logic model show the “relationship” and links between the different columns (inputs/activities, outputs, outcomes)
• The arrows are important in depicting the underlying causal connections
Logic Model ActivityINPUTS ACTIVITIES OUTPUTS EVALUATION
CRITERIAOUTCOMES
Knowledge Actions Conditions
Goals/Objectives
• Goals relate to aspirations, purpose and vision.
• Objectives are the battle plan, the stepping stones on the path towards the achievement of goals
SMART GOALS/OBJECTIVES
• SPECIFIC
• MEASURABLE
• ATTAINABLE
• REALISTIC
• TIME-BOUND
Goals/Objectives
• Specific– Well defined– Clear to anyone that has a basic
knowledge of the project
• Measurable– Know if the goal is obtainable
and how far away completion is– Know when it has been achieved
Goals/Objectives• Attainable
– Agreed upon- all stakeholders
• Time-Bound– Enough time to achieve the goal
• Realistic– Within the availability of resources,
knowledge and time
Goals/Objectives
• Tips for Success– Sort out the difference between objectives and
aims, goals and/or targets before you start– Measurable is a very important consideration. – Make sure you state how you will record your
success.– Achievable is linked to measurable. Usually,
there’s no point in starting a job you know you can’t finish, or one where you can’t tell if/when you’ve finished it
Goals/Objectives
• Tips for Success– The devil is in the specific detail. – Timely means setting deadlines. You
must include one, otherwise your objective isn’t measurable. But your deadlines must be realistic, or the task isn’t achievable.
Goals/Objectives Activity
Goals/Objective Examples
• Vague goal – I want to be rich in three months.
– SMART Goal?
• Vague goal – We want to reduce breast cancer mortality.
– SMART Goal?
Goals/Objective ExamplesObjective Examples– Increase by x% the proportion of women who
participated in an educational or outreach intervention who get a mammogram within 90 days
– Decrease the average wait time for a symptomatic women seeking a mammogram
– Decrease by x% the proportion of patients with a confirmed diagnosis of breast cancer who are “lost to follow-up.”
– Decrease by x% the proportion of patients with an abnormal mammogram who are “lost to follow-up.”
Project Plans
• What are they?
• Why use them?
Benefits of Project Plans• Identify all of the phases,
activities and tasks
• Sum up the effort needed to complete those tasks
• Document all of the project inter-dependencies
• List the planning assumptions and constraints
• Create a detailed project planning schedule
• Define the project scope & milestones
• Identify the Work Breakdown Structure
• Set and agree the target delivery dates
• Monitor and control the allocation of resources
• Report on the progress of the project, to the sponsor
Project Plan Detail
• Goals
• Objectives
• Activities
• Timetable
• Evaluation methods
Project Plan Q & A
Evaluation
• What is evaluation and what does it mean?
Logic Model and Evaluation• Process Evaluation – evaluates:
– Activities delivered as intended– Participants reached as
intended
– Participant Reactions
• Outcome Evaluation – evaluates:
– Extent desired changes are occurring– Who is benefitting– What works/does not work– Unintended outcomes
• Impact Evaluation –
evaluates:
– What extent can changes be attributed to program/project?
– Program worth the resources invested?
Why Evaluate Anything?
• Gain greater understanding
• Improve performance
• Accountability
• Other reasons?
What should we evaluate?
There are some questions to answer first
– Who will be using the evaluation– What do they want to know– How will the information be used
What questions will the evaluation answer?
• What do people do differently as a result of the program?
• Are the participants satisfied with what they have learned or gained from the program?
• What are the strengths and weaknesses of the program?
• What amount of time and money were invested?
• Were all the sessions delivered? How well?
• To what extent did knowledge increase? For whom?
What information is needed to answer the questions?
• Indicators answer the questions–How will I know it –What will be the evidence–How else might you know there
was change?• Indicators can be qualitative as
well quantitative
Example of evaluation question and indicators
• What amount of time and money were invested?
Evaluation Activity
• Provide indicators for the following questions
1. Who and how many attended/did not
attend?
2. To what extent did knowledge and skills increase?
3. How many sessions were held and how effectively?
Data Collection• Sources
– Program Participants– Key Informants– Program records– Attendance logs
• Methods– Survey– Interview– Group Interviews– Testimonials– Observation– Document Review– Test– Case Study
Other Factors to Consider
• Who will be involved in data analysis?
• How will the information be share?
• Who will the information be shared with?
• What is the budget for evaluation?
• Who will be responsible for managing the evaluation process?
Evaluation Q & A
Resources• Logic Model and Evaluation Sites
– University of Wisconsin-Extension: http://www.uwex.edu/ces/lmcourse/
– Kellogg Foundation Logic Model Development Guide: www.wkkf.org
– W.K. Kellogg Foundation Evaluation Resources: http://www.wkkf.org/programming/overview.aspx?CID=281
– Intro to Program Evaluation for PH Programs—A Self-Study Guide: http://www.cdc.gov/eval/whatsnew.htm
Bringing It All Together
• Logic Models
• SMART goals/objectives
• Project Plans
• Evaluation
• Application Due Date
• Technical Assistance Meeting Reminder
Recommended
