Embed Size (px)
Citation preview
National Capital AreaNational Capital AreaNational Capital AreaNational Capital Area
Technical Assistance Technical Assistance Technical Assistance Technical Assistance
TrainingTrainingTrainingTraining
July 14, 2010July 14, 2010July 14, 2010July 14, 2010
Meeting Agenda• Welcome
• Introductions
• Training objectives
• Logic Models
• SMART goals/objectives
• Lunch/Networking
• Project Plans
• Program Evaluation
• Wrap-up
IntroductionsIntroductionsIntroductionsIntroductions
• Your name
• Organization you represent
• Current grantee yes/no
TRAINING OBJECTIVES
• Participants will understand
– Logic models fundamentals– How to write SMART goals/objectives– Basics of project plans and how to
use them– Evaluation Fundamentals
� Founded in 1982 by Nancy G. Brinker
� World's largest grassroots network of breast cancer survivors and activists
� Invested $1.5B, and pledge to invest another $2B in the next 10 years
� Our promise: to save lives and end breast cancer forever.
Susan G. Komen for the Cure ®
122 Domestic Affiliates and Three International – Germany, Italy and Puerto Rico
Our Work: Fighting breast cancer on all fronts
RURAL AREAS
LOCALLY
LABORATORY
GLOBALLY
GOVERNMENT POLICY
URBAN AREAS
Hospitals
Online Champions
RECRUIT
ENGAGE
Grantmaking in the National Capital Area
25% to the Global Promise Fund
75% to fund local programs
Profile Provides Direction
Continuum of Care
Application Process and Grant Program Overview
• Overview of the Process
–Important dates–Review–Notification
Logic Models
What is a logic model?
• A logic model is a systematic and visual way to present and share information
Inputs Activities Outputs Outcomes
Benefits of using logic models• Points out areas of strengths and/or weaknesses
• Provides a clearer understanding of the methods being used to bring about change
• Serves as a planning tool
• Strengthens program design and evaluation
– Helps match evaluation to program– Know what to measure
• Tool that helps organizations to consider and prioritize activities/programs
• Can strengthen the case for program investment
Logic model basics
• Underlying a logic model is a series of if-then statements
• If I have access to certain resources needed for this project then I can use them to accomplish this project
Logic model basics
• Inputs/Resources– Staff time– Money– Location– Equipment– Partnerships– Other funding– Technology
Logic model basics
• Activities
– Processes• Client reminders-example
– Tools– Events
• Provider Education Conference -example
– Actions
Logic model basics
• Outputs- can be described as of the size and/or scope of the services and products delivered or produced by the program. (Kellogg Foundation)– A program output, for example, might be the
number of classes taught, meetings held, or materials produced and distributed
Logic Model Activity
Logic model basics
• Outcomes-specific changes in behavior, knowledge, skill, attitude, and motivation
• Short-term outcomes
– Individual and organizational change
• Long-term outcomes
– Large changes have taken place within the community
Logic model basics
• Hierarchy of effects Social
Change
Actions
Learning
Reactions
Participation
Don’t forget the arrows!
• Arrows on a logic model show the “relationship” and links between the different columns (inputs/activities, outputs, outcomes)
• The arrows are important in depicting the underlying causal connections
Logic Model ActivityINPUTS ACTIVITIES OUTPUTS EVALUATION
CRITERIAOUTCOMES
Knowledge Actions Conditions
Goals/Objectives
• Goals relate to aspirations, purpose and vision.
• Objectives are the battle plan, the stepping stones on the path towards the achievement of goals
SMART GOALS/OBJECTIVES
• SPECIFIC
• MEASURABLE
• ATTAINABLE
• REALISTIC
• TIME-BOUND
Goals/Objectives
• Specific– Well defined– Clear to anyone that has a basic
knowledge of the project
• Measurable– Know if the goal is obtainable
and how far away completion is– Know when it has been achieved
Goals/Objectives• Attainable
– Agreed upon- all stakeholders
• Time-Bound– Enough time to achieve the goal
• Realistic– Within the availability of resources,
knowledge and time
Goals/Objectives
• Tips for Success– Sort out the difference between objectives and
aims, goals and/or targets before you start– Measurable is a very important consideration. – Make sure you state how you will record your
success.– Achievable is linked to measurable. Usually,
there’s no point in starting a job you know you can’t finish, or one where you can’t tell if/when you’ve finished it
Goals/Objectives
• Tips for Success– The devil is in the specific detail. – Timely means setting deadlines. You
must include one, otherwise your objective isn’t measurable. But your deadlines must be realistic, or the task isn’t achievable.
Goals/Objectives Activity
Goals/Objective Examples
• Vague goal – I want to be rich in three months.
– SMART Goal?
• Vague goal – We want to reduce breast cancer mortality.
– SMART Goal?
Goals/Objective ExamplesObjective Examples– Increase by x% the proportion of women who
participated in an educational or outreach intervention who get a mammogram within 90 days
– Decrease the average wait time for a symptomatic women seeking a mammogram
– Decrease by x% the proportion of patients with a confirmed diagnosis of breast cancer who are “lost to follow-up.”
– Decrease by x% the proportion of patients with an abnormal mammogram who are “lost to follow-up.”
Project Plans
• What are they?
• Why use them?
Benefits of Project Plans• Identify all of the phases,
activities and tasks
• Sum up the effort needed to complete those tasks
• Document all of the project inter-dependencies
• List the planning assumptions and constraints
• Create a detailed project planning schedule
• Define the project scope & milestones
• Identify the Work Breakdown Structure
• Set and agree the target delivery dates
• Monitor and control the allocation of resources
• Report on the progress of the project, to the sponsor
Project Plan Detail
• Goals
• Objectives
• Activities
• Timetable
• Evaluation methods
Project Plan Q & A
Evaluation
• What is evaluation and what does it mean?
Logic Model and Evaluation• Process Evaluation – evaluates:
– Activities delivered as intended– Participants reached as
intended
– Participant Reactions
• Outcome Evaluation – evaluates:
– Extent desired changes are occurring– Who is benefitting– What works/does not work– Unintended outcomes
• Impact Evaluation –
evaluates:
– What extent can changes be attributed to program/project?
– Program worth the resources invested?
Why Evaluate Anything?
• Gain greater understanding
• Improve performance
• Accountability
• Other reasons?
What should we evaluate?
There are some questions to answer first
– Who will be using the evaluation– What do they want to know– How will the information be used
What questions will the evaluation answer?
• What do people do differently as a result of the program?
• Are the participants satisfied with what they have learned or gained from the program?
• What are the strengths and weaknesses of the program?
• What amount of time and money were invested?
• Were all the sessions delivered? How well?
• To what extent did knowledge increase? For whom?
What information is needed to answer the questions?
• Indicators answer the questions–How will I know it –What will be the evidence–How else might you know there
was change?• Indicators can be qualitative as
well quantitative
Example of evaluation question and indicators
• What amount of time and money were invested?
Evaluation Activity
• Provide indicators for the following questions
1. Who and how many attended/did not
attend?
2. To what extent did knowledge and skills increase?
3. How many sessions were held and how effectively?
Data Collection• Sources
– Program Participants– Key Informants– Program records– Attendance logs
• Methods– Survey– Interview– Group Interviews– Testimonials– Observation– Document Review– Test– Case Study
Other Factors to Consider
• Who will be involved in data analysis?
• How will the information be share?
• Who will the information be shared with?
• What is the budget for evaluation?
• Who will be responsible for managing the evaluation process?
Evaluation Q & A
Resources• Logic Model and Evaluation Sites
– University of Wisconsin-Extension: http://www.uwex.edu/ces/lmcourse/
– Kellogg Foundation Logic Model Development Guide: www.wkkf.org
– W.K. Kellogg Foundation Evaluation Resources: http://www.wkkf.org/programming/overview.aspx?CID=281
– Intro to Program Evaluation for PH Programs—A Self-Study Guide: http://www.cdc.gov/eval/whatsnew.htm
Bringing It All Together
• Logic Models
• SMART goals/objectives
• Project Plans
• Evaluation
• Application Due Date
• Technical Assistance Meeting Reminder
