21
Linking program efforts with outcomes The Strength of Community Health Programming Index Sarah C. Shelton, MPH, CHES Center for Tobacco Policy Research Washington University in St. Louis American Evaluation Association Annual Conference November 11, 2009

Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Linking program efforts with outcomes

The Strength of CommunityHealth Programming Index

Sarah C. Shelton, MPH, CHESCenter for Tobacco Policy ResearchWashington University in St. Louis

American Evaluation Association Annual Conference

November 11, 2009

Page 2: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Presentation OverviewBackground

Planning and Development

Construct Components and Reliability

Preliminary Results

Implications

Page 3: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Background

Page 4: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

MFH Tobacco Prevention and Cessation Initiative (TPCI)

9-year, $40M commitment initiated in 2004

Page 5: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

TPCI Program Sites,2005-062007-08

Page 6: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Challenge of TPCI Evaluation

OutcomesEfforts

Page 7: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Planning and Development

Page 8: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Strength of CommunityHealth Programming Index

Metric that measures the extensiveness of TPCI efforts at the county level

( + )* = Index Score

Depth Breadth Quality

Page 9: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Construct Components and

Reliability

Page 10: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Construct Components

Depth

Amount of Funding

# of program

sites

# of people reached

Page 11: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Depth Construct Reliability

Cronbach’s alpha = .786

Page 12: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Construct Components

Breadth

# of populations

targeted

# of types of settings

# of activity categories

Page 13: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Breadth Construct Reliability

Cronbach’s alpha = .902

Page 14: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

*Potential*Construct Components

Quality

Level of evidence Sustainability

Evaluation Replicability

Page 15: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Preliminary Results

Page 16: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Depth Construct Scores

Page 17: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Breadth Construct Scores

Page 18: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Implications

Page 19: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Implications for…Evaluators

Tool to link program efforts with outcomes

FundersIdentify gaps in activitiesStrategic planning; identify priority funding areasDetermine where over- or under-funding

Public Health StakeholdersCan be translated to other health issues

Page 20: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

AcknowledgementsCenter for Tobacco Policy Research

Stephanie HerbersDouglas LukeAmy SorgJenine Harris

Missouri Foundation for HealthMatthew Kuhlenbeck

Page 21: Linking program efforts with outcomes€¦ · American Evaluation Association . ... Challenge of TPCI Evaluation. Efforts Outcomes. Planning and Development. Strength of Community

Contact Information

Sarah SheltonCenter for Tobacco Policy ResearchWashington University in St. Louis

[email protected]

http://ctpr.wustl.edu