4
CHAPTER 5 Future Directions In this publication, we discuss key outcome indicators to evaluate comprehen- sive state tobacco control programs. Outcome indicators are important for program planning, monitoring, and evaluation. In addition, increasing demands for timelier program performance measures and the need to synthesize existing evidence for evaluation of tobacco control programs contributed to the need for this publication. The Centers for Disease Control and Prevention’s (CDC’s) future plans include (1) developing process indicators for evaluating comprehensive tobacco control programs, (2) developing process and outcome indicators for evaluating activities that address tobacco-related disparities (National Tobacco Control Program [NTCP] goal area 4), and (3) conducting research and building scientific evidence for indica- tors and theories related to tobacco control. Process Indicators Process indicators are used to measure success in program planning and imple- mentation. Indicators in this area help to answer questions about the planning, infrastructure, and implementation of a program’s activities and the extent to which these activities are reaching the target population. Process indicators are also used to understand why outcomes were or were not achieved as planned. For example, program managers can learn whether implementation of a program component could be improved or whether a new strategy is needed to overcome an unexpected obstacle (e.g., political opposition). In the NTCP logic models, the emphasis is on environmental, behavioral, and health outcomes; it is assumed that the capacity and infrastructure needed for goal-specific activities are, for the most part, in place. However, for fully informed program plan- ning and evaluation, the program’s capacity, infrastructure, and processes must also be assessed. To do so, well-defined indicators of these aspects of the program are needed. Although considerable work has been completed on defining indicators that can be used by program planners and evaluators for measuring program capacity, working with CDC partners to define these indicators in a meaningful and systematic way is necessary. Indicators for NTCP Goal Area 4: Eliminating Tobacco-related Disparities Unlike activities to prevent initiation of tobacco use by young people, eliminate nonsmokers’ exposure to secondhand smoke, and promote quitting among adults and young people, activities to identify and eliminate tobacco-related disparities lack a definitive evidence base for implementing a program and identifying target outcomes. Sufficient public health knowledge and experience exists, however, to provide a well-founded framework for approaching tasks associated with improving C H A P T E R 5 Future Directions 269

Chapter 5 - Future Directons · CHAPTER 5 Future Directions In this publication, we discuss key outcome indicators to evaluate comprehen-sive state tobacco control programs. Outcome

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Chapter 5 - Future Directons · CHAPTER 5 Future Directions In this publication, we discuss key outcome indicators to evaluate comprehen-sive state tobacco control programs. Outcome

C H A P T E R 5�

Future Directions�

In this publication, we discuss key outcome indicators to evaluate comprehen-sive state tobacco control programs. Outcome indicators are important for program planning, monitoring, and evaluation. In addition, increasing demands for timelier program performance measures and the need to synthesize existing evidence for evaluation of tobacco control programs contributed to the need for this publication.

The Centers for Disease Control and Prevention’s (CDC’s) future plans include (1) developing process indicators for evaluating comprehensive tobacco control programs, (2) developing process and outcome indicators for evaluating activities that address tobacco-related disparities (National Tobacco Control Program [NTCP] goal area 4), and (3) conducting research and building scientific evidence for indica-tors and theories related to tobacco control.

Process Indicators

Process indicators are used to measure success in program planning and imple-mentation. Indicators in this area help to answer questions about the planning, infrastructure, and implementation of a program’s activities and the extent to which these activities are reaching the target population. Process indicators are also used to understand why outcomes were or were not achieved as planned. For example, program managers can learn whether implementation of a program component could be improved or whether a new strategy is needed to overcome an unexpected obstacle (e.g., political opposition).

In the NTCP logic models, the emphasis is on environmental, behavioral, and health outcomes; it is assumed that the capacity and infrastructure needed for goal-specific activities are, for the most part, in place. However, for fully informed program plan-ning and evaluation, the program’s capacity, infrastructure, and processes must also be assessed. To do so, well-defined indicators of these aspects of the program are needed. Although considerable work has been completed on defining indicators that can be used by program planners and evaluators for measuring program capacity, working with CDC partners to define these indicators in a meaningful and systematic way is necessary.

Indicators for NTCP Goal Area 4: Eliminating Tobacco-related Disparities

Unlike activities to prevent initiation of tobacco use by young people, eliminate nonsmokers’ exposure to secondhand smoke, and promote quitting among adults and young people, activities to identify and eliminate tobacco-related disparities lack a definitive evidence base for implementing a program and identifying target outcomes. Sufficient public health knowledge and experience exists, however, to provide a well-founded framework for approaching tasks associated with improving

C H A P T E R 5 Future Directions 269

Page 2: Chapter 5 - Future Directons · CHAPTER 5 Future Directions In this publication, we discuss key outcome indicators to evaluate comprehen-sive state tobacco control programs. Outcome

the public health infrastructure and related capacities so that tobacco control programs can address tobacco-related disparities among specific populations.

Building on successful capacity-building and infrastructure activities during the past 10 years, CDC began the Disparities Pilot Training Project, an initiative to improve the state and territorial public health capacity and infrastructure needed to address tobacco-related disparities. To assist health departments and their partners with planning and implementing strategic activities to identify and eliminate tobacco-related disparities, CDC prepared a draft logic model that is based on state practices, published scientific findings, and input from external partners (see draft logic model, page 271). Instead of focusing on traditional health outcomes, this logic model focuses on the minimum capacity needed by state and territorial health departments to pursue strategic activities that would identify and eliminate tobacco-related disparities.

In cooperation with its partners, CDC will continue the task of developing an approach to identifying, evaluating, and eliminating tobacco-related disparities. The draft logic model is a window to the work that is being done now and that needs to continue.

Research Opportunities

We encourage researchers outside CDC who read this publication to identify research opportunities. For example, where the strength of the evidence for using certain in-dicators is low, expanding that evidence base would be beneficial. Researchers might also consider developing new evaluation designs that could (1) further refine theories related to tobacco control or (2) identify other outcome indicators, especially indica-tors for program components that need additional research or scientific evidence to support them. In addition, researchers might work on developing methods for measuring indicators for which no well-established methods are currently available.

K E Y O U T C O M E I N D I C A T O R S for Evaluating Comprehensive Tobacco Control Programs 270

Page 3: Chapter 5 - Future Directons · CHAPTER 5 Future Directions In this publication, we discuss key outcome indicators to evaluate comprehen-sive state tobacco control programs. Outcome

}}

C H A P T E R 5 Future Directions 271

Goal

Are

a 4

Iden

tifyi

ng a

nd E

limin

atin

g To

bacc

o-Re

late

d Di

spar

ities

Inpu

ts

Activ

ities

Ou

tput

s Ou

tcom

es

1 H

ealth

2

Con

vene

a

5Pl

anni

ng�

wor

kgro

up �

depa

rtm

ents

di

vers

e an

dan

d di

vers

e in

clus

ive

grou

p fo

rmed

�na

tiona

l, st

ate,

of

sta

keho

lder

s�tr

ibal

, and

�6

com

mun

ity

Dat

a so

urce

s pa

rtne

rs

asse

ssed

3LO

CA

TE

Acc

ess

rele

vant

Shor

t-te

rm

Inte

rmed

iate

Lo

ng- t

erm

colle

ctio

n sy

stem

Com

mun

ityno

rms

supp

ortiv

eof

toba

cco

use

Dis

sem

inat

ion

inte

rven

tions

Inst

itutio

naliz

a-tio

n an

dle

vera

ging

of

Ow

ners

hip

and

subs

tant

ive

part

icip

atio

nin

toba

cco

use

CO

MM

UN

ITY

CO

MPE

TEN

T

deve

lope

d

FUN

DIN

G a

ndR

ESO

UR

CES

Stab

le fu

ndin

g

CO

MM

UN

ITY

DEV

ELO

PMEN

T

soci

al c

apita

lde

velo

ped

for

spec

ific

popu

latio

ns

DIV

ERSI

TY

and

INC

LUSI

VIT

Y

and

prac

tice

in p

lace

12 13

16 17 18 19

Ong

oing

iden

tifica

tion

of

20

10

DA

TA S

YST

EMS

A m

ore

sens

itive

dat

a

crea

ted

prev

entio

n an

d co

ntro

l eff

orts

and

diff

usio

n of

reso

urce

s

prev

entio

n an

d co

ntro

l

INT

ERV

ENT

ION

SA

ppro

pria

te a

nd

effe

ctiv

e in

terv

entio

ns

stre

am id

entifi

ed

Cap

acity

, in

fras

truc

ture

, and

Rep

rese

ntat

ive

and

equi

tabl

e pa

rtne

rshi

ps

15

11

14

toba

cco-

rela

ted

PLA

N T

O

AD

DR

ESS

DIS

PAR

ITIE

S

Polic

y an

dda

ta s

ourc

es to

7

envi

ronm

enta

l id

entif

y to

bacc

o-C

apac

ity,

chan

gere

late

d di

spar

ities

in

fras

truc

ture

, an

d so

cial

capi

tal a

sses

sed

Hea

lth4

LEA

RN

equi

tyId

entif

y ga

ps

8To

bacc

o-�

and

asse

ss�

in a

vaila

ble

data

re

late

d �

oppo

rtun

ities

for

disp

ariti

es �

Soci

al ju

stic

eex

pand

ed d

ata

iden

tified

�co

llect

ion�

9 Q

ualit

ativ

ean

d qu

anti

tati

veda

ta n

eeds

iden

tified

disp

ariti

es

colle

ctio

n sy

stem

Com

mun

ityno

rms

supp

ortiv

eof

toba

cco

use

Dis

sem

inat

ion

inte

rven

tions

Inst

itutio

naliz

a-tio

n an

dle

vera

ging

of

Ow

ners

hip

and

subs

tant

ive

part

icip

atio

nin

toba

cco

use

CO

MM

UN

ITY

CO

MPE

TEN

T

deve

lope

d

FUN

DIN

G a

ndR

ESO

UR

CES

Stab

le fu

ndin

g

CO

MM

UN

ITY

DEV

ELO

PMEN

T

soci

al c

apita

lde

velo

ped

for

spec

ific

popu

latio

ns

DIV

ERSI

TY

and

INC

LUSI

VIT

Y

and

prac

tice

in p

lace

12 13

16 17 18 19

Ong

oing

iden

tifica

tion

of

20

10

DA

TA S

YST

EMS

A m

ore

sens

itive

dat

a

crea

ted

prev

entio

n an

d co

ntro

l eff

orts

and

diff

usio

n of

reso

urce

s

prev

entio

n an

d co

ntro

l

INT

ERV

ENT

ION

SA

ppro

pria

te a

nd

effe

ctiv

e in

terv

entio

ns

stre

am id

entifi

ed

Cap

acity

, in

fras

truc

ture

, and

Rep

rese

ntat

ive

and

equi

tabl

e pa

rtne

rshi

ps

15

11

14

toba

cco-

rela

ted

PLA

N T

O

AD

DR

ESS

DIS

PAR

ITIE

S

12 3 4

Page 4: Chapter 5 - Future Directons · CHAPTER 5 Future Directions In this publication, we discuss key outcome indicators to evaluate comprehen-sive state tobacco control programs. Outcome