30
KidCARE TV Promotional Evaluation NINE MONTH TEST/POST-TEST ASSESSMENT Presentation by: IMS Health Consulting & CARE Media Holdings Corp.

KidCARE TV Promotional Evaluation

Embed Size (px)

DESCRIPTION

Results of research analysis to assess the impact of CARE Media Holding’s KidCARE TV program; evaluated on Product X on prescribing behavior of participating physicians using a nine month test/post-test period.

Citation preview

Page 1: KidCARE TV  Promotional Evaluation

KidCARE TV Promotional Evaluation NINE MONTH TEST/POST-TEST ASSESSMENT

Presentation by: IMS Health Consulting & CARE Media Holdings Corp.

Page 2: KidCARE TV  Promotional Evaluation

Agenda

• Objective

• Research Methodology

• Methodology Assumptions

• Study Results

• Conclusions

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 20112

Page 3: KidCARE TV  Promotional Evaluation

Objective

• To assess the impact of CARE Media Holding’s KidCARE TV program that is being evaluated on Product X on prescribing behavior of participating physicians using a nine month test/post-test period

• This analysis is limited to participants who began exposure during April 2010

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

KidCARE TVfor

Product XIncremental

NRx?

3

Page 4: KidCARE TV  Promotional Evaluation

Agenda

• Objective

• Research Methodology

• Methodology Assumptions

• Study Results

• Conclusions

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 20114

Page 5: KidCARE TV  Promotional Evaluation

Research Methodology

• Impact of KidCARE TV programming for Product X is assessed using IMS Consulting’s Promotion EvaluationSM methodology

− Paired comparison analysis to measure changes in the product of new prescription writing behavior of a Test group relative to a similar group of Control physicians

− Utilizes physician-level new prescription data* that is “raw,” or not projected, which removes any potential bias that might be introduced by projection

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

*Data source: IMS Health’s prescriber prescription database

5

Page 6: KidCARE TV  Promotional Evaluation

Agenda

• Objectives

• Research Methodology

• Methodology Assumptions

• Study Results

• Conclusions

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 20116

Page 7: KidCARE TV  Promotional Evaluation

Research Methodology

• Impact of CARE Media’s KidCARE TV for Product X is assessed

using IMS Consulting’s Promotion EvaluationSM methodology

– Paired comparison analysis to measure changes in Product X new

prescription writing behavior of a Test group relative to a similar group

of Control physicians

– Utilizes physician-level new prescription data* that is “raw,” or not

projected, which removes any potential bias that might be introduced

by projection

*Data source: IMS Health’s prescriber prescription database

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 20117

Page 8: KidCARE TV  Promotional Evaluation

Study Time Periods

• Test physicians were initially exposed to the KidCARE TV promotion during April 2010

• NRx data for the same nine months during the previous year (as compared to the post-test period during the current year) is used as the pre-test period

• NRx data for the test month and following eight months of exposure (test/post-test period) reflects prescribing behavior influenced by the KidCARE TV promotion

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

Pre-Test Period9 Months

Test/Post-Test Period9 Months

Apr – Dec 2009 Apr – Dec 2010

8

Page 9: KidCARE TV  Promotional Evaluation

Test Group

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

2,264 Physicians participated in the KidCARE TV program for

1,888 Physicians qualified as potential Test physicians (successfully matched to the IMS

Health prescriber universe)

1,831 Physicians had a matched Control

1,548 Physicians were Specialists

283 Physicians were All Other

Specialties

9

Page 10: KidCARE TV  Promotional Evaluation

Promo.Return Client Product Study Name • Month 201010

Statistical Approaches

•ANCOVA was used to measure statistical significance of the difference between the post-test NRx volume generated by the Test and Control physicians

– Adjustments were made in the post-test period to eliminate any pre-test period differences between the Test and Control groups

– Program success was determined by looking for an Index of Adjusted Means (IAM) above “1” with a p-value <0.10, i.e., a confidence level >90% showing that the result is not due to chance

•Z-tests were performed to determine the effectiveness of the program on

– Product X NRx share, defined as the ratio of Product X NRx over market NRx, and

– Product X physician penetration, defined as the number of physicians writing at least one prescription for Product X

Page 11: KidCARE TV  Promotional Evaluation

Control Group Selection

• 1,888 potential Test physicians were matched to the IMS Health prescriber universe to identify potential Control physicians based on the following criteria:

− Product X NRx during the pre-test period;

− Product X’s competitors NRx in the pre-test period;

− Sales force promotion;

− MD geography; and

− MD specialty

• 1,831 Test physicians were successfully matched to a Control physician

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201111

Page 12: KidCARE TV  Promotional Evaluation

Methodology Assumptions

• Test and Control group physicians are assumed to have similar levels of exposure to promotional activity for the duration of the study time period

− Cannot control for disproportionate changes in promotional levels in the post-program exposure time period

• Managed care influences are also assumed to be similar between the Test and Control physicians

− Cannot control for disproportionate changes in patient flow or patient health care plans at any time of the study time period

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201112

Page 13: KidCARE TV  Promotional Evaluation

Quality Control Procedures

• Two different quality control procedures were utilized as necessary to ensure that sporadic reporters do not bias the results

− Constant Store Panel – a pharmacy must report prescription activity in each study period month to be included in the analysis

− Active Writers – a physician must generate at least one prescription during the most current three months to be included in the analysis

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201113

Page 14: KidCARE TV  Promotional Evaluation

Agenda

• Objective

• Research Methodology

• Methodology Assumptions

• Study Results

• Conclusions

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201114

Page 15: KidCARE TV  Promotional Evaluation

Product X NRx Comparison

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

0

2000

4000

6000

8000

10000

12000

Pro

du

ct

X

NR

x

Test Product X Control Product X

15

During the nine month post period, Test physicians prescribed 3.0% more Product X NRx compared to Control physicians. This change in prescribing behavior is statistically significant (cl=89.96%).

Note: cl = Confidence level; if cl >= 90% the program impact is significant, cl=80-90% is directional, else it is non-significant. Analysis conducted : ANCOVA.

Page 16: KidCARE TV  Promotional Evaluation

Competitor NRx Comparison

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

0

5000

10000

15000

20000

25000

30000

35000

40000

Co

mp

eti

tor N

Rx

Test Competitor Control Competitor

16

Test physicians prescribed 1.1% more Competitor NRx compared to Control physicians. This change in prescribing behavior is not statistically significant (cl=58.37%).

Note: cl = Confidence level; if cl >= 90% the program impact is significant, cl=80-90% is directional, else it is non-significant. Analysis conducted : ANCOVA.

Page 17: KidCARE TV  Promotional Evaluation

Market NRx Comparison

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

0

5000

10000

15000

20000

25000

30000

35000

40000

45000

50000

Market

NR

x

Test Market Control Market

17

Test physicians prescribed 1.5% more Market NRx compared to Control physicians. This change in prescribing behavior is directional (cl=79.59%).

Note: cl = Confidence level; if cl >= 90% the program impact is significant, cl=80-90% is directional, else it is non-significant. Analysis conducted : ANCOVA.

Page 18: KidCARE TV  Promotional Evaluation

Product X NRx Share Comparison

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

During the nine month test/post-test period, Product X NRx share decreased to a greater extent among Control physicians than Test physicians, resulting in a statistically significant difference in share change of +0.4 share points (cl=97.71%).

25.2% 25.2%

24.9%

24.5%

24.2%

24.3%

24.4%

24.5%

24.6%

24.7%

24.8%

24.9%

25.0%

25.1%

25.2%

25.3%

Test Group Control Group

Pro

du

ct

X

NR

x S

hare

Pre-Test Test/Post-Test

0.3 pointdecrease

0.6 point decrease

18

Note: Analysis conducted : Z-test.

Page 19: KidCARE TV  Promotional Evaluation

Product X Physician Penetration Report

89.8% 89.8%

89.1%

88.4%

87.5%

88.0%

88.5%

89.0%

89.5%

90.0%

Test Group Control Group

MD

Pen

etr

ati

on

Pre-Test Test/Post-Test

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

Physician penetration decreased to a lesser extent among Test than Control, resulting in a net increase of 0.7 points. The results are not statistically significant (cl=34.98%).

0.8 pointdecrease

1.4 point decrease

Note: Physician Penetration is defined as the ratio of MDs writing / MDs in program. Analysis conducted : Z-test

19

Page 20: KidCARE TV  Promotional Evaluation

Comparison of the Impact of KidCARE TV on Physicians by Specialty

Specialists n = 1,548All Other Specialties n = 283

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201120

Page 21: KidCARE TV  Promotional Evaluation

Participants Breakout by Specialty

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

SpecialtyPhysician

Count% of Total

Specialists 1,548 85%

All Others 283 15%

Total 1,831 100%

All Other SpecialtiesPhysician

Count% of Total Physicians with Patients Enrolled

Specialty C 117 41%

Specialty D 39 14%

Specialty E 14 5%

All Others (individual specialties comprising of less than 7%)

113 40%

Total 283 100%

21

Page 22: KidCARE TV  Promotional Evaluation

Product X NRx Volume Comparison by Specialty

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

0

2000

4000

6000

8000

10000

12000

Pro

du

ct

X

NR

x

Specialists Test Product X Specialists Control Product X

All Others Test Product X All Others Control Product X

22

Test Specialists prescribed 2.5% (cl=80.80%) more Product X NRx compared to Control physicians, as All Other Test physicians prescribed 8.7% (cl=87.00%) more NRx. These changes in prescribing behavior are directional.

Note: cl = Confidence level; if cl >= 90% the program impact is significant, cl=80-90% is directional, else it is non-significant. Analysis conducted : ANCOVA.

Page 23: KidCARE TV  Promotional Evaluation

Competitor NRx Volume Comparison by Specialty

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

0

5000

10000

15000

20000

25000

30000

35000

Co

mp

eti

tor N

Rx

Specialists Test Competitor Specialtists Control Competitor Competitor

All Others Test Competitor All Others Control Competitor

23

Note: cl = Confidence level; if cl >= 90% the program impact is significant, cl=80-90% is directional, else it is non-significant. Analysis conducted : ANCOVA.

Test Specialists prescribed 1.5% (cl=72.70%) more Competitor NRx compared to Control physicians, as All Other Test physicians prescribed 2.2% (cl=49.33%) fewer Competitor NRx. However, these changes in prescribing behavior are not statistically significant.

Page 24: KidCARE TV  Promotional Evaluation

Market NRx Volume Comparison by Specialty

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

0

5000

10000

15000

20000

25000

30000

35000

40000

45000

Market

NR

x

Specialists Test Market Specialists Control Market

All Others Test Market All Others Control Market

24

Note: cl = Confidence level; if cl >= 90% the program impact is significant, cl=80-90% is directional, else it is non-significant. Analysis conducted : ANCOVA.

Test Specialists prescribed 1.8% (cl=83.25%) more Market NRx compared to Control physicians, as All Other Test physicians prescribed 0.3% (cl=6.98%) fewer Market NRx. Specialist changes in prescribing behavior are directional, All Others are not statistically significant.

Page 25: KidCARE TV  Promotional Evaluation

Product X NRx Share Comparison by Specialty

25.7% 25.9%

20.3%19.0%

25.4% 25.3%

20.7%

17.7%

0%

5%

10%

15%

20%

25%

30%

Test Group Control Group Test Group Control Group

Sp

ecia

lists

NR

x S

hare

Pre-Test Test/Post-Test

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

The program increased Product X NRx share among All Others with statistical significance. Specialists increased share to a lesser extent, and without statistical significance.

A non-significant net increase among Test of 0.2 share points (cl=75.75%)

A significant net increase among Test of 1.6 share points (cl=99.97%)

Specialists All Others

25

Note: Analysis conducted : Z-test.

Page 26: KidCARE TV  Promotional Evaluation

Physician Penetration Comparison by Specialty

94.9% 94.9%

62.2% 62.2%

94.4% 94.0%

60.1% 58.0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Test Group Control Group Test Group Control Group

% P

hysic

ian

Pen

etr

ati

on

Pre-Test Test/Post-Test

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

Physician penetration increased among All Others to a greater extent than among Specialists. However, results are not statistically significant.

A non-significant net increase of 0.4points (cl=26.29%)

A non-significant net increase of 2.1 points (cl=28.49%)

Specialists All Others

26

Note: Physician Penetration is defined as the ratio of MDs writing / MDs in program. Analysis conducted : Z-test

Page 27: KidCARE TV  Promotional Evaluation

ROI Analysis – Methodology

Step I

Step II

• Calculate Average Product TRx (average retail price for a prescription) = TRx sales/ 9 month study period (for ) is $148.30 (source: IMS NPA Plus – TRx retail price)

Step III

• Calculate Revenue Associated with Test Physicians = Projected Product X TRx x Average Product Price

350,703 x $148.30 = $52,008,378

Step IV

• Calculate Revenue Associated with Control Physicians = Projected Product X TRx for Control Physicians* x Average Product Price

340,488 x $148.30 = $50,493,519

Note: Projected Product TRx for Control physicians calculated using Index of Adjusted Means (1.03) from ANCOVA, which means Test physicians wrote 3.0% more NRx than Control physicians during a 9 month post-test period.

• Incremental Revenue due to the program = Revenue Associated with Test Physicians – Revenue Associated with Control Physicians

$52,008,378 - $50,493,519 = $1,514,859

Step V• Return on Investment = Incremental Revenue from program/

Cost of the program

$1,514,859/$236,460 = 6.4:1 or $1,278,399

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 2011

Page 28: KidCARE TV  Promotional Evaluation

Agenda

• Objective

• Research Methodology

• Methodology Assumptions

• Study Results

• Conclusions

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201128

Page 29: KidCARE TV  Promotional Evaluation

Conclusions

• The KidCARE TV promotion for Product X was successful at increasing Product X NRx volume and share with statistical significance. During the latter months of the post-test period, Test group appears to be outperforming the Control group as evidenced by the separation in trend lines. The program also retained writers as indicated by the positive result for physician penetration, however results are not statistically significant.

− Among the specialties, Specialists increased Product X NRx directionally, with a non-significant increase in share. All Others showed a directional increase in NRx volume, with a significant increase in share.

− Both specialty groups showed non-significant increases in physician penetration.

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201129

Page 30: KidCARE TV  Promotional Evaluation

Conclusions

• The KidCARE TV promotion for was successful at increasing Product X NRx volume and share with statistical significance. During the latter months of the post-test period, Test group appears to be outperforming the Control group as evidenced by the separation in trend lines. The program also retained writers as indicated by the positive result for physician penetration, however results are not statistically significant.

− Among the specialties, Specialists increased NRx directionally, with a non-significant increase in share. All Others showed a directional increase in NRx volume, with a significant increase in share.

− Both specialty groups showed non-significant increases in physician penetration.

Promo.Return CARE Media Holdings KidCARE TV Final Report • February 201130