13
www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 831 ABSTRACT BACKGROUND: There is evidence that pharmacist interventions improve clinical outcomes. The few studies that address economic outcomes (a) often report estimated instead of actual medical costs, (b) report only medication costs, or (c) have been conducted in settings that are not typical of community-based primary care. OBJECTIVES: To (a) determine whether a clinical pharmacist’s recommen- dations to physicians regarding optimizing medication therapy are related to medical costs in capitated patients in an internal medicine practice, and (b) compare what primary care physicians (PCPs) in a comparison group actually did proactively to optimize medication therapy versus what a clinical pharmacist would have recommended to them. METHODS: This was a prospective, controlled study comparing 2 internal medicine practices. Study enrollment was performed using a screening process carried out every 1-2 weeks on a rolling basis for 1 year from July 2001 through June 2002. Eligibility criteria for prospective enrollment were (a) 1 or more risk factors: at least 1 chronic disease or an event (e.g., emergency room visit, adverse drug reaction, medication nonadher- ence) or aged 50 years or older, (b) a scheduled visit to see a PCP within 2 weeks from the screening date or a diagnosis of diabetes without a PCP visit during the first 6 months of the study, (c) need for optimization of medication therapy as determined by a clinical pharmacist on the screening date, and (d) 12 months of continuous insurance eligibility before enroll- ment in the study. For inclusion in the final study analyses, patients were also required to have continuous insurance eligibility through 12 months from study enrollment. One clinical pharmacist made recommendations to optimize medication therapy in the intervention group. For the compari- son group, the same pharmacist proposed recommendations that remained concealed from the physicians. The primary outcome measure was per patient per year (PPPY) medical cost, based on plan liability (gross allowable costs minus patient costs), excluding prescription drug cost. Additional outcome measures included numbers of outpatient visits, hospital admissions, emergency room (ER) visits per 1,000 patients, and hospital days; and percent of recommendations that were accepted by the PCPs. Changes in outcome measures from the pre-intervention to post- intervention period were compared across study groups in a difference-in- difference analysis, using the Student’s t -test for normally distributed data and the Mann-Whitney U -test (nonparametric) for skewed data. RESULTS: There were 127 and 216 adult patients in the intervention and comparison groups, respectively. The primary outcome, change in mean PPPY medical (excluding pharmacy) cost, did not differ significantly between the groups ( P = 0.711). The between-group difference in the change in ER visits per 1,000 patients approached statistical significance ( P = 0.054). Intervention group patients were more likely than comparison group patients to have the following issues addressed: medication non- adherence (85.7% vs. 40.0%, respectively; P = 0.032), untreated indication (72.6% vs. 11.5%, P < 0.001), suboptimal medication choice (60.0% vs. 5.9%, P < 0.001) and cost-ineffective drug therapies (72.1% vs. 6.5%, P < 0.001). Of the estimated number of actionable opportunities identified for the comparison group (but concealed from the physicians), 23.5% were adopted by comparison group physicians without any assistance from a clinical pharmacist. CONCLUSION: Compared with patients of PCPs who received no input from a clinical pharmacist, patients of PCPs who received clinical pharmacist recommendations were more likely to have several medication-related issues addressed, including medication nonadherence, untreated indica- tions, suboptimal medication choices, and cost-ineffective drug therapies. However, total medical (excluding pharmacy) costs for the intervention and comparison groups were not significantly different. J Manag Care Pharm. 2008;14(9):831-43 Copyright © 2008, Academy of Managed Care Pharmacy. All rights reserved. A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System Jeanette L. Altavela, PharmD, BCPS; Matt K. Jones, BA; and Merrilee Ritter, MS RESEARCH • Pharmacists can optimize medication therapy, resulting in improved patient outcomes, such as decreased exacerbations in patients with congestive heart failure and improved blood sugar management in patients with diabetes. • Pharmacists are effective at recognizing potential and actual drug-related problems, such as drug-induced conditions and clinically relevant drug interactions. • Pharmacist interventions can limit health care costs in specific groups of patients such as Medicaid and some health mainte- nance organizations. What is already known about this subject What this study adds • Patients in the intervention group were more than twice as likely to have medication nonadherence issues addressed (85.7% vs. 40.0%, P =0.032), 6 times as likely to have a medication pre- scribed that was indicated but not prescribed previously (72.6% vs. 11.5%, P <0.001), 10 times as likely to be prescribed an opti- mal medication for their condition (60.0% vs. 5.9%, P < 0.001) and 11 times as likely to have their PCP prescribe more cost- effective therapies (72.1% vs. 6.5%, P < 0.001). • Of the estimated number of actionable opportunities identi- fied by the clinical pharmacist for the comparison group but concealed from physicians, 23.5% were adopted by physicians without any intervention, whereas 76.5% were not adopted. • The intervention and comparison groups did not significantly differ with respect to the study’s primary outcome, change in per patient per year (PPPY) medical cost excluding costs for pre- scription medications (P =0.711). From the pre-intervention to post-intervention period, mean PPPY medical costs declined by 15.1% in the intervention group and increased by 39.7% in the comparison group; however, median 12-month costs increased in both study groups, from $1,045 to $1,411 in the intervention group and from $1,130 to $1,638 in the comparison group.

A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

Embed Size (px)

Citation preview

Page 1: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 831

ABSTRACT

BACKGROUND: There is evidence that pharmacist interventions improve clinical outcomes. The few studies that address economic outcomes (a) often report estimated instead of actual medical costs, (b) report only medication costs, or (c) have been conducted in settings that are not typical of community-based primary care.

OBJECTIVES: To (a) determine whether a clinical pharmacist’s recommen-dations to physicians regarding optimizing medication therapy are related to medical costs in capitated patients in an internal medicine practice, and (b) compare what primary care physicians (PCPs) in a comparison group actually did proactively to optimize medication therapy versus what a clinical pharmacist would have recommended to them.

METHODS: This was a prospective, controlled study comparing 2 internal medicine practices. Study enrollment was performed using a screening process carried out every 1-2 weeks on a rolling basis for 1 year from July 2001 through June 2002. Eligibility criteria for prospective enrollment were (a) 1 or more risk factors: at least 1 chronic disease or an event (e.g., emergency room visit, adverse drug reaction, medication nonadher-ence) or aged 50 years or older, (b) a scheduled visit to see a PCP within 2 weeks from the screening date or a diagnosis of diabetes without a PCP visit during the first 6 months of the study, (c) need for optimization of medication therapy as determined by a clinical pharmacist on the screening date, and (d) 12 months of continuous insurance eligibility before enroll-ment in the study. For inclusion in the final study analyses, patients were also required to have continuous insurance eligibility through 12 months from study enrollment. One clinical pharmacist made recommendations to optimize medication therapy in the intervention group. For the compari-son group, the same pharmacist proposed recommendations that remained concealed from the physicians. The primary outcome measure was per patient per year (PPPY) medical cost, based on plan liability (gross allow able costs minus patient costs), excluding prescription drug cost. Additional outcome measures included numbers of outpatient visits, hospital admissions, emergency room (ER) visits per 1,000 patients, and hospital days; and percent of recommendations that were accepted by the PCPs. Changes in outcome measures from the pre-intervention to post-intervention period were compared across study groups in a difference-in-difference analysis, using the Student’s t-test for normally distributed data and the Mann-Whitney U-test (nonparametric) for skewed data.

RESULTS: There were 127 and 216 adult patients in the intervention and comparison groups, respectively. The primary outcome, change in mean PPPY medical (excluding pharmacy) cost, did not differ significantly between the groups (P = 0.711). The between-group difference in the change in ER visits per 1,000 patients approached statistical significance (P = 0.054). Intervention group patients were more likely than comparison group patients to have the following issues addressed: medication non-adherence (85.7% vs. 40.0%, respectively; P = 0.032), untreated indication (72.6% vs. 11.5%, P < 0.001), suboptimal medication choice (60.0% vs. 5.9%, P < 0.001) and cost-ineffective drug therapies (72.1% vs. 6.5%, P < 0.001). Of the estimated number of actionable opportunities identified for the comparison group (but concealed from the physicians), 23.5% were adopted by comparison group physicians without any assistance from a clinical pharmacist.

CONCLUSION: Compared with patients of PCPs who received no input from a clinical pharmacist, patients of PCPs who received clinical pharmacist

recommendations were more likely to have several medication-related issues addressed, including medication nonadherence, untreated indica-tions, suboptimal medication choices, and cost-ineffective drug therapies. However, total medical (excluding pharmacy) costs for the intervention and comparison groups were not significantly different.

J Manag Care Pharm. 2008;14(9):831-43

Copyright © 2008, Academy of Managed Care Pharmacy. All rights reserved.

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

Jeanette L. Altavela, PharmD, BCPS; Matt K. Jones, BA; and Merrilee Ritter, MS

RESEARCH

• Pharmacists can optimize medication therapy, resulting inimproved patient outcomes, such as decreased exacerbations inpatientswith congestiveheart failure and improvedbloodsugarmanagementinpatientswithdiabetes.

• Pharmacists are effective at recognizing potential and actualdrug-related problems, such as drug-induced conditions andclinicallyrelevantdruginteractions.

• PharmacistinterventionscanlimithealthcarecostsinspecificgroupsofpatientssuchasMedicaidandsomehealthmainte-nanceorganizations.

What is already known about this subject

What this study adds

• Patientsintheinterventiongroupweremorethantwiceaslikelytohavemedicationnonadherence issuesaddressed(85.7%vs.40.0%,P =0.032), 6 times as likely tohave amedicationpre-scribedthatwasindicatedbutnotprescribedpreviously(72.6%vs.11.5%,P <0.001),10timesaslikelytobeprescribedanopti-malmedicationfortheircondition(60.0%vs.5.9%,P < 0.001) and11 timesas likely tohave theirPCPprescribemorecost-effectivetherapies(72.1%vs.6.5%,P < 0.001).

• Of the estimated number of actionable opportunities identi-fied by the clinical pharmacist for the comparison groupbutconcealedfromphysicians,23.5%wereadoptedbyphysicianswithoutanyintervention,whereas76.5%werenotadopted.

• The interventionandcomparisongroupsdidnotsignificantlydifferwith respect to the study’sprimaryoutcome,change inperpatientperyear(PPPY)medicalcostexcludingcostsforpre-scriptionmedications(P =0.711).Fromthepre-interventiontopost-interventionperiod,meanPPPYmedicalcostsdeclinedby15.1%intheinterventiongroupandincreasedby39.7%inthecomparisongroup;however,median12-monthcostsincreasedinbothstudygroups,from$1,045to$1,411intheinterventiongroupandfrom$1,130to$1,638inthecomparisongroup.

Page 2: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

832 Journal of Managed Care Pharmacy JMCP November/December 2008 Vol. 14, No. 9 www.amcp.org

Studieshaveshownthatpharmacistconsultationprogramscan improve clinical outcomes by optimizingmedicationuse in ambulatory patients.1-5 Among patients in a heart

failure clinic, a program of pharmacist evaluation (medicationevaluationandrecommendations,patienteducationandfollow-uptelemonitoring)resultedinasignificantdecreaseinheartfail-ureeventsandall-causemortality.Studyauthorsattributedthisresult to closer follow-upandoptimizingdosesof angiotensin-convertingenzyme(ACE)inhibitors.1In2randomizedtrialsofpatients with hypertension, those whowere treated collabora-tivelybyphysiciansandpharmacistsachievedbettercontrolofbloodpressurethandidthosewhoweremanagedbythephysi-cianalone.2,3Thephysician-pharmacistteamin1studyincreasedmedication optimization by titrating doses more effectively,switchingtolessexpensiveormoreappropriateformulationsofmedications,andincreasingappropriatelaboratorymonitoring.2 Evenwhenpatients’medicationswerenotchanged,bloodpres-sureswerestillimproved.Theauthorsspeculatedthatimprovedmedicationadherenceandbeneficialeducationabouthyperten-sioncontributedtotheseoutcomes.2Collaborationbetweenphy-siciansandpharmacistshasresultedinahigherrateofpatientsmeetingtheirlipid-levelgoalsthanpreviouslyachievedwithoutcollaborationinthesamepractice.4TheAshevilleProjectdemon-stratedthatclosecollaborationbetweencommunitypharmacistsandpatientswithdiabetesmellituswasassociatedwithimprovedbloodsugarmanagement.5

TheNationalCommitteeforQualityAssurance’skeyprogramfor quality measurement is the Healthcare Effectiveness DataandInformationSet (HEDIS).Since2007,HEDIShas includedmeasuresofhealthcareefficiencyinthecostofcare,referredtoas “relative resource use” for chronic conditions. For example,asthma and cardiovascular conditions are measured both forquality,suchasappropriatemedicationuseandmedicationadher-ence,andforthecostofcare.6,7Somestudiesofclinicalpharma-cistactivitieshaveconcentratedonloweringmedicationcosts,8,9 butfewhaveattemptedtolookattheimpactonmedicalhealthcare costs andutilization.Loweringmedication costshasbeenaccomplishedbysimplifyingmedicationregimens,recommend-inglessexpensivealternatives,andprovidingpharmacotherapyconsultationdirectlytopatients.8-10Inanefforttodecreasemedi-calhealthcarecostsandutilization,somestudieshavedemon-stratedthatpharmacistseffectivelyidentifypotentialandactualdrug-relatedproblems,potentiallyresultingincostavoidance.8,10

Previous studies that assessed clinical or medical cost out-comes were either conducted in U.S. Department of VeteransAffairs (VA) systems, in a setting where the patient was seenataseparatepharmacistvisit, inapharmacist-runclinic,or inpopulationsthatweredissimilartogeneralprimarycareinternalmedicinepractices.10-14Althoughthesestudiesdescribeeffectivemodels,theydonotextrapolatewelltothetypicalprimarycare,internalmedicinepracticewheremedicalpatientsaremostoftenseenbyphysiciansandinwhichpharmaciststypicallyhaveno

access to pertinent medical information (e.g., medical history,progress notes, laboratory and other test results, and consultnotes)necessarytomakeclinicalrecommendationstoprescrib-ers. Embedding a clinical pharmacistwithin the primary carepracticecanremovethosebarriers.

Inthe2yearsbeforethepresentstudy,2clinicalpharmacistsworking for the Greater Rochester Independent Practice Asso-ciation (GRIPA) had gained experience with a number of pri-marycarephysicians(PCPs)onhowtoimprovemedicationuse and prevent the known hazards associated with medicationmisuseintheirpatients.GRIPAisauniquepartnershipofmorethan 600 physicians and 2 hospitals in 2 counties inwestern NewYork. Thepharmacistswere locatedwithin the physicianpracticewithlittledisruptiontothenormalofficeworkflow.Atthat time, thepharmacistsdidnotmeetwith thepatients, butprovidedwritten recommendations to eachpatient’s physician.The clinical pharmacist had opportunities to affect a patient’smedicationadherence,toensurethatthemostappropriatemedi-cationswerebothprescribedandmonitoredappropriately,andtohelpprevent therapeutic duplication and adversedrug reac-tions.Inaddition,pharmacistsservedasadynamicdruginfor-mationresourceforthephysician.Forpatientswhosecarewasaffected by the clinical pharmacist’s recommendations, a trendtoward lowered medical health care costs and utilization wasobserved.15,16However,nocomparisongroupofpatientswithouttheservicesofaclinicalpharmacistwasavailableatthattime.

Theprimarypurposeofthepresentstudywastodeterminewhethertherecommendationsofaclinicalpharmacistembeddedin a primary care practice, which had not previously receivedservices fromGRIPA’sclinicalpharmacists,woulddecrease themedical costs of capitated patients. The secondary purpose ofthestudywastocompareactionstakenbyphysiciansinacom-parisongroup,whichreceivednopharmacistinput,withactionstakenbyphysicianswhowereprovidedrecommendationsbyaclinicalpharmacist.

■■ MethodsStudy SettingThiswasaprospective,controlledstudyconductedin2primarycare practices located in the suburbs of Rochester, New York.One practice served as the intervention group, and the otherserved as the comparison group. Physicians at both practicesweremembersofGRIPAandhadnever received services fromGRIPA’s clinical pharmacists. ViaHealth, GRIPA’s parent com-pany, owns 2 hospitals and one-half ofGRIPA; the physiciansowntheotherhalf.GRIPAoperatesunderfinancialriskcontractswith insurance companies. A portion of the patients in theseprimarycarepracticesweremembersofaninsurancecompanywithwhichGRIPAhadariskcontract.Thepatientswereenrolledin either the insurance company’s commercial insurance planor itsMedicare insurance product. The risk contract providedGRIPAwithanincentivetoproactivelyoptimizemedicalcareto

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

Page 3: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

decrease its financialrisk.Themedicalcostdata, termed“planliability”inthisstudy,wereactual(notestimated)plansponsorcosts (gross allowable costs minus patient costs). The patientsforwhomGRIPAandtheirphysiciansareatriskare“capitated”patients. Although the plan was capitated, the physicians hadincentive to submit all claims to receive payment for servicesprovided.Theriskcontractprovidedopportunityforphysicianstogetpaidmorethanthestandardfeesreimbursedthroughtheclaimssubmissionandpaymentprocess.

The intervention group practice had 957 capitated patients,andthecomparisongrouppracticehad1,272capitatedpatients,with12.3%and31.6%enrolledintheMedicareinsuranceprod-uct,respectively.Theremainingcapitatedpatientsineachgroupwereenrolledinthecommercial insuranceproduct.Bothprac-ticesconsistedofinternalmedicinephysicians,with2physiciansin the intervention group and 4 physicians in the comparisongroup.Theinterventiongroupwasprivatelyowned,whereasthecomparisongroupwasownedbyViaHealth.Bothpracticesusedpaper-basedmedical records and appointment scheduling sys-tems.The2physiciansintheinterventiongrouphadpracticedfor18and6years,respectively,whereasthe4physiciansinthecomparisongrouphadbeeninpracticefor20yearsonaverage(range17-25years).

One clinical pharmacist worked within both practices andbrought a laptop computer to record her activity in a securedatabase.Attheinterventiongrouppractice,thepharmacistdidnot have Internet access. The comparison group practice wasequippedwithcomputerswithlimitedInternetaccess,whichthepharmacistcoulduseifneeded.Theclinicalpharmacistrecordedmedicationrecommendationsthatwereeitherprovidedtophysi-cians(interventiongroup)orconcealed(comparisongroup).

Writteninformedconsentwasobtainedfromthephysiciansatbothpractices.TheViaHealthClinicalInvestigationsCommittee(institutionalreviewboard)approvedthisstudy.

Patient SelectionPatientsenrolledinthisstudywerecontinuouslyenrolledin1ofthe2contractedinsuranceproducts(commercialorMedicare)fortheentire12monthsbeforetheirstudyenrollmentdatetoensurethattherewerecompletebaselineclaimsdata.Thepatientselec-tionperiod,duringwhichpatientswereentered into thestudyinarollingscreeningandenrollmentprocessconductedbytheclinicalpharmacistevery1-2weeks,beganonJuly1,2001,andendedonJune30,2002.Patientmembershipstatuswasprovidedtothepharmacistatstudyinitiation,andinsuranceclaimswereused todetermine eachpatient’s risk factors,whichwereusedaspartoftheentrycriteriainthestudy(Table1).Tobeeligiblefor enrollment into the study,patientshad tobe scheduled foranappointmentwithaPCPwithin1-2weeksof the screeningdateorhaveadiagnosisofdiabetesmellitusdocumentedintheirclaimsbutnoPCPvisitduringthefirst6monthsofthestudy.The second criterion served to identify patients with diabetes

mellitusthatdidnothaveoptimalfollow-upcare.Patientsidenti-fiedontheappointmentschedulehadtomeetat least1of thefollowing 2 criteria: (a) 1 ormore of the risk factors listed in Table1,identifiedthroughInternational Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM), DiagnosisRelatedGroup(DRG),orCurrentProceduralTerminology(CPT)codesfoundineachpatient’sinsuranceclaimsforthe12monthsbeforeApril 2001, or (b) absence of anyof the above risk fac-tors,but aged50yearsorolder.Finally, aneed formedicationoptimizationwasrequiredforstudyentry;patientsmeetingtheotherstudycriteriawereenrolledonlyiftheclinicalpharmacistrecorded recommendations to optimize medication therapy,whether reported to thePCP(interventiongroup)orconcealed(comparisongroup).

Each patient’s study enrollment date was the first date onwhichthepharmacistmadearecommendationforthatpatient.Post-enrollment follow-up lasted 12 months for each patient.Thus,tobeincludedinthefinalstudyanalyses,thepatienthadtomaintain continuous insurance eligibility and remain in thecareof thesamePCPfor the12monthsafter thestudyenroll-ment date. Insurance eligibility was determined by amonthlymembershiprostersenttoGRIPAfromtheinsurancecompany.ThemembershipstatusandriskfactorevaluationofthepatientsinthephysicianpracticeswereupdatedinJanuary2002.

TABLE 1 Risk Criteria for Study Entry: Hospital and Medical Claim Codes

ICD-9-CM DRG CPTDiabetes 250.XX 294,295

Congestiveheartfailure 428.XX 115,124,125,127

Coronaryarterydisease 410, 410.9 411.XX, 412-414.XX, (Except414.1 414.10, 414.11 or 414.19)

106,107,109,112, 116, 121, 122, 123, 132, 140

33510-33545

Asthma 493.XX 096,097

Chronicobstructive pulmonarydisease

491-492.XX 493.2 496.XX

088

Hypertension 401-405.XX 134

Hypercholesterolemia 272.XX

Migraine 346.XX

Atrialfibrillation 427.31,427.32 138, 139

Adversedrugreaction 995,995.1,995.2

Noncompliancewith medicaltreatment

V15.81

Anyemergencyroomvisit 99281-99285

Tobaccoabusedisorder 305.1,989.84

CPT = Current Procedural Terminology; DRG = Diagnosis Related Group; ICD-9-CM = International Classification of Disease, Ninth Revision, Clinical Modification.

Page 4: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

834 Journal of Managed Care Pharmacy JMCP November/December 2008 Vol. 14, No. 9 www.amcp.org

Description of the InterventionIn both practices, the same clinical pharmacist reviewed eachpatient’s medical record and assessed whether the patient’smedication therapy could be optimized. For the interventiongroup, the clinical pharmacist provided the PCP with writtenrecommendations(consultnote)regardingdrug-relatedproblemssimilar to those described by Strand et al.17 All consult noteswerecompletedbefore thepatient’sappointmentwith thePCP.Theconsultnoteswerenotmeanttobeapermanentpartofthe medical recordandwere labeledaccordingly,which likely lim-itedphysicians’potentialconcernsaboutmedicalmalpracticeorliabilityrelatedtothesenotes.Theconsultnoteswerewrittenoncolorful paper and placed conspicuously in the papermedicalrecord.

Forthecomparisongroup,theclinicalpharmacistdocumented in the database the recommendations for each patient, whichremainedconcealedfromthePCP;physiciansinthecomparisongrouppracticewereaskedto“actasthoughtheclinicalpharma-cistpresent in theoffice is invisible.”Theestimatednumberofactionableopportunitiesforthecomparisongroupwas(a)calcu-latedbymultiplyingtherecommendationacceptanceratefortheinterventiongroup(thepercentageofclinicalpharmacistrecom-mendations that were actually adopted by intervention physi-cians)timesthenumberofconcealedrecommendationsforthecomparisongroup,andthen(b)comparedwiththeactualnum-ber of changesmadeby comparison groupphysicianswithoutclinicalpharmacistassistance.Thepharmacistalsodocumentedintheprivacy-secureddatabaseallknownchronicdiseasesandotherdemographicinformationforbothstudygroups,includingheight andweight, if these data were available in themedicalrecord.

Medical record reviewswere conducted for allpatientswhowereenrolledinthestudy.Themedicalrecordincludedmedicalhistory,physicalexam,consultnotes,laboratorydata,andothertestresults.For72.9%and39.3%ofthecapitatedpatientsintheinterventionandcomparisongroup,respectively,thepharmacisthad access to claims data reflecting the patient’s prescriptionrefill (pharmacy) claims from thepatient’s insurance company.Pharmacy claims data were available only for the capitatedpatients that had a prescription benefit through the insurancecompanywithwhichGRIPAhad a risk contract.For instance,therewerenopharmacydataonpatientswhohadmedicalinsur-ancebutfilledalltheirprescriptionsthroughtheVA.Noneofthephysicianshaddirect access to thepharmacyclaimsdata.Thepharmacist interpreted thepharmacy claimsdata anddistilledthat information into her consult notes as needed to optimizemedicationtherapy.However,becausepharmacydatawerenotavailableforallstudypatients,costsforprescriptiondrugscouldnotbeassessedexceptintheaggregate.

In addition to providing proactive recommendations to theintervention group physicians, the clinical pharmacist wasavailabletohelpwithanymedication-relatedproblemsordrug

informationissuesatthephysicians’orstaff’srequest.Theclini-calpharmacistalsoofferedphysicianeducation,patientcounsel-ing,adherencemonitoringandeducationasdeemedappropriate.Patient counseling was done only on an as-needed basis, wasnotdirectedatanyparticularcondition,andgenerallydealtwithmedication nonadherence. Otherwise, most of the medicationadherenceissuesweresimplybroughttotheattentionofthePCPsforthemtoaddressduringthepatient’svisit.

The clinical pharmacist was not available to the compari-songroupphysicians forconsultationduring thestudyperiod.However, an a priori decision was made that, if a significantfinding were discovered during a medical record review inthe comparison group that required immediate attention toprevent patient harm, the clinical pharmacist would consultthe physician and the patient would be discontinued from thestudy.

Theclinicalpharmacistrecordedphysicianresponsestoeachrecommendation at6months and12months after the recom-mendationwasmade,inboththeinterventionandcomparisongroups.Recommendationsmadebythepharmacistthatwerenolongerapplicablebythetimeofthepatient’sappointmentwereexcluded from the analysis. The clinical pharmacist recordedaphysicianresponseas “accepted” if therewasevidencedocu-mentedwithinthemedicalrecordindicatingthattherecommen-dationwasfollowed(e.g.,achangeinaprescription,alaboratorytestordered).

Once patients met all criteria for inclusion, the study wasconductedwith an intent-to-treat analysis.Whether ornot thephysicianadoptedthepharmacist’srecommendation,thatpatientwasincludedinthefinalanalysis.

Outcome MeasuresMedicalcostsandutilizationwereobtainedfrommedicalclaimsdatacontainedintheGRIPAdatawarehouse.Thesedataorigi-natedfromeachenrolledpatient’sinsurancecompany.Cost(planliability)wascalculatedasaperpatientperyear(PPPY)amountfortheprimaryoutcomeandtabulatedforallclaimsforhospi-talizations, emergency room (ER) visits, radiology and labora-torytests,PCPvisits,andspecialtyvisits.Althoughincludedinmedical costs, inpatient costs also were tallied separately. Theutilization data included number of hospitalizations, ER visits,PCP visits and specialty visits, and hospital length of stay indays.Hospitalizationswereidentifiedbyanyclaimwithavaliddiagnosisrelatedgrouporarevenuecodebetween100and219(roomandboard)as longas the facility typewasnota skillednursing facility or nursinghome.Medical costs andutilizationweredetermined for 12monthsbefore and after eachpatient’senrollmentdate.

Prescription cost datawere available only in aggregate as a one-timereportprovidedbytheinsurancecompany.Investigatorsdidnothaveaccesstocompleteprescriptionmedicationclaimsdata because GRIPA was not at financial risk for medication

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

Page 5: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 835

expenses. Thus, no patient-level analyses of prescription datawereperformed.

Episode TreatmentGroups (ETGs) for each groupwere notavailableat thestartof thestudybutwerecalculatedbasedonhistoricinformationbeforestudyanalysiswascompleted.ETGsidentify and quantify an episode of care that spans inpatient, outpatient,andallancillaryservices,includingpharmaceuticals,and takes into consideration patient age and comorbidities.18 ETGs were believed to be important to include in the studyanalyses to determine the degree of similarity of the 2 groupsthroughout the studybecauseETGs are a clinicallyuseful tool tomeasurehealthcaredemand.18

StatisticsBefore the study, interesthadbeenexpressed in lookingat theresponse variables by different age groups as well as over theentirepopulation,becausepublishedstudiesaboutclinicalphar-macistinterventionshavetypicallybeeninpatientswithchronicdiseaseandoften inolderagegroups.1,10-12,15Twosubgroups—age 65 or younger versus older than age 65—were compared.Othersubgroupswerecreatedfor3agecategories—20-50years,51-65 years, and older than age 65—and the data for these 3subgrouppopulationswereanalyzedseparately.

Categoricaldata(e.g.,rates,percentages)wereanalyzedusingthelikelihoodratiochi-squaretestfordifferencesinproportions,comparing the intervention group and comparison group. Thevariables analyzed included sex, age category,weight category,andpresenceorabsenceofcomorbiditiesandriskfactorsinclud-ing congestive heart failure (CHF), diabetesmellitus, coronaryartery disease (CAD), asthma, chronic obstructive pulmonarydisease,andcurrentcigarettesmoking.

Continuousdatawereexamined,usinghistogramsandscatterplots,todeterminedistributioncharacteristicsandrelationshipswith other variables. Normally distributed datawere analyzedusing Student’s t-tests for 2-group differences. Non-normallydistributeddatawereanalyzedusingtheMann-WhitneyU-test,whichisanonparametrictestfor2-groupcomparisons.Baselinevariablesanalyzedwiththesemethodsincludedage,ETGs,andbodymassindex(BMI).Studyoutcomemeasureswereassessedusingadifference-in-differenceanalysisbysubtractingpre-inter-ventionvaluesfrompost-interventionvaluesandcomparingthechangeamountsbystudygroup.

Statistical significancewas determined using an alpha level of 0.05. Statistical analysis was performed using the Minitab version13.32(MinitabInc.,StateCollege,PA)andSPSSversions13.0and14.0(SPSSInc.,Chicago,IL)statisticalpackages.

■■ ResultsStudy EnrollmentCountsofeligiblepatientswhowereenrolledbetweenJuly2001and June 2002, patients excluded, and patients included inthefinaldatasetareshowninFigure1.Morethan80%ofthe

enrolledpatientsmetmore than1 risk factordetermined frominsuranceclaims(datanotshown).Twopercentoftheenrolledpatientswereidentifiedbecausetheyhadadiagnosisofdiabeteswith no scheduled appointment during the first 6 months ofthestudy.Theonlypatientinthecomparisongroupwithasig-nificantfindingthatrequiredtheclinicalpharmacisttomakeanurgentrecommendationtothecomparisongroupphysicianwasexcludedfornothaving12monthsofcontinuousinsuranceeligi-bilityafterstudyenrollment.Thus,nopatientsinthecomparisongroupwerediscontinuedfromthestudysolelybecauseofclinicalpharmacistinteractionwiththecomparisongroupphysicians.Ofpatientswhometallthecriteriaforenrollmentintheprospectivephaseofthestudy(i.e.,ofthosewhowereassignedtoeithertheinterventiongroup[n=159]orthecomparisongroup[n=290]),exclusionsforfailuretomaintaincontinuousinsuranceeligibilityweremadefor30(18.9%)ofinterventiongroupand71(24.5%)ofcomparisongroupsubjects.

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

Page 6: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

836 Journal of Managed Care Pharmacy JMCP November/December 2008 Vol. 14, No. 9 www.amcp.org

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

DemographicsPatientdemographicsatstudyenrollmentareshowninTable2. Themean [SD] age of patients in the intervention group (59.6[11.6])wasyoungerthaninthecomparisongroup(68.2[12.7];P <0.001). Therewas a nonsignificant (P =0.068) trend towardlowerratesofCADintheinterventiongroup(14.2%and22.2%forinterventionandcomparisongroups,respectively).Thepro-spectiverisks(ETGs)foreachagegroupweresimilar.Theinter-ventiongrouphadahigherproportionofmorbidlyobesepatientsthan did the comparison group (12.7% vs. 4.8%, respectively;P = 0.009).

Inconductinganalysesforthe3agegroupsshowninTable2,thegreatestattentionwasgiventothelargestgroupofpatients(older than 65 years of age), though the data are not shown.Amongpatients older than 65 years of age, themean agewasyoungerintheinterventiongroup(72.3)thaninthecomparisongroup(75.6),andthecomparisongrouphadahigherproportion

ofpatientsolderthan80yearsofage.Also,amongpatientsolderthan65yearsofage, theBMI,selecteddiseaseconditions,andETGs were similar between the intervention and comparisongroups. Because of the small number of patients in the other 2agegroups, results for theseagegroupsarenotpresented inthisreport.However,theseresultsareavailablefromtheprimaryauthorbyrequest.

Primary and Secondary OutcomesAll Patients: Mean (SD) PPPY medical costs (excluding costs for prescription medications) declined by 15.1% ($755) in theintervention group, from $4,995 ($15,774) pre-intervention to$4,240 ($11,391) post-intervention, and increased by 39.7%($1,435) in the comparison group, from $3,616 ($8,256) to$5,051($14,862;Table3).Median12-monthcosts increased inboth study groups, from $1,045 to $1,411 in the interventiongroupandfrom$1,130to$1,638inthecomparisongroup.The

TABLE 2 Demographic and Clinical Characteristics of Patients at Study Enrollment

Characteristics Intervention Group (n = 127)

Comparison Group (n = 216)

P Value/Statistical Testa

Ageinyears,mean[SD] 59.6 [11.6] 68.2 [12.7] <0.001 M-W

Age, number (%) < 0.001 chi-square

20-50years 25 (19.7%) 22 (10.2%)

51-65years 58 (45.7%) 48 (22.2%)

>65years 44 (34.7%) 146 (67.6%)

Sex, male (%) 35.4% 42.1% 0.229 chi-square

Select chronic conditions (%)CHF 4.7% 4.2% 0.807 chi-square

Diabetesmellitus 23.6% 19.0% 0.306 chi-square

CAD 14.2% 22.2% 0.068 chi-square

Asthma 11.0% 8.8% 0.484 chi-square

COPD 13.4% 10.7% 0.446 chi-square

Currentsmoker 13.4% 9.7% 0.297 chi-square

Prospective risk (ETG)Aged20-50years 0.99 1.21 0.197 t-testAged51-65years 1.76 1.78 0.454 t-test>65years 2.81 2.89 0.596 t-test

Weight category,b number (%) (n = 118) (n = 210)Normalweight 16 (13.6%) 59 (28.1%) 0.003 chi-square

Overweight 24 (20.3%) 49 (23.3%) 0.532 chi-square

Obese 63 (53.4%) 92 (43.8%) 0.095 chi-square

Morbidlyobese 15 (12.7%) 10 (4.8%) 0.009 chi-square

BMI(kg/m2),mean[SD]c 32.06 [7.51] 28.45 [5.67] < 0.001 t-testa P values were determined from independent 2-sample t-tests for continuous variables and likelihood ratio chi-square tests for categorical variables; the Mann-Whitney U-test for 2 independent sample groups was used when the continuous variables were not normally distributed. b Normal weight = BMI ≤ 25 kg/m2, overweight = BMI 25.1-27.99 kg/m2, obese = BMI 28-39.9 kg/m2, morbidly obese = BMI > 40 kg/m2.c 4.7% and 2.3% of patients in the intervention and comparison groups, respectively, did not have calculated BMI measures because their height data were unavailable.BMI = body mass index; CAD = coronary artery disease; CHF = congestive heart failure; chi-square = likelihood ratio chi-square test; COPD = chronic obstructive pulmonary disease; ETG = Episode Treatment Group; kg/m2 = ratio of weight in kilograms to height in meters squared; M-W = Mann-Whitney U-test; t-test = Student’s t-test for independent groups.

Page 7: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 837

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

interventionandcomparisongroupsdidnotdifferwithrespectto the study’s primary outcome, change in PPPYmedical cost(P =0.711).

SecondaryoutcomesaredisplayedinTable4.Bothbeforeandafter the intervention, intervention group patients had a loweraveragenumberofPCPvisitsthandidcomparisongrouppatients.However, the between-group difference in the mean changein PCP visits from pre-intervention to post-intervention was notstatisticallysignificant(P =0.914).Fromthepre-intervention to the post-intervention periods, hospital admissions per 1,000patientsincreasedfrom206.0to221.0(7.3%)intheinter-ventiongroupandfrom121.0to204.0(68.6%)inthecomparisongroup,althoughthebetween-groupdifferenceintheamountofchangefrompre-interventiontopost-interventiondidnotreachstatistical significance (P =0.329). ER visits per 1,000 patientsdeclinedby44.1%intheinterventiongroup(from127.0to71.0)and increased by 57.6% in the comparison group (from 144.0to227.0); thebetween-groupdifference in thechangeamountsapproachedstatisticalsignificance(P =0.054).

Prescriptioncostwascomparedatanaggregatelevel,withnostatisticalanalysesavailable.Theinterventiongroup’sprescriptionclaims cost (insurance plan liability) increased by 17.4% (from $105,000to$123,227),whereasthecomparisongroup’sprescrip-tionclaimscostdecreasedby10.1%(from$90,135to$81,042).

Patients Older Than 65 Years of Age: Forpatientsolderthan 65 years of age, study groups did not significantly differ withrespect to thestudy’sprimaryoutcome,change frompre-inter-vention topost-intervention inmedical costs (datanot shown).However, the intervention group’s average PPPY cost increased29.7%, whereas the comparison group’s cost increased 65.8%frombeforetoaftertheintervention.ERvisitsdecreasedby1.6%

in the interventiongroupand increasedby60.4% in thecom-parisongroup.

Clinical Pharmacist Interventions: Theclinicalpharmacistmade271 recommendations to the interventiongroupwithanaverage of 2.1 recommendations per patient versus 286 con-cealed recommendations for patients in the comparison groupwith an average of 1.3 per patient. In the intervention group,189 (69.7%) of the recommendations were accepted, whereas47(16.4%)oftheconcealedrecommendationswereactedonbycomparison groupphysicians.Thus, assuming that about 70%of the concealed (comparison group) recommendations wereactionable(i.e.,wouldhavebeenacteduponbythecomparisongroupphysiciansiftherecommendationshadbeenmadeandnotconcealed),comparisongroupphysiciansidentified47of200,orabout23.5%,ofactionableopportunitieson theirownwithouttheservicesofaclinicalpharmacist.

Figure2showsbroadcategoriesofrecommendationsacceptedintheinterventiongroupresultinginmoreoptimalcareforthosepatients.Table5providesspecificexamplesofrecommendationswithinthesebroadcategories.Interventiongrouppatientsweremorethantwiceaslikelyascomparisongrouppatientstohavemedication nonadherence issues addressed (85.7% vs. 40.0%,P =0.032),and6timesaslikelytohaveamedicationprescribedthatwasindicatedbutnotprescribedpreviously(72.6%vs.11.5%,P <0.001).Amongpatientsatriskforcardiovascularevents,inter-ventiongrouppatientsweremorethan8timesaslikelyascom-parisongrouppatientstobestartedondailyaspirin(90.9%vs.11.1%,P <0.001;datanotshowninfigure)andmorethan7timesas likelytoreceivepneumoniavaccinationasrecommendedbytheCentersforDiseaseControlandPrevention(76.9%vs.10.0%,P <0.001;datanotshowninfigure).Interventiongrouppatients

TABLE 3 Cost Outcomes in the 12 Months Before and After Study Enrollment Date

Cost Outcomes Intervention Group Comparison Group P Value a

(n = 127) (n = 216)

Total medical cost b Median Mean [SD] Median Mean [SD]

PPPYbefore $1,045 $4,995 [$15,774] $1,130 $3,616 [$8,256] 0.993 a

PPPYafter $1,411 $4,240 [$11,391] $1,638 $5,051 [$14,862] 0.213 a

PPPYdifference $238 –$755 [$15,617] $257 $1,435[$15,710] 0.711a

Percentchange –15.1% 39.7%

Inpatient cost

PPPYbefore $0 $2,090 [$12,983] $0 $1,213 [$6,144] 0.751 a

PPPYafter $0 $1,415 [$7,665] $0 $1,434 [$6,904] 0.324 a

PPPYdifference $0 –$675[$156,965] $0 $221 [$9,065] 0.452a

Percentchange –32.3% 18.2%

a M-W = Mann-Whitney U-test; the Mann-Whitney U-test for independent 2-sample groups was used when the continuous variables were not normally distributed.b Total medical cost excluding outpatient pharmacy costs. Cost outliers were not removed from this analysis and ranged from a decrease of $1.8 million for 1 patient in the intervention group to an increase of $1.7 million for another patient in the comparison group and were attributable to hospitalizations for cancer treatments, congestive heart failure, and major surgeries, including 1 liver transplant.Cost = plan sponsor costs (gross allowable minus patient costs); PPPY = per patient per year.

Page 8: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

838 Journal of Managed Care Pharmacy JMCP November/December 2008 Vol. 14, No. 9 www.amcp.org

were10timesaslikelytobeprescribedanoptimalmedicationfor their condition (60.0% vs. 5.9%, P <0.001) andmore than11timesaslikelytobeprescribedmorecosteffectivetherapies(72.1%vs.6.5%,P < 0.001).

■■ DiscussionThis studydemonstrated that embeddinga clinicalpharmacisttoworkwithinaprimarycarephysician’sofficebenefitspatientcareandthatphysiciansreadilyadoptopportunitiestooptimizemedication therapywhen theyareprovidedwithclinicalphar-macist recommendations. Although the difference in medicalcostsbetweentheinterventiongroupandthecomparisongroupwasnot statistically significant, anonsignificant trend suggeststhattheinterventionmayhavehadapositiveeffectonmedicalcostsandwarrantsfurtherinvestigationwithalargersamplesize.Thetrendinpatientsolderthan65yearsofagerevealedthattheaveragePPPYcostincreasedby29.7%fortheinterventiongroup,comparedwith65.8%forthecomparisongroup,butagainthisdifferencewasnotstatisticallysignificant.

To our knowledge, the current study is the first to dem-onstrate in detail the types and frequency of opportunities toimprovemedication therapy by physicians whowere not pro-videdwithclinicalpharmacistinterventions.Thisstudyshowedthatphysiciansappeartoactononlyaboutone-quarteroftheseopportunitieswhentheyarewithouttheassistanceofaclinicalpharmacist.

The Impact of Managed Pharmaceutical Care ResourceUtilization andOutcomes in Veterans AffairsMedical Centers(IMPROVE) study of an older high-risk population describedsimilar increases in PPPYhealth care costs for both the inter-vention group (20.7%) and the comparison group (29.7%).11 The PPPY cost in the IMPROVE study was calculated differ-ently, in that it included the cost of the pharmacist cognitive services and medications and relied on estimated medical costs for the primary outcomes. Many other studies present-ing medical health care cost outcomes have also been basedonestimatedcosts,8,12,14,20-22whereas fewer studiesused actualcosts.5,13,23,24

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

TABLE 4 Utilization Outcomes in the 12 Months Before and After Study Enrollment Date

Utilization Outcomes Intervention Group Comparison Group P Value a Statistical Test(n = 127) (n = 216)

PCP visits Mean SD Mean SDPPPYbefore 4.5 4.2 5.7 6.3 0.027 M-WPPPYafter 5.3 4.2 6.3 4.3 0.029 M-WDifference 0.9 3.2 0.6 5.4 0.914 M-WPercentchange 17.8% 10.5%SCP visitsPPPYbefore 9.6 12.2 9.8 11.1 0.347 M-WPPPYafter 9.3 12.5 10.5 11.9 0.133 M-WDifference –0.3 9.5 0.7 12.5 0.774 M-WPercentchange –3.1% 7.1%Hospital admissions per 1,000 patients b

Before 206.0 1042.0 121.0 4140.0 0.753 M-WAfter 221.0 1374.0 204.0 719.0 0.267 M-WDifference 15.0 604.0 83.0 716.9 0.329 M-WPercentchange 7.3% 68.6%Emergency room visits per 1,000 patientsBefore 127.0 471.0 144.0 445.0 0.473 M-WAfter 71.0 313.0 227.0 545.0 0.001 M-WDifference –56.0 524.1 83.0 596.5 0.054 M-WPercentchange –44.1% 57.6%Hospital days b PPPYbefore 5.37 3.13 8.84 11.37 0.132 t-testPPPYafter 4.36 2.18 5.07 5.21 0.496 t-testDifference 1.01 2.70 3.77 8.85 0.133 t-testPercentchange –18.8% –42.6%

a P values were determined from independent 2-sample t-tests for continuous variables; the Mann-Whitney U-test for independent 2-sample groups was used when the continuous variables were not normally distributed.b Hospitalizations were identified by any claim with a valid diagnosis related group or a revenue code between 100 and 219 as long as the facility type was not a skilled nursing facility or nursing home.M-W = Mann-Whitney U-test; PCP = primary care physician; SCP = specialty care physician; t-test = Student’s t-test for independent groups.

Page 9: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 839

Wewereunabletoassessdifferencesindrugcostbetweentheinterventiongroupandcomparisongroup in thepresentstudybecause study enrollment criteria did not require that patientshadprescriptiondrugcoverageduringanypartofthestudy.Theinsurerdidnotgrant access to individualprescriptionmedica-tionfinancialdatabecauseGRIPAwasnotatriskformedicationcosts.However,aggregatedpharmacyclaimscostdatasuggestedanincreasedcostintheinterventiongroup.Thiscostfindingissimilartothoseofothersimilarstudiesinwhichthepharmacistshad access to the patients’ medical records and did not limitpharmacist services toonedisease state.These studies showedatrendofslightlyhigherannualcostofprescriptionmedication(5.7%-8.6%)intheinterventiongroups.24-26Inthepresentstudy,despitetheclinicalpharmacist’sabilitytolowerthecostofsomemedications, one of the most common recommendations wastostartanewmedicationwhenitwasindicatedbutpreviouslyoverlookedby thephysician.Thispatternpotentially increasedmedicationcost.Theinterventiongroupwas6timesaslikelyas

thecomparisongrouptohaveanewmedicationstarted.SomemedicationsinitiatedduringthestudywerecalciumandvitaminDsupplements for thepreventionor treatmentofosteoporosis,ordailyaspirinforpatientswithdiabetesmellitus,whichwouldnot be expected to change the overall prescriptionmedicationcosts.However,othermedicationswereinitiatedtotreathyper-lipidemia, provide ACE inhibitors for patients diagnosed withdiabetesmellitusorCHF,orassurethatCADpatientshadfreshsublingualnitroglycerin.

Uniquetothisstudywasthatoutcomesfor“usualcare”withregard tomedicationmanagementweredocumentedandcom-paredwithoutcomesfortheinterventioninaprimarycareprac-tice.Thisdesignprovidedgreaterunderstandingofwhatmighthave potentially been accomplished for the patients receivingusualcare,hadtheyreceivedtheservicesofaclinicalpharmacist.Figure 2 shows thatmanypotential opportunities appeared toexistforphysicianstooptimizemedicationtherapy.Hanlonetal. also recorded concealed recommendations for a randomized

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

Page 10: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

840 Journal of Managed Care Pharmacy JMCP November/December 2008 Vol. 14, No. 9 www.amcp.org

control group and found that, similar to the present study’sresults, 55.1% of intervention group and 19.8% of controlgroupphysiciansenactedtheclinicalpharmacist’srecommendedchanges.27

In thepresent study,between-groupdifferences in the ratesof optimizedmedication therapymay have contributed to thetrend in lower hospital admissions and ER visits for patientsprovidedwithclinicalpharmacistservices.Forexample,medi-cationnonadherence, leading topoordisease control, also can leadtoincreasedhospitalizationsandcanbeanimportantdriver

ofoverallmedicalcosts.28Althoughfindingsofsomestudiescallinto question the relationship between improved medicationadherenceandclinicaloutcomesorhealthcarecosts,26,29otherstudies have found a beneficial effect of adherence on clinicaloutcomes.20,30 Recognizing drug interactions and adverse drugreactions arepartof the expertiseof a clinicalpharmacist andmayhavecontributed tominimizingERvisits in the interven-tiongroupasevidencedinothersettings.20-22,25Forexample,the comparisongroupinthepresentstudyincludedawomanolderthan 80 years of age who was prescribed a low-dose tertiary

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

TABLE 5 Specific Examples of Optimal Care Opportunities

Description of Optimum Care Intervention Type

Examples of Recommendations:

Untreated indication:Recommendationtostarta medicationforamedicalconditionthatiscurrentlyuntreatedbutconsideredastandardofcare

•Statinsforpatientswithcoronaryarterydiseaseandlow-densitylipoproteincholesterol above goal

•Angiotensin-convertingenzymeinhibitorforpatientwithdiabetesandmicroalbuminuria

Cost:Recommendationforanequallyeffectivebut lessexpensivemedication

•Useone-halftabletofahigherstrengthtabletofthesamemedicationtoachievethedose (e.g.,80mgofatorvastatin,one-halftabletdaily,insteadof40mgofatorvastatindaily).

•Changeprescriptionto1tabletofahigherstrengthinsteadofmultipletabletsoflowerstrength toachievethedose(e.g.,40mgofatorvastatintwicedailyto80mgofatorvastatinoncedaily).

Optimal drug:Recommendationtoreplaceacurrentmedicationwithamoreappropriatemedicationbased onpatientcharacteristics,comorbidities,and pharmacokineticorothercharacteristicsofthe medication

•Glipizideispreferredoverglyburideinpatientaged71yearswithchronickidneydisease.

•Switchfromalong-actingbenzodiazepine(flurazepam)toashorter-actingbenzodiazepinesuchasoxazepaminelderlypatientwithinsomnia.

Adverse drug reactions:Identificationofapotential oractualadversedrugreaction

•Forpatientwithprostatecanceronleuprolideacetate,considercalciumandvitaminD administrationandbonedensitytestbecausethereisbonelossassociatedwithadministration ofleuprolide.

•Avoidpioglitazoneorrosiglitazoneinpatientwithstage3congestiveheartfailure.

Nonadherence:Evidencethatthepatientisnottak-ingthemedicationasprescribed

•Addressnonadherencewithpatientswithosteoporosiswhohavestoppedfillingtheir prescriptionforalendronate.

•Addressnonadherencewithapatientprescribedastatinwhosecholesterolhasincreased dramaticallyyetnotbeenaddressedatpreviousappointments.

Drug monitoring:Identificationofinappropriate medicationmonitoringandrecommending appropriatemedicationmonitoring

•Orderaserumpotassiumdeterminationforpatientstartedonhydrochlorothiazidemorethan 1yearago.

•Orderthyroid-stimulatinghormonedeterminationforpatientwithchangeinlevothyroxinedosemorethan3monthsagowhodoesnothavecurrentbloodworkdone.

Drug interactions:Identificationofclinicallyrelevantdruginteractionsorwarningofpotentialdrug interactions

•Assurethatpatienttreatedforhypothyroidismandstartingoncalciumsupplementdoesnot takecalciumandlevothyroxinetogether.

•Limitacetaminophendosingtolessthan2gmperdayinpatientonchroniccarbamazepine,whichcaninduceacetaminophenconversiontotoxicmetabolite.

Subtherapeutic dose:Recommendationforalterna-tivedosingforsomeoneonasubtherapeuticdose

•Increaseangiotensin-convertingenzymeinhibitordosetogoaldosepercongestiveheart failurestandards.

•IncreasecalciumandvitaminDsupplementtoachieverecommendedtotaldailyintake.

Supradose:Recommendationforalternativedosing foridentificationofapatientprescribedadosethat isinappropriatelyhighorshouldideallybetitrateddownward

•Startingdoseofniacinextended-releasetabletsat1,000mgisunlikelytobetoleratedbypatient;suggest500mgatbedtime.

•Patienttakingconjugatedestrogens,0.9mgdaily—attempttitratingestrogendosetominimumeffectivedoseforpostmenopausalsymptoms.

No indication:Recommendationtodiscontinuea medicationthatappearstolackanindication

•Discontinueprotonpumpinhibitorinapatientrecentlydischargedfromhospitalwithnew prescriptionforaprotonpumpinhibitorwithoutagastrointestinalcondition.

•Discontinue1mgfolicaciddailysupplementinapatientwhodiscontinuedoralmethotrexatemorethan1yearago.

Page 11: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 841

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

amine tricyclic antidepressant for suspectedurge incontinence.Withinweeksofstartingthiscentralnervoussystemactivemedi-cationwith anticholinergic activity, she suffered falls, resulting inhospitalizationforfracture.

Unlike much of the published literature about health care systems such as the VA, this study took place in a typical primary care practice that did not have a common electronic medical record platform. This study also involved a privatelyowned medical practice that was not associated with either apharmacyormedicalschool,unlikemanyofthestudiescon-ducted in ambulatory care pharmacist practice environmentswithin the United States.1,2,9,21,31-33 The clinical pharmacist’sapproachusedinthepresentstudycouldpotentiallytakeplacein any community, in any doctor’s office, with little disrup-tion to workflow. Space is a precious commodity in primarycarepractices;using thisparticularmodelwouldallowclinicalpharmaciststoworkinanytypeofspaceandflextheirscheduleaccordingtotheneedsofthemedicalpractice.

In contrast toother studies,patientswhomayhaveneeded themosthelpwithmedicationtherapywerenotexcluded.1,3,30,33 The IMPROVE study excluded patientswho had a psychiatricillness requiringmentalhealthservices,poorunderstandingofwritten and spoken English, visual impairment and residencefar from the physician office, or no working telephone.19 Theonlyabilityrequiredforpatientsinthecurrentstudywasabilityto physicallymake it to a physician office visit; therewere no otherlimits.

LimitationsFirst, the medical practices were selected, not randomized.Recruitingphysicianstoparticipateinthecomparisongroupwasachallengingtask,asthecomparisongroupphysiciansdidnotbenefitfromparticipating.Thephysiciansinthepresentstudy’scomparisongroupwerelikelywillingtoparticipatebecausetheyhadanunderstandingofthevaluableroleofaclinicalpharma-cist;theyhadpastexperienceworkingwithclinicalpharmacistswhomanagedanticoagulationandprovidedmonthlyeducationsessionsonmedicationswithinahealthmaintenanceorganiza-tion.Neitherphysicians in thesamepracticenorpatientswererandomized,whichmayhavebiasedtheresults.However,itdidprevent thecontamination that couldhaveoccurred if a singlephysician hadworkedwith both intervention and comparisonpatients.This contamination, althoughnot ideal for a researchstudy,istypicallysomethingthatclinicalpharmacistsstriveforwithin a medical practice. Ideally, after a clinical pharmacistmakes a recommendation2or3 times, thephysician tends toapply thisknowledgeappropriately to the remainderof similarpatientsinhisorherpractice.

Second, therearemajorconcernsaboutwhether thepatientcohortswerecomparable,particularlybecauseof thedifferenceinage.Theinterventiongroupandcomparisongroupsdifferedatbaseline;ofpatientswith12monthsofpre-interventioneligibil-

ity,25.9%ofinterventionand45.3%ofcomparisonpatientswereaged66yearsorolder.Thepercentagesofstudypatientsexcludedfromthefinalanalysisfornothaving12monthsofcontinuous insurance eligibility following the date of study enrollmentwere similar in the intervention group (30 of 159 patients or18.9%)andthecomparisongroup(71of290patientsor24.5%).However,just15.6%oftheexcludedpatientsintheinterventiongroupwereaged65yearsoryounger,comparedwith66.2%inthe comparison group.This pattern appeared to be a result ofan insurancechange toaself-insuredproductmadeby1 largeemployer in Rochester during this study, thus removing its participantsfromthecapitatedpopulation.Theemployerchangeexcluded so many younger patients in the comparison groupthat the difference inmean age between the 2 groups became evenlarger.

Third,wemade an a priori decision to exclude all patients that did not have 12months of continuous insurance eligibil-ityafterstudyenrollment; thus it isunknownhowtheclinicalpharmacist interventions affected those patients that subse-quently either died or disenrolled from the insurance plan.Fourth,themedicalcostdatacontainedsomeoutliercasesthatwerenotremovedfromourstudysamplebecauseofourapriori decisiontoretainalleligiblecasesforfinalanalysis.Therewere nopatientswith traumaormotorvehicleaccidents,butaverysmall number of patients in both the intervention and com-parison groups had extreme changes in 12-month medicalcosts; these changes ranged from a decrease of $1.8 million for1patientintheinterventiongrouptoanincreaseof$1.7mil-lionforanotherpatientinthecomparisongroup.Thesechargeswere attributable to hospitalizations for cancer treatments,congestive heart failure, and major surgeries including 1 livertransplant.

Fifth, thegeneral applicationof the study findingscouldbeaffectedbyseveralfactors.The69.7%acceptancerateofrecom-mendations by physicianswas higher than inmanypublishedoutpatient studies.23,24,26,34Thisoutcomemayhavebeenattrib-utabletotheuseofonly1person,theclinicalpharmacistwhoperformed the intervention, to determine the acceptance rateineachof the2studygroups.However, therelationshipsbuiltbetweentheclinicalpharmacistandphysiciansintheinterven-tion group over the 12 months probably played a role in the successof the interventionasdemonstrated inother studies inwhichauthorssurmisedthatinterpersonalrelationshipsbetweenthe pharmacist and physicians contributed to improved out-comes.2,36Althoughthepresentstudydidnotmeasurewhetheracceptance of recommendations resulted in resolution of theidentifiedproblems,theacceptancesdidreflectpositivecaredeci-sionsmovinginthedirectionofresolution.TheIMPROVEstudyauthorsstatedthat69%oftheirrecommendationswereresolved,but when they removed the interventions performed directlyby the pharmacist (without needing physician approval), their resolutionratedeclinedto57%.19

Page 12: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

842 Journal of Managed Care Pharmacy JMCP November/December 2008 Vol. 14, No. 9 www.amcp.org

Sixth, the study may have underestimated the benefits ofthe clinical pharmacist because one of the comparison groupphysiciansalsowasamemberofapharmacyand therapeuticscommitteeforanotherlargeinsurerinRochester,NewYork,andwas acutely aware ofmedication related problems andmoney-savingopportunities.Theaveragenumberof recommendations per patient in the intervention group versus the comparisongroup (2.1 vs. 1.3, respectively) might also have contributed to study findings. Lastly, the inclusion criteria for this study wereratherbroad.Asaresultofourfindings,wehavenarrowedthecriteriaforconsultation,limitingourtargetpopulationtothemosthigh-riskpatientswithmultiplecomorbidities.

ConclusionAclinicalpharmacist canpromoteoptimalmedication therapyinoutpatientsbyworkingwithprimarycarephysicianswithintheirofficepractices.Althoughthemedical(excludingpharmacy)costsof the interventionandcomparisongroupsdidnotdiffersignificantly, a nonsignificant trend suggests that the interven-tionmayhavehadapositiveeffectonmedicalcostsandwarrantsfurtherinvestigationwithalargersamplesize.

3.BorensteinJE,GraberG,SaltielE,etal.Physician-pharmacist comanagementofhypertension:arandomized,comparativetrial.Pharmacotherapy.2003;23(2):209-16.

4.CordingMA,Engelbrecht-ZadvornyEB,PettitBJ,EasthamJH,SandovalR. Developmentofapharmacist-managedlipidclinic.Ann Pharmacother.2002; 36(5):892-904.

5.CranorCW,BuntingBA,ChristensenDB.TheAshevilleproject:Long-termclinicalandeconomicoutcomesofacommunitypharmacydiabetescare program. J Am Pharm Assoc (Wash).2003;43(2):173-84.

6.NationalCommitteeforQualityAssurance.Health Plan Employer Data and Information Set for 2007; Volume 2: Technical Specifications.Washington,DC:NationalCommitteeforQualityAssurance;2007.Availableat:www.ncqa.org/Portals/0/HEDISQM/Archives/2007/Vol2/Cost_of_Care_Update.pdf.AccessedOctober1,2008.

7.NationalCommitteeforQualityAssurance.HealthPlanEmployerDataandInformation2008SummaryTableofMeasures,ProductLinesand Changes.Availableat:www.ncqa.org/Portals/0/HEDISQM/HEDIS2008/ 2008_Measures.pdf.AccessedOctober1,2008.

8.MasonJD,ColleyCA.Effectivenessofanambulatorycareclinical pharmacist:Acontrolledtrial.Ann Pharmacother.1993;27(5):555-59.

9.JamesonJ,VanNoordG,VanderwoudK.Theimpactofapharmaco-therapyconsultationonthecostandoutcomeofmedicaltherapy.J Fam Pract.1995;41(5):469-72.

10.BlakeySA,Hixson-WallaceJA.Clinicalandeconomiceffectsofpharmacyservicesingeriatricambulatoryclinic.Pharmacotherapy. 2000;20(10):1198-203.

11.MaloneDC,CarterBL,BillupsSJ,etal.Aneconomicanalysisofarandomized,controlled,multicenterstudyofclinicalpharmacistinter-ventionsforhigh-riskveterans:theIMPROVEstudy.ImpactofManagedPharmaceuticalCareResourceUtilizationandOutcomesinVeteransAffairsMedicalCenters.Pharmacotherapy.2000;20(10):1149-58.

12.CowperPA,WeinbergerM,HanlonJT,etal.Thecost-effectivenessofaclinicalpharmacistinterventionamongelderlyoutpatients.Pharmacotherapy. 1998;18(2):327-32.

13.LaiLL,SorkinAL.CostbenefitanalysisofpharmaceuticalcareinaMedicaidpopulation—fromabudgetaryperspective.J Manag Care Pharm. 1998;4(3):303-08.Availableat:www.amcp.org/data/jmcp/research_v3_303-308.pdf.AccessedOctober1,2008.

14.GerberRA,LiuG,McCombsJS.Impactofpharmacistconsultations providedtopatientswithdiabetesonhealthcarecostsinahealthmain-tenanceorganization.Am J Manag Care.1998;4(7):991-1000.Availableat:www.ajmc.com/files/articlefiles/AJMC1998JulGerber991_1000.pdf. AccessedOctober1,2008.

15.AltavelaJL,GeraciL.Decreasedhealthcareutilizationcostsafter additionofclinicalpharmacyservicesinaninternalmedicinepractice.Posterpresentedat:2001AmericanCollegeofPharmacyAnnualMeeting;October21-24,2001;Tampa,FL.

16.AltavelaJL,BarbeauL,SorrentoT,SmeenkK,HaasC.Physicianresponsetoclinicalpharmacyservicesinaprivatepracticesetting.Posterpresentedat:1999AmericanCollegeofClinicalPharmacyInternationalCongressonClinicalPharmacy;April11-14,1999;Orlando,FL.

17.StrandLM,MorleyPC,CipolleRJ,RamseyR,LamsamGD.Drug-relatedproblems:theirstructureandfunction.DICP.1990;24:1093-97.

18.ForthmanMT,DoveHG,WoosterLD.EpisodeTreatmentGroups(ETGs):Apatientclassificationsystemformeasuringoutcomesperformancebyepisodeofillness.Top Health Inf Manage.2000;21(2):51-61.Availableat:www.thedeltagroup.com/Corporate/Pubs/ETGs.pdf.AccessedSeptember20,2008.

19.EllisSL,BillupsSJ,MaloneDC,etal.TypesofinterventionsmadebyclinicalpharmacistsintheIMPROVEstudy:impactofmanagedpharma-ceuticalcareonresourceutilizationandoutcomesinVeteransAffairs medicalcenters.Pharmacotherapy.2000;20(4):429-35.

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

JEANETTE L. ALTAVELA, PharmD, BCPS, is Manager, Pharmacy Services; MATT K. JONES, BA, is Senior Managed Care Analyst; and MERRILEE RITTER, MS, is Statistical Consultant, Greater Rochester Independent Practice Association, Rochester, New York.

AUTHOR CORRESPONDENCE: Jeanette L. Altavela, PharmD, BCPS, Greater Rochester Independent Practice Association, 60 Carlson Road, Rochester, NY 14610. Tel.: 585.922.1548; E-mail: [email protected]

Authors

DISCLOSURESThis research was not funded. The authors are employees of the GreaterRochesterIndependentPracticeAssociation.Studyconceptanddesignwereprimarily thework ofAltavela, andAltavela performed all of the data col-lection.AltavelaandRitter interpreted thedatawithassistance fromJones.AltavelawroteandrevisedthemanuscriptwithsomeassistancefromRitter. The authors acknowledge JamesR. Tobin,who contributed to the studyconceptanddesign;PeterB.Zajkowski,whohelpedwithdatainterpretation;andCurtisE.HaasandJuneF.Johnson,whocontributedtothemanuscriptrevision.

REfERENCES

1.GattisWA,HasselbladV,WhellanDJ,O’ConnorCM.Reductioninheartfailureeventsbytheadditionofaclinicalpharmacisttotheheartfailuremanagementteam:resultsofthePharmacistinHeartFailureAssessmentRecommendationandMonitoring(PHARM)study.Arch Intern Med.1999; 159(16):1939-45.

2.BogdenPE,AbbottRD,WilliamsonP,OnopaJK,KoontzLM. Comparingstandardcarewithaphysicianandpharmacistteamapproachforuncontrolledhypertension.J Gen Intern Med.1998;13(11):740-45.

Page 13: A Prospective Trial of a Clinical Pharmacy … Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 833 A Prospective Trial of a Clinical Pharmacy Intervention

www.amcp.org Vol. 14, No. 9 November/December 2008 JMCP Journal of Managed Care Pharmacy 843

A Prospective Trial of a Clinical Pharmacy Intervention in a Primary Care Practice in a Capitated Payment System

20.FarrisKB,KumberaP,HaltermanT,FangG.Outcomes-based pharmacistreimbursement:reimbursingpharmacistsforcognitiveservices,part1.J Manag Care Pharm.2002;(8)5:383-93.Availableat:www.amcp.org/data/jmcp/Contemporary%20Subjects-383-393.pdf.AccessedOctober1,2008.

21.ChiquetteE,AmatoMG,BusseyHI.Comparisonofananticoagulationclinicwithusualmedicalcare:anticoagulationcontrol,patientoutcomes,andhealthcarecosts.Arch Int Med.1998;158(15):1641-47.

22.PauleyTR,MageeMJ,CuryJD.Pharmacist-managed,physician-directedasthmamanagementprogramreducesemergencydepartmentvisits.Ann Pharmacother.1995;29(1):5-9.

23.MurrayMD,HarrisLE,OverhageJM,etal.Failureofcomputerizedtreatmentsuggestionstoimprovehealthoutcomesofoutpatientswithuncomplicatedhypertension:resultsofarandomizedcontrolledtrial.Pharmacotherapy.2004:24(3):324-37.

24.SorensenL,StokesJA,PurdieDM,WoodwardM,ElliottR,RobertsMS.Medicationreviewsinthecommunity:Resultsofarandomized,controlledeffectivenesstrial.Br J Clin Pharmacol.2004;58(6):648-64.Availableat:www.pubmedcentral.nih.gov/picrender.fcgi?artid=1884656&blobtype=pdf. AccessedOctober2,2008.

25.McLeanW,GillisJ,WallerR.TheBCCommunityPharmacyAsthmaStudy:astudyofclinical,economic,andholisticoutcomesinfluencedbyanasthmacareprotocolprovidedbyspeciallytrainedcommunitypharmacistsinBritishColumbia.Can Respir J.2003;10(4):195-202.

26.CarterBL,MaloneDC,BillupsSJ,etal.InterpretingthefindingsoftheIMPROVEstudy.Am J Health Syst Pharm.2001;58(14):1330-37.

27.HanlonJT,WeinbergerM,SamsaGP,etal.Arandomized,controlledtrialofaclinicalpharmacistinterventiontoimproveinappropriateprescrib-inginelderlyoutpatientswithpolypharmacy.Am J Med.1996;100(4):428-37.

28.SokolMC,McGuiganKA,VerbruggeRR,EpsteinRS.Impactofmedi-cationadherenceonhospitalizationriskandhealthcarecost.Med Care. 2005;43(6):521-30.

29.HanlonJT,LindbladCI,GraySL.Canclinicalpharmacyservices haveapositiveimpactondrug-relatedproblemsandhealthoutcomesincommunity-basedolderadults?Am J Geriatr Pharmacother.2004;2(1):3-13.

30.SolomonDK,PortnerTS,BassGE,etal.Clinicalandeconomic outcomesinthehypertensionandCOPDarmsofamulticenteroutcomesstudy.J Am Pharm Assoc. (Wash).1998;38(5):574-85.

31.IsettsBJ,BrownLM,SchondelmeyerSW,LenarzLA.Qualityassessment ofacollaborativeapproachfordecreasingdrug-relatedmorbidityandachievingtherapeuticgoals.Arch Intern Med.2003;163(15):1813-20.

32.WhitleyHP,FermoJD,ChumneyEC.5-yearevaluationofelectronicmedicalrecordflagalertsforpatientswarrantingsecondarypreventionofcoronaryheartdisease.Pharmacotherapy.2006;26(5):682-88.

33.OdegardPS,GooA,HummelJ,WilliamsKL,GraySL.Caringforpoorlycontrolleddiabetesmellitus:arandomizedpharmacistintervention.Ann Pharmacother.2005;39(3):433-40.

34.DoucetteWR,McDonoughRP,KlepserD,McCarthyR.Comprehensivemedicationtherapymanagement:identifyingandresolvingdrug-relatedissuesinacommunitypharmacy.Clin Ther.2005;27(7):1104-11.

35.HaggertySA,CerulliJ,ZeollaMM,CottrellJS,WeckMB,FaragonJJ.Communitypharmacytargetinterventionprogramtoimproveaspirinuse inpersonswithdiabetes.J Am Pharm Assoc.2003;45(1):17-22.

36.LeapeLL,CullenDJ,ClappMD,etal.Pharmacistparticipationonphysicianroundsandadversedrugeventsintheintensivecareunit.JAMA. 1999;282(3):267-70.