Upload
amia
View
221
Download
0
Embed Size (px)
Citation preview
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
1/20
SittingonPinsandNeedles:
CharacterizationofSymptomDescriptionsinClinicalNotes
TylerB.Forbush,CRT
SaltLakeCityVAHealthCareSystem
DepartmentofInternalMedicine,UniversityofUtah
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
2/20
Background
TheVAcontinuestostudymedicallyunexplainedsyndromessuchasChronicFatigue,Fibromyalgia,andIrritableBowelSyndromeandtheirsymptoms.
MUSarecommonintheveteranpopulation. MUShavemuchincommonwithotherchronicmulti-symptomillnesses,likegulfwarsyndrome.
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
3/20
Symptoms
Importantfordiagnosis,assessmentofseverityandresponsetotreatment,therapeuticdecisionmaking,phenotypic
classification. *Bothatthetimeofpatientcare,andforretrospectiveresearch
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
4/20
StudyAims
Giventhatyourstudyrequiressymptomdata,howcouldyougetitonalargescale?
Useexistingcodedata(ICD-9-CM) NLP
Anoff-the-shelfsystemthatusesterminologiesAcustomsystemthattakesallyourtime/money
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
5/20
Howaresymptomsrecorded?
SymptomTerms:writteninmedicalterminology
SubjectiveSymptomExpressions:QuotesorcapturepatientsvoiceFiguresofspeechIdiomsLayterms
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
6/20
Methods
CohortincludedallpatientsseenintheVAin2009. 750documentswererandomlyselectedfromalltextnotesforthesepatientsandgroupedintoMentalhealth/socialwork,andPrimary/Specialty
4healthcareproviderswithannotationexperienceconducteda2layerreview.
ReviewersweretrainedforeachlayeruntilastableIAA>.80wasachieved.
2reviewersannotatedeachnoteindependently,disagreementswereadjudicatedbya3rd.
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
7/20
Methods
Layer1:Annotateallsymptomsandsubjectivesymptomexpressions.
Layer2:ReviewSSEannotationstoClassifyintosymptomtypesDetermineifthesymptomwascodeDetermineifSSEwasalsomentionedinwordsthatcouldbemappedtoaterminology.i.e.symptomterm
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
8/20
Classification
Somatic:LossofsomaticfunctionUnpleasantoralteredsensationSomatic,non-sensory,notfunctional
Cognitive/Behavioral/MentalCognitiveDysfunctionFalsePerceptions/beliefsEmotionalDistressHarmtoself/othersBehavioralDysfunction
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
9/20
ICD9-CMCoding
ICD9-CMcodingfortheencounterwasreviewedtoseeiftheSSEwascodedIftheSSEwascoded,itwasconsideredexplicitlycoded Feelslikeaviceonmyhead=CodeforHeadache
IftheSSEwasaplausiblemanifestationofthecode,itwasconsideredcontainedby IdontevenwanttogetoutofbedcontainedbyMajorDepressioncode
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
10/20
RestatedinSymptomTerm
TheSSEwerecomparedtoSymptomTermsinthesamenote.IftheSSEwasalsorestatedinasymptomterm,itmaybefeasibletouseanNLPpipelinethatutilizesstandardterminologiesordictionaries.
Icantkeepfooddownrestatedasvomiting
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
11/20
Results
5,031SymptomTermsand543SSE Only170notescontainedSSE
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
12/20
Results-Classification
Emotionaldistress,behavioraldysfunction,andlossofsomaticfunctionwerecommon.
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
13/20
ResultsICD9-CM
Only2SSEwereexplicitlycoded,bothwereheadache,andbothwererestated. 79werecontainedbybutnotrestated 36%ofSSEisthebestyoucoulddousingcodingifyouacceptimprecision.
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
14/20
Results-Restated
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
15/20
Limitations
176ofthedocumentshadnocodingfortheencounter. Insomesettings,codingmaybemoreinclusiveofsomesymptoms
TheVAusesICD-9-CM,ICD-10mayofferbetterresults
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
16/20
Conclusions
Codingwonthelpyoumuch.OnlyheadachesweretrulycodedThebestyoucouldgetis36%
NLPsystemsthatextractsymptomtermsgetsyou55%.
Therestwillrequiremorework.
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
17/20
TheFullStory
Thesesubjectivesymptomexpressionscontainadepthofinformationnotfoundinmedicalterms.
69y/opatientwasreferredforSuicidalIdeation. thinkingabouthisdeceasedwife,heputaguntohisheadforaminute,thenwenttobed
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
18/20
TheFullStory
SSEcommunicatethenatureandseverityofsymptoms.Mykneedoesntfeelright
IwishIcouldjustcutmylegoff Theyoftenindicatetheimpactofthesymptomonthepatient.
FunctionalstatusandQualityoflifemeasuresInevermakeittothebathroomintimeIhaventleftmyroominweeks,Imsofreakedout
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
19/20
FutureWork
UsingNLPtolocatephrasesthatmaybeaSubjectiveSymptomExpressionandreferringthemoutforhumanclassification,
thenfeedingthesebacktothesystem.
PreliminaryuseofthesesymptomexpressionsinPTSDandfunctionalstatusstudies
7/28/2019 Sitting on Pins and Needles-Characterization of Symptom Descriptions in Clinical Notes
20/20
QuestionsandComments?
AdiV.Gundlapalli,MDPhD,MilandN.Palmer,MPHRHIA,ShuyingShen,MStat,BrettR.SouthMS,GuyDivitaMS,MarjorieCarter,MPH,AndrewReddPhD,Jorie
M.ButlerPhD,MatthewSamore,MD
ThisworkwassupportedbytheDepartmentofVeteransAffairs,OfficeofResearchandDevelopment,HealthServicesResearchandDevelopment,ProWATCH:EpidemiologyofMedicallyUnexplainedSyndromesproject#HIR10-001.