||ETH Zurich, Data Analytics Lab

Lorenz Kuhn & Carsten Eickhoff

21.09.2016 1

Implicit Negative Feedback in Clinical IR

Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 2

Medical Literature: Scale & Growth

21.09.2016Carsten Eickhoff

▪ 25 Million articles indexed in MedLine▪ Recently growing by ~1 Million new articles per year▪ Manual search and processing become infeasible▪ Search technology is needed▪ Goal: Processing the collection in < 20 mS

||ETH Zurich, Data Analytics Lab 3

Patient-centric Search Scenarios

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 4

Patient-centric Search Scenarios

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 5

Patient-centric Search Scenarios

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 6

Patient-centric Search Scenarios

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 7

Patient-centric Search Scenarios

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 8

Medical IR

A 58-year-old African-American woman presents to the ER with episodic pressing/burning chest pain that began two days earlier for the first time in her life. The pain started while she was walking, radiates to the back, and is accompanied by nausea, diaphoresis and mild dyspnea, but is not increased on inspiration. The latest episode of pain ended half an hour prior to her arrival. She is known to have hypertension and obesity. She denies smoking, diabetes, hypercholesterolemia, or a family history of heart disease. She currently takes no medications. Physical examination is normal. The EKG shows nonspecific changes.

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 9

Medical IR

A 58-year-old African-American woman presents to the ER with episodic pressing/burning chest pain that began two days earlier for the first time in her life. The pain started while she was walking, radiates to the back, and is accompanied by nausea, diaphoresis and mild dyspnea, but is not increased on inspiration. The latest episode of pain ended half an hour prior to her arrival. She is known to have hypertension and obesity. She denies smoking, diabetes, hypercholesterolemia, or a family history of heart disease. She currently takes no medications. Physical examination is normal. The EKG shows nonspecific changes.

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 10

Medical IR

A 58-year-old African-American woman presents to the ER with episodic pressing/burning chest pain that began two days earlier for the first time in her life. The pain started while she was walking, radiates to the back, and is accompanied by nausea, diaphoresis and mild dyspnea, but is not increased on inspiration. The latest episode of pain ended half an hour prior to her arrival. She is known to have hypertension and obesity. She denies smoking, diabetes, hypercholesterolemia, or a family history of heart disease. She currently takes no medications. Physical examination is normal. The EKG shows nonspecific changes.

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 11

Medical IR

A 58-year-old African-American woman presents to the ER with episodic pressing/burning chest pain that began two days earlier for the first time in her life. The pain started while she was walking, radiates to the back, and is accompanied by nausea, diaphoresis and mild dyspnea, but is not increased on inspiration. The latest episode of pain ended half an hour prior to her arrival. She is known to have hypertension and obesity. She denies smoking, diabetes, hypercholesterolemia, or a family history of heart disease. She currently takes no medications. Physical examination is normal. The EKG shows nonspecific changes.

21.09.2016Carsten Eickhoff

▪ Negated phrases contain valuable information

||ETH Zurich, Data Analytics Lab 12

Detrimental Effects on Search Performance

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 13

Medical IR

A 58-year-old African-American woman presents to the ER with episodic pressing/burning chest pain that began two days earlier for the first time in her life. The pain started while she was walking, radiates to the back, and is accompanied by nausea, diaphoresis and mild dyspnea, but is not increased on inspiration. The latest episode of pain ended half an hour prior to her arrival. She is known to have hypertension and obesity. She denies smoking, diabetes, hypercholesterolemia, or a family history of heart disease. She currently takes no medications. Physical examination is normal. The EKG shows nonspecific changes.

21.09.2016Carsten Eickhoff

▪ Negated phrases contain valuable information▪ Using them as query terms can be problematic

||ETH Zurich, Data Analytics Lab 14

Medical IR

A 58-year-old African-American woman presents to the ER with episodic pressing/burning chest pain that began two days earlier for the first time in her life. The pain started while she was walking, radiates to the back, and is accompanied by nausea, diaphoresis and mild dyspnea, but is not increased on inspiration. The latest episode of pain ended half an hour prior to her arrival. She is known to have hypertension and obesity. She denies smoking, diabetes, hypercholesterolemia, or a family history of heart disease. She currently takes no medications. Physical examination is normal. The EKG shows nonspecific changes.

21.09.2016Carsten Eickhoff

▪ Negated phrases contain valuable information▪ Using them as query terms can be problematic▪ Naive approach: Remove all negated phrases

||ETH Zurich, Data Analytics Lab 15

Medical IR

A 58-year-old African-American woman presents to the ER with episodic pressing/burning chest pain that began two days earlier for the first time in her life. The pain started while she was walking, radiates to the back, and is accompanied by nausea, diaphoresis and mild dyspnea, but is not increased on inspiration. The latest episode of pain ended half an hour prior to her arrival. She is known to have hypertension and obesity. She denies smoking, diabetes, hypercholesterolemia, or a family history of heart disease. She currently takes no medications. Physical examination is normal. The EKG shows nonspecific changes.

21.09.2016Carsten Eickhoff

▪ Negated phrases contain valuable information▪ Using them as query terms can be problematic▪ Naive approach: Remove all negated phrases▪ Alternative: Use them as negative feedback

||ETH Zurich, Data Analytics Lab 16

Formal Patient-centric Retrieval

21.09.2016Carsten Eickhoff

Standard Retrieval Model

Negation Filtering

Negative Feedback

||ETH Zurich, Data Analytics Lab 17

Experimental Setup

21.09.2016Carsten Eickhoff

▪ TREC Clinical Decision Support Track▪ 30 anonymized clinical notes▪ 733,000 PubMed articles▪ Find relevant literature for each patient▪ Evaluated by NLM experts

||ETH Zurich, Data Analytics Lab 18

Results

21.09.2016Carsten Eickhoff

||ETH Zurich, Data Analytics Lab 19

Conclusion

21.09.2016Carsten Eickhoff

▪ Clinical data science becomes crucial as collections scale

▪ Accounting for phrase compositionality is important

▪ E.g., negated phrases

▪ Negations detriment state-of-the-art retrieval methods

▪ Explicitly modelling and using this type of information helps

▪ Future (ongoing) work: Deep neural networks for modelling phrase compositionality

||ETH Zurich, Data Analytics Lab 20

Thank You!

21.09.2016Carsten Eickhoff