1
Prediction of Acute Kidney Injuries in ICU Mia Kanzawa, Rohan Paul, Nielson Weng {mkanzawa, ropaul, nweng}@stanford.edu INTRODUCTION RESULTS DISCUSSION REFERENCES Acute Kidney Injury (AKI), is a clinicopathologic entity characterized by a sudden decrease in kidney function, leading to retention of metabolic waste products and the dysregulation of electrolyte homeostasis (1). Despite our progress in understanding the pathophysiology and a pre- cise clinical definition and staging for diagnosis, AKI remains a global public health concern impacting approximately 13.3 million patients per year and resulting in 1.7 million deaths per year (2). In our study, we are interested in the AKI acquired from the hospital set- ting because this is often caused by medical procedures and/or medica- tions and may be preventable. Recent studies have concluded that early nephrology consultations leading to preventative measures decreases both the incidence and severity of AKI (3-5). Furthermore, electronic medical records and e-Alerts offer the potential for identifying high-risk patients and warning the use of nephrotoxic medications (6-8). There- fore, a reliable predictive machine learning model could address this unmet need. GOAL: To predict a risk probability for developing AKI within the following 24 hours for patients admitted to the ICU based on all available prior electronic medical data Download Raw Data Sample Extraction Feature Extraction Feature Engineering Raw Data Concatenation Hidden Layers Probability of developing AKI METHODS Pre-analysis Data Extraction and Processing Model Building by Deep Learning .0001 .001 .1 0.0 0.5 1.0 Accuracy .0001 .001 .1 0.0 0.5 1.0 F 1 -Score .0001 .001 .1 0 2 4 6 8 10 Loss .0001 .001 .1 0.0 0.5 1.0 Precision .0001 .001 .1 0.0 0.5 1.0 Recall 0.05 0.1 0.5 0.0 0.5 1.0 Precision 0.05 0.1 0.5 0.0 0.5 1.0 Accuracy 0.05 0.1 0.5 0.0 0.5 1.0 F 1 -Score 0.05 0.1 0.5 0.0 0.5 1.0 Recall 0.05 0.1 0.5 0 2 4 6 8 10 Loss 0.0 0.5 1.0 F 1 -Score 0.0 0.5 1.0 Loss 0.0 0.5 1.0 Precision 0.0 0.5 1.0 Recall 5 6 7 0.0 0.5 1.0 Accuracy 50 100 300 500 1000 0.0 0.5 1.0 Precision 50 100 300 500 1000 0.0 0.5 1.0 F 1 -Score 50 100 300 500 1000 0 2 4 6 8 10 Loss 50 100 300 500 1000 0.0 0.5 1.0 Accuracy 50 100 300 500 1000 0.0 0.5 1.0 Recall SeLU ReLU Tanh 0.0 0.5 1.0 Precision SeLU ReLU Tanh 0.0 0.5 1.0 Recall SeLU ReLU Tanh 0.0 0.5 1.0 Accuracy SeLU ReLU Tanh 0.0 0.5 1.0 F 1 -Score SeLU ReLU Tanh 0.0 0.5 1.0 Loss Learning Rate Tau Hidden Layers Hidden Units Activation Function Accuracy Precision Recall F 1 -Score Loss Our method demonstrates that the application of deep learning to ICU patient data can reliably predict onset of AKI within 24 hours with good accuracy, recall, and pre- cision. High recall and accuracy indicate that our model has potential applications in clinical decision support. Specifically, a model with high recall allows physicians to identify patients for early intervention and prevention. Identifying high risk patients will not only help reduce ICU mortality rate but also sig- nificantly reduce cost. A patient diagnosed with AKI in the ICU will cost the health system in excess of $8,000 on average. With approximately 75,000 patients afflicted each year, our model can lower expenditure by hundreds of millions of dollars annu- ally. Given our very high performance metrics, we investigated the possibility that some features could be very highly correlated with the outcome and therefore allow the model to easily make accurate predictions. After sequentially removing features to identify potential strong contributors, we iden- tified a list of features that were highly correlated with AKI onset in our dataset. This list was primarily made up of medications, including epinephrine, diltiazem, diphenhydr- amine, and entacapone. While, clinically, the relationship between medications that regulate blood pressure might be more clearly related with AKI onset through renal hy- poperfusion, the strong correlation with diphenhydramine and entacapone warrants further investigation given that they are not known to be nephrotoxins. 1. Kumar V, Abbas A, Fausto N, Robbins S, Cotran R (2010) Pathologic Basis of Disease. 2. Lewington AJP, Cerdá J, Mehta RL (2013) Raising awareness of acute kidney injury: a global perspective of a silent killer. Kidney Int 84(3):457–467. 3. Mehta RL, et al. (2002) Nephrology consultation in acute renal failure. Am J Med 113(6):456–461. 4. Nephrology B, et al. (2007) Prognosis and serum creatinine levels in acute renal fail- ure at the time of nephrology consultation: an observational cohort study. BMC Nephrol 8(8). 5. Balasubramanian G, et al. (2011) Early Nephrologist Involvement in Hospital-Ac- quired Acute Kidney Injury: A Pilot Study. Am J Kidney Dis 57(2):228–234. 6 McCoy AB, et al. (2012) Real-time pharmacy surveillance and clinical decision sup- port to reduce adverse drug events in acute kidney injury. Appl Clin Inform 3(2):221–238. 7. Colpaert K, et al. (2012) Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class*. Crit Care Med 40(4):1164–1170. FUTURE DIRECTION Training Set Dev Set Test Set Loss 0.013 0.036 0.040 Accuracy 99.6% 99.2% 99.1% Precision 0.998 0.991 0.986 Recall 0.998 0.989 0.992 F1-score 0.998 0.999 0.989 7 8 4 5 6 7 8 4 5 6 7 8 4 5 6 7 8 4 5 6 7 8 4 Figure 1: Results of experiments to determine parame- ters for neural network. Final model with 6 hidden units, 300 units/layer, dropout rate 0.1, learning rate 0.001, tau = 0.1, mini batch size of 128, ran with 30 epochs. Darker color represents Training Set. Lighter color represents Dev Set. Figure 2: Final Model Results

Prediction of Acute Kidney Injuries in ICUcs229.stanford.edu/proj2017/final-posters/5148524.pdf · quired Acute Kidney Injury: A Pilot Study. Am J Kidney Dis 57(2):228–234. 6 McCoy

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Prediction of Acute Kidney Injuries in ICUcs229.stanford.edu/proj2017/final-posters/5148524.pdf · quired Acute Kidney Injury: A Pilot Study. Am J Kidney Dis 57(2):228–234. 6 McCoy

Prediction of Acute Kidney Injuries in ICUMia Kanzawa, Rohan Paul, Nielson Weng

{mkanzawa, ropaul, nweng}@stanford.edu

INTRODUCTION RESULTS DISCUSSION

REFERENCES

Acute Kidney Injury (AKI), is a clinicopathologic entity characterized by a sudden decrease in kidney function, leading to retention of metabolic waste products and the dysregulation of electrolyte homeostasis (1). Despite our progress in understanding the pathophysiology and a pre-cise clinical de�nition and staging for diagnosis, AKI remains a global public health concern impacting approximately 13.3 million patients per year and resulting in 1.7 million deaths per year (2).

In our study, we are interested in the AKI acquired from the hospital set-ting because this is often caused by medical procedures and/or medica-tions and may be preventable. Recent studies have concluded that early nephrology consultations leading to preventative measures decreases both the incidence and severity of AKI (3-5). Furthermore, electronic medical records and e-Alerts o�er the potential for identifying high-risk patients and warning the use of nephrotoxic medications (6-8). There-fore, a reliable predictive machine learning model could address this unmet need.

GOAL: To predict a risk probability for developing AKI within the following 24 hours for patients admitted to the ICU based on all available prior electronic medical data

Download Raw Data

Sample Extraction

Feature Extraction

Feature Engineering

Raw Data

Concatenation

Hidden Layers

Probabilityof

developing AKI

METHODSPre-analysis Data

Extraction and ProcessingModel Building

by Deep Learning

.0001 .001 .10.0

0.5

1.0

Accu

racy

.0001 .001 .10.0

0.5

1.0

F 1-S

core

.0001 .001 .10

2

4

6

8

10

Loss

.0001 .001 .10.0

0.5

1.0

Prec

isio

n

.0001 .001 .10.0

0.5

1.0

Reca

ll

0.05 0.1 0.50.0

0.5

1.0

Prec

isio

n

0.05 0.1 0.50.0

0.5

1.0

Accu

racy

0.05 0.1 0.50.0

0.5

1.0

F 1-S

core

0.05 0.1 0.50.0

0.5

1.0

Reca

ll

0.05 0.1 0.50

2

4

6

8

10

Loss

0.0

0.5

1.0

F 1-S

core

0.0

0.5

1.0

Loss

0.0

0.5

1.0

Prec

isio

n

0.0

0.5

1.0

Reca

ll

5 6 70.0

0.5

1.0

Accu

racy

50 100 300 500 10000.0

0.5

1.0

Prec

isio

n

50 100 300 500 10000.0

0.5

1.0

F 1-S

core

50 100 300 500 10000

2

4

6

8

10

Loss

50 100 300 500 10000.0

0.5

1.0

Accu

racy

50 100 300 500 10000.0

0.5

1.0

Reca

ll

SeLU ReLU Tanh0.0

0.5

1.0

Prec

isio

n

SeLU ReLU Tanh0.0

0.5

1.0

Reca

ll

SeLU ReLU Tanh0.0

0.5

1.0

Accu

racy

SeLU ReLU Tanh0.0

0.5

1.0

F 1-S

core

SeLU ReLU Tanh0.0

0.5

1.0

Loss

Lear

ning

Rat

eTa

uH

idde

nLa

yers

Hid

den

Uni

tsA

ctiv

atio

nFu

nctio

n

Accuracy Precision Recall F1-Score Loss

Our method demonstrates that the application of deep learning to ICU patient data can reliably predict onset of AKI within 24 hours with good accuracy, recall, and pre-cision. High recall and accuracy indicate that our model has potential applications in clinical decision support. Speci�cally, a model with high recall allows physicians to identify patients for early intervention and prevention.

Identifying high risk patients will not only help reduce ICU mortality rate but also sig-ni�cantly reduce cost. A patient diagnosed with AKI in the ICU will cost the health system in excess of $8,000 on average. With approximately 75,000 patients a�icted each year, our model can lower expenditure by hundreds of millions of dollars annu-ally.

Given our very high performance metrics, we investigated the possibility that some features could be very highly correlated with the outcome and therefore allow the model to easily make accurate predictions.

After sequentially removing features to identify potential strong contributors, we iden-ti�ed a list of features that were highly correlated with AKI onset in our dataset. This list was primarily made up of medications, including epinephrine, diltiazem, diphenhydr-amine, and entacapone. While, clinically, the relationship between medications that regulate blood pressure might be more clearly related with AKI onset through renal hy-poperfusion, the strong correlation with diphenhydramine and entacapone warrants further investigation given that they are not known to be nephrotoxins.

1. Kumar V, Abbas A, Fausto N, Robbins S, Cotran R (2010) Pathologic Basis of Disease.2. Lewington AJP, Cerdá J, Mehta RL (2013) Raising awareness of acute kidney injury: a global perspective of a silent killer. Kidney Int 84(3):457–467.3. Mehta RL, et al. (2002) Nephrology consultation in acute renal failure. Am J Med 113(6):456–461.4. Nephrology B, et al. (2007) Prognosis and serum creatinine levels in acute renal fail-ure at the time of nephrology consultation: an observational cohort study. BMC Nephrol 8(8). 5. Balasubramanian G, et al. (2011) Early Nephrologist Involvement in Hospital-Ac-quired Acute Kidney Injury: A Pilot Study. Am J Kidney Dis 57(2):228–234.6 McCoy AB, et al. (2012) Real-time pharmacy surveillance and clinical decision sup-port to reduce adverse drug events in acute kidney injury. Appl Clin Inform 3(2):221–238.7. Colpaert K, et al. (2012) Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class*. Crit Care Med 40(4):1164–1170.

FUTURE DIRECTION

Training Set Dev Set Test Set

Loss 0.013 0.036 0.040

Accuracy 99.6% 99.2% 99.1%

Precision 0.998 0.991 0.986

Recall 0.998 0.989 0.992

F1-score 0.998 0.999 0.989

7

84 5 6 7 84 5 6 7 84 5 6 7 84 5 6 7 84

Figure 1: Results of experiments to determine parame-ters for neural network. Final model with 6 hidden units, 300 units/layer, dropout rate 0.1, learning rate 0.001, tau = 0.1, mini batch size of 128, ran with 30 epochs. Darker color represents Training Set. Lighter color represents Dev Set.

Figure 2: Final Model Results