Science-as-a-Service - Talk at AWS re:Invent - Public Sector Breakfast

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Science-as-a-Service on AWS

Go Far With Less

Ravi K Madduri, Argonne National Laboratory and University of Chicago

November 13, 2013

1Computation Institute, University of Chicago, Chicago, IL, USA. 2Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL, USA. 3 Section Genetic Medicine, University of Chicago, Chicago, IL.

Challenges in Next-Gen Sequencing Analysis

!

!

!

!

!

!

!

High Performance, Reusable Consensus

Calling Pipeline

!

!

!

"

"

"

! "

!

"

"

Parallel Workflows on Globus Genomics

!

!

!

!

!

!

!

No.

Historie

s

Executio

n Time

(s)

No. Per

Hour

On-demand

Cost ($2.10)

Spot Cost

($0.50)

1.5B 570 6 $35 $9

1B 445 8 $27 $7

0.5B 283 12 $18 $5

0.25B 170 21 $10 $2

>10,000 registered users; >150 daily24 PB moved; >1B files

10x (or better) performance vs. scp99.9% availability

Entirely hosted on Amazon

Figure 1: Globus Genomics spot instance usage in hours/day and cost in $/day for October 2013.

Our research is supported by:

U.S. DEPARTMENT OF

ENERGY

23