21
on the Yet another on-demand Galaxy cloud, but only powered by Apache CloudStack

Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Embed Size (px)

DESCRIPTION

These slides are presented at the Galaxy Community Conference 2014. https://wiki.galaxyproject.org/Events/GCC2014/Abstracts/Talks#Galaxy_on_the_GenomeCloud_:_Yet_another_on-demand_Galaxy_cloud.2C_but_only_powered_by_Apache_CloudStack

Citation preview

Page 1: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

on theYet another on-demand Galaxy cloud,

but only powered by Apache CloudStack

Page 2: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 3: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

6 9

2

2

1

1

1014

# GCC 2014 Talks

# GCC 2014 Posters

Korea

Page 4: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

http://genome-cloud.com

Page 5: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

2X more hosts than

GenomeCloud

0

0.5

1

1.5

2

2.5

3

U S E G A L A XY . O R G G E N O ME - C L O U D . C O M

DATA TRANSFER SPEED (MB/S)

Page 6: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 7: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Launch

GenomeCloud2012.12

Start Galaxy setup in servers

• 2013.7

Complete Galaxy system architecture and software stacks•2013.9

Automated and integrated with GenomeCloud•2013.12

Launch

Galaxy on the GenomeCloud

• 2014.01

Page 8: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

OS(Linux [ubuntu v12])

Python

DBMS

[Postgr

eSQL]

HTTP Server

[NGINX]

FTP Server

[ProFTPD]

Ganglia Master

Grid Engine

(Head)

Galaxy

Job

Handler0

Job

HandlerN

Web

Handler0

Web

HandlerNNFS/LVM

NTP

(Server)

HTTP Server

[Apache]

OS(ubuntu v12)

Grid Engine

(Worker)

NTP

(Client)

NFS

(Client)

Ganglia

(slave)

R / R packages

Head Worker

Galaxy

Users

Page 9: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Head

Worker X N

Galaxy

Cluster

Central NFS

/DB/BIO

Galaxy core, tools, user data

Shared storage for Grid Engine

1 2

1

2 Reference genomes data,

Genome data locations

NFS

Page 10: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Clustering

,

Software

setup,

Galaxy

setup

Deploy

head node

Associate

public IP

Create port

forwarding

rule

Create and

attach disk

volumes

Deploy

worker

nodes

1

4

3

2

5

6

Clo

ud

Sta

ck A

PIs

Page 11: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 12: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 13: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Head

Worker X 15

Galaxy Cluster

Workshop

/BIO

Head

Worker X N

Galaxy Cluster

Research

/BIO X N

100

GB100

GB

Page 14: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 15: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 16: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 17: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

OS(Linux [ubuntu v12])

DBMS

Nginx

FTP Server

Ganglia Master

Grid Engine

(Head)

Galaxy

NFS/LVM

Apache

OS(ubuntu v12)

Gride Engine

(Worker)

NFS/LVM

(Client)

Ganglia

(slave)

R / R packages

Head Worker

Galaxy

Users

Page 18: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 19: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 20: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 21: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)