36
1 A Complete Open Cloud Storage, Virt, IaaS, PaaS Dave Neary Open Source and Standards, Red Hat

A complete Open Source cloud: Storage, Virt, IaaS, PaaS

Embed Size (px)

DESCRIPTION

You can do everything in your datacenter with open source these days. With GlusterFS, oVirt, OpenStack, OpenShift, all running on CentOS or Fedora and orchestrated with the Foreman, you can run a complete open source cloud where all the pieces talk to each other and leverage integration points for no money.

Citation preview

Page 1: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

1

A Complete Open Cloud

Storage, Virt, IaaS, PaaS

Dave NearyOpen Source and Standards,

Red Hat

Page 2: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

2

Agenda

1. Traditional virtualization

2. The move to IaaS

3. Storage

4. PaaS, application encapsulation and orchestration

5. Cloud monitoring, service brokerage

Page 3: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

3

Agenda

1. Traditional virtualization

2. The move to IaaS

3. Storage

4. PaaS, application encapsulation and orchestration

5. Cloud monitoring, service brokerage

Page 4: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

4

Virtualization

Before

After

Page 5: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

5

Virtualization

● Consolidation of hardware – fewer, bigger servers

● Workload management – over-subscribed services get more hardware

● Protect your apps – fault tolerance, high availability, live migration, Network, disk, compute, memory Quality of Service

● Ability to scale up – add more hardware and modify resources allocated to VM on the fly

● No change to legacy apps

Page 6: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

6

Open Source virtualization

KVM management applicationOpen Source alternative to vSphere

Widely deployed HypervisorHosted by Linux Foundation since April 2013

Ganeti Developed by Google to manage clustersManages KVM and Xen nodes

Page 7: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

7

Agenda

1. Traditional virtualization

2. The move to IaaS

3. Storage

4. PaaS, application encapsulation and orchestration

5. Cloud monitoring, service brokerage

Page 8: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

8

Infrastructure as a Service

● Self-service provision

● Many identical servers

● Stateless services

● Scale-out easily – load balancing, public IPs, database as service

● Move to object storage

Page 9: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

9

Pets vs Cattle (yes, again)

“Future application architectures should use Cattle but Pets with strong configuration management are viable and still needed”

- Tim Bell, CERN“

Scale Up- Servers are like pets.

Pets are given names, are unique, lovingly hand raised and cared for. When they get ill, you nurse them back to health

Scale Out- Servers are like cattle.

Cattle are given numbers and are almost identical to each other. When they get ill, you get another one.

Page 10: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

10

OpenStack architecture

● Modular architecture

● Designed to easily scale out

● Based on (growing) set of core services

Page 11: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

11

Instance types

Server 1923432 cores60GB memory

Server 1923532 cores60GB memory

XL16 cores

30 GB memory

L L

XL

L

M

M

Page 12: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

12

Sample cloud application

Web service

1. Load balancerwith public IP

2. Load balancedweb servers 3. Load balancer

4. Load balancedapplication server

5. Replicateddatabase

6. Shared storage

Page 13: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

13

Sample cloud application

● Stateless – no side-effects in instance, memory only

● Persistent storage requires block storage or object storage service, or shared filesystem

● Requires rearchitecture of legacy applications

Page 14: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

14

Agenda

1. Traditional virtualization

2. The move to IaaS

3. Storage

4. PaaS, application encapsulation and orchestration

5. Cloud monitoring, service brokerage

Page 15: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

15

Storage

● Clouds needs scale-out storage

● Disk drives fail. All the time

● Image, block, and object storage, and/or shared filesystem

● Scale-out storage on commodity hardware - GlusterFS, Ceph, RiakCS, Swift

● Virtualization aware, tight integration with virtualization and Infrastructure as a Service desirable

Page 16: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

16

Scale-out storage

Page 17: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

17

Scale-out storage

Page 18: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

18

Agenda

1. Traditional virtualization

2. The move to IaaS

3. Storage

4. PaaS, application encapsulation and orchestration

5. Cloud monitoring, service brokerage

Page 19: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

19

PaaS = Platform as a Service

A Cloud Application Platform

Code Deploy Enjoy

Save Time and MoneyCode your app

Push-button

Deploy, and your App is running in the Cloud!

Page 20: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

20

Consolidated B-24 Liberator

Incredibly sophisticated. ~500k parts, assembled by unskilled labor.

No manufacturing process. Parts were cast in rubber molds, so every part was slightly different.

Assembled in the heat of San Diego, which warped the metal and required whole assemblies to be adjusted.

Ford Motor Co. brought a manufacturing process … ●unit production went from 250 planes a year to

650 planes a month.

THIS IS OUR CHALLENGE TODAY

Page 21: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

21

With PaaS

How to Build an App:1. Have Idea2. Get Budget3. Code4. Test5. Launch6. Automatically Scale

How to Build an App:1. Have Idea2. Get Budget3. Submit VM Request request4. Wait5. Deploy framework/appserver6. Deploy testing tools7. Test testing tools8. Code9. Configure Prod VMs10. Push to Prod11. Launch12. Request More Prod VMs to

meet demand13. Wait14. Deploy app to new VMs15. Etc.

Virtualized

How to Build an App:1. Have Idea2. Get Budget3. Submit hardware acquisition request4. Wait5. Get Hardware6. Rack and Stack Hardware7. Install Operating System8. Install Operating System

Patches/Fix-Packs9. Create user Accounts10. Deploy framework/appserver11. Deploy testing tools12. Test testing tools13. Code14. Configure Prod servers (and buy

them if needed)15. Push to Prod16. Launch17. Order more servers to meet demand18. Wait…19. Deploy new servers20. Etc.

Physical

“The use of Platform-as-a-Service technologies will enable IT organizations to become more agile and more responsive to the business needs.” –Gartner*

Page 22: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

22

Control vs automation

STORAGE(GlusterFS)

HARDWARE(x86)

VIRTUALIZATION(KVM)

OPERATING SYSTEM(RHEL)

APPLICATION PLATFORM(JBOSS, PHP, RUBY, ETC)

APPLICATION

Automated and Managed by the Public or Private Cloud Offering

Managed and Controlled by Customer (IT, Dev, or User)

IaaS PaaS SaaS

Increased Control

Increased Automation

Page 23: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

23

Multi-language,Auto-Scaling,Self-service,

Elastic,Cloud Application Platform

OpenShift Origin

Page 24: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

24

CloudFoundry

Page 25: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

25

Docker

Page 26: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

26

Orchestration and deployment

● Containerization – Docker, OpenShift cartridges

● Orchestration templates – Heat, CloudFormations

● Configuration management – Foreman, Puppet, Chef, Ansible, CFEngine...

Page 27: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

27

Agenda

1. Traditional virtualization

2. The move to IaaS

3. Storage

4. PaaS, application encapsulation and orchestration

5. Cloud monitoring, service brokerage

Page 28: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

28

Industry Trend – Hybrid CloudExisting IT + Private Cloud + Public Cloud = “Hybrid Cloud”

It's all coming together!!!

Physical IT Virtual IT Private Cloud Hybrid Cloud

Private Cloud

Public Cloud

Page 29: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

29

One Ring to Rule them All

● Cloud management software

● “Single pane of glass” to allow management of traditional Virt and private and public IaaS

● Enables policy enforcement● Facilitates service migration● Frees you from vendor lock-in

● CloudForms Management Engine

Page 30: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

30

Open Hybrid Cloud

Legacyvirtualization

(VMware,oVirt/RHEV)

Privatecloud

(eg. OpenStack)

Publiccloud

(AWS, GCE)

Page 31: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

31

Open Hybrid Cloud

Privatecloud

(eg. OpenStack)

Publiccloud

(AWS, GCE)

Cloud services broker, Cloud management

Legacyvirtualization

(VMware,oVirt/RHEV)

Page 32: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

32

Open Hybrid Cloud

Privatecloud

(eg. OpenStack)

Publiccloud

(AWS, GCE)

Cloud services broker, Cloud management

Platform as a Service

Guestinstances

Developer environment

Legacyvirtualization

(VMware,oVirt/RHEV)

Page 33: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

33

Open Hybrid Cloud

Privatecloud

(eg. OpenStack)

Publiccloud

(AWS, GCE)

Cloud services broker, Cloud management

Platform as a Service

Guestinstances

Developer environment

Shared storage (object, block)

Sof

twar

e D

efin

ed

Net

wor

king

Legacyvirtualization

(VMware,oVirt/RHEV)

Page 34: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

34

Open Hybrid Cloud

Privatecloud

(eg. OpenStack)

Publiccloud

(AWS, GCE)

Cloud services broker, Cloud management

Platform as a Service

Guestinstances

Developer environment

Shared storage (object, block)

Sof

twar

e D

efin

ed

Net

wor

king

Dev

elop

men

t, d

eplo

ymen

t, o

rche

stra

tion

Legacyvirtualization

(VMware,oVirt/RHEV)

Page 35: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

35

Open Hybrid Cloud needs Open Source

participate integrate stabilize

Page 36: A complete Open Source cloud: Storage, Virt, IaaS, PaaS

36

THANK YOU!QUESTIONS?

Dave [email protected]

@nearyd