8
Cloudian® S3 Cloud Storage Pla/orm Building a Resilient, Scalable, Storage System with OpenStack Paul Turner Cloudian Inc. April 15 th 2014

Building a Resilient, Scalable, Storage System with OpenStack

Embed Size (px)

DESCRIPTION

Cloudian has been working closely with Red Hat on their OpenStack offerings and certified its integration into OpenStack Horizon, Nova, Glance and Keystone . We provide a scalable capacity storage layer for OpenStack and are the leader in Open Hybrid Cloud – acting as the storage fabric between on-premise data and cloud data. Cloudian is the preferred storage solution for large scale environments, multi datacenter storage, and hybrid cloud tiering.

Citation preview

Page 1: Building a Resilient, Scalable, Storage System with OpenStack

Cloudian®  S3  Cloud  Storage  Pla/orm  

Building  a  Resilient,  Scalable,  Storage  System  with  OpenStack  

Paul Turner Cloudian Inc. April 15th 2014

Page 2: Building a Resilient, Scalable, Storage System with OpenStack

The  Technology  for  Storage  is  changing…  

Flashhost/array

TraditionalSAN/NAS

ObjectStorage

Scale  Out  /Peta  ByteScalability  /  Big  DataScale  Up  /  

Tera  Byte

Low  PriceBit  PriceHigh  Price

Low  SpeedLatencyHigh  Speed

LargeTransaction  VolumeLimited

RemoteAccessLocal

CapableRobustness  /  DRLimited

Page 3: Building a Resilient, Scalable, Storage System with OpenStack

OpenStack  Pla/orm  

Source: http://ken.pepple.info/openstack/2012/09/25/openstack-folsom-architecture/

Management  •  Dashboard  –  Horizon  •  Image  –  Glance  •  Iden9ty  –  Keystone    

Infrastructure  •  Compute  –  Nova  •  Network  –  Quantum  •  Block  Storage  –  Cinder  •  Object  Storage  –  

Cloudian  or  SwiG  

Page 4: Building a Resilient, Scalable, Storage System with OpenStack

ElasEc,  distributed  and  reliable

NOSQL  database  distributes  and  replicates  data

Logical  ringData  is  automaEcally  replicated  to  mulEple  nodes.

LocaEon  of  data  can  be  designated,  for  instance,  to  mulEple  datacenters  and  per  rack.

DC1

DC2

In  theory,  #  of  nodes  in  a  logical  ring  can  be  up  to  2127  (almost  infinite).

Data  load  can  be  rebalanced  when  a  node  is  added  or  removed.

5-14

Page 5: Building a Resilient, Scalable, Storage System with OpenStack

Enhanced  HyperStore®  Technology  

•  Policies  tailored  for  different  object  types  

• Op9mized  for  all  data  •  Chunking  for  beLer  performance  

•  Erasure  Coding  for  deep  archive  efficiency  

•  Reliable  Storage  across  mul9-­‐node  failures  

HyperStorePatent  Pending

Small  objects

Large  ObjectsActive  Content

File  System

NOSQL  DB

Erasure  Coding

DeepArchives

Page 6: Building a Resilient, Scalable, Storage System with OpenStack

•  “As  is”  app  re-­‐use  =  instant  use  cases/solu9ons  •  Highly  innova9ve,  ac9ve  S3  developer  community  

Brings  the  wealth  of  S3  ApplicaEon  ecosystem  to  your  OpenStack  Cloud  

Backup/DRArchiving

Enterprise  NFS/CIFSGateway

Desktop  FileStorage/Backup

Enterprise  SecureFile  Sharing

350+  S3  apps  demand  full  compatibility

Page 7: Building a Resilient, Scalable, Storage System with OpenStack

OpenStack  Integrated  Storage  Full  integraEon  with  Horizon,  Nova,  Glance,  KeyStone  

ü  Single  Sign-­‐on  ü  Integrated  

Management  GUI  ü  Integrated  

provisioning  ü  Store  OS  images  &  

snapshots    

Page 8: Building a Resilient, Scalable, Storage System with OpenStack

ü  Low  cost  cloud  storage  ü QoS  controls  built-­‐in  ü  Compression  &  Encryp9on  ü  Peer-­‐to-­‐peer  scaling  ü  Easy  deployment  ü  Fully  S3  compa9ble