27
Storage Architectures and the Cloud & field notes from 18 months at SolidFire Andy Roberts – [email protected] - Field Solutions Architect

Storage architectures and the cloud

Embed Size (px)

DESCRIPTION

Andy Roberts talks storage, cloud, SolidFire storage, and brings it together with CloudStack storage evolution.

Citation preview

Page 1: Storage architectures and the cloud

Storage Architectures and the Cloud& field notes from 18 months at SolidFire

Andy Roberts – [email protected] - Field Solutions Architect

Page 2: Storage architectures and the cloud

Career Cloudwash

First day in storage was a Register worthy event March 2002 50K Mailboxes lost with a storage system on fire Supporting a SPaaS platform based on OpenSource

Customers bring VMWare into production 2004 – 2007 as VMWare becomes de facto Everything very manual or with minimal scripting

First Clouds – 2007 - 2010 Early attempts at automation Multi-tenancy becomes a daily focus

Cloud.Com appears on my radar - 2011 Cloud product evaluation The birth of a Cloud

March 2013 – time for a change First day at SolidFire – 8th April Jully 2013 – first CloudStack meetup Invested time into learning CloudStack & OpenStack

Page 3: Storage architectures and the cloud

Public Cloud Has Raised the Bar

…driving the transformation of enterprise IT globally

Page 4: Storage architectures and the cloud

The Silo’ed Infrastructure Model Is Unsustainable

Source: http://www.wired.com/2012/05/stuck-in-silo/

Purchasing Marketing Sales Development

First Cloud NIH Cloud 3rd go… This will be the

one…

Page 5: Storage architectures and the cloud

Legacy Data Center

Single Tenant

Isolated work loads

Dedicated Infrastructure

Scale-up

Pre-provisioned capacity

Hardware defined

Project Based

Manual Administration

Next Generation Data Center

Multi-tenant

Mixed workloads

Shared infrastructure

Scale-out

Capacity on demand

Software defined

Self service

Automation

Entering a whole new world…

Page 6: Storage architectures and the cloud

Regardless of the name, desired outcomes are the same

Next Generation Data Center

Software Defined Data Center Infrastructure 2.0 Cloud Computing

Private Cloud IT-as-a-Service

Agile Scalable Automated Predictable

Page 7: Storage architectures and the cloud

A Fundamental Shift In App Design & Delivery

Apps span VMs

Data stored in scalable DBs, cached in memory tiers

Interaction via API, web or mobile

Apps run on a computer

Data stored in files

Interaction via UI

Legacy Data Center Next Generation Data Center

Page 8: Storage architectures and the cloud

CloudStack ?

OpenStack ?

Next Gen VMWare ?

All of the above?

Roll my own?

Commodity Stack?

Engineered Stack?

Leave the legacy behind?

Bring it with me?

Public or private?

Page 9: Storage architectures and the cloud

The “Community” is what makes it work

Users

Service Providers

Vendors

Integrators

Page 10: Storage architectures and the cloud

Expanding the Reach of The Next Generation Data Center

Agile

Scalable

Automated

Predictable

Page 11: Storage architectures and the cloud

What you build on matters

Page 12: Storage architectures and the cloud

Flash for the Next Generation Data Center

Page 13: Storage architectures and the cloud

Performance

Cap

acity

Scale-Out

Scale-Out vs. Scale-Up

Performance

Cap

acity

Scale-Up

Limited performance scalability Creates islands of storage with

poor utilization Forklift upgrade model

Massive single system scale Capacity and performance

managed as independent pools Performance increases as you

grow capacity New performance and capacity

resources available in minutes

Page 14: Storage architectures and the cloud

Capacity

Perform

ance

SF2405 Initial Cluster

SF9010 nodes added

SF2405 nodes added

Addition of future SF nodes

Mixed Node Clusters

Dynamically change capacity and performance characteristics of your cluster over time

Page 15: Storage architectures and the cloud

Two views on benefits of scale

Service Provider & Internal Service Provider Simplifies capacity management Re-use across product lines as they come and go Match spending to cash flow

Enterprise Buy only what you need, rather than 3 years up-front Continual Refresh of platform Simplifies capacity management

Page 16: Storage architectures and the cloud

Performance Virtualization: Independent global pools of capacity and performance

Allocate: Storage performance independent of capacity

Manage: Performance real-time without impacting other volumes

Guarantee: Performance to every volume with fine-grain QoS settings

Deliver Guaranteed Storage Performance and Firm Performance SLAs

Guaranteed Performance - QoS

Page 17: Storage architectures and the cloud

Two views on benefits of QoS

Service Provider & Internal Service Provider Much better for multi-tenancy than just vLANs alone Sell QoS as an advantage Remove performance / noisy-neighbour headaches

Enterprise The business will trust your XaaS platform Match performance to LOB applications Remove performance management headaches

Page 18: Storage architectures and the cloud

Automated Management

Integrated REST-based API Enables complete automation of any

SolidFire function Supports development of user-facing

storage controls Seamless integration into current

billing/charge-back systems and management stacks

API Integration Support from SolidFire

Page 19: Storage architectures and the cloud

Drastically Simplified Storage Management

SolidFire Architecture

Unified pool of capacity and performance

Automatic load distribution

Mixed-Node Cluster Support

Self-healing HA

Complete REST-based API automation

Traditional Storage Management

Separate pools of SATA, SAS, and Flash

RAID levels, aggregates, volume groups

Forklift controller and system upgrades

Fire drills on hardware failure

Manual UI Management

Page 20: Storage architectures and the cloud

Views on benefits of Automation

Service Provider & Internal Service Provider Just what the market expects

Enterprise Reduce costs and/or drive out re-work Increase agility and time to market

Enabler for all other benefits QoS + Automation + Scale = Huge Compound Benefit

Page 21: Storage architectures and the cloud

Personal View Storage marketplace is exciting as its ever been (!) Great range of options Blend multiple technologies together Persistent or ephemeral

Cloud Automation Market Amazing what you can achieve Things really have come a long

Challenges as a vendor Collaborate and differentiate at the same time Give people the widest choice Move up to the “Higher Ground”

Page 22: Storage architectures and the cloud

CloudStack Storage EvolutionAndy Roberts - SolidFire

Page 23: Storage architectures and the cloud

We’ve been busy...● Google Summer of Code

o http://www.solidfire.com/blog/mentoring-with-google-summer-of-code-and-lessons-in-cloudstack/

o Automated Regression Testingo Reworking host and storage taggingo New GUI functionality for plugins o Mentoring new talent as part of Apache Foundation

Page 24: Storage architectures and the cloud
Page 25: Storage architectures and the cloud

CloudStack Storage Evolution4.2 - dynamic provisioning for data drives4.3 - adding KVM support 4.4 - root disk dynamic provisioning & resize 4.5 - GUI for storage plug-in & snapshot baby steps4.6 - planned : snapshot & clone integration

immutable UUIDs are a challenge breaking the 256 LUN limit a focus

collaborative work with other vendors continues

Page 26: Storage architectures and the cloud

Whats next?Come and see Mike present if you are at CollabCatch-up on slides if not Ideas appreciated on storage improvementSolidFire Continue to Invest in CloudStack

[email protected]( on behalf of [email protected])

Page 27: Storage architectures and the cloud

Smiths Bar and Grill - Beers Are on Us!