41

3 Windows Azure is Microsoft’s cloud platform that enables you to quickly build, deploy and manage applications and store your data across a global

Embed Size (px)

Citation preview

StorSimple: Cloud-integrated StorageTechnical OverviewJai DesaiWorldwide Technology Solution ProfessionalMicrosoftWS-B324

Agenda• Windows Azure• CiS Overview• Primary Storage & Platform• Cloud-integrated Tiering• Backup/Restore & Disaster Recovery• Security• Case Studies

3

Windows Azure

What is Windows Azure?

Windows Azure is

Microsoft’s cloud

platform that enables

you to quickly build,

deploy and manage

applications and store

your data across a

global network of

Microsoft managed

datacentres.

You Manage You Manage

Vendor Manages

You Manage

Vendor Manages

Platform(as a Service)

Storage

Servers

Networking

O/S

Middleware

Virtualization

Applications

Runtime

Data

Software(as a Service)

Storage

Servers

Networking

O/S

Middleware

Virtualization

Applications

Runtime

Data

Infrastructure(as a Service)

Storage

Servers

Networking

O/S

Middleware

Virtualization

Data

Applications

Runtime

You Manage

Vendor Manages

Cloud ServicesOn Premises

Storage

Servers

Networking

O/S

Middleware

Virtualization

Data

Applications

Runtime

Cloud Computing Patterns

tCom

pu

te

Inactivity

Period

On and OffOn & off workloads (e.g. batch job)Over provisioned capacity is wasted Time to market can be cumbersome

t

Unpredictable BurstingUnexpected/unplanned peak in demand Sudden spike impacts performance Can’t over provision for extreme cases

Com

pu

te

t

Predictable BurstingServices with micro seasonality trends Peaks due to periodic increased demandIT complexity and wasted capacity

Com

pu

te

t

Growing FastSuccessful services needs to grow/scale Keeping up w/ growth is big IT challenge Cannot provision hardware fast enough

Com

pu

te

North America Region Europe Region Asia Pacific Region

Major datacenter

CDN node

Windows Azure Global Presence

N. Central – U.S. Sub-region

S.E. AsiaSub-region

E. AsiaSub-region

N. Europe Sub-region

W. Europe Sub-region

S. Central – U.S. Sub-region

Microsoft Confidential - Signed NDA Required

East – U.S. Sub-region

West – U.S. Sub-region

StorSimple CiS Overview

Storage Challenges Are Broad

10

Primary Storage

Disk-Based Backup Storage

Tape Infrastructure and Management

Archival Storage

Replicated Storage for

DR

Offsite Facility for

Georesilience

Storage Today = Complex & Expensive

Data Management Complexity

Backup Issues

Untested Disaster Recovery

Data Growth

and Footprint

Equipment Sprawl

…and are Challenges with using Cloud Storage• Integration

• HTTP/REST API• Integration with existing backup apps & processes

• Performance• WAN latency performance impact• WAN bandwidth costs• Traditional WAN optimization does not work with public clouds

• Security• Data security & compliance risk

11

Application Servers

HTTP/REST API

Cloud-integrated Storage (CiS) Can Help

12

Azure + StorSimple = 60–80% Lower TCO

Thin, ReducedSnapshots

Cloud Snapshots Recover in Cloud or Any DC

Automated Cloud-as-a-Tier

Use Cloud asSecondary DC

Cloud-Integrated SAN Storage

Primary Storage

Disk-Based Backup Storage

Tape Infrastructure and Management

Archival Storage

Replicated Storage for

DR

Offsite Facility for

Georesilience

Storage Today = Complex & Expensive

Focused CiS Applications and Workloads

13

Cap

acit

y

Time

Data Grows Exponentially(50–60% Annually)

However, Most I/O Happens to the “Working

Set” Data

CapEx, OpEx

of Traditional

Storage

CapEx, OpEx of

StorSimple

CloudStorage

Local Storage

Target Use Cases

File Share• CIFS• NFS

• File servers• NAS

SharePoint• Business

intelligence• Collaboration• Content and

records management

Archives• EMR/PACS• Legal• Construction

• Media• Engineering• Logs, records

VMs• Regional office

storage• VM sprawl• VM archives

StorSimple Cloud-Integrated Storage

14

Connects Windows and VMware Servers to Azure Storage in Minutes with No Application Modification

Benefits• Consolidates primary, archive,

backup, DR thru seamless integration with Azure

• Cloud snapshots = revolutionary speed, simplicity and reliability for backup and recovery

• Reduces enterprise storage TCO by 60–80%

Application Servers

Inactive Data + Backup Copies on Azure storage

Speed of SSD/SAN + Elasticity of Cloud

SAS Local Tier

Most Active Data on SSD

StorSimple Solution

StorSimple Solution Characteristics

16

Sca

labili

ty /

Perf

orm

ance

Capacity

552010-50TB* usable local300TB max capacity

752020-100TB* usable local500TB max capacity

* Denotes usable local storage capacity with compression and de-duplication, varies by use case.

* Additional details about appliance specifications can be found at: http://storsimple.xyratex.com/storsimple/specifications

50202-10TB* usable local100TB max capacity

70204-20TB* usable local200TB max capacity

• Seamless iSCSI integration• Highly efficient storage

• Thin provisioning• Primary storage de-duplication

• High performance + cloud elasticity• Integrated tiering: SSD, SAS & cloud

StorSimple Cloud-integrated Architecture

• Full security for the cloud• Local keys + encryption of all cloud data• Protecting both data-in-motion and data at

rest• Fast, automated data protection + recovery

• Automated snapshots to cloud• Fast online restores and elimination of tape• Integrated disaster recovery – lowest cost &

complexity17

On an Enterprise-Class Platform• Certified: VMware-ready and Microsoft Windows Server-certified• HA: full redundancy + hot swaps + non-disruptive upgrades

SAN Storage• iSCSI SAN with auto-tiering

(SSD/SAS)• Automated snapshots• Primary dedupe/compress

Seamless Cloud Integration for:• Tiered primary + archives• Cloud snapshots: mountable for

DR

With Cloud Data Management

De-dupe and Compression• Maximizes storage of ‘hot or warm data’ on-

premise for higher IOPS and/or lower response times for application access.

• Minimizes size of data transfer and storage in Azure

• Works at the block-level and replaces duplicate data blocks with a meta data map (pointers to the original block)

• Data is de-duped in the SSD tier and compressed in the SAS tier before being tiered to Azure

• On-premise data capacity can be increased by 2x – 5x based on the type of data stored

• Backup de-dupe: Cloud snapshots are differential and thereby eliminate copies of redundant blocks across backups

Datablocks

Total data capacity required = 10TB

D C

AA

E

C B

BB

F

D C

AD

E

D C

AC

F

5x de-dupe ratio

• De-duped• Compress

ed

Metadata map

Data blocks

+Capacity used = 2TB A

B CD

E F

Enterprise-class Hardware Platform

19

1. Full MPIO Support

2. Dual controllers with auto-failover

3. Dual power

4. Dual cooling

5. RAID drives

6. Hot-spare drives

7. Non-disruptive software upgrades

8. Certified by Microsoft & VMware

Highly available - no single point of failure

* 5020, 7020, 5520 and 7520 appliances are built and distributed by Xyratex

Cloud-integrated Tiering

StorSimple Tiered ArchitectureSSD Performance, Deduplication and Auto-Tiering to Cloud

21

SSDDeduplicated

SASDeduplicatedCompressed

CloudDeduplicatedCompressedEncrypted

SSDLinear TierA B C A B D E

C D E

D E

E

Backup/Restore & Disaster Recovery

Cloud Snapshots: Simplicity in Data Protection & Recovery

23

PrimaryVolume

Snapshots

Backup, Restore & DR with StorSimple: Automated, Optimized, Reliable

Cloud Snapshots

1. Backup copy of data volume created in cloud2. Changes to local volume automatically transferred3. Cloud snapshots mountable for restore

Benefits• Backup now as easy as snapshots• Very fast restores from off-site

backups• Integrated, easy to test disaster

recovery• Truly eliminates tape

Primary Volume

Virtual Tape/Replication

Physical Tape

SnapshotOffsite Tape

Storage

Backup, Restore & DR Today: Inefficient, Complex, Laborious, and Risky

…Enables Seamless Scalability and Rapid Recovery

24

CloudSnapshots

Enterprise Data Center 1

Enterprise Data Center 2

Connect Many Servers to Cloud Storage and Scale

Data Sets with StorSimple Solution

Rapidly Recover to Any Data Center, Location-

Independent, via Mounting the Cloud

Production Data Production Data

Disaster Recovery Behind the Scenes

• Configuration import process populates DR appliance with all information from original appliance

• Registry restore downloads available backup information from the cloud

• Clone operation fetches volume metadata from the cloud and creates the volume on the DR appliance

• As and when data is requested, blocks are downloaded from the cloud

Benefits

• Quick restore

• Download only the required data 25

1

2 3 4

4

META DATA

DATA

Cloud Snapshots: Up to 100x Faster RTO

26

Application Recovery Times from Offsite Backups in a Disaster

Reco

very

Tim

e

Primary Data

1 TB 5 TB 20 TB 50 TB 100 TB

15 Min.

1 Hour

1 Day

7 Days

30 Days

90 Days

Regular Cloud BackupWith 100 Mbps WAN Link

Tape

StorSimple Cloud SnapshotsWith 50 Mbps WAN Link

Security

Industry-leading Security for Cloud Storage• Multiple layers of obfuscation through the system

• Original data is broken to storage blocks• Blocks are fingerprinted + deduplicated with data from

other volumes• Obfuscated blocks are stored in compressed form

• Encrypt everything before sending to Azure• AES-256 CBC encryption is applied before transmission

using customer key• Additional SSL encryption of all data + meta-data operations

with Azure

• Encryption keys stay only with customer• Microsoft/StorSimple doesn’t have access to customer

encryption keys• Keys can be imported from customer’s secure key mgmt

system or generated from pass phrases

• Encrypted / compressed / obfuscated blocks stored in Azure• Data is secure even if account gets compromised

• Obfuscated• Deduplicated• Compressed

Data in cloud• Deduplicated• Compressed• Encrypted with customer

key

Application Servers

• Blocks encrypted with customer key

• SSL communication:• Authentication• Metadata• Data transfer

Local DataBroken into storage blocks, then:

Cloud Storage Access Security

• Risk mitigation and best practices• Compartmentalize information

• Azure subscription can have multiple storage accounts• Recommended to use different storage accounts to compartmentalize info – e.g. per

dept, project, role, etc.• Periodical key rotation

• Each account has two 256-bit access keys allows easy key rotation without service disruption

• Only requests with valid access keys are allowed to access stored blocks• Data fragments accessed are still obfuscated and encrypted

• Frequent key rotation (e.g. every 90 days) is recommended• Ad-hoc/emergency key rotation if a key is compromised

• StorSimple allows use of up to 64 storage accounts per system29

Scenario 1: Access key got compromised

Scenario 2: Storage admin employee leaves company

Cloud Storage Data-at-Rest Security

• Risk mitigation and best practices• Data at-rest is obfuscated

• Data is broken to individual small blocks and fingerprinted to comprise a global de-duplication dictionary – no volume, file system or file context

• ~16 Million obfuscated blocks per 1TB of Azure storage, spread across multiple hard drives

• Data at-rest is encrypted• StorSimple systems encrypt data stored in cloud with a customer-provided

encryption key. Federal standard AES-256 encryption used.• Up to 64 different encryption keys can be used in one appliance for data-at-rest

isolation to complement access compartmentalization practice.• Encryption key is derived from Customer Passphrase or Key generated by Key

Management System. Only entered input is accessible in appliance UI. • Microsoft or 3rd parties cannot read data when physical drives are lost, replaced, or

repaired in Azure DC30

Scenario 3: Cloud Provider decommissions server hardware or loses physical hard drives in maintenance process.

Case Studies

• Live archives

• Automatic Backup

• Disaster Recovery

Customer Case Study: Major Semiconductor Co.Customer

Needs

ProposedSolution

Impact

• Large data storage footprint for storing engineering docs and chip designs for various products

• Rapid data growth (1.8TB/month @ single location)

• 95% of data not used

• Eliminate expensive on-premise storage

• 3x 7520 StorSimple systems with Azure

• Systems in two different locations for providing file share/archive across multiple volumes (~600TB)

• 5-week PoC

• $900K Azure commit over 3 years

• Dramatic cost savings, ease-to-use, secure data storage in Azure

• Adoption of additional use cases

Total data size = 300TB

Vol1 Vol2 VolN…

Vol1 Vol2 VolN…

Total data size = 300TB

DR site

Phoenix, AZ

Austin, TX

7520appliance

7520appliance

Chandler, AZ

7520appliance

Customer Case Study: Fortune 500 Global Contractor

CustomerNeeds

ProposedSolution

Impact

• Massive unstructured, geographically-dispersed data

• Struggled to deploy SharePoint for data consolidation and sharing

• On-premise storage needed for specific performance and scalability requirements

• Multi-tiered BLOB storage and data management with StorSimple

• Optimized database layout with SSDO (SharePoint Database Optimizer)

• Data stored across 5 appliances• $600K Azure commit over 3 years

• Azure Storage footprint to double to >400TB over 2 years

StorSimple at Each Remote Location backing up data to datacenter

34

Servers

Site A

Existing Servers and Storage

Data Center - HQ

Microsoft AzureCloud

Storage Service

Servers

Site B

Servers

Site C

Servers

Site D

Servers

Site E

Servers

Site F

Servers

Site G

Servers

Site H

DFS Replication to the Data Center

Tiering to the Cloud (No Backup)

Tiering to the Cloud with CloudSnap Backup

Cloud Storage Service

Data Center

Hybrid Cloud Storage for Media and Entertainment

Source Media

On-PremisesTransformation and

Experience

SP CDN

Internet CDN

Carrier/Mobile CDN

Demo

Demo Topics• Configure the StorSimple Solution• Map a Volume to FileServer• Backup the volume via SnapShot and Cloud SnapShot• Restore the data from Local SnapShot and Azure• Disaster Recovery

37

Questions?

Evaluation

Complete your session evaluations today and enter to win prizes daily. Provide your feedback at a CommNet kiosk or log on at www.2013mms.com.Upon submission you will receive instant notification if you have won a prize. Prize pickup is at the Information Desk located in Attendee Services in the Mandalay Bay Foyer. Entry details can be found on the MMS website.

We want to hear from you!

Resources

http://channel9.msdn.com/Events

Access MMS Online to view session recordings after the event.

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.