Storage challenges Addressing storage challenges with StorSimple StorSimple 8000 series - Overview -...

StorSimple 8000 Series: Enabling Enterprise Workloads for Microsoft Azure

Jai Desai – Microsoft (WW TSP)Thomas Kaessheimer -iTernity

CDP-B350

• Storage challenges

• Addressing storage challenges with StorSimple

• StorSimple 8000 series

- Overview

- Cloud integration, tiering, deduplication, compression, and encryption

- StorSimple Manager in Microsoft Azure Management Portal

- StorSimple Virtual Appliance

- Data protection and disaster recovery

• Use cases and workloads

• iTernity Solution

Agenda

Storage challenges

Storage Today = Complex & Expensive

Storage cost and

infrastructure sprawl

Complex data protection &

recovery

Resource constraints

Rapid data growth - 40% YoY*

* Source: EMC Digital Universe with Research and Analysis by IDC, 2014

Addressing storage challenges with

StorSimple

Primary Storage

Archival Storage

Disk-based Backup

Remote Replication

Tape backup and DR

Storage Today Microsoft Azure StorSimple

Managedata growth

Lower storage costs

Simplify data protection and

disaster recovery

Increase business agility

Reduce storage costs by 40-60%

StorSimple

Here is how customers benefitA

StorSimple provides enterprise storage with cloud economics

Unstructured data growing

40% YoY

Working data set stays fairly

constant

Hybrid storage array

performance for working set

Inactive data is tiered to the

SSD HDD Cloud

Working set data

Inactive data

StorSimple Overview

Fundamental value of StorSimple

Applications in Physical or Virtual Servers

StorSimple

Customer Data Center

Enterprise SAN storage

Inline de-dupe, compression &

automatic tiering

Automated offsite data protection

using cloud snapshots

Highly efficient, location

independent disaster recovery

StorSimple connects Windows, Linux and Hyper-V/VMware servers to Azure Storage in minutes with no application modification

StorSimple 8000 Series

Series 8000 Hybrid Storage

Arrays

Microsoft Azure StorSimple Manager

Microsoft Azure Storsimple

Virtual Appliance

More capacity,

better performanc

Consolidated

Management of

multiple appliances

Additional use cases

with StorSimple

in Azure

Microsoft Azure StorSimple Big Picture

ON-PREMISES DATA CENTER

iSCSIInternet

connection

StorSimple Virtual Applianc

BLOB Data

Administrator

CLOUD DATACENTER

Server

StorSimple Snapshot Manager Plug-in

Series 8000 Hybrid Storage

StorSimple Manager

Series 8000 modelsModels

Model Number 8100 8600

Total usable capacity 15TB 40TB

Usable SSD Capacity 800GB 2TB

Effective Local Capacity 15-45TB 40-120TB

Max Volume Capacity 64TB 64TB

Max Capacity (including cloud)

200TB 500TB

Network Interface Cards

4 x 1Gbps and 2 x 10Gbps

Enclosure Form Factor 1 X 2U 2 X 2U

Fault tolerance of enterprise class storage

Software Feature

Protects Against?

How is works?

Controller failover

Protection against the failure of a controller.

The dual controllers are active/passive. In the event the active controller fails the passive controller automatically takes over. NVRAM mirrored across controllers via NTB.

Storage Spaces

Protection in the event of one or more drive failures.

Disk insert into and removal from pools.

Nondisruptive software upgrades (NDU)

Allows updates to be made to the operating system without taking downtime.

The software is downloaded and updated on each controller. One controller is up at all times to continue processing and serving data.

Redundant Power

Supplies

Dual Controllers

Network Interfaces

Networking Physical,

Virtual Servers

Switch 1 Switch 2

Switch 3

Internet/WAN connection

CONTROLLER 1

CONTROLLER 2

NICMGMT

NIC NIC

WAN (Corporat

8000 Series

iSCSI should be on the storage network and it is not recommended to route the iSCSI traffic

To access azure, the firewall should allow HTTPS port (443)

If external DNS server is used, ports for DNS should be open

If external SMTP server is used for notification, port 25 should be open

Local redundant and geo redundant storagePrimary Location

Secondary Location

Data protection for

data in the cloud

Asynchronous replication between

Azure data centers

Replicated data does not count against data limit for the account

Prevents against a partial or complete

data center failure

Makes 3 copies of data

across separate fault

domains

Failover to alternate location

determined by Azure

operations

Automatic tieringLow

Threshold

High Threshol

Oldest

DataData exceeds high watermark

Old data spills to next tier

Tier is empty in the beginning

New data is written at start of free space

Tier returns to low watermark level

DeduplicationSSD4MB

64KB ChunksDedupe Algorithm

0xaab123

0xccc123

0xabc123

0xaaa123

0xbbb123

0xccc123

0xaac123

0xbbc123

0xbcc123

0xabb123

Record of hash keys already generated0xaab12

0xccc123

0xabc123

Compression

0xaab123

0xccc123

Compress Data

Performed on data already deduplicated

Heuristics based compression to reduce CPU overhead when data is not compressible

Default algorithm is the standard DEFLATE (loss less compression)

Deduped Data

Encryption

0xabc12..

Data chunk before

encryption

Data chunk after

encryption

0xabc12..

Performed deduped and compressed data

Encryption key is generated based on the seed value provided

Encryption algorithm is AES-256 with CBC

Security keys maintained by the customer, stored securely on the appliance

Compress Data

Secure data throughout the solution

Account authentication with User ID, Password

On-premise Data Center

2 x 512 bit keys

Account Access

Data Access

Data In-flight

Data At-restWindows Azure management

portal

IT administrator (customer)

StorSimple

AES-256 bit encryption

Microsoft Azure StorSimple Manager

Consolidated management of appliances

Microsoft Confidential

StorSimple_PhysicalAppliance1 StorSimple_PhysicalApplia

StorSimple_VirtualAppliance1

Azure StorSimple ManagerStorSimple

Manager service in Azure

portal and manages one or

more StorSimple appliances

All device will need the Registration Key and Service Data Encryption Key to be added to the Service

(Service Data Encryption Key is generated, on device console, when first device is registered)

Adding an appliance to a StorSimple

Manager service

1. Login to Azure Management Portal

2. Create a StorSimple Manager Service

3. Generate a registration key for the created StorSimple Manager

4. Register device (from device console)

Will show up in Storage tab of Azure Portal

XXXXXXXXXXXXXXXXXXXXXXXXXXX

Storage accounts and volume containers

A Storage Account is applied to a Volume Container.

A Volume Container will have one or more volumes.

Creating a Volume Container on device requires:

1. A Volume Container Name

2. Selected Storage Account

3. Customer provided Cloud Storage Encryption Key

Isolating volume data with volume containers

Storage_Account1

File_Share_VC

SharePoint_VC

Cloud Encryption Key 1

Cloud Encryption Key 2

Volumes and data protection policies

Microsoft Azure StorSimple Virtual Appliance

IT agility in Azure with StorSimple Virtual Appliance

Failover Clone

The StorSimple Virtual Appliance facilitates data mobility of production datasets for the purpose of disaster recovery, on-demand development and test infrastructure, and Cloud applications.

The StorSimple Manager service provides workflows for failover of datasets for disaster recovery and clone workflows for replicating production datasets in Azure for Cloud applications and development and test scenarios

StorSimple Virtual Appliance

The Virtual Appliance is a software version of the physical array that runs on a VM in Azure and can be provisioned and turned-on as needed.

The StorSimple Virtual Appliance is an iSCSI target for the VMs in Azure.

A virtual network joins VMs and the StorSimple Virtual Appliance.

iSCSI Initiator

iSCSI Target

Creating virtual networks in Azure

Virtual networks are created in the Azure Management Portal and available to the StorSimple Virtual

Appliance when it is provisioned.

Data Protection and Disaster Recovery

Local and Cloud snapshots

Local Snapshot

Cloud Snapshot

Example Group Of Data Protection Policies

Backup Type

Snapshot Type

Frequency Retention Period

Short-term backup

Local & Cloud

Daily ~1 week

Medium-term

backup

Cloud Weekly ~4 weeks

Long-term Backup

Cloud Monthly ~52 weeks

Local snapshot

Point-in-time reference to volume data

Stored locally on

the appliance

Instantaneous and provide

short term data

recovery

Volume DataA B C D

Volume Metadata

Volume Data

Metadata

a b c d

Snapshot 1

Snapshot 2

C’ E’

c’ e’

Snapshot 3

F’C”

f’c"

cReference to data chunk

Cloud snapshot

Point-in-time copy of

volume data

Stored in the Cloud

Metadata is preserved in its entirety

Only changed

blocks are copied to

StorSimple Snapshot Manager

MMC UI snap-in that lives on

application host and

communicates with

appliance(s)

Orchestrates application consistent snapshots

Manages backup policies

Restores volumes and mounts them

as NTFS folders/drives

Disaster recovery

Cloud Snapshot

Secondary Datacenter

or Provisioned StorSimple

Virtual Appliance

• Thin restores provides fast recovery of data, downloading a small subset of data necessary data bring applications online. Not dependent on volume size.

• Recover data anyway: a secondary datacenter or a StorSimple Virtual Appliance in Azure

• A volume container is failed over to the destination appliance. Time to recover is the same for physical and virtual appliance

What is

needed?

DR to secondary datacenter or Virtual Appliance

Filer ServerPhysical Appliance

(Appliance1)

Datacenter 1

File Server

Azure Storage

Virtual Appliance

(Appliance3)

Filer ServerPhysical Appliance

(Appliance2)

Datacenter 2

StorSimpleManager1

Appliance1

Appliance2

Appliance3

Recover data to Appliance2 (physical) or Appliance3 (virtual) by rehydrating data from a Cloud snapshot stored in

Azure BLOB storage.

Use Case and Workloads

Application and workload focus

* New with Microsoft Azure StorSimple 8000 Series

Cloud Apps

Virtual Machines SharePoi

ntFileshare

Archives SQL Server*

AzureWorkloads

On-premisesworkloads

DR* Dev/test*

File shares and archives

Before

Applications (Tier 2, & Tier

3 data)

FC/iSCSI

On-premise footprint

Capacity on-demand

Applications

Primary Storage

Disk-based Backup Storage

Tape Infrastructure

Archival Storage

SharePoint

Before

AfterSharePoint

FC/iSCSI

Capacity on-demand

SharePoint Farm

Primary Storage

Tape Infrastructure

Archival Storage

Offsite Facility

SharePoint metadata

BLOB data

SharePoint

metadata

BLOB data

Virtual machines and eliminating VM sprawl

Before

All Hyper-V/ VMware

VMs Primary Storage

Tape Infrastructure & Management

Archival Storage

FC/iSCSI

VMs using Tier 2/Tier 3

Active VM data (VHDs, VMDKs)

Inactive VM data

Storage migration/

vMotion

Active VM data (VHDs, VMDKs)

Free space

InactiveSpin up

Capacity on-demand

SQL for Tier-2 and Tier-3 applications

Before

Applications (Tier 2, & Tier

3 data)

FC/iSCSI

StorSimple Virtual Appliance and Cloud backup and DR

Applications

Primary Storage

Tape Infrastructure

Archival Storage

StorSimple with iCAS ascompliant Storage platform

Software vendor specialized in compliant archivingEstablished 2004Headquarter in Freiburg, GermanyInternational representations in Europe and USAOver 600 customers in various markets/verticalsCore product: iCAS (iTernity Compliant Archive Software)iCAS is patented in Europe since 2011 in Europe and since 2012 in the USA

Company Overview – iTernity

Challenge – Compliance for your dataRequirements based on various legal regulationsData must be tamper proofData cannot be deleted (WORM)Data must be kept for a specific period (retention)Data must be able to be migrated to future storage mediaAccess to archived objects must be possible at all times

Industry specific demandsGxP Data (Pharma), SEC17a4 (Banking), HIPAA, patient record (Healthcare),product liability (Automotive)

Internal demands for important dataProtection from data breach (deletion, destruction, theft)

How was archiving solved until today?Dedicated storage appliances for archivingEMC CenteraHitachi HCPNetApp SnapLockDell DX (discontinued)IBM DR550/Information Archive (discontinued)Optical Jukeboxes (Plasmon etc.) (discontinued)etc.

How to replace that solutions by usingStorSimple with iCAS?

Bond to vendor and technology (vendor lock)Migration to other platforms are complicated and cost intensiveRebuy of the whole archiving solution with the end of every hardware lifecycleProprietary and separated systems cause a lot effort for management and maintenanceExtension of additional archiving space can cause high costs

Disadvantages of HW based archives

Business oriented and IT oriented viewBusiness View

Data amount is growing rapidly

Legal and compliance requirements getting more important

Data has to be archived for long time periods

Budgets are limited

IT ViewNew applications generating new archiving content

The object size and count grows

Technologies are changing

High availability gets more important

Data migration gets critical

Management of separated systems gets complex

Cost efficiency gets more important

Protection for application data (ECM, ERP, Mail etc.)Retention Management and WORMSoftware defined Storage - for archivingCertified by KPMG and for special regulations like SEC17a4 (Banking)Certified by more than 80 ISVs (e.g. Agfa, GE, OpenText, Symantec EV etc.)Combined with StorSimple a perfect replacement for all dedicated archiving appliances

What is iCAS?

Microsoft & iCAS Archiving Layers

Business applications ERP, CRM, ECM, File Services, E-Mail, PACS, custom applications e.g. OpenText, AGFA, GE, Symantec EV, CommVault…

Business Process

iCAS & Microsoft

archive software

Microsoft StorSimple Appliance

Microsoft Azure Cloud

Archive - Protection (iCAS Software)

WORM Function / Retention Management /Self-Healing

WORM functionality with patented Content-Storage-Container Technology (CSC)Save data archiving via 512 bit Hash code (HMAC SHA 512)Based on industry standards (.NET, MS Windows, Web service)DoD- compliant data shredder High availability via cluster supportInterfaces to applications via CIFS/NFS-Share or Webservice API

iCAS Technology

Software defined Archiving – ContainersiCAS combines metadata like retention and hash-value with the archived objects into CSC-Containers.

The archive-objects can be migrated to future infrastructure without the loss of validity.

Minimization of company risksbetter protection for important data with high security industry standards

More flexibility to future IT InfrastructuresiCAS adapts to the future infrastructure

Higher AvailabilityArchive virtualizationBackend data migration without downtimes

Lower TCOMore efficient use of centralized storage infrastructureInvestment protectionCost efficient and calculable migrations

iCAS Benefits for Customers

From an industry perspectiveCustomers >200 employeesHospitalsCustomers in regulated markets (e.g. pharmaceutical industry, finance, energy, telecom…)Highly demands regarding product liability (e.g. automotive customers)Public customers

From an application perspectiveEvery customer with an SAP/ERP system needs an archiving platformEvery customer with an DMS/ECM system needs an archiving platform

Which are the customers for archive?

Integrated migration tool iCopyTotally compliant migration solution designed by KPMG and iTernityMigration per file shareBackground migrationRepositories simultaneously available via CIFS/NFSMigration time depends on speed of the old and new environmentApproach for replacement of optical jukeboxes, NetApp SnapLock etc.

Data Migration – File Share Applications

Applications

NetApp ClusteriCAS Cluster

migration

Migration via applicationsBackground MigrationMigration time depends on speed of old archiving solution and the applicationsSupport from iTernity to find migration partners if neededApproach for replacement of EMC Centera, Hitachi HCP, IBM DR550 etc.

Data Migration – API Applications

Applications

Centera ClusteriCAS Cluster

migratio

Dedicated Microsoft Server 2008 R2 64Bit or Microsoft Server 2012 (R2)Installed Windows Updates and Service Packs.NET Framework 4.5.1Internet Information ServerHardware minimum requirements:

current Quad Core CPU4GB Memory 40GB free space

Hardware requirements depending on archive size, number and size of objects etc. ask iTernity for individual recommendations

iCAS Preconditions

High regulations for archiving of patient records, radiographs etc.High cost pressure and limited budgetsMostly existing archiving platforms like EMC Centera or NetApp SnapLock to replaceCommon healthcare applications are certified for iCAS:

AgfaGESectraVisus

Practical Example – Healthcare Customer

Initial Situation:

Existing archiving data 50 TBAnnual data growth of 20% up to 30 %Different applications who have to be archived centralized: ECM, PACS, RIS, KISCurrent archiving solution: NetApp SnapLockHardware is end of lifeSnapLock licenses have to be bought new with the new hardwareVirtual Infrastructure based on a common hypervisor (Hyper-V, VMWare, Citrix)High potential for savings with alternative archiving solution based on StorSimple and existing virtualizing (no upfront payment for new infrastructure)

read/write

ApplikationsebeneECM, DMS,PACS, Mail …

Storage Layer

Archiving Layer

Application Layer

Microsoft Azure

StorSimple

Solution with iCAS and StorSimpleMigration from NetApp Snaplock to StorSimple with iTernity Migration-Tool „iCopy“iCAS installed on existing hypervisor (Hyper-V, VMWare, Citrix)iCAS CSC-Containers are written to StorSimple ApplianceStorSimple is responsible for „Tiering“ of data between appliance onsite and MS AzureTransparent access for the applications to the data via iCAS

Advantages for the customerDirect and easy migration without external help (ISVs)No upfront investment in new archive infrastructure monthly billing by Microsoft based on TBsHigh availability and security of data with StorSimple and MS Azure

Breakout SessionsCDP-B351 StorSimple 8000 Series: Customer Case Study

Microsoft Solutions Experience Location (MSE)TechExpo Happy Hour: Thursday October 30th, 16:00-17:00 in Hall 7

Ask the Experts: Thursday October 30th, 18:30-20:00 in Hall 5

Find Us Later…E-mail: jaidesai@Microsoft.com E-Mail: thomas.kaessheimer@iternity.com

Storage challenges Addressing storage challenges with StorSimple StorSimple 8000 series - Overview -...

Documents

Challenges of Electricity Storage Technologies

Challenges Embracing Cloud Storage

Episerver...Notification Hubs Hybrid Cloud Backup StorSimple Azure Site Recovery Import/Export SQL Database DocumentDB Redis Cache Azure Search Storage Tables SQL Data Warehouse

Cloud Storage & Security: Solving Compliance Challenges

Hybrid Cloud Storage Microsoft Azure StorSimple製 …download.microsoft.com/download/C/E/0/CE041DB1-BE60-4419...Hybrid Cloud Storage Microsoft Azure StorSimple製品概要 2015 年7

Distributed Storage Systems Challenges in Using Persistent … · 2019-12-21 · Challenges in Using Persistent Memory In Distributed Storage Systems Dan Lambright Storage System

S11 StorSimple 入門

StorSimple Data Protection Console Quick Start Guide

New Cloud Geintegreerde Microsoft Azure endownload.microsoft.com/download/C/3/2/C3278024-9F15-4189... · 2018. 10. 16. · StorSimple zorgt voor enterprise storage met cloud schaalvoordeel

Meeting the Challenges of Archival Storage

Storage Challenges for Petascale Systems

SMB JumpStart: Reimagine Hybrid Cloud Storage with · PDF fileStorage with the StorSimple Virtual Appliance Session 3 ... Third lesson: Configuring StorSimple as a File ... SMB JumpStart:

Energy Storage Opportunities and Challenges

2 Agenda Challenges of Disaster Recovery Overview of Microsoft’s Solution Azure Backup Azure Site Recovery StorSimple Next Steps

Challenges for onshore CO2 storage

The Challenges of Storage System Growth Challenges of Storage System Growth ... Challenges of Storage System Growth Object Storage System Architecture ... • Not your daddy’s filesystem

Challenges for storage operation and valuation

Addressing storage challenges with StorSimple Primary Storage Archival Storage Disk-based Backup Remote Replication Tape backup and DR Storage

SMB JumpStart: Reimagine Hybrid Cloud Storage with … · SMB JumpStart: Reimagine Hybrid Cloud Storage with the ... Storage with the StorSimple Virtual Appliance Session 4 ... StorSimple

Textron Case Study - MARQUAM | Microsoft Solution … Case Study.docx · Web viewThe solution was based on Microsoft Azure StorSimple cloud-integrated storage, an on-premises enterprise