Soyez Big Data ready avec Isilon

© Copyright 2015 EMC Corporation. All rights reserved © Copyright 2015 EMC Corporation. All rights reserved

JEUDI 19 NOVEMBRE 2015

Bertrand OUNANIAN: Advisory System Engineer

BIG DATA READY WITH ISILON


Unstructured Data Growth

Source: IDC

2 © Copyright 2015 EMC Corporation. All rights reserved.

2013

37 EB

Total Capacity Shipped Worldwide

% of Unstructured Data

67%

74%

80%

2015

71 EB

2017

133 EB

Demand doubles essentially every 2 years


3

Data of Life Generation

doubles every 2 years

We want to KEEP EVERYTHING


Silos vs Consolidated Data Lake

4


NAS

SAN CLOUD

TAPE

DAS

OBJECT

5

NEXT-GEN WORKLOADS TRADITIONAL WORKLOADS

Apps

Backup/Archive

Analytics

Mobile Accessibility

Shares

Cloud Apps


TAPE

NAS DAS

CLOUD SAN

OBJECT

Isilon Scale-Out Data Lake

6


Apps

Backup/Archive

Analytics


Shares

Cloud Apps



Isilon Next-Gen Access Methods

FILE

FILE

Apps

Analytics

Cloud Apps

Apps

Backup/Archive

Shares


One instance of the file

services all dependent

workloads

simultaneously


Isilon OneFS: Scale-Out Architecture

Single Volume/ File System

Cloud Tiering Ready

Simplicity & Ease of Use

Linear Scalability

Hadoop Enabled

High Performance

8

Unmatched Efficiency

Easy Growth


EMC Isilon Scale-Out NAS Architecture

Clients and Applications

Object API GET PUT POST DELETE

1 Gig-e 10 Gig-e Network

OneFS Operating Environment

Multi-Protocol Client/Application

Layer Ethernet Layer

Protocols

SMB NFS

FTP HTTP

HDFS for Hadoop

REST for Object

Intra-cluster Communication


From TeraBytes to Petabytes with a few clicks

•

•

•

System Evolution


Storage Lifecycle

Reduce Risk

Never Migrate STORAGE EVOLUTION

• Coexistent Generations of Nodes • Push-Button Retire


Isilon Platform Portfolio

X-SERIES NL-SERIES

High Throughput

Platform

Nearline Storage

Platform

X210

NL410

*Scales from 3 node cluster to 144 node cluster

S-SERIES

High Transactional Platform

S210

X410

HD-SERIES

High Density

Platform

HD400

SSD and SATA 1-4TB (24 TB –20.7 PB)*

SATA 1-6TB (108 TB – 30 PB)*

SSD and SAS (16 TB – 4.15 PB)*

SATA 6TB (1 PB – 50 PB)*

© Copyright 2015 EMC Corporation. All rights reserved

• Single point of management – Single file system/single volume

– Multiple performance tiers

• Automatic data movement – Policy-based tiering management

– Transparent reallocation

– NO application changes

• Optimize storage resources – Automatically match storage resources

with data requirements

– Eliminate data migration

Optimize Resources with Automated Tiering

Isilon SmartPools

S-Series Performance

NL/HD-Series Active archives

X-Series Collaboration

Reduced cost/TB


HDFS

SMB, NFS, HTTP, FTP,

HDFS

Node reply Node reply Node reply Node reply

Data

Support Hadoop Distributions

name node

name node

name node

name node

data n

od

e

NFS

SMB

SMB

NFS

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce


The Business Data Lake Approach

Analytic Sandbox

Ad Hoc Analytic Environment

Structured BI Reporting Environment

Data Preparation and Enrichment Via Hadoop

Content

ALL data fed into Business Data Lake

EDW ETL

Offload EDW to Hadoop


Comprehensive Enterprise Software

SnapshotIQ Fast, Efficient Data Backup And Recovery

SyncIQ Fast And Flexible Asynchronous Replication For Disaster

Recovery Protection

SmartConnect Policy-based Client Failover With Load Balancing

SmartLock Policy-based WORM Data Protection

SmartPools Policy-based Automated Tiering

SmartDedupe Data Deduplication to reduce storage requirements and

costs without impacting performance

SmartQuotas Quota Management And Thin Provisioning

InsightIQ Performance Monitoring And Reporting To Manage

Storage Resources

DATA PROTECTION DATA MANAGEMENT


CONNECTING EDGE TO CORE TO CLOUD

Big Data ready ?


Recent EMC Isilon Innovations

Leadership in Scale-out nas

2X increase

in performance

2X increase

in capacity

NEW high density

platform

INTRODUCED Data

Lake


Enterprise Customer Challenges Managing storage at remote locations / branch offices (EDGE)


Data storage growth

Limited IT resources

Islands of disconnected storage

Inconsistent data protection

Management complexity

Inefficient storage utilization


PRODUCT FEATURES

Software Defined scale-out NAS with OneFS features

Runs on commodity hardware

Integrated with VMware

Scales to 36 TB and 3-6 nodes

Free & frictionless (non-production, community support)

KEY BENEFITS

Simple, agile and cost efficient platform

Easy to manage with standard VMware tools

Consolidate/distribute data from/to remote locations

Other use cases: test/dev, small-medium businesses


EMC IsilonSD EDGE


REMOTE OFFICES (EDGE) DATA CENTER (CORE)

Software Defined Data Lake EDGE to CORE

SyncIQ

Access time

21

• Unified data lake

• Simplicity at scale

• Seamless management

• No complex cloud gateway required


IsilonSD Edge deployment

… Client 0 App 1 Client 1 App 2 Client N

NFS / SMB/ HTTP / HDFS / Swift / etc. network

IsilonSD

ESXi

SSD

SSD

HD

D

HD

D

HD

D

HD

D

ESXi

SSD

SSD

HD

D

HD

D

HD

D

HD

D

EMPTY FULL CAPACITY EMPTY FULL CAPACITY

ESXi

SSD

SSD

HD

D

HD

D

HD

D

HD

D

CAPACITY EMPTY

ESXi

SSD

SSD

HD

D

HD

D

HD

D

HD

D

EMPTY FULL CAPACITY FULL

22


IsilonSD edge solves Customer Challenges

Managing storage at remote locations / branch offices (EDGE)


Scales up to 36TB

Leverage commodity storage

Eliminate islands of storage

Increases data protection

Simplifies management

>80% storage utilization


Isilon and IsilonSD edge comparison

Isilon IsilonSD Edge

Package Appliance (HW+SW) Software Only

Commodity Hardware

OneFS version Same Same

Protocols / Access Methods

Same Same

Software/Apps Same Same

Size 3 – 144 nodes 18 TB to 50 PB

3 - 6 nodes 4 TB – 36 TB

Support EMC Community, EMC

Management InsightIQ InsightIQ, vCenter


IsilonSD edge solves Customer Challenges Managing storage at remote locations / branch offices (EDGE)

EXPAND DATA LAKE TO THE EDGE


EDGE CORE CLOUD


Enterprise Customer Challenges Optimizing use of the cloud

26

Leverage Cloud TCO

Intelligent integration with cloud

Data security concerns

Choice of cloud providers

Management complexity


PLATFORM FEATURES

Cloud Enabled Data Lake

Simple to deploy and manage

Encryption and compression

Seamless policy-based data placement

KEY BENEFITS

Multi-cloud choice of vendors

Lower costs and optimize storage resources

Extend data center with cloud-scale capacity

Secure network transmission to the cloud

Transparent to users and applications

EMC ISILON CloudPools C

apac

ity

$/TB


High Low

HD-Series Deep archive

X-Series Throughput

NL-Series Archive

Cloud Cold archive

S-Series Performance


S - Series X - Series

NL-Series

Isilon CloudPools

3rd Platform cloud Innovation

HD-Series


FUTURE


DATA CENTER

CloudPools

SmartPools Policy Example

<30 days

>30 days

S210

NL410

>2 years Cloud

29

EXPAND DATA LAKE TO THE CLOUD

30 days-1 year

> 1 year HD400

CLOUD PROVIDER

1 year – 2 years


DATA CENTER

30

CLOUD PROVIDER

APPS & USERS

Access time

CloudPools

CLOUD ENABLE DATA LAKE


Cloudpools meets Customer Challenges Optimizing use of the cloud

31

© Copyright 2015 EMC Corporation. All rights reserved.

Lower costs and meet performance

Seamlessly integrate with cloud

Secure data transmission with cloud

Flexible choice of cloud providers

Eliminate management complexity


Enterprise customer challenges Connecting Edge to Core to Cloud

44% of enterprises have 10 - 50 TB per Branch Office

4 - 10% of Remote servers to support data collection for IoT

Massively Scalable Capacity

Reduce Cost

EDGE CORE CLOUD

EXPAND DATA LAKE TO THE EDGE … AND TO THE CLOUD ESG: Remote office / Branch Office technology Trends, May 2015 IDC: “Preparing for the Internet of Things: Assessing the Impact on your data center and edge IT sites”, June 2015



Si vous avez des questions sur cette présentation, n’hésitez pas à prendre contact directement contact

avec :

Bertrand OUNANIAN [email protected]

Technology

Soyez Big Data ready avec Isilon