34
Isilon Data Lake Overview

MT129 Isilon Data Lake Overview

Embed Size (px)

Citation preview

Isilon Data Lake Overview

2

Dell EMC News for October 19, 2016

New Isilon All Flash Products

Isilon Momentum

Isilon and the Data Lake

3

Isilon Momentum

2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

#1 in Scale-Out NAS (IDC)

7,500+ customers

worldwide

4

Customer challenges

Predictable Performance

Data Growth Insights From Data

Cloud Integration Consumption Choices

Capacity Utilization

4

5

Collect, store, analyze and use

Traditional and emerging sources

Social Networks,

User Generated Content

Public records

Location DataInternet Of Things

Emerging

Enterprise File Data

Machine Data

Traditional

Video Archive

6

CURRENT AND FUTURE CHALLENGES

Surveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

Home Directories & File Shares

6

DATA SILOS MULTIPLYING PLATFORM 3 INTEGRATION

7

DATA LAKE CONSOLIDATION

Home Directories & File SharesSurveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

7© Copyright 2016 EMC Corporation. All rights reserved.

8

DATA LAKE CONSOLIDATION

Home Directories & File SharesSurveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

8© Copyright 2016 EMC Corporation. All rights reserved.

9

DATA LAKE CONSOLIDATION

DATA LAKE

Home Directories & File SharesSurveillance

Next-Gen Application

Hadoop & Analytics

Transaction

Logs

BLOBSSync & Share

Content

Shares

Marketing M&E

Social & Next-Gen

Archive &

Backup Target

Data Monetization

Design, Test

& Manufacture

Application Test

9© Copyright 2016 EMC Corporation. All rights reserved.

10

DATA LAKE

SCALE-OUT

SINGLE

REPOSITORY

IN-PLACE

ANALYTICS

MULTI-PROTOCOL

/ WORKLOAD

TIERS

10

ENTERPRISE

FEATURES

MANAGE

PBs

© Copyright 2016 EMC Corporation. All rights reserved.

11

THE

DATA LAKE 2.0CORE TO CLOUD

EDGE CORE CLOUD

Dell - Internal Use - Confidential11

12

Isilon scales from

16TB to 68PBin a single file system,

single volume cluster

Under 60 seconds to

scale with no downtime

Migration-less replacement of

old nodes

Isilon is massively scalable

More scalable than traditional storage

13

Industry leading NAS efficiency

Traditional NAS: 50-60%

Isilon: 80+%

STORAGE CAPACITY

UTILIZATION

FINANCIAL

EFFICIENCY

capacity

future

Isilon matches need

and financial timing

Utilization increases with scale

Space-efficient data protection

Single OneFS volume

No dedicated spares

Automated workload balance

55%

Traditional NAS

$0.55

$0.80+

14

Enterprise grade softwareDATA MANAGEMENT DATA MANAGEMENTDATA PROTECTION & EFFICIENCY

SnapshotIQFast, Efficient Data Backup And Recovery

SyncIQFast And Flexible Asynchronous Replication

For Disaster Recovery Protection

SmartConnectPolicy-based Client Failover With Load

Balancing

SmartLockPolicy-based Compliance and WORM Data Protection

SmartDedupeData Deduplication to reduce storage

requirements and costs

SmartPoolsPolicy-based Automated Tiering

SmartQuotasQuota Management And Thin Provisioning

InsightIQPerformance Monitoring And Reporting To

Manage Storage Resources

CloudPoolsCloud-scale Capacity

15

Isilon product family

Linear Scaling of Performance and Capacity

High Performance Platform

NearlinePlatform

S-Series

Capacity

Pe

rfo

rma

nc

e

NL-Series

High DensityPlatform

HD-SeriesHighly Versatile Platform

X-Series

Internal Cloud

External Cloud

Software Defined

Your hardware

16

Optimize with automated storage tiering

Single point of management

• Single file system/single volume

• Multiple performance tiers

Automatic data movement

• Policy-based tiering management

• Transparent reallocation

• NO application changes

Optimize storage resources

• Automatically match storage resources with data requirements

• Eliminate data migration

• Isilon SmartPools

S-Series

Performance

HD-Series

High Density

X-Series

Throughput

NL-Series

Nearline

Perf

orm

an

ce

Capacity

17

Isilon advantage for Hadoop

In-place analytics

• Native integration speeds time to insight

Enterprise data protection

• Simple, efficient data replication for DR

Lower costs

• Eliminates the need for dedicated Hadoop infrastructure

Increase flexibility

• Simultaneous support for any Apache-compliant Hadoop distribution

• Scale-out storage with native Hadoop integration

“EMC Isilon is indeed an easy to

operate, highly scalable and efficient

Enterprise Data Lake Platform (EDLP).

IDC validated that a shared storage

model based on the Data Lake can in

fact provide enterprise-grade service-

levels while performing better than

dedicated commodity off-the shelf

(COTS) storage for Hadoop workloads”

18

Consumption choice

INTEGRATED APPLIANCE

CONVERGED INFRASTRUCTURE

SOFTWARE DEFINED

CLOUD ENABLED

19

TIER CLOUD

Core To Cloud

20

CORE

CloudPools - seamless tiering of frozen data

CLOUD PROVIDER

HOT DATA

>30 days

WARM DATA

1-2 Months

FROZEN DATA

1-2 years

21

CloudPools - seamless tiering of frozen data

APPS & USERS

Access time

SEAMLESS

CLOUD

INTEGRATION

CORE CLOUD PROVIDER

22

PRIVATE

PUBLICHOSTED

COREDATACENTER

Data Lake Benefits

• Lower IT costs

• Seamless Cloud

advantage

• Flexible SDS

deployments

• Future proofed for

Emerging workloads

• Agility with automated

control

• Linear scalable

performance

EDGE

CLOUDSCALE-OUT FLASHSOFTWARE DEFINED

The Flash RevolutionMODERNIZING THE DATA LAKE

23

24

Customer Adoption of All-flash is Accelerating

Data in the Data CenterProjection of Capacity Disk & Scale-out Capacity NAND Flash

Unstructured Data

20%structured

80% unstructured data

$1500

$1000

$500

$02015 2016 2017 2018 2019 2020

Cost/TB for Disk

Cost/TB for Flash

By 2020, Flash $/TB reaches parity with

HDDs

4-yr Cost/TB

Analysis of Unstructured Data: Applications of Text Analytics and Sentiment Mining SAS. Retrieved June 24, 2016.

25

Unstructured Data Drives Final Frontier

Media

EDA

Big Data

Life Sciences

25

Unstructured DataFinal Frontier

26

Introducing Isilon All-Flash scale-out NAS

26

27

Extreme Performance

15GB/s

~1PB

In 4U

IB or 40GbE

250,000IOPs

2828

1.5 TB/s BANDWIDTH

100 PETABYTES

400+NODES

Extreme performance and scale powers the data lake

29

BUT, ITS ABOUT THE SOFTWARE!!

SOFTWARE

30SOFTWARE

Dell - Internal Use - Confidential30

ANY UNSTRUCTURED PROTOCOL

• Full, multi-protocol support

SMB, NFS, HDFS, Object, NDMP and more

• In-place Hadoop analytics

• Enable new workloads

• Eliminate silos of storage

31SECURITY

Dell - Internal Use - Confidential31

ENTERPRISE GRADE PROTECTION & SECURITY• Iron clad data protection,

Up to N+4 redundancy

• Snapshots, Replication

• NFS/SMB automatic failover & load

balancing

• Backup and recovery

• Secure Access, WORM, SEC 17a-4

32TIERING

32

TIERING ECONOMICS = <$.50/GB

Ext

rem

e

Pe

rfo

rma

nce

tie

rS

tora

ge

tie

r

• Reduce Capital

Expense

• Just Enough

Flash

• Transparent to

Users and

Applications

• Flexible Admin

defined policies

• Deduplication

1PB

33

GENERAL AVAILABILITY2017

PRE-ORDER PROGRAM TODAY

AVAILABILITYDell - Internal Use - Confidential33

CUSTOMER TRIALNOW