Embed Size (px)
Citation preview
Isilon: Scalable solutionsusing clustered storage
TERENA Storage WG Conference
September, 2008
Rob AndersonSystems Engineering Manager, UK & [email protected]
Isilon at HEAnet
HEAnet were looking for a large, scalable storage system for…
Video (such as parliamentary recordings)Multimedia deliveryData backupHostingVirtualisation
Wanted to be able to allot storage out to their client organisationsThey selected clustered storage as the solutionWhy clustered storage?
Why clustered storage?
Organisatons face rapid data growth
Organisations are adopting clustered computing
Traditional SAN/NAS solutions are often struggling
(PB
)
File Based: 79.3% CAGR Block Based: 31% CAGR
By 2011, 75% of all storage capacity sold will be for file-based data
* Source: IDC, 2007
Organisations face rapid data growth
Evolution of Servers
Organisations are (finally) adopting clustering
Benefits of ClusteringVastly superior performanceVastly superior scalability – modular and incrementalSubstantially lower cost to own and operateAccelerates business workflow and productivity
Traditional solutions are often strugglingIn
form
atio
n A
vaila
bilit
y
Performance
Clustered Storage100x larger file systems20x higher total performanceUnmatched reliability and self healing File/object-basedEasy to manage 1000+ TBs
of storage
Storage Area Networks (SAN)Limited file system sizeDesigned for I/Os not throughputHigh cost and complexityBlock-level storage (not file)Difficult to manage and maintain
Network Attached Storage (NAS)Limited file system sizeInherent performance limits and
bottlenecksSingle points of failureFile-basedMany file systems to manage
Isilon Clustered Storage SystemElements of clustered storage
Ease of Use/ManagementHigh AvailabilityEnterprise Services
(Windows, Unix, Security, authentication, etc.)
Unlimited ScalabilityHigh PerformanceMaximum Data Protection
Isilon clustered storage system
9
Scaling clustered storage
Expandable to more than
96 nodes and 2.3 PB
in a single file system
Enterprise-class
hardwareComplete
storage system
Isilon IQOneFS™
intelligentsoftware
A 3-nodeIsilon IQ Cluster
10
Product suite
Capacity
Performance
Independent Performance Scalability
Isilon IQ 1920, 3000, 6000, 9000 or 12000 + IQ Accelerator
Linear Performance and Capacity Scaling
Isilon IQ 1920, 3000, 6000, 9000 and 12000Platform Nodes
Independent Capacity Scalability
Isilon IQ 6000/9000/12000 + EX 6000/9000/12000
Isilon IQ 200 Platform Node
11
Cluster file striping
Cornerstone for a truly symmetric clustered architecture
• High performance• Linear scalability• Unmatched reliability• Ease of Use
(optional 2nd
switch)
Isilon IQ Storage Layer
Infiniband Intracluster
Communication
Servers
Client/Application Layer
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Standard GbE or 10 GbE Ethernet Layer
Servers
Servers
12
Isilon IQ network architecture
13
Writing a file with Isilon IQ
(optional 2nd
switch)
(optional 2nd
switch)
Servers
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Servers
Servers
14
Writing a file with Isilon IQ
(optional 2nd
switch)
15
(optional 2nd
switch)
Servers
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Servers
Servers
Writing a file with Isilon IQ
(optional 2nd
switch)
Reading a file with Isilon IQ
16
Reading a file with Isilon IQ
(optional 2nd
switch)
Servers
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Servers
Servers
17
Fortunately … scaling is easy
OneFS™ can scale from 4 TB to 2.3 PB in a single file system• Traditional SAN/NAS limited to 2-16TB max file systemUnder 60 seconds to scale, with no user disruption
18
AutoBalance: Automated data balancing across nodes• Reduces costs, complexity and risks for scaling storage
Data in a liquid pool
EM
PTY
EM
PTY
EM
PTY
EM
PTY
EM
PTY
FULL
FULL
FULL
FULL
BA
LAN
CE
DB
ALA
NC
ED
BA
LAN
CE
DB
ALA
NC
ED
BA
LAN
CE
D
AutoBalance migrates content to new storage nodes while system is online and in production
Requires no manual intervention, no reconfiguration, no server or client mount point or application changes
1919
If it’s big, it must be resilient
(optional 2nd switch)
Built-in high availability clustered architecture• EMC and NetApp require costly, redundant heads and software
With N+1 protection,data is 100% available even if a single drive or node failsAnd… Isilon IQ offers the industry’s fastest drive rebuild times—
in less than an hour
With N+2, N+3, and N+4 protection, data is 100% available if multiple drives or nodes fail
100% AVAILABILITYFAILED
100% AVAILABILITY
100% AVAILABILITY
100% AVAILABILITY
100% AVAILABILITY
100% AVAILABILITY
100% AVAILABILITY
100% AVAILABILITY
FAILED
20
Investment protectionUnlike with SANs, you can keep your existing investmentVirtualise different ages of hardware in same cluster(With some rules) different sizes of node in same cluster too
Suite of software applications
Data ProtectionSimple, scalable and flexible data protection with SnapshotIQ
Data ManagementPolicy-based load balancing with failover with SmartConnectQuota management and thin provisioning with SmartQuotas
Data MigrationAutomated content migration across storage tiers with MigrationIQ
Data ReplicationFast and flexible file-base asynchronous replication with SyncIQ
High-Performance Content DeliveryHigh performance wide area file and content delivery with Aspera for Isilon IQ
21
22
Local Data Protection
SnapshotIQ is a software application that leverages OneFS and Isilon’s clustered architecture
Facilitates frequent, near instantaneous, low-impact, user-recoverable backup of data
First line of defense against local data corruption, accidental deletion (i.e. “fat finger deletion”), or modifications
Snapshots vastly improve the frequency and granularity of backups/restore
simple, scalable & flexibleA snapshot is a locally retained read-only point-in-time image of data
23
Load Balancing with Failover
Client Connection: Load balancing based on intelligent policiesRedundant: Dynamic failover of NFS client connections between nodesPerformance: Zoning for priority user, group & application optimization
SmartConnect Advanced software application provides seamless enterprise storage access to an Isilon IQ cluster
Clie
nts
SmartConnect
24
Quota Management and Thin Provisioning
Data management and provisioning feature of Isilon’s OneFS operating system software
Partition and control your cluster (single pool) usage exactly the way you want, on the fly
Industry-leading flexibilityCluster, directory, subdirectory, user and
groupHard, soft and advisory thresholds
Robust storage provisioningThin provisioning and oversubscriptionManage user exposure to capacity
simple, scalable & flexibleSimple, scalable & flexible management for clustered storage
25
Asynchronous File-based Replication
Primary source cluster
LAN/ WAN
connection
Additional cluster
Additional cluster
Additional cluster
SyncIQ is a software application that delivers file-based, asynchronous replication for DR, D2D backup and distributed workflow
Enterprise-wide: One-to-many replication locations throughout enterpriseFlexible: Choose what/when content to replicate based on policy engineIntelligent: Cluster-aware design delivers unmatched performance
High-Performance Wide Area File and Content Delivery
Speeds file transfers across any wide area network—slow or fastScales beyond the limits of a single-head storage systemSupports interoperability between Windows, Mac, Linux, IsilonEnsures predictable speeds and transfer timesReduced infrastructure costs as software lives on Isilon clustered storage
IP NetworkFasp Clients Aspera Enterprise Server for Isilon IQ
OneFS 5.0 featuresSymmetric multi-processor (SMP) support
Allows OneFS to take advantage of multi-core and multi-processor Isilon IQ nodes.
Support for 64-bit memory addressingAllowing OneFS to scale far beyond 4 GB of RAM in Isilon IQ nodes.
Support for the Accelerator-x platformNew Accelerator node with up to 10 Gigabit Ethernet, 32 GB of memory, and 8 processing cores.
Native Windows opportunistic locksAllows CIFS clients to take advantage of client-side caching.
OneFS 5.0 features
FlexNet version 2.0Includes support for multiple subnets, VLANs, tighter integration with SmartConnect Advanced, and a completely redesigned WebAdmin and command-line interface.
NIC Bonding for performanceImproves concurrent performance
Flexible AllocationA new OneFS per-file attribute which allows file layout to be optimized for streaming or random access.
OneFS 5.0 features
Drive Timeout & Threshold ImprovementsUnique capability which allows OneFS to proactively quarantine drives which are failing to respond and analyze whether they should be SmartFailed or returned to service.
Isilon Firmware ToolSeparate software upgrade from firmware upgrade.
EUC-KR and CP949 Korean encodings.
Thousands of Quality Improvements
X-Series storage node performancePerformance Metric Linux
NFSWindows NFS
Windows CIFS
Mac NFS
FTP HTTP
Read (MB/s)
Concurrent Sequential (per node)
1 NIC 112 100 96 96
Bonded NICs
206 195 228 231
Single File 1 thread 91 82 54 84 72 79
File Stream 1 thread 88 60 / 66* 48 63
4 threads 96 94 / 114* 72 86
Write (MB/s)
Concurrent Sequential (per node)
1 NIC 112 98 117
Bonded NICs
201 150 178
Single File 1 thread 120 97 107 77 117
File Stream 1 thread 91 92 / 86* 64 72
4 threads 112 112 / 196* 113 110
* Run with bonded NICs
Accelerator X-series performancePerformance Metric Linux
NFSWindows NFS
Windows CIFS
Mac NFS
FTP HTTP
Read (MB/s)
Concurrent Sequential (per node) 518 564 854 849
Single File 1 thread 341 228 112 269 230 233
File Stream 1 thread 180 / 220*
106 / 152*
104 / 131*
132
4 threads 380 297 161 191
8 threads 420 378 170
Write (MB/s)
Concurrent Sequential (per node) 730 581 442
Single File 1 thread 400 332 246 303 251
File Stream 1 thread 273 248 129 213
4 threads 504 419 286 244
8 threads 540 512
* Run with filename prefetch turned on
OneFS 5.0 Performance (by Cluster Size)
Performance Metric (MBps) Per Node 3 Node Cluster
6 Node Cluster
10 Node Cluster
42 Node Cluster
96 Node Cluster
Sequential Concurrent Read NFS 206 618 1,236 2,060 8,652 19,776
Sequential Concurrent Read CIFS 195 585 1,170 1,950 8,190 18,720
Sequential Concurrent Write NFS 201 603 1,206 2,010 8,442 19,296
Sequential Concurrent Write CIFS 150 450 900 1,500 6,300 14,400
Performance Metric (MBps) Per Node 3 Node Cluster
6 Node Cluster
10 Node Cluster
42 Node Cluster
96 Node Cluster
Sequential Concurrent Read NFS 110 330 660 1,100 4,620 10,560
Sequential Concurrent Read CIFS 110 330 660 1,100 4,620 10,560
Sequential Concurrent Write NFS 88 264 528 880 3,696 8,448
Sequential Concurrent Write CIFS 87 261 522 870 3,654 8,352
OneFS 4.7
OneFS 5.0*
* Run with bonded NICs
OneFS 5.0 WebAdmin
34
Example scenario: share some storage
Click on FileSystem -> Windows File SharingClick Create a New ShareFill in details, click NextClick FinishDone! Your users can now start using the share.
35
Example scenario: (thin) provision space
click Modules -> SmartQuotas -> Create Quota
select ‘Apply quota to Directory’, and choose directory
Specify enforcement criteria
click on Save
Done! You’ve provisioned space for a user, group or set of users.
Enterprise clustered storage customers
Central repository for software development
Scene7 delivers cloud-based software as a service (SaaS)
400TB+ Isilon IQ Clustered Storage deployed
Reduced management complexity vs. SAN/NAS storage
Orange is the key brand of France Telecom, one of the world's leading telecommunications operators
Pioneering multimedia solutions offering voice, internet, mobile & video convergence
70TB’s of Isilon Clustered Storage is primary storage repository for Orange’s video-on-demand global architecture
Enterprise clustered storage customers
One media repository for entire editorial staff
Real-time playback & editing from Isilon Clustered Storage
Rapid, cost-effective scalable storage w/no configuration
“With Isilon, we’ve done about five years worth of work in two.”Ken Brady, Director of Technical Operations and
Digital Media, Turner Broadcasting
