EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTS

1© Copyright 2012 EMC Corporation. All rights reserved.

EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTSEMC Symmetrix VMAX 40K, EMC Symmetrix FAST VP, EMC SRDF, and VMware vSphere 5

EMC Solutions Group


Agenda Solution Overview Key Technology components Solution Architecture and Design Validation and Testing Summary and Solution Benefits Q & A


Solution Overview Deploy multiple critical database applications on a

VMware private cloud enabled by a VMAX 40K array running Enginuity 5876 Code and optimized by FAST VP with site protection enabled by EMC SRDF replication

Simulate a highly active customer database environment, serving multiple Tier-1 Applications

• Oracle Database 11g R2• SAP ERP 6.0 EHP 4• Microsoft SQL Server 2012

Online Transactional

Databases• Microsoft SQL Server 2012 Data Warehouse


Solution Overview, continued Managed, monitored, and optimized through

EMC Unisphere for VMAX– Simplified array management of FAST VP using “Allocation

by Policy” feature of FAST VP

– Assured performance in DR scenarios enabled by SRDF-aware FAST VP (Enginuity 5876) with constant, automated tuning of application storage at both production and disaster recovery sites

Virtualized with VMware vSphere 5 update 1


Symmetrix VMAX 40K Array with Enginuity 5876 Operating Environment

High-end enterprise storage array with simple, intelligent, modular design that allows system to grow seamlessly and cost-effectively from entry-level configuration to world’s largest storage array

New dense configuration options with 2.5” Flash, FC, SAS drives– Up to 33% more drives in the same footprint– More performance per Watt

Virtual provisioning provides non-disruptive, on-demand thin provisioning FAST VP provides automatic storage tiering at the sub-LUN level FAST VP SRDF coordination ensures performance at Recovery Site FAST VP allocate by Policy Cascaded storage groups Simplified configuration and management with Unisphere for VMAX Capacity efficient snapshot capabilities with TimeFinder VP SNAP Federated Tiered storage

FLASH

FC

SATA


EMC Virtual Provisioning Overview Improves storage utilization Reduces storage provisioning complexity and

overhead Automates processes to easily grow storage Overprovision storage to last lifetime of

application, without providing all the physical storage up front

Add capacity non-disruptively and on demand Automatically rebalance thin pools to maintain

performance Simplifies storage management with Unisphere

for VMAX

ESXi 310 TB

ESXi 210 TB

ESXi 1 10 TB

3 TB4 TB

Physicalallocation

3 TB

CommonStorage Pool


EMC Symmetrix FAST VP – Overview Automatic storage tiering for Virtual

Provisioning thin pools Analysis and data movement at sub-LUN

level:– Spreads data from a single thin device across

multiple pools– Places very active parts of a LUN on high-

performing Flash Drives– Places less active parts of a LUN on higher-

capacity, more cost-effective FC or SATA drives Moves data at the extent group level (7,680

KB) Moves data based on user-defined policies

and application performance needs Data movement is automatic and

nondisruptive

SATA

FC

Flash

• Radically simplifies storage management

• Optimizes performance• Increases storage

efficiency

Symmetrix VMAX with FAST VP – Getting the right data, to the right place, at the right time


FAST VP SRDF Coordination FAST VP continually

monitors and adjusts data placement at production site

Performance stats captured at both sites and exchanged every hour

Decisions on data placement made on both sites using data from the active site

Symmetrix VMAX with FAST VP and SRDF Co-Ordination– Getting the right data, to the right place, at the right time at both Production

and DR Sites


Cascaded Storage Groups New feature with

5876 providing the ability to nest multiple storage groups in a single masking view

Simplifies FAST VP configurations in virtual environments Multiple application within a single masking view managed

with its own storage group and FAST policy Simplified monitoring and management at application level

made easier


Solution Architecture Two ESXi servers

configured at each site

Oracle, SAP, and SQL Server deployed on VMs

EMC VMAX 40K storage arrays optimized by FAST VP protected by SRDF/S

8 GBs FC SAN running between hosts and sites

1 GB Ethernet network connection between hosts


Solution HardwareComponent Quantity Configuration

Storage array 2 EMC Symmetrix VMAX 40K, with:• 3 Engines• 384 GB Cache• 32 x 200 GB Flash drives• 126 x 600 GB 10K FC drives• 64 x 450 GB 15K FC drives• 72 x 2TB 7.2 K SATA drives

VMware ESXi servers (Production virtual environment)

2 ESXi Server with:• 8 x Ten-core Intel Xeon E7 CPU @2.4 GHz• 1 TB RAM• 2 x dual Port Brocade 825 8 GB FC HBA

VMware ESXi servers (Disaster recovery virtual environment)

2 ESXi Server with:• 4 x Ten-core CPU Intel Xeon E7CPU @2.4GHz• 128 GB RAM • Dual 1 Gb NICs• Dual 10 Gb CNAs

FC switches 2 Brocade DCX 4S 8GB FC Director Class switchEthernet switches 2 1 Gb/s Ethernet switches


Key Technology Components EMC components:

– Symmetrix VMAX 40K with Enginuity 5876– Unisphere for VMAX– Symmetrix Remote Data Facility (SRDF)– Symmetrix FAST VP with SRDF coordination– PowerPath/VE– VMware vSphere 5– VMware Storage Integrator(VSI)

Applications– Oracle Database 11g R2 Enterprise Edition– Microsoft SQL Server 2012– SAP ERP 6.0 EHP 4


Configuration Details


Storage Configuration-Virtual PoolsThin Pool Name

Drive Size/ Technology /RPM

RAID Protection

Number of Drives TDAT Size

Number of DATA Device (TDAT)

Pool Capacity

FLASH_3RAID5 200GB Flash RAID5 (3+1) 32 68.8 GB 64 4.2TB

FC10K_RAID1 600GB FC 10K RAID1 126 66 GB 504 32TB

FC15K_RAID1 450GB FC 15K RAID1 64 49.2 GB 256 12.2TB

SATA_6RAID6 2TB SATA 7.2K RAID6 (6+2) 72 240GB 256 60TB


Virtual Pool Use by Application SAP, Oracle, and MS SQL

OLTP share common Flash, FC, and SATA pools

MS SQL DSS application shares a common SATA pool with all applications but is bound to a separate FC pool


Configuring FAST VP FAST VP is either enabled

or disabled Data Movement should

be set to automatic Relocation Rate controls

aggressiveness of FAST New Feature Allocate- by-

Policy simplifies capacity management of thin Provisioned environments

Time windowsCreate time windows to specify when data can be collected for performance analysis and when data movements can be executed. Recommend to have windows always open so FAST VP can use most recent analysis to optimize data placement.


Enable FAST VP Coordination on Storage Groups With this feature enabled, FAST VP sends device usage statistics from R1 to R2

to ensure that the FAST engine at the standby/failover site has up-to-date metrics on which to base decisions.

Enabled under storage group management in Unisphere:– Check Box: Enable FAST VP RDF Coordination

Coordination should be enabled on storage groups at both source and target VMAX


VMware Configuration


VMware Configuration

vCenterscreenshots

Reduce HBA queuing for vSphere ESXi servers by changing the queue depth

– esxcli system module parameters set -p bfa_lun_queue_depth=64 -m bfa

Virtual Machine boot LUNs configured to use LSI SAS adapter

VMware Paravirtual SCSI (PVSCSI) adapters are used to configure DATA LUNs for high performance


EMC Virtual Storage Integrator and VMAX 40K


Application ConfigurationOracle OLTP

1 Oracle DB instance, 12 vCPUs with 53 GB RAM1 DB per VM, 2 TB capacity

SwingBench entry workload on 400 users, 60:40 R/W ratio

MSSQL OLTP (TPC-E Like)2 SQL instances, 16 vCPUs with 32 GB RAM1 DB per VM, 1 TB capacity

Mixed workloads to simulate hot, warm applications, 85:15 R/W ratio

MSSQL OLAP (DSS, TPC-H Like)1 SQL instance, 32 vCPUs with 128 GB RAM1 DB per VM, 2 TB capacity

2 concurrent loads, 100% Read

SAP OLTP3 SAP ERP 6 IDES EHP 4 instances, 16 vCPUs with 32 GB RAM1 Oracle DB instance at 845 GB capacity1000 LoadRunner Update users + local client copy simulation, 80:20 R/W ratio


FAST VP PoliciesThe table below details the FAST VP Policies set for our baseline configuration:

Both MSSQL1 and MSSQL2 applications share the same FAST policy Policies restrict Flash tier to prevent any single application from

dominating Flash resources

Storage group FAST policy name Flash FC SATAMSSQL1_OLTP MSSQL_OLTP 5% 40% 100%

MSSQL2_OLTP MSSQL_OLTP 5% 40% 100%

MSSQL_DSS MSSQL_DSS 0% 100% 100%

Oracle Oracle 15% 35% 50%

SAP SAP 10% 80% 10%


Validation and Testing• Application Performance Validation• Online Policy Tuning• SRDF Coordination• Application Failover with Rapid Ramp-Up


Application Performance Validation


OLTP Application

Server Transactions Per Minute

Average Read Response Time

Oracle 97,846 5.5 ms

MSSQL1 37,920 10 ms

MSSQL 2 139,020 11 ms

DSS/OLAP Application Average Throughput

MSSQL DSS 808 MB/s

Application Server Transactions Per Minute

Average Dialogue Response time

SAP 2894.8 929.93 ms

Build Validation—All Applications Running


FAST VP Responsiveness and Flexibility

At 7:40am SQL OLTP policy adjusted to add additional Flash capability

After 30 minutes performance improvements were seen

SQL txn/sec increased and latency dropped

After 2 hours the SQL performance stabilized

Zero impact observed by other running applications


Validating FAST VP SRDF Coordination SRDF coordination

– Balance at Source and target

– Similar tier usage at both sites

Solid lines are source devices

Dotted lines are target devices


SRDF Coordination, continued

Device has been balanced across all tiers in a similar distribution on both R1 and R2

[root@solenabler1 ~]# symcfg list -tdev -range 426:426 -bound -detail -v -sid 541

Symmetrix ID: 000195700541

Enabled Capacity (Tracks) : 1826068704Bound Capacity (Tracks) : 1048590

S Y M M E T R I X T H I N D E V I C E S---------------------------------------------------------------------- Pool Pool Total Bound Flags Total Subs Allocated WrittenSym Pool Name ESPT Tracks (%) Tracks (%) Tracks (%)---- ------------ ----- ---------- ----- ---------- --- ---------- ---0426 FC10K_RAID1 F..B 1048590 0 570996 54 1044492 100 FLASH_3RAID5 -.-- - - 352524 34 - - SATA_6RAID6 -.-- - - 120972 12 - -

Total ---------- ----- ---------- --- ---------- ---Tracks 1048590 0 1045620 0 1044754 00

Source Array

Disaster Recovery

Array


Failover Test

Oracle & SAP Running at R1

Oracle & SAP Failed over and running at R2

Application loads were run for extended periods at R1 site and FAST VP balanced storage groups on both arrays

RDF links split to simulate failover SAP and Oracle were brought up on remote ESXi Server Performance was monitored before and after failover


Failover Test, continued Following failover

performance at application levels were on par with production

Transactions per minute and response times observed were equal


Summary and Solution Benefits VMAX 40K provides an ideal platform for virtualized critical database

applications, running varied workloads. Cascaded storage groups enable simplified management of ESX environments

with FAST VP. FAST VP is tunable and responsive. By adjusting FAST policies, performance can

be tuned to meet changing business performance needs. Increased performance within 30 minutes with no negative impact to other running workloads.

End-to-end visibility with VMware Storage Integrator from EMC enables simplified management and identification of VMAX devices direct from vCenter

SRDF coordination with FAST VP ensures production level performance at the R2 site in FAST VP environment in the event of a failover when configurations are similar. This delivers the performance and cost benefits of FAST VP at both production and disaster recovery sites.


Questions?

Documents

EMC INFRASTRUCTURE FOR VMWARE CLOUD ENVIRONMENTS