Strategic Solutions Engineering (SSE) EMC Solutions Group (ESG)

1© Copyright 2012 EMC Corporation. All rights reserved.

EMC MANAGEMENT INTEGRATION FOR MICROSOFT PRIVATE CLOUDEMC Symmetrix VMAX, EMC VNX, EMC Storage Integrator (ESI) for Windows Suite, Microsoft System Center 2012

Strategic Solutions Engineering (SSE)EMC Solutions Group (ESG)

Michael Morris – Principal Solutions EngineerIke Aikemu –Solutions EngineerAlex Bowers – Senior Solutions Engineer

• Application to Infrastructure management and monitoring• Optimized storage for elastic infrastructures• Automated storage provisioning


EMC Proven Solutions Solution overview

– Application requirements– System Management– VNX storage pool allocation

Results– VNX in-tier rebalance– Application results– System Center 2012 SP1

▪ SCOM, SCVMM, SCO

Summary– Solution pack

Q&A

Agenda


EMC Proven Solutions Approach

Capture and

defineTest and validate Document Publish

Singapore Shanghai, China

Cork, Ireland

Hopkinton, MA

Santa Clara, CA

Vienna, Austria

1 2 3 4Re

quire

men

ts

…real world Solutions


Solution Overview


Solution Purpose

Microsoft System Center 2012 SP1 VMware ESXi and Windows Server Hyper-V 2012

– Multi-hypervisor environment EMC Symmetrix VMAX 10K, EMC VNX5700

– Multi-array environment EMC Storage Integrator (ESI) for Windows Suite Mixed application workloads

This objective of this solution is to demonstrate EMC’s integration with Microsoft System Center 2012 SP1, which allows support for Windows Server 2012 for management of a Microsoft private cloud environments.


Solution Overview System Center 2012 SP1

– Provides centralized management– Windows Server 2012 support

ESI Management Packs for SCOM– Monitor health & performance

EMC SMI-S provider– Allows SCVMM 2012 SP1 to easily manage and

provision EMC storage ESI PowerShell

– Allows automated provisioning and allocation of EMC storage with SCO 2012 SP1

SCVMM 2012 SP1 – provides simplified and centralized

management of both ESXi and Hyper-V

VNX Automatic in-tier rebalance FAST VP policies for workload co-location


Application Item Quantity/Type/Size

Exchange

Mailbox Count 5,000Mailbox Size 2 GB IOPS (per mailbox) 0.10 IOPS Availability DAG, 2 Copies Disk type, number, and RAID type 48 * 2TB NL-SAS, RAID 1/0

DB LUN size per server 1700GB * 20 (10 DB LUNs per server)LOG LUN size per server 100GB * 20 (10 log LUNs per server)

SharePoint

Total User Count 5,000

Usage Profile (%browse/%search/%modify/%download) 60/10/10/20

User Concurrency 10%Total Data 4.4 TBTotal Site Collections (Content DBs) Count 5Sites per Site Collection 10 - 100Document Size Range 200 kb – 2 MBDisk type, number, and RAID type VNX FAST VP enabled Storage Pool

SQL Server

SQL – IOPs (Disk Transfers/sec) Try to achieve 5,000 IOPS SQL Server Instances 1Workload type TPC-E Like SQL Server Production VM 16 vCPU / 64GB SQL User Databases 1 User DB – 500GB

Disk type, number, and RAID type VNX FAST VP enabled Storage Pool

Application requirements

..workload profiles


Hyper-V cluster ESXi cluster

VNX5700 VMAX 10K

SCOM 2012

ESI

SCVMM 2012

Agent(VM)Agent

ESI ServiceESI Service

System Management

…how it all works

SCO 2012

SMI-S


18 Disks (0-17)

SAS (Pool 0 -Tier 1)8+18+1 4+1

1 2 3 40

FLASH DRIVES (Pool 0 – Tier 0)

4+1 1mirror 1mirror 1 mirror

2.0

1.0

1 2 3 4 5 6 70

NL-SAS(Pool 0 – Tier 2)

6+2

0.1

18 Disks (0-17)

SAS (Pool 0 -Tier 1)8+18+1 4+1

3.0

4 5 6 7

FAST Cache(Array Resource)

1+1

0.0

1+1

VNX Storage Pool Allocation

Application consolidation …for SQL & SharePoint!

…available if required! …but not required in this solution!


Results


VNX in-tier rebalance - Physical Disk Utilization (%)

…in-tier rebalance following storage pool expansion


VNX Physical Disk Utilization (%)

…disk utilization across all configurations

Disk Configurations• Baseline configuration: 18 * SAS (R5 *, 8+1) + 8 * NL-SAS (R6, 6+2)• with additional SAS drives (18 * drives added): 36 * SAS (R5, 8+1) + 8 * NL-

SAS (R6, 6+2)• with Flash drives 36 * SAS (R5, 8+1) + 8 * NL-SAS (R6, 6+2) + 5 * Flash

(R5, 4+1)


SQL Server results

…SQL Server workload hosted on VNX

Results• Over x 4 increase in IOPs between base and final configuration• Latency reduced from 23ms Read / 13ms Write to 2ms Read / 2ms Write

VNX storage pool expansion and enabling FAST VP


SharePoint & Exchange results

…SharePoint workload on VNX, Exchange on VMAX 10K

SharePoint – Medium Farm• Browse Modify, Search and Download test times

– were completed in less than 3 seconds• Passed tests/sec were constant, averaging 29.83

– which equates to 17,900 users @ 10% concurrency

Exchange – 5,000 Users, 2 * Copies• Information Store Avg. Latency was 1.9ms

(<10ms)• I/O Database Reads Avg. Latency was 7.35ms

(<20ms)• I/O Database Writes Avg. Latency was 3.5ms

(<20ms)• I/O Log Writes Avg. Latency was 5.5ms (10ms)


VNX Physical Disk Utilization (%)

…healthy view of storage pool in Unisphere

Disk Utilizations across three tier storage pool• Flash (77%), SAS (25%) …hosting OS, SQL Data & SharePoint LUNs (minus

contents DBs)• NL-SAS (38%) - hosting only SharePoint content database LUN pinned to

lowest tier


LUN Names Tier allocation %SSD SAS NL-SAS

LUN_1_Admin_VMs 1.05 98.95 LUN_2_App_VMs 0.7 99.3 LUN_3_SQL_Data 48.14 51.86 LUN_4_TempDB_And_DB_Logs 1.29 98.71 LUN_5_SP_ContentDatabases 100 LUN_6_SP_ContentDatabases_Logs 0.2 99.8LUN_7_Config_DB 0.79 99.21 LUN_8_Search_TempDB 0.53 99.47 LUN_9_SP_Search_TempDB_Logs 1.74 98.26 LUN_10_SP_Query_Index 0.19 99.81

VNX LUN tier allocation

…following FAST VP relocation window


EMC Integration


SCOM – Monitor and Report

…single console view

…in this solution• EMC Storage system monitor

• ESI management packs for SCOM • Reporting

• Storage• Host utilization• Chargeback

• Application monitor• Exchange• SQL• SharePoint

• OS health monitor• CPU• Memory• Disk volume


SCOM- Health Monitor for EMC Storage

…SCOM storage topology view

Overall topology view of storage system in SCOM

VNX5700VMAX 10K

• Import and configure ESI Management Packs for SCOM

• Health monitor via ESI Service and RESTFul API• Storage system topology

• Array health• Space utilization• Alerts


ESI Management Packs for SCOM

…monitoring components with SCOM

Storage Group Overall Health

Monitored Components• ESI Service• Logical Components

– Storage Pools– Snapshot Volume– Storage Group

• Physical Components– CPU Module– Disk Drive– Enclosure– Network Switch– Memory Module


SCVMM – Cloud Management

…manage both Hyper-V and ESXi

…in this solution• Storage Management and provisioning via EMC SMI-S

provider• EMC VNX5700• EMC VMAX 10K

• Host Management• Hyper-V• ESXi (via VMware vCenter)

• VM Provisioning


SCVMM – EMC Storage Management

…storage management

Managing both VNX5700 and VMAX 10K

Manage EMC storage system via EMC SMI-S provider• Discover VNX and VMAX• Configure storage pools• Create LUNs


SCO – Orchestrator RunBook Designer

…RunBook Designer

…no activities of LUN creation in SCVMM IP

…Runbook – a series of activities

Workflow management1. Create VM via

SCVMM IP (Integration Pack)

2. Create LUN with ESIPS

3. Add Disk to VM…


SCO – ESIPowerShell toolkit

…ESIPowerShell cmdlets

Example activity Run .Net script

Automatically created based on user input, which:• Provisions storage• Allocates storage to

VM


Hyper-V cluster ESXi cluster

VNX5700 VMAX 10K

SCOM 2012

ESI

SCVMM 2012

Agent(VM)Agent

ESI ServiceESI Service

System Management

…how it all works

SCO 2012

SMI-S


Summary


SummaryThis solution highlights the close integration of ESI for Windows Suite with Microsoft System Center 2012 SP1, which allows administrators to control application and EMC storage infrastructure throughout the data center. This includes multi-hypervisor and multi-array environments.

ESI Management Packs for SCOM monitor EMC storage systems. EMC SMI-S Provider allows storage management with SCVMM ESI PowerShell allows automated provisioning of EMC storage SCO provides workflow management SCVMM manages both ESXi and Hyper-V VNX automatic in-tier rebalance, following storage-pool tier

expansion FAST VP policies allow co-location of multiple workloads


Solution Pack Collateral …ECN/YouTubeInformation Link

Whitepaper location's http://www.emc.com/collateral/whitepaper/h11228-management-integration-cloud-wp.pdf

Technical Presentation …available soonSolution Webcast …19th February 2012Tech Articles: Everything Microsoft @ EMCEMC MANAGEMENT INTEGRATION FOR MICROSOFT PRIVATE CLOUD - Solution homepage https://community.emc.com/docs/DOC-21431

System Center management with ESI and SMI-S https://community.emc.com/docs/DOC-21432Monitoring EMC storage using SCOM 2012 SP1 with ESI Management Packs https://community.emc.com/docs/DOC-21433Application monitoring with SCOM Management Packs https://community.emc.com/docs/DOC-21434Chargeback with SCOM SP1 https://community.emc.com/docs/DOC-21435SCVMM 2012 SP1 support for ESXi https://community.emc.com/docs/DOC-21436EMC SMI-S provider for SCVMM 2012 SP1 allows EMC storage discovery https://community.emc.com/docs/DOC-21437SCO 2012 SP1 and ESI PowerShell https://community.emc.com/docs/DOC-21438Co-location of SQL Server and SharePoint volumes in VNX storage pool https://community.emc.com/docs/DOC-21439Videos: Everything Microsoft @ EMC / YouTube: EMCProvenSolutions

Adding an EMC VMAX and creating a LUN in Microsoft SCVMM 2012 SP1 • https://community.emc.com/videos/4949• http://youtu.be/ts_vQlMuqTk

Creating and adding an EMC LUN to a host in Microsoft SCVMM 2012 SP1 • https://community.emc.com/videos/4950• http://youtu.be/sZw66BoeMVY

Automating the creation of a virtual machine and adding an EMC LUN in Microsoft SCO 2012 SP1

• https://community.emc.com/videos/4951• http://youtu.be/g3inYLpSYL8

ESI for Windows Suite integration with Microsoft SCOM 2012 SP1 for monitoring EMC arrays

• https://community.emc.com/videos/4952 • http://youtu.be/kdzDt9a5d1M

…collateral ECN & YouTube channel: EMCProvenSolutions

http://www.emc.com/collateral/whitepaper/h11228-management-integration-cloud-wp.pdf


https://community.emc.com/docs/DOC-21431









https://community.emc.com/videos/4949

http://youtu.be/ts_vQlMuqTk

http://youtu.be/ts_vQlMuqTk



http://youtu.be/sZw66BoeMVY

http://youtu.be/sZw66BoeMVY



http://youtu.be/g3inYLpSYL8

http://youtu.be/g3inYLpSYL8



http://youtu.be/kdzDt9a5d1M

http://youtu.be/kdzDt9a5d1M


Q&AECN solution homepage: https://community.emc.com/docs/DOC-21431

WP: http://www.emc.com/collateral/whitepaper/h11228-management-integration-cloud-wp.pdf YouTube channel: http://www.youtube.com/user/EMCProvenSolutions





http://www.youtube.com/user/EMCProvenSolutions



Documents

Strategic Solutions Engineering (SSE) EMC Solutions Group (ESG)