34
The Scalable & Capable Cloud OS Didier Van Hoye

Sysctr Track: The Capable & Scalable Cloud OS

Embed Size (px)

DESCRIPTION

by Didier Van Hoye A Session full of demos about SMB Direct, ODX, UNMAP, Storage QoS, Live Migration options, DVMQ & vRSS etc. Real life commodity hardware that renders nice performance accessible to everyone.

Citation preview

Page 1: Sysctr Track: The Capable & Scalable Cloud OS

The Scalable & CapableCloud OS

Didier Van Hoye

Page 2: Sysctr Track: The Capable & Scalable Cloud OS

Microsoft MVP in Hyper-V

MEET Member

DELL TechCenter Rockstar

Didier Van HoyeTechnical Architect – FGIA

@workinghardinithttp://workinghardinit.wordpress.com

Page 3: Sysctr Track: The Capable & Scalable Cloud OS
Page 4: Sysctr Track: The Capable & Scalable Cloud OS
Page 5: Sysctr Track: The Capable & Scalable Cloud OS
Page 6: Sysctr Track: The Capable & Scalable Cloud OS
Page 7: Sysctr Track: The Capable & Scalable Cloud OS
Page 8: Sysctr Track: The Capable & Scalable Cloud OS
Page 9: Sysctr Track: The Capable & Scalable Cloud OS

Windows Server 2012 R2 Hyper-V

Performance Scalability Excellent data protection High to continuous availability Great Economics Leverage existing investment Solutions for any size, needs &

challenges

Page 10: Sysctr Track: The Capable & Scalable Cloud OS

Hyper-V Storage

– Improvements in the storage stack– Storage QoS–VHDX –ODX/UNMAP

Page 11: Sysctr Track: The Capable & Scalable Cloud OS

IO SCALING LIMITATIONS WITH W2K8R2

vCPU 0

1 channel per vSCSI Controller for all attached devices

256 Queue Depth per vSCSI controller shared for all attached devices

Storage IO on vCPU 0 ONLY

Hyper-V Host

Parent PartitionVirtual Storage Stack

VHD VHD

Virtual Machine

vSCSI

Page 12: Sysctr Track: The Capable & Scalable Cloud OS

IO SCALANBILITY WITH W2K12R2

http://workinghardinit.wordpress.com/2012/11/02/hyper-v-guest-storage-performance-above-beyond-1-million-iops/

vSCSI

vCPU 0 vCPU 1 vCPU 2 vCPU 63

...

Storage IO spread across all vCPUs

1 channel / 16 vCPUs per device per vSCSI controller

è 4 with 64 vCPUs

256 Queue Depth per device per vSCSI controller

VHDX VHDX

Virtual Machine

Hyper-V Host

Parent PartitionVirtual Storage Stack

Page 14: Sysctr Track: The Capable & Scalable Cloud OS

VHDX

Up To 64 TB

Larger Virtual Disks

Disk Sector Alignment

Large Sector Support

Enhanced Performance

Larger Block Sizes

Internal Log

Enhanced Resiliency

Embed Custom

Metadata

User Defined Metadata

Page 15: Sysctr Track: The Capable & Scalable Cloud OS

512e RWM

Page 16: Sysctr Track: The Capable & Scalable Cloud OS

512e Disk

Large Sector Support – 512e Disks

HardwareRMW

LegacyVHD

Unaligned F(Off)+512b

VHD

Aligned F(Off)+4 KB

No Auto Align For Existing VHDs

HardwareRMW

Windows Server 2012 • New VHDs 4K Aligned - Padding Better Performance, Reduced

Need For RMW

4K Aligned

Sub-Optimal Performance For Existing VHDs ~30%• 512b structures - Sector Bitmap,

Header, Footer, Parent Locators Extra Hardware Read-Modify-Write

Page 17: Sysctr Track: The Capable & Scalable Cloud OS

Large Sector Support – Native 4K Disks

VHDVHD

X

512 4K

SoftwareRMW

512

4K4K 4K

Native 4K Disk

VHDX

• Support For Native 4K Disks Software Read-Modify- Write

• 512b Logical Sector Virtual Disk Performance Penalty For RMW

• 4K Logical Sector VHDX No Performance Penalty

http://support.microsoft.com/kb/2515143 http://technet.microsoft.com/en-us/library/hh831459

Page 18: Sysctr Track: The Capable & Scalable Cloud OS

Increased Storage Efficiency – Unmap• Unmap

– Storage Informed Of Unused Space

• Efficiencies At Virtual Layer• Allows Reuse Of Unused Blocks

• Efficiencies At Physical Layer– VMs Unmap Passed To Hardware

• Supported On– VHDX & PassThru Disks– vSCSI, vIDE or Virtual Fibre

Channel / iSCSI

VHD Stack

VHDX

External Storage Array

Page 19: Sysctr Track: The Capable & Scalable Cloud OS

Offloaded Data Transfer (ODX)

Intelligent SAN

Virtual Disk Virtual Disk

Offload Read Token Token Offload Write

Token

Actual Data Transfer

Page 20: Sysctr Track: The Capable & Scalable Cloud OS

High To Continuous Availability

• Online Virtual Disk Merge• Storage Live Migration• Shared Nothing Live Migration• Online Set Parent• Online resize of VHDX

Page 21: Sysctr Track: The Capable & Scalable Cloud OS

Storage Demos

Page 22: Sysctr Track: The Capable & Scalable Cloud OS

Hyper-V Networking

– Live Migration• Compression• SMB Multichannel & SMB Direct

–DVMQ– vRSS

Page 23: Sysctr Track: The Capable & Scalable Cloud OS

Tips for optimal live migrations

1. Set optimal performance option2. Bigger Pipes3. Use jumbo frames4. Optimize power settings5. Tweak # of simultaneous live

migrations

Page 24: Sysctr Track: The Capable & Scalable Cloud OS

Live Migration Performance Options

• TCP/IP (what we had)• Compression• SMB– SMB MultiChannel– SMB Direct

• iWarp• RoCE• Infiniband

Page 25: Sysctr Track: The Capable & Scalable Cloud OS

No VMQ (W2K8)All the interrupts of incoming network traffic to a VM has to be handled by core 0.

Page 26: Sysctr Track: The Capable & Scalable Cloud OS

Static VMQ (W2K8R2)Sorting, filtering is done by NIC & each VM get a core to handle the interrupts

Page 27: Sysctr Track: The Capable & Scalable Cloud OS

Dynamic VMQ (W2K12/R2)Sorting, filtering is done by NIC & the VM(s) gets one or multiple core dynamically assigned to handle the interrupts

Page 28: Sysctr Track: The Capable & Scalable Cloud OS

Dynamic VMQ & vRSS (W2K12R2)Sorting, filtering is done by NIC & the VM(s) gets one or multiple core dynamically assigned to handle the interrupts

Page 29: Sysctr Track: The Capable & Scalable Cloud OS

Network Demos

Page 30: Sysctr Track: The Capable & Scalable Cloud OS

You can have your cookie & eat it to!

Page 31: Sysctr Track: The Capable & Scalable Cloud OS

Didier Van HoyeTechnical Architect – FGIAMicrosoft MVP, MEET Member, DELL TechCenter Rockstar http://workinghardinit.wordpress.com @workinghardinit

Page 32: Sysctr Track: The Capable & Scalable Cloud OS

And take home the Lumia 1320

Present your feedback form when you exit the last session & go for the drink

Give Me Feedback

Page 33: Sysctr Track: The Capable & Scalable Cloud OS

Follow TechNet Belgium@technetbelux

Subscribe to the TechNet newsletteraka.ms/benews

Be the first to know

Page 34: Sysctr Track: The Capable & Scalable Cloud OS

Belgiums’ biggest IT PRO Conference