Upload
ldangelo0772
View
283
Download
4
Embed Size (px)
Citation preview
VMWorld :31st Aug - 3rd Sep, 2015
Desktop Virtualization Performance Solutions Team Computing Systems Product Group, Data Center Solutions, Cisco System Inc., San Jose.
Cisco UCS GPU Solution NVidia Grid Cards and VMware Horizon with View
2 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Agenda
• GPU enabled VDI with UCS
• GPU Deployment Methods
• GPU Hardware Installa<on on Cisco UCS
• UCSM Integrated GPU Scenario
• GPU Installa<on on VMware ESXi Hypervisor
• VMware vDGA & vSGA
• MicrosoD Remote FX with GPU
3 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
GPU Requirement for VDI User Profile
DESIGNERR Graphics & Media
Professionals, Design Engineers
CATIA, CS6 Inventor
POWER USER PLM, Solidworks
Adobe Dreamweaver Medical Imaging
Showcase
Financial Analysts, Traders, Design Reviewers
KNOWLEDGE WORKER Office workers, productivity & line-of-business workers
MS Office Photoshop
4 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
NVIDIA GRID K2
GPU 4 Kepler GK 107 2 High End Kepler GK 104 CUDA cores 768 (192 / GPU) 3072 (1536 / GPU)
Memory Size 16GB DDR3 (4GB / GPU) 8GB GDDR5 Max Power 130 W 225 W Aux power
requirement 6-pin connector 8-pin connector
PCIe x16 x16 OpenGL 4.x 4.x
Microsoft DirectX 11 11 vGPU support Yes Yes
# users 4 - 1001 2 – 641
1 Number of users depends on software solution, workload, and screen resolution
NVIDIA GRID K1
5 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Graphics Methods for Virtual Desktop Users
• Horizon vDGA – GPU Pass-‐through “Virtualized Dedicated Graphics Accelera=on”
1:1 dedicated GPU to user
• Horizon vSGA -‐ Shared GPU “Virtualized So@ware Graphics Accelera=on”
So$ware virtualiza<on of the GPU.
• Horizon vGPU -‐ Virtual GPU “Virtualized Graphics Processing Unit”
Hardware virtualiza<on of the GPU
6 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Guest OS
UCS Server
CPU
vDGA- GPU Pass-Through H
ardw
are
Memory Storage Network
Soft
war
e
Virtual Driver
Virtual Driver
Virtual Driver
Virtual Driver
Virt
ualiz
atio
n
HYPERVISOR
VIRTUAL MACHINE
vCPU vMemory vStorage vNetwork
App App App App VDA
Client
NVIDIA Driver
GPU
GPU
VMware View 6.1
VMware ESX 6 vDGA
GRID K1/K2
7 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
App App App VDA
HYPERVISOR
Guest OS
Virtual Graphics Driver
OS
Virtual Graphics Driver
Guest OS
UCS Server
CPU
Shared GPU- vSGA
Har
dwar
e
Memory Storage Network
Soft
war
e
Virtual Driver
Virtual Driver
Virtual Driver
Virtual Driver
Virt
ualiz
atio
n VIRTUAL MACHINE
vCPU vMemory vStorage vNetwork vGraphics
Client
GPU
NVIDIA Driver
Virtual Graphics Driver Graphics APIs
Rendered Desktop
App App App VDA
App App App App VDA
VMware vSGA – DX9, OGL 2.1
GRID K1/K2
8 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Guest OS
VIRTUAL MACHINE
HYPERVISOR
NVIDIA Driver
NVIDIA Driver
Guest OS
UCS Server
CPU
Virtual GPU- vGPU H
ardw
are
Memory Storage Network
Soft
war
e
Virtual Driver
Virtual Driver
Virtual Driver
Virtual Driver
Virt
ualiz
atio
n VIRTUAL MACHINE
vCPU vMemory vStorage vNetwork
Client
GPU
NVIDIA Driver
vGPU
GRID Software
Graphic Commands
App App App App VDA App App App App VDA
App App App VDA
Client
Client
Standard NVidia Driver
VMware ESXi 6
NVidia GRID VGX software
9 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
User No-GPU GPU Sharing GPU Pass-through
✗ ✗ ✔
✗ ✗ / ✔ ✔
✔ ✔ ✔
Recommended Mode
Designer
Power User
Knowledge Worker
10 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Chassis: 2 RU Rack Unit
CPU: 1 or 2 Intel Xeon E5 -2600 family processors
Memory: 24 slots registered ECC DIMMS or load reduced DIMMS
Expansion Slots: Up to 6 PCIe slots (CPU1- controls PCIE slots1,2,3 and CPU2 controls slots 4,5,6)
Internal storage devices: Up to 24 2.5” (63.5 mm) SAS/SATA/HDD/SSD drives with 24 drive backplane
C240 M4 Hardware Overview
C240 M4 Server configuration for GPU Testing
2 Intel Xeon E5-2680v3 @ 2.50 GHz Processors
12 Cores per Processor, 48 Logical Processors per server
384Gb DDR4 2133MHz memory DPC
11 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
UCS Managed C240 M4
Nexus 2232
UCS 6200 UCS 6200
• Single Wire Management • UCSM version 2.2.(4b)
VIC 1227 GPU 2 GPU 1
!
IntelInsideXEON
UCSC240 M4
Console
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
1 6 12 18 24
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
OS or Hypervisor
12 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
VMware vDGA setup • GPU Pass-‐through mode
• Virtual Dedicated Graphic Accelerator (vDGA)
• Supports all versions of DX, OpenGL and CUDA
• No driver/soDware installa<on needed on ESXi host
• PCI Pass thru must be enabled on the ESXi server
• NVIDIA Win7 driver needed on the VMs
• Also need to make Primary Display accelerated NVidia GPU adapter
• VMware ESXi 5.1 or later & Horizon view 5.2 or later
13 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Enabling Pass thru on ESXi for vDGA • Go to vCenter client and Click on host where GPU card is installed
• Click on Configura<onà Advanced Se\ngs
• Click on Configure Pass-‐through
• Select the GPU card in the pass-‐through
14 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Enabling Pass thru on ESXi for vDGA • For one K2, there will be two PCI VGA Controller
• For one K1 or 2x K2, there will be four PCI VGA Controller
• Select all and click OK
• ESXi host reboot is required
• TO validate pass-‐through working, ssh to ESXi console & issue cmd: vmkvsitools lspci | grep “nVidia”
15 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Verify VMWare vDGA • Check the device manager, there will be NVidia GRID
adapter under Display Adapter.
• Login to Virtual machine via VNC or RDP and check the device manager for NVIDIA GRID card present or not.
• Select that adapter as primary & disable the VMware SVGA 3D.
• Log Off the VNC or RDP & log back in with VMware view client.
• Go to vSphere web client and edit the virtual machine properties . You can see the NVidia GRID pass through device attached to the virtual machine
16 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Verify VMware vDGA • Fully accelerated Open GL and DX apps can be
run.
• NVidia Control Panel is also available for graphics adapter settings.
• CUDA capable programs can be run with full GPU acceleration
• nvidia-sim command . SSH into ESXI host and check the NVidia-sim command for a graphics card usage and health.
17 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
VMWare vSGA setup
• GPU sharing Mode with API intercept
• Virtual Shared Graphics Accelerator (vSGA)
• Nvidia Driver (.vib) needs to be installed on the ESXi hypervisor
• No Nvidia driver in the VM
• Supports OGL 2.1 and DX 9.0 only
• VMware ESXi 5.1 or later with Horizon View 5.2 or later
• Has multi user shared access to Nvidia GPU
• Number of users varies with the application, GPU card & rendering requirement
18 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
vSGA ESXi Host Installation and Verification
Verify the ESXi vSGA mode drivers are installed successfully. gpuvm
Download the latest .vib file from Nvidia website http://www.nvidia.com/download/driverResults.aspx/85391/en-us
Copy .vib file to ESXi host via SCP or FTP to /tmp directory Go to /tmp directory and run the command below ~#esxcli software vib install --no-sig-check -v <driver file>.vib
Install Example
Verify Card Install esxcli software vib list | grep NVIDIA lspci | grep –I display
19 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
VIRTUAL DESKTOPS
VIRTUAL MACHINE Windows 7
NVIDIA Driver
Apps
NVIDIA GRID Enabled Virtual Desktop Agent
NVIDIA GRID GPU
NVIDIA GRID ENABLED Hypervisor
vGPU Enabled VDI
!
IntelInsideXEON
UCSC240 M4
Console
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
1 6 12 18 24
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
UC
S-H
DD3
00G
I2F1
0515
K S
AS
300
GB
!
20 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• Go to vSphere Web client -‐-‐> Virtual Machine à Proper<es
• Click on New Device. Add PCI device from drop down menu
• Select GPU profile to be added.
• Click ok & Restart virtual machine
• Install latest NVidia driver for Windows 7 (64 or 32 bit)
Attaching vGPU Profile to Win7 VM
21 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
NVIDIA GRID CARD
Virtual GPU Profile
Application Certification
Graphics Memory in MB
Max Display per User
Max Resoltion per Display
Max Users per Board
Use Case
GRID K2 K280Q YES 4096 4 2560x1600 2 Designer
K260Q YES 2048 4 2560x1600
4 Designer/ Power User
K240Q YES 1024 2 2560x1600
8 Designer/
Power User
K220Q YES 512 2 2560x1600
16 Power User
GRID K1 K180Q YES 4096 4 2560x1600
4 Power User
K160Q YES 2048 4 2560x1600
8 Power User
K140Q YES 1024 2 2560x1600
16 Knowledge Worker
K120Q YES 512 2 2560x1600
32 Knowledge Worker
NVIDIA GRID vGPU Profile Selection Chart
22 © 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Cisco UCS, VMware Horizon and NVIDIA Reference Documents
http://www.cisco.com/go/vdi-cvd http://www.cisco.com/c/en/us/products/servers-unified-computing/ucs-c240-m4-rack-server/index.html https://www.vmware.com/support/horizon-view/doc/horizon-61-view-release-notes.html https://www.vmware.com/support/horizon-view/doc/horizon-view-602-release-http://blogs.vmware.com/performance/2014/12/vmware-horizon-6-hardware-accelerated-3d-graphics.html http://www.vmware.com/files/pdf/VMware-View-OptimizationGuideWindows7-EN.pdf http://www.nvidia.com/content/grid/pdf/GRID_K2_BD-06580-001_v02.pdf http://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-c-series-rack-servers/nvidia_grid_vgx.pdf
Thank you