35
Intel Virtualization Intel Virtualization Technology: Technology: Strategy And Strategy And Evolution Evolution Lorie Wigle Lorie Wigle Director: Server Marketing Director: Server Marketing Digital Enterprise Group Digital Enterprise Group Rajesh Sankaran Rajesh Sankaran Principal Engineer Principal Engineer Corporate Technology Group Corporate Technology Group

Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Embed Size (px)

Citation preview

Page 1: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Intel Virtualization Intel Virtualization Technology:Technology:Strategy And EvolutionStrategy And Evolution

Lorie WigleLorie WigleDirector: Server MarketingDirector: Server MarketingDigital Enterprise GroupDigital Enterprise Group

Rajesh SankaranRajesh SankaranPrincipal Engineer Principal Engineer Corporate Technology GroupCorporate Technology Group

Page 2: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

AgendaAgenda

Server Virtualization: Evolution from mainframes to x86 Server Virtualization: Evolution from mainframes to x86 platformsplatforms

The trajectory of virtualizationThe trajectory of virtualization

Virtualization usage modelsVirtualization usage models

RAS, performance and ecosystem enabling: The Intel valueRAS, performance and ecosystem enabling: The Intel value

Intel Virtualization Technology (VT) RoadmapIntel Virtualization Technology (VT) RoadmapChallenges for SW - only virtual machine monitors (VMMs)Challenges for SW - only virtual machine monitors (VMMs)

VT-x: Intel Virtualization Technology for IA-32 ProcessorsVT-x: Intel Virtualization Technology for IA-32 Processors

VT-d: Intel Virtualization Technology for Directed I/OVT-d: Intel Virtualization Technology for Directed I/O

Summary and QuestionsSummary and Questions

Page 3: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Virtualization Awareness Virtualization Awareness Today*Today*

75% of enterprises aware 75% of enterprises aware of virtualizationof virtualization

34% Implementing 34% Implementing virtualization by mid 2006virtualization by mid 2006

Very large biz at 46%; Very large biz at 46%; SMB at 25%!SMB at 25%!

North America leading; North America leading; Other GEO’s right behind!Other GEO’s right behind!

60% increasing 60% increasing virtualization in virtualization in next 12 months! next 12 months!

WW Server VirtualizationBy Geography

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Americas EMEA APAC

Not Aware

Aware/No Interest

Interested

Using

WW Server VirtualizationBy Geography

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Americas EMEA APAC

Not Aware

Aware/No Interest

Interested

Using

* Forrester 2-22-06 Server Virtualization Goes Mainstream; 1221 end user quant study

WW Server VirtualizationBy Business Size

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Global 2000 Very Large Large NA SMB

Not Aware

Aware/No Interest

Interested

Using

WW Server VirtualizationBy Business Size

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Global 2000 Very Large Large NA SMB

Not Aware

Aware/No Interest

Interested

Using

Page 4: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Virtualized x86 Server Market Overview*Virtualized x86 Server Market Overview*

80% of customers using virtualization do so for consolidation80% of customers using virtualization do so for consolidationVirtualized server market growing from 4.5% today to >12% of Virtualized server market growing from 4.5% today to >12% of all servers in 2009all servers in 2009

Growing from 276K in 2005 to 1.1M units in 2009 (51% CAGR)Growing from 276K in 2005 to 1.1M units in 2009 (51% CAGR)Feedback from the market: Aggressive projections for 2005; conservative for 2009Feedback from the market: Aggressive projections for 2005; conservative for 2009

*Source: IDC WW Virtualization Forecast Aug-2005

Virtualized Server Forecast

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

2004 2005 2006 2007 2008 2009

Ph

ys

ica

l S

erv

ers

Sh

ipp

ed

16-Way

8-Way

4-Way

2-Way

1-Way

Virtualized Server Forecast

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

2004 2005 2006 2007 2008 2009

Ph

ys

ica

l S

erv

ers

Sh

ipp

ed

16-Way

8-Way

4-Way

2-Way

1-Way

Integrated Hypervisors inVolume OS’s

Virtualization: Significant growth due to compelling value

Page 5: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Today’s UsesToday’s UsesVirtualization addresses today’s IT concernsVirtualization addresses today’s IT concerns

10:1 in many cases10:1 in many cases Enables rapid deploymentEnables rapid deployment

Server ConsolidationServer Consolidation

HWn

HW0

VM1 VMn

OS

App

OS

App …

HW

VM1 VMn

VMM

OS

App

OS

App

Test and DevelopmentTest and DevelopmentVM1VM1

HW

VMM

OS

App

OS

App

Page 6: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Emerging Usage ModelsEmerging Usage Models

Goal: True “Lights Out” DatacenterGoal: True “Lights Out” DatacenterInstantaneous failoverInstantaneous failover

Dynamic load balancingDynamic load balancingAutonomicsAutonomicsSelf healingSelf healing

Dynamic Load BalancingDynamic Load Balancing

HW0

VM1VM1 VMnVMn

VMM

OS

App

OS

App …

HWn

VM1VM1 VMnVMn

VMM

OS

App

OS

App

Disaster RecoveryDisaster Recovery

HW0

VM1VM1

OS

App

HWn

VMn

OS

App

HW

VM1VM1

VMM

OS

App …

VMn

OS

App

Page 7: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

A Better Platform For VirtualizationA Better Platform For Virtualization

First to Market And Massive Ecosystem SupportFirst to Market And Massive Ecosystem SupportChoice: Broadest virtualization software Choice: Broadest virtualization software support in the industry support in the industry Robust: First x86 hardware assisted virtualization Robust: First x86 hardware assisted virtualization technology (Intel VT)technology (Intel VT)Innovation: Common specification = enhanced Innovation: Common specification = enhanced virtualization on x86 and will set the standard virtualization on x86 and will set the standard Flexibility: Leverage Intel Xeon processor-based servers Flexibility: Leverage Intel Xeon processor-based servers widely deployed infrastructure for advanced failover and widely deployed infrastructure for advanced failover and dynamic load balancingdynamic load balancing

Better Platform ReliabilityBetter Platform ReliabilityCritical for more applications on the same serverCritical for more applications on the same serverMore reliability features More reliability features Proven Platform Architecture - almost 40X more IA based Proven Platform Architecture - almost 40X more IA based servers than other x86 based servers since 1996servers than other x86 based servers since 1996

Performance HeadroomPerformance HeadroomIntel Xeon processors have key performance features for Intel Xeon processors have key performance features for virtualization: Dual-core, hyper-threading, I/O, memory, virtualization: Dual-core, hyper-threading, I/O, memory, and larger caches and larger caches

Whitepaper on Virtualization benefits: http://www.intel.com/business/bss/products/server/virtualization_wp.pdf

1 – source: Q4’05 IDC server Tracker, 1996-2005 total system shipped

“Choose the right basket”

Page 8: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

A More Reliable ServerA More Reliable ServerUnique Intel x86 Reliability FeaturesUnique Intel x86 Reliability Features

Intel Xeon processor

Based Servers

Memory Sparing

Predicts a “failing” DIMM & copies the data to a Predicts a “failing” DIMM & copies the data to a spare memory DIMM , maintaining server spare memory DIMM , maintaining server available & uptime available & uptime

Memory Mirroring

Data is written to 2 locations in system memory so Data is written to 2 locations in system memory so that if a DRAM device fails, mirrored memory that if a DRAM device fails, mirrored memory enables continued operation and data availabilityenables continued operation and data availability

Symmetric Access

to all CPUs

Enables a system to restart and operate if the Enables a system to restart and operate if the primary processor failsprimary processor fails

Memory CRC (FBD)

Address & command transmissions are Address & command transmissions are automatically retried if a transient error occurs vs. automatically retried if a transient error occurs vs. the potential of silent data corruption the potential of silent data corruption

Enhanced Memory ECC

Retry double-bit errors vs. standard memory ECC Retry double-bit errors vs. standard memory ECC that does single-bit errors onlythat does single-bit errors only

Enabled by a combination of processor, chipset and platform memory technologies. Data as of March 6, 2006

Other x86 Based

Servers

A Better Business Foundation Less Downtime, Higher Service Availability and Improved Confidence

Memory ECC Detects & corrects single-bit errorsDetects & corrects single-bit errors

Data Integrity & Availability

Data Integrity & Availability

Continued Operation

& Availability

Data Availability

Data Protection

Server Continuity

Feature Benefit Description

Page 9: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Introducing: Introducing: New Dual - Core New Dual - Core Intel Xeon Processor - based ServersIntel Xeon Processor - based Servers

What’s New?What’s New?

Lower Power 64-bit Dual-Core Processors Lower Power 64-bit Dual-Core Processors

Hardware assisted virtualization (VT)Hardware assisted virtualization (VT)

New dual independent point-to-point busNew dual independent point-to-point bus

Fully Buffered DDR2 DIMM Memory (FBD)Fully Buffered DDR2 DIMM Memory (FBD)

Intel I/O Acceleration Technology (option)Intel I/O Acceleration Technology (option)

Embedded RAID technology (option)Embedded RAID technology (option)

Intel Core Micro-architecture (Q3’06)Intel Core Micro-architecture (Q3’06)

Quad-Core support (1H’07)Quad-Core support (1H’07)

PLUS PLUS

64 bit computing (standard since 2004)64 bit computing (standard since 2004)

PCI Express* (standard since 2004)PCI Express* (standard since 2004)

Intel Execute Disable Bit (standard since 2005)Intel Execute Disable Bit (standard since 2005)

Intel Software Optimization Tools (option)Intel Software Optimization Tools (option)

Intel Power Efficiency Tools (option)Intel Power Efficiency Tools (option)

Intel I/O Acceleration Technology, Intel Active Server Manager, Intel Power Toolkit and Intel xScale™ storage controllers are advanced innovation that are options on select OEM systems. Contact your preferred OEM for more details

Advancing All Areas of The System Together For Outstanding Business Value

Page 10: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Enables richer software capabilitiesEnables richer software capabilities64-bit guest OS support in virtualized environment64-bit guest OS support in virtualized environment

Support for unmodified, heterogeneous guest operating systems Support for unmodified, heterogeneous guest operating systems to run on new VMM’sto run on new VMM’s

Intel is working with the industry Intel is working with the industry

Common virtualization standards from client to serversCommon virtualization standards from client to servers

Broad availability of both client and server platforms since Broad availability of both client and server platforms since November 2005 for accelerated software developmentNovember 2005 for accelerated software development

Endorsements and beta SW available from multiple vendorsEndorsements and beta SW available from multiple vendors

Support for VT in Microsoft Virtual Server 2005 R2 SP1Support for VT in Microsoft Virtual Server 2005 R2 SP1

Intel Virtualization Technology (VT)Intel Virtualization Technology (VT)

Provides silicon-based functionality that works Provides silicon-based functionality that works togethertogether with with compatible VMM software to provide new capabilitiescompatible VMM software to provide new capabilities

Page 11: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Other brands and names are the property of their respective owners.Other brands and names are the property of their respective owners.Source: Intel Corporation, 4/05, statistics based on Fortune* Global 100 Source: Intel Corporation, 4/05, statistics based on Fortune* Global 100 ranking of largest companies published in 2004. WorldWide IDC Server Tracker - Q3’05ranking of largest companies published in 2004. WorldWide IDC Server Tracker - Q3’05

Driving Virtualization Driving Virtualization MomentumMomentum

Providing a balanced server platform solution that Providing a balanced server platform solution that delivers CPU, memory, I/O and advanced technology delivers CPU, memory, I/O and advanced technology support for the datacentersupport for the datacenter

Supplying the most reliable, thoroughly validated and Supplying the most reliable, thoroughly validated and widely deployed server platforms available in the marketwidely deployed server platforms available in the market

Working with the industry to build a vibrant ecosystem Working with the industry to build a vibrant ecosystem and build solutions that relieve the pressure on ITand build solutions that relieve the pressure on IT

Page 12: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Intel VT RoadmapIntel VT Roadmap

Page 13: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

IA System Virtualization TodayIA System Virtualization Today

Physical Memory I/O DevicesLogicalProcessors

Virtual Machine Monitor (VMM)

VirtualMachines

BinaryTranslation

Paravirtualization

Page-tableShadowing

IO-DeviceEmulation

InterruptVirtualization

DMA Remap

IA-based System Virtualization TodayRequires Frequent VMM Software Intervention

Page 14: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

IA Virtualization TodayIA Virtualization TodaySummary Of ChallengesSummary Of Challenges

ComplexityComplexityCPU virtualization requires binary translation or paravirtualizationCPU virtualization requires binary translation or paravirtualization

Must emulate I/O devices in softwareMust emulate I/O devices in software

FunctionalityFunctionalityParavirtualization may limit supported guest OSesParavirtualization may limit supported guest OSes

Guest OSes “see” only simulated platform and I/O devicesGuest OSes “see” only simulated platform and I/O devices

Reliability and SecurityReliability and SecurityI/O device drivers run as part of host OS or hypervisorI/O device drivers run as part of host OS or hypervisor

No protection from errant DMA that can corrupt memoryNo protection from errant DMA that can corrupt memory

PerformancePerformanceOverheads of address translation in softwareOverheads of address translation in software

Extra memory required (e.g., translated code, shadow tables)Extra memory required (e.g., translated code, shadow tables)

Page 15: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Hardware support for IO-device virtualization

Device DMA remapping

Direct assignment of I/O devices to VMs

Interrupt Routing and RemappingVT-d

Intel Virtualization Technology EvolutionIntel Virtualization Technology Evolution

VMMSoftwareEvolution

PastNo Hardware

SupportVMM software evolution over time with hardware support

Software-only VMMs

Binary translation

Paravirtualization

Simpler and more Secure

VMM through foundation

of virtualizable ISAs

Vector 3:I/O Focus

PCI-SIG

Standards for IO-device sharing: Multi-Context I/O Devices Endpoint Address Translation Caching Under definition in the PCI-SIG* IOVWG

Vector 1:Processor Focus

Vector 2:Platform Focus

Establish foundation for virtualization in the

IA-32 and Itanium architectures…

VT-x

VT-i

… followed by on-going evolution of support: Micro-architectural (e.g., lower VM switch times)

Architectural (e.g., Extended Page Tables)

Increasingly better CPU and I/O virtualization performance and functionality as I/O devices

and VMMs exploit infrastructure provided by VT-x, VT-i, VT-d

*Other names and brands may be claimed as the property of others

Today

Page 16: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-x Overview:VT-x Overview:Intel Virtualization Technology Intel Virtualization Technology For IA-32 ProcessorsFor IA-32 Processors

Page 17: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

CPU Virtualization With VT-xCPU Virtualization With VT-x

Two new VT-x operating modesTwo new VT-x operating modesLess-privileged modeLess-privileged mode(VMX non-root) for guest OSes(VMX non-root) for guest OSes

More-privileged modeMore-privileged mode(VMX root) for VMM(VMX root) for VMM

Two new transitionsTwo new transitionsVM entry to non-root operationVM entry to non-root operation

VM exit to root operationVM exit to root operation

Ring 3

Ring 0

VMXRoot

Virtual Machines (VMs)

AppsApps

OS

VM Monitor (VMM)

AppsApps

OS

VM ExitVM Exit VM EntryVM Entry

Execution controls determine when exits occurExecution controls determine when exits occurAccess to privilege state, occurrence of exceptions, etc.Access to privilege state, occurrence of exceptions, etc.

Flexibility provided to minimize unwanted exitsFlexibility provided to minimize unwanted exits

VM Control Structure (VMCS) controls VT-x operationVM Control Structure (VMCS) controls VT-x operationAlso holds guest and host stateAlso holds guest and host state

Page 18: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Extended Page Tables (EPT)Extended Page Tables (EPT)

A VMM must protect host physical memoryA VMM must protect host physical memoryMultiple guest operating systems share the Multiple guest operating systems share the same host physical memorysame host physical memory

VMM typically implements protections through VMM typically implements protections through “page-table shadowing” in software“page-table shadowing” in software

Page-table shadowing accounts for a large Page-table shadowing accounts for a large portion of virtualization overheadsportion of virtualization overheads

VM exits due to: #PF, INVLPG, MOV CR3VM exits due to: #PF, INVLPG, MOV CR3

Goal of EPT is to reduce these overheads

Page 19: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

What Is EPT?What Is EPT?

EExtended xtended PPage age TTableableA new page-table structure, under the control of the VMMA new page-table structure, under the control of the VMM

Defines mapping between guest- and host-physical addressesDefines mapping between guest- and host-physical addressesEPT base pointer (new VMCS field) points to the EPT page tablesEPT base pointer (new VMCS field) points to the EPT page tablesEPT (optionally) activated on VM entry, deactivated on VM exitEPT (optionally) activated on VM entry, deactivated on VM exit

Guest has full control over its own IA-32 page tablesGuest has full control over its own IA-32 page tablesNo VM exits due to guest page faults, INVLPG, or CR3 changesNo VM exits due to guest page faults, INVLPG, or CR3 changes

Guest IA-32Page

Tables

Guest Linear Address Guest Physical Address ExtendedPage

Tables

Host Physical Address

EPT Base Pointer (EPTP)CR3

Page 20: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Guest Linear Address

EPT Tables

CR3

EPT Tables

+

EPT Tables

+

Page TablePage

Directory

Host Physical Address

Guest Physical

Page Base Address

+

Guest Physical Address

EPT Translation: DetailsEPT Translation: Details

All guest-physical memory addresses go through EPT tablesAll guest-physical memory addresses go through EPT tables(CR3, PDE, PTE, etc.)(CR3, PDE, PTE, etc.)

Above example is for 2-level table for 32-bit address spaceAbove example is for 2-level table for 32-bit address spaceTranslation possible for other page-table formats (e.g., PAE)Translation possible for other page-table formats (e.g., PAE)

Page 21: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-d Overview:VT-d Overview:Intel Virtualization TechnologyIntel Virtualization TechnologyFor Directed I/OFor Directed I/O

Page 22: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Options For I/O VirtualizationOptions For I/O Virtualization

Pro: Higher PerformancePro: Higher Performance

Pro: I/O Device SharingPro: I/O Device Sharing

Pro: VM MigrationPro: VM Migration

Con: Larger HypervisorCon: Larger Hypervisor

Hypervisor

SharedDevices

I/O Services

Device Drivers

VM0

Guest OSand Apps

VMn

Guest OSand Apps

Monolithic ModelMonolithic Model

Pro: Highest PerformancePro: Highest Performance

Pro: Smaller HypervisorPro: Smaller Hypervisor

Pro: Device assisted sharingPro: Device assisted sharing

Con: Migration ChallengesCon: Migration Challenges

AssignedDevices

Hypervisor

VM0

Guest OSand Apps

DeviceDrivers

VMn

Guest OSand Apps

DeviceDrivers

Pass-through ModelPass-through Model

VT-d Goal: Support all Models

Pro: High SecurityPro: High Security

Pro: I/O Device SharingPro: I/O Device Sharing

Pro: VM MigrationPro: VM Migration

Con: Lower PerformanceCon: Lower Performance

SharedDevices

I/O Services

Hypervisor

Device Drivers

Service VMs

VMn

VM0

Guest OSand Apps

Guest VMs

Service VM ModelService VM Model

Page 23: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-d OverviewVT-d OverviewVT-d is platform infrastructure for I/O virtualizationVT-d is platform infrastructure for I/O virtualization

Defines architecture for DMA remappingDefines architecture for DMA remapping

Implemented as part of platform core logicImplemented as part of platform core logic

Will be supported broadly in Intel server and client chipsetsWill be supported broadly in Intel server and client chipsets

CPU CPU

DRAM

South Bridge

System Bus

PCI Express

PCI, LPC, Legacy devices, …

IntegratedDevices

North Bridge

VT-dPCIe* Root Ports

Page 24: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-d UsageVT-d Usage

Basic infrastructure for I/O virtualizationBasic infrastructure for I/O virtualizationEnable direct assignment of I/O devices to unmodified Enable direct assignment of I/O devices to unmodified or paravirtualized VMsor paravirtualized VMs

Improves system reliability Improves system reliability Contain and report errant DMA to softwareContain and report errant DMA to software

Enhances security Enhances security Support multiple protection domains under SW controlSupport multiple protection domains under SW controlProvide foundation for building trusted I/O capabilitiesProvide foundation for building trusted I/O capabilities

Other usagesOther usagesGeneric facility for DMA scatter/gatherGeneric facility for DMA scatter/gatherOvercome addressability limitations on legacy devicesOvercome addressability limitations on legacy devices

Page 25: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Memory-resident Partitioning And Translation Structures

Device Assignment Structures

Address Translation Structures

Device D1

Device D2

Address Translation Structures

VT-d Architecture DetailVT-d Architecture Detail

DMA Requests

Device ID Virtual Address Length

Memory Access with System Physical Address

DMA RemappingEngine

Translation Cache

Context Cache

Fault Generation

…Bus 255

Bus 0

Bus N

Dev 31, Func 7

Dev P, Func 1

Dev 0, Func 0

Dev P, Func 2

PageFrame

4KB Page Tables

Page 26: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-d: Remapping StructuresVT-d: Remapping Structures

PControlsRsvdAddress Space Root Pointer

Address WidthRsvdRsvd Domain ID

Ext.Controls

0

64

63

127

VT-d Page Table EntryVT-d Page Table Entry

RSP

Page-Frame / Page-Table Address

063

WAvailableRsvd Rsvd Ext.Controls

VT-d supports hierarchical page tables for address translationVT-d supports hierarchical page tables for address translationPage directories and page tables are 4 KB in sizePage directories and page tables are 4 KB in size4KB base page size with support for larger page sizes4KB base page size with support for larger page sizesSupport for DMA snoop control through page table entriesSupport for DMA snoop control through page table entries

VT-d hardware selects page-table based on source of DMA request VT-d hardware selects page-table based on source of DMA request Requestor ID (bus / device / function) in request identifies DMA sourceRequestor ID (bus / device / function) in request identifies DMA source

VT-d Device Assignment EntryVT-d Device Assignment Entry

Page 27: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-d: Hardware Page WalkVT-d: Hardware Page Walk

000000b000000bBusBus DeviceDevice FuncFunc

00223377881515

Requestor IDRequestor ID

DeviceDeviceAssignmentAssignment

TablesTables

BaseBase

Level-4 Level-4 Page Page TableTable

Level-3 Level-3 Page Page TableTable

Level-2 Level-2 Page Page TableTable Level-1 Level-1

Page Page TableTable

PagePage

Example Device Assignment Example Device Assignment Table Entry specifying 4-level Table Entry specifying 4-level page tablepage table

5656

DMA Virtual AddressDMA Virtual Address

001111

Level-4 Level-4 table offsettable offset

Level-3 Level-3 table offset table offset

Level-2 Level-2 table offset table offset

Level-1 Level-1 table offset table offset

12122020212129293030383839394747

000000000b000000000b

6363 48485757

Page OffsetPage Offset

Page 28: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-d: Translation CachingVT-d: Translation Caching

Architecture supports caching of remapping structuresArchitecture supports caching of remapping structuresContext CacheContext Cache: Caches frequently used device-assignment entries: Caches frequently used device-assignment entries

IOTLBIOTLB: Caches frequently used translations (results of page walk) : Caches frequently used translations (results of page walk)

Non-leaf CacheNon-leaf Cache: Caches frequently used page-directory entries: Caches frequently used page-directory entries

When updating VT-d translation structures, software When updating VT-d translation structures, software enforces consistency of these cachesenforces consistency of these caches

Architecture supports global, domain-selective, and page-range Architecture supports global, domain-selective, and page-range invalidations of these cachesinvalidations of these caches

Primary invalidation interface through MMIO registers for Primary invalidation interface through MMIO registers for synchronous invalidationssynchronous invalidations

Extended invalidation interface for queued invalidationsExtended invalidation interface for queued invalidations

Page 29: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

VT-d: Extended FeaturesVT-d: Extended FeaturesPCI Express protocol extensions being defined by PCI Express protocol extensions being defined by PCISIG for Address Translation Services (ATS)PCISIG for Address Translation Services (ATS)

Enables scaling of translation caches to devicesEnables scaling of translation caches to devicesDevices may request translations from root complex and cacheDevices may request translations from root complex and cacheProtocol extensions to invalidate translation caches on devicesProtocol extensions to invalidate translation caches on devices

VT-d extended capabilitiesVT-d extended capabilitiesEnables VMM software to control device participation in ATSEnables VMM software to control device participation in ATSReturns translations for valid ATS translation requestsReturns translations for valid ATS translation requestsSupports ATS invalidationsSupports ATS invalidationsProvides capability to isolate, remap and route interrupts to VMsProvides capability to isolate, remap and route interrupts to VMsSupport device-specific demand paging by ATS capable devicesSupport device-specific demand paging by ATS capable devices

VT-d Extended features utilize PCI Express enhancements being pursued within the PCI-SIG

Page 30: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

BinaryTranslation

Paravirtualization

Page-tableShadowing

IO-DeviceEmulation

InterruptVirtualization

DMA Remap

VT-x & VT-d Working TogetherVT-x & VT-d Working Together

Physical Memory I/O DevicesLogicalProcessors

Virtual Machine Monitor (VMM)

VirtualMachines

Hardware VirtualizationMechanisms under VMM Control

VT-x

VT-d

Page 31: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

How Intel Virtualization TechnologyHow Intel Virtualization TechnologyAddress Virtualization ChallengesAddress Virtualization Challenges

Reduced ComplexityReduced ComplexityVT-x removes need for binary translation / paravirtualizationVT-x removes need for binary translation / paravirtualizationCan avoid I/O emulation for direct-mapped I/O devicesCan avoid I/O emulation for direct-mapped I/O devices

Improved FunctionalityImproved Functionality64-bit guest OS support, remove limitations of paravirtualization64-bit guest OS support, remove limitations of paravirtualizationCan grant Guest OS direct access to modern physical I/O devicesCan grant Guest OS direct access to modern physical I/O devices

Enhanced Reliability and ProtectionEnhanced Reliability and ProtectionSimplified VMM reduces “trusted computing base” (TCB)Simplified VMM reduces “trusted computing base” (TCB)DMA errors logged and reported to softwareDMA errors logged and reported to software

Improved PerformanceImproved PerformanceHardware support reduces address-translation overheadsHardware support reduces address-translation overheadsNo need for shadow page tables (saves memory)No need for shadow page tables (saves memory)

Page 32: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Delivering Intel VTDelivering Intel VT

Established Intel Virtualization Technology Specifications Established Intel Virtualization Technology Specifications for Intel based platforms for Intel based platforms

For the IA-32 Intel Architecture (Jan 2005)For the IA-32 Intel Architecture (Jan 2005) VT-xVT-xFor the Intel Itanium Architecture (Jan 2005)For the Intel Itanium Architecture (Jan 2005) VT-iVT-iFor Directed I/O Architecture (March 2006)For Directed I/O Architecture (March 2006) VT-dVT-dSee See http://www.intel.com/technology/computing/vptech/http://www.intel.com/technology/computing/vptech/

Shipping Intel based platforms enabled with Intel VTShipping Intel based platforms enabled with Intel VTVT-x: VT-x: Desktop in 2005, Mobile platforms and Intel Xeon Desktop in 2005, Mobile platforms and Intel Xeon

processor based servers and workstations in 2006processor based servers and workstations in 2006VT-i:VT-i: Later in 2006, Intel Itanium processor based servers Later in 2006, Intel Itanium processor based serversVT-d:VT-d: Intel is enabling VMM vendors with VT-d silicon in 2006 Intel is enabling VMM vendors with VT-d silicon in 2006

Page 33: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Summary And QuestionsSummary And Questions

Key challenges to IA system virtualizationKey challenges to IA system virtualizationComplexity, Performance, Reliability, FunctionalityComplexity, Performance, Reliability, Functionality

Intel Virtualization Technology (VT)Intel Virtualization Technology (VT)A long-term, comprehensive roadmap designed to A long-term, comprehensive roadmap designed to address virtualization challengesaddress virtualization challenges

Support for CPU and I/O virtualizationSupport for CPU and I/O virtualization

Strong ecosystem supportStrong ecosystem support

Page 34: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer

Call To ActionCall To Action

Download the Intel VT-x, VT-i and VT-d Download the Intel VT-x, VT-i and VT-d specificationsspecifications

Available at Available at http://www.intel.com/technology/computing/vptech/http://www.intel.com/technology/computing/vptech/

Begin developing solutions on VT enabled Begin developing solutions on VT enabled hardwarehardware

Monitor the PCI-SIG for the latest on I/O Device Monitor the PCI-SIG for the latest on I/O Device virtualization standardsvirtualization standards

Page 35: Intel Virtualization Technology: Strategy And Evolution Lorie Wigle Director: Server Marketing Digital Enterprise Group Rajesh Sankaran Principal Engineer