Windows Enterprise Windows Enterprise Storage DirectionsStorage Directions

James PinkertonJames PinkertonArchitectArchitectCore File SystemsCore File SystemsMicrosoft CorporationMicrosoft Corporation

AgendaAgenda

Situational SummarySituational Summary

Storage Vision for Branch and HubsStorage Vision for Branch and Hubs

Interfaces for InnovationInterfaces for Innovation

Microsoft Storage RoadmapMicrosoft Storage Roadmap

Customer SituationCustomer Situation

Disk Replacing Tape Distributed Environments

Moving Beyond File Data Management costs

Storage Management Is Too Storage Management Is Too Expensive At All LayersExpensive At All Layers

Block levelBlock levelDaily IssuesDaily Issues

Pro-active versus re-active fault managementPro-active versus re-active fault management

Adding/removing disksAdding/removing disks

Managing the boot volumeManaging the boot volume

Capacity planningCapacity planningTension between DAS initial cost of ownership and SAN total cost of ownershipTension between DAS initial cost of ownership and SAN total cost of ownership

File LevelFile LevelBackup and recoveryBackup and recovery

QuotasQuotas

Security managementSecurity management

System LevelSystem LevelManaging a distributed environmentManaging a distributed environment

Managing storage consolidationManaging storage consolidation

System errors which map to storage errors (chkdsk,etc.)System errors which map to storage errors (chkdsk,etc.)

Enterprise Deployment ModelsEnterprise Deployment Models

Server in the HubServer in the HubHeadquarters or other central locationHeadquarters or other central location

Highly skilled/specialized IT staffHighly skilled/specialized IT staff

Provides shared, cross-org infrastructureProvides shared, cross-org infrastructure

Network is lower latency, higher throughputNetwork is lower latency, higher throughput

Server in the BranchServer in the BranchGeographically distinct from hub Geographically distinct from hub location, relatively small location, relatively small

Minimal IT staffMinimal IT staff

Infrastructure dedicated to Infrastructure dedicated to single locationsingle location

Network is much higher latency, Network is much higher latency, lower throughputlower throughput

Enterprise Desktop Enterprise Desktop (out-of-scope for this track)(out-of-scope for this track)

Consolidation – Branch To HubConsolidation – Branch To Hub

Server consolidation focus is shifting to branch Server consolidation focus is shifting to branch server consolidationserver consolidation

Choices are less obvious – TCO gains come with trade-offsChoices are less obvious – TCO gains come with trade-offs

Servers in branch sites?Servers in branch sites?Servers in central sites?Servers in central sites?

Lower server management costsLower server management costs

WANs decrease branch productivityWANs decrease branch productivityMany application not tuned for lower Many application not tuned for lower bandwidth, higher latency, availabilitybandwidth, higher latency, availabilityof WANof WAN

oror

Higher server management costsHigher server management costsBackup, recovery, repair, etc…Backup, recovery, repair, etc…

Increases branch productivity/autonomyIncreases branch productivity/autonomy

Branch Business ImpactBranch Business Impact

Branch impact on servers and storageBranch impact on servers and storage25% of all servers are in branches (nearly25% of all servers are in branches (nearly50% in organizations with multiple locations!)50% in organizations with multiple locations!)

30% of businesses have branches30% of businesses have branches

33% of IT budgets are consumed by Branches33% of IT budgets are consumed by Branches

55% of larger organizations’ (1000+ employees) 55% of larger organizations’ (1000+ employees) headcount located in branch sitesheadcount located in branch sites

Larger organizations (1000+ employees)Larger organizations (1000+ employees)spent U.S. $25B on WANs in 2003spent U.S. $25B on WANs in 2003

HoweverHoweverTraditional market trackers don’t track branch Traditional market trackers don’t track branch contributions to storagecontributions to storage

Sources: Harte-Hanks 2004, AMI Partners 2003Sources: Harte-Hanks 2004, AMI Partners 2003

Storage VisionStorage Vision

Universal Distributed StorageUniversal Distributed Storage

Universal Distributed StorageUniversal Distributed Storage

UniversalIndustry-standard hardware

Mainstreaming high-end technology

Rich partner ecosystem

DistributedUbiquitous and always accessible

Datacenter, departments and branch offices

DAS, NAS, SAN, CAS

Universal Distributed StorageUniversal Distributed StorageA standards based platform with strong partnershipsA standards based platform with strong partnerships

Industry-standard hardware and interfacesIndustry-standard hardware and interfacesStrong support for evolving Strong support for evolving hardware standardshardware standards

INCITS T10 – SASINCITS T10 – SAS

INCITS T11 – Fibre Channel, SM-HBA, FC-HBAINCITS T11 – Fibre Channel, SM-HBA, FC-HBA

INCITS T13 – SATA INCITS T13 – SATA

New interfacesNew interfacesIETF – iSCSI, iSNSIETF – iSCSI, iSNS

SNIA – Fixed Content Addressable Storage (FCAS), SMI-SSNIA – Fixed Content Addressable Storage (FCAS), SMI-S

DMTF – WS-ManagementDMTF – WS-Management

NFS as a first tier file systemNFS as a first tier file system

Mainstreaming high-end technologyMainstreaming high-end technologyToday: MPIO, Snapshots, iSCSI target, Storage Explorer, SISToday: MPIO, Snapshots, iSCSI target, Storage Explorer, SIS

Tomorrow: Transactions, Fixed Content StorageTomorrow: Transactions, Fixed Content Storage

Rich partner ecosystemRich partner ecosystem

Rich Partner Eco-SystemRich Partner Eco-SystemSome of our valued partners in storageSome of our valued partners in storage

Storage Servers

SAN Interconnects

Storage Arrays

Universal Distributed StorageUniversal Distributed StorageBeyond file data – DAS, NAS, SAN, CASBeyond file data – DAS, NAS, SAN, CAS

Storage Fabric as easy to deploy as file sharesStorage Fabric as easy to deploy as file sharesPreferred Storage PlatformPreferred Storage Platform

Early fault detectionEarly fault detection

Simple SANSimple SANSimple Management for SANS (SMfS)Simple Management for SANS (SMfS)

Web Services Management (WS-Management)Web Services Management (WS-Management)

Diskless BootDiskless Boot

Enhanced application robustness and capabilities Enhanced application robustness and capabilities through new storage semantics through new storage semantics

Transactional File SystemTransactional File System

Common Log File SystemCommon Log File System

Fixed Content Storage (Content Addressable Storage)Fixed Content Storage (Content Addressable Storage)

Universal Distributed StorageUniversal Distributed StorageBeyond file data – TransactionsBeyond file data – Transactions

Transacted File System – Enables more Transacted File System – Enables more robust application behavior for complex robust application behavior for complex operations – examplesoperations – examples

Registry updatesRegistry updatesUpdates to multiple files on the same volumeUpdates to multiple files on the same volumeUpdates to multiple files across multiple volumesUpdates to multiple files across multiple volumesUpdates to multiple local and remote filesUpdates to multiple local and remote files

Transacted PlatformTransacted PlatformCommon Log File SystemCommon Log File SystemFilter ManagerFilter ManagerKernel Transaction ManagerKernel Transaction Manager

Universal Distributed StorageUniversal Distributed StorageUbiquitous and always accessibleUbiquitous and always accessible

Reliable and ScalableReliable and ScalableMulti-pathing fail-over and load balancingMulti-pathing fail-over and load balancing

Single Instance Store (SIS)Single Instance Store (SIS)

Self healing NTFSSelf healing NTFS

Symbolic LinksSymbolic Links

Volume ManagerVolume ManagerLarge sector drivesLarge sector drives

LUN/Volume ShrinkLUN/Volume Shrink

Easy integration into Unix environmentsEasy integration into Unix environmentsServices For Unix (SFU) is now part of the OSServices For Unix (SFU) is now part of the OS

Easy backup and recoveryEasy backup and recoverySnapshotsSnapshots

Data Protection ManagerData Protection Manager

Universal Distributed StorageUniversal Distributed StorageInnovation for the branch officeInnovation for the branch office

Better replication – reduction of WAN bandwidth Better replication – reduction of WAN bandwidth DFS-Replication – differential compression DFS-Replication – differential compression

New improvements in SYSVOL and on-demand replicationNew improvements in SYSVOL and on-demand replication

Improved performanceImproved performanceSMB 2.0SMB 2.0

Client Side Cache (CSC) improvementsClient Side Cache (CSC) improvements

Filecopy performanceFilecopy performance

Improved security within the branchImproved security within the branchSecure StartupSecure Startup

Read-Only DCRead-Only DC

Easier to deployEasier to deployAppliance: Full-featured branch office SKUAppliance: Full-featured branch office SKU

OptionalDisposableReplaceable

Continuity ofServices

ServiceAccelerator

Branch Office VisionBranch Office Vision

Clients failover to a central serverClients failover to a central server

Service cacheService cache

Easy to re-provision replacements Easy to re-provision replacements

State-of-the-art compressionState-of-the-art compression

Limits bandwidth usageLimits bandwidth usage

Mitigates WAN latencyMitigates WAN latency

Local request handlingLocal request handling

Store-and-forward Store-and-forward to central serverto central server

A simple, self-healing, self diagnosing, “admin-free” serverA simple, self-healing, self diagnosing, “admin-free” server

Windows Server 2003 R2Windows Server 2003 R2Performance improvementsPerformance improvements

NFS version 3 Spec SFS97*NFS version 3 Spec SFS97*UDP 23064 (prior Windows Server 2003 best UDP 23064 (prior Windows Server 2003 best was 13319)was 13319)

TCP 22416 (prior Windows Server 2003 best TCP 22416 (prior Windows Server 2003 best was 9209)was 9209)

*Based on HP hardware. *Based on HP hardware. See See http://www.spec.org for full information

Remote Differential Compression (RDC)Remote Differential Compression (RDC)

New protocol that identifies sub-file changesNew protocol that identifies sub-file changesUpdates to objects: Efficiently detects insertions, removals, re-arrangements of data in filesUpdates to objects: Efficiently detects insertions, removals, re-arrangements of data in filesNew objects: Efficiently discovers and re-uses relevant pieces of object on receiving machineNew objects: Efficiently discovers and re-uses relevant pieces of object on receiving machineDramatic reduction in bandwidth consumptionDramatic reduction in bandwidth consumption

Generalized technique – completely file type agnosticGeneralized technique – completely file type agnostic

409400

350300250200150100500

292

924130311715133

450

.VSD318 K

.DOC489 K

.DOC2.6 M

.MPP241K

.PPT594K

.XLS2.4M

.ZIP348K

.HTM425K

.PPT3.9M

.PST293M

Longhorn and Vista Beta 2 Longhorn and Vista Beta 2 Status: Status: Remote Filesystem PerfRemote Filesystem Perf

Current Vista & Longhorn improvements:Current Vista & Longhorn improvements:SMB 2.0 protocol has pipelined transfersSMB 2.0 protocol has pipelined transfersCopyfileEx pipeliningCopyfileEx pipeliningCache manager and memory manager deferred writesCache manager and memory manager deferred writesTCP receive window auto-tuningTCP receive window auto-tuning

Future improvements: small file workloadsFuture improvements: small file workloadsBenchmark details Benchmark details

Data presented today is just a status reportData presented today is just a status reportXcopy used to move the dataXcopy used to move the dataHi-Perf client and server disks (10K RPM, RAID)Hi-Perf client and server disks (10K RPM, RAID)Vista build 5306 and 5294Vista build 5306 and 5294WAN latency is emulated on a 1 gigabit EthernetWAN latency is emulated on a 1 gigabit Ethernet

Filecopy and SMB 2.0 PerformanceFilecopy and SMB 2.0 Performance

HubHub(LAN)(LAN)

BranchBranch(100 ms WAN)(100 ms WAN)

SMB 1 on Win2k3 SP1 vs. SMB 2 on Vista100ms RTT WAN, Single File

0

50

100

150

200

250

0.26 1 4 16 32 64 100 1000

Size of Data Transferred (MBytes)

Do

wn

load

Ban

dw

idth

(M

bit

s/se

c)

0

50

100

150

200

250

Up

load

Ban

dw

idth

(M

bit

s/se

c)

Download - SMB1, BuffCopyfile, win2k3

Download - SMB2, UnbuffCopyFile, LH SRV

Upload - SMB1, BufCopyFile, Win2k3

Upload - SMB2, UnbuffCopyfile, LH SRV

SMB 1 on Win2k3 SP1 vs. SMB 2 on Vista1 gigabit LAN, Single file

0

100

200

300

400

500

600

700

Size of Data Transferred (Mbytes)

Do

wn

load

Ban

dw

idth

(M

bit

s/se

c)

0

100

200

300

400

500

600

700

Up

load

Ban

dw

idth

(M

bit

s/se

c)

Download - SMB 1, BuffCopyfile, win2k3

Download - SMB2, UnbuffCopyFile, LH SRV

Upload - SMB1, BufCopyFile, Win2k3

Upload - SMB2, UnbuffCopyfile, LH SRV

Windows Platform And SolutionsWindows Platform And SolutionsWinHEC contentWinHEC content

Physical Disk

Volume

Files and Folders

Network andDistribution DFS NamespacesDFS Namespaces

DFS Replication DFS Replication Offline FilesOffline Files

SMfS, Storage ExplorerSMfS, Storage Explorer Volume ManagerVolume Manager S/W iSCSI Target/Initiator S/W iSCSI Target/Initiator

Server Backup, DPMServer Backup, DPM FSRMFSRM SISSIS Disk DefragmenterDisk Defragmenter BitLockerBitLocker

VDS & SMI-S VDS & SMI-S VSS VSS

Storage Fabrics Storage Fabrics Optical Platform Optical Platform

New H/W Support New H/W Support

Self-healing andSelf-healing and Transactional Transactional

NTFS NTFS Common LogCommon Log

SMB 2.0 SMB 2.0 NFSNFS

Storage Storage TrackTrack

Business Business TrackTrack

SystemSystemTrackTrack

File Server RoleFile Server RoleIntegratedIntegrated UX UX

Text LegendText Legend

Platform TechnologiesPlatform Technologies Solution TechnologiesSolution Technologies

Storage At WinHECStorage At WinHEC

Storage TrackStorage TrackWindows Storage Directions – Overview of Storage Track at WinHECWindows Storage Directions – Overview of Storage Track at WinHEC

Storage Area NetworksStorage Area NetworksWindows SAN: Resolving Technical Barriers to Adoption and DeploymentWindows SAN: Resolving Technical Barriers to Adoption and Deployment

Enabling Diskless Windows Boot with iSCSIEnabling Diskless Windows Boot with iSCSI

GeneralGeneralStorage Management DirectionsStorage Management Directions

The Windows Storage Driver Stack in DepthThe Windows Storage Driver Stack in Depth

Windows Vista Storage Support and Logo RequirementsWindows Vista Storage Support and Logo Requirements

Before Terabytes Fail: Disk Reliability in Windows Vista and BeyondBefore Terabytes Fail: Disk Reliability in Windows Vista and Beyond

Business TrackBusiness TrackBackup and Restore in Windows Vista and Windows Server “Longhorn”Backup and Restore in Windows Vista and Windows Server “Longhorn”

System Fundamentals TrackSystem Fundamentals TrackMicrosoft BitLocker™ Drive Encryption: Hardware Enhanced Data ProtectionMicrosoft BitLocker™ Drive Encryption: Hardware Enhanced Data Protection

Enterprise and Server Use of Microsoft BitLocker™ Drive EncryptionEnterprise and Server Use of Microsoft BitLocker™ Drive Encryption

How to Write a Device Driver that Doesn’t Break on Partitioned SystemsHow to Write a Device Driver that Doesn’t Break on Partitioned Systems

Developing for the Windows Hardware Error ArchitectureDeveloping for the Windows Hardware Error Architecture

Interfaces For InnovationInterfaces For Innovation

Interfaces For InnovationInterfaces For Innovation

DFS NamespacesDFS Namespaces DFS Replication DFS Replication Offline FilesOffline Files

File Server RoleFile Server Role Integrated UXIntegrated UX

SMfS, Storage ExplorerSMfS, Storage Explorer Volume ManagerVolume Manager S/W iSCSI Target/Initiator S/W iSCSI Target/Initiator

Server Backup, DPMServer Backup, DPM FSRMFSRM SISSIS Disk DefragmenterDisk Defragmenter BitLockerBitLocker

VDS & SMI-S VDS & SMI-S VSS VSS

Storage Fabrics Storage Fabrics Optical Platform Optical Platform

New H/W Support New H/W Support

Self-healing andSelf-healing and Transactional Transactional

NTFS NTFS Common Log Common Log

RDC RDC

SMB 2.0 SMB 2.0 NFSNFS

Platform TechnologiesPlatform Technologies Solution TechnologiesSolution Technologies

Filter ManagerFilter Manager

Physical Disk

Volume

Files and Folders

Network andDistribution

Storage In Windows SKUsStorage In Windows SKUs

Windows Server 2003 R2Windows Server 2003 R2General purpose serverGeneral purpose server

File Server Resource Manager (FSRM)File Server Resource Manager (FSRM)Quotas, screening, reportingQuotas, screening, reporting

Storage Management for SANSStorage Management for SANS

iSCSI remote bootiSCSI remote boot

VDS 1.1VDS 1.1

NFS is a standard feature, has substantial performance improvementsNFS is a standard feature, has substantial performance improvements

Common Log Filesystem (CLFS)Common Log Filesystem (CLFS)

DFS Replication and ManagementDFS Replication and Management

SharepointSharepoint

Windows Storage Server (WSS) 2003 R2Windows Storage Server (WSS) 2003 R2NAS appliance (OEM only) version of Windows Server R2, plusNAS appliance (OEM only) version of Windows Server R2, plus

Single Instance Store (SIS)Single Instance Store (SIS)

Optimized for file workloadsOptimized for file workloads

Search optimizationsSearch optimizations

Future: Windows Storage Server feature packFuture: Windows Storage Server feature packFunctionality to enable WSS to compete in Data Center class NAS, includingFunctionality to enable WSS to compete in Data Center class NAS, including

iSCSI software targetiSCSI software target

Improved storage management interfacesImproved storage management interfaces

Microsoft Windows:Microsoft Windows:Roadmap For Storage InnovationRoadmap For Storage Innovation

Improved Improved clustering clustering Better load Better load balancingbalancing

SAN SAN connectivityconnectivity

Volume Shadow Volume Shadow Copy Services (VSS)Copy Services (VSS)Virtual Disk Services Virtual Disk Services (VDS)(VDS)Flexible volume Flexible volume mountingmountingMultipath IO Multipath IO SAN BootSAN BootiSCSI (SAN over IP)iSCSI (SAN over IP)Data Protection Data Protection ManagerManagerHBA-APIHBA-API

Storage Manager Storage Manager for SANs (SMfS)for SANs (SMfS)File Server File Server Resource Resource Manager (FSRM)Manager (FSRM)VDS 1.1VDS 1.1iSCSI remote bootiSCSI remote boot

1996 2000 2003 1996 2000 2003 20062006 Longhorn Longhorn

ReliabilityReliability

SAN SAN FriendlyFriendly

SAN SAN IntegrationIntegration

ConnectivityConnectivity VirtualizationVirtualization

SMB 2.0SMB 2.0Self-healing NTFSSelf-healing NTFSFile system transactionsFile system transactionsFilecopy performanceFilecopy performanceVolume based encryptionVolume based encryptionClient Side CacheClient Side CacheDFS improvements DFS improvements (replication, namespace)(replication, namespace)Storage ExplorerStorage ExplorerServer BackupServer BackupIPv6 storage fabricsIPv6 storage fabricsiSCSI targetiSCSI target

Call To ActionCall To Action

Understand, support, and take advantage Understand, support, and take advantage of storage enhancements coming in Vistaof storage enhancements coming in Vista

Look for synergy between your future Look for synergy between your future plans for storage device product and plans for storage device product and feature development and Microsoft’s feature development and Microsoft’s key areas for investmentkey areas for investment

Additional ResourcesAdditional Resources

Web ResourcesWeb ResourcesDMTF Specs: DMTF Specs: http://http://www.dmtf.orgwww.dmtf.org

WS-Management WS-Management http://msdn.microsoft.com/library/default.asp?url=/library/en-us/http://msdn.microsoft.com/library/default.asp?url=/library/en-us/dnglobspec/html/wsmgmtspecindex.aspdnglobspec/html/wsmgmtspecindex.asp

SMI-S: SMI-S: http://http://www.snia.org/smi/tech_activities/smi_spec_pr/specwww.snia.org/smi/tech_activities/smi_spec_pr/specLook for the 1.2 specification when it’s releasedLook for the 1.2 specification when it’s released

Windows Server 2003 R2 Storage FeaturesWindows Server 2003 R2 Storage Featureshttp://www.microsoft.com/windowsserver2003/R2/storage/default.http://www.microsoft.com/windowsserver2003/R2/storage/default.mspxmspx

Email for information:Email for information: ws-store @ microsoft.comws-store @ microsoft.com

© 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions,

it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.