Upload
hannah-woods
View
218
Download
2
Embed Size (px)
Citation preview
© 2009 EMC Corporation. All rights reserved.
Storage VirtualizationStorage Virtualization
Module 2.6
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 2
Module Objectives
Upon completion of this module, you will be able to:
Identify different virtualization technologies
Describe block-level virtualization technologies
Describe file-level virtualization technologies
Discuss virtual provisioning
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 3
Lesson –Virtualization Overview
Upon completion of this lesson, you will be able to:
Identify and discuss virtualization technologies
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 4
What is Virtualization
Virtualization is a technique of abstracting physical resources in to logical view
Increases utilization and capability of IT resource
Simplifies resource management by pooling and sharing resources
Significantly reduce downtime– Planned and unplanned
Improved performance of IT resources
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 5
Virtualization Comes in Many Forms
5
Each application sees its own logical memory, independent of physical memory
Virtual Memory
Each application sees its own logical network, independent of physical network
Virtual Networks
Each application sees its own logical server, independent of physical servers
Virtual Servers
Each application sees its own logical storage, independent of physical storage
Virtual Storage
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 6 6
Each application sees its own logical memory, independent of physical memory
Virtual Memory
Memory Virtualization
Benefits of Virtual Memory•Remove physical-memory limits•Run multiple applications at once
Physical memory
Swap space
App
App
App
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 7 7
Each application sees its own logical network, independent of physical network
Virtual Networks
Network Virtualization
Benefits of Virtual Networks•Common network links with access-control properties of separate links
•Manage logical networks instead of physical networks
•Virtual SANs provide similar benefits for storage-area networks
VLAN A VLAN B VLAN C
VLAN trunkSwitch
Switch
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 8
Server Virtualization
Before Server Virtualization:
Operating system
Application
Single operating system image per machine
Software and hardware tightly coupled
Running multiple applications on same machine often creates conflict
Underutilized resources
After Server Virtualization:
Virtual Machines (VMs) break dependencies between operating system and hardware
Manage operating system and application as single unit by encapsulating them into VMs
Strong fault and security isolation
Hardware-independent
Virtualization layer
Operating system
App App App
Operating system
App App App
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 9
Storage Virtualization Process of presenting a logical view
of physical storage resources to hosts
Logical storage appears and behaves as physical storage directly connected to host
Examples of storage virtualization are:
– Host-based volume management
– LUN creation
– Tape virtualization
Benefits of storage virtualization:– Increased storage utilization
– Adding or deleting storage without affecting application’s availability
– Non-disruptive data migration
Virtualization Layer
Heterogeneous Physical Storage
Servers
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 10
Lesson Summary
Key topics covered in this lesson:
Various forms of virtualization– Memory, network, server and storage virtualization
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 11
Lesson – Storage Virtualization Implementation
Upon completion of this lesson, you will be able to:
Discuss SNIA virtualization taxonomy
Describe Block-Level Virtualization technologies and implementation
Describe File Level Virtualization technologies and implementation
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 12
SNIA Storage Virtualization Taxonomy
StorageVirtualization
BlockVirtualization
DiskVirtualization
File System,File/record
Virtualization
Other DeviceVirtualization
Tape, Tape Drive,Tape LibraryVirtualization
NetworkBased Virtualization
Storage Device/StorageSubsystem Virtualization
Host Based Virtualization
In-band Virtualization
Out-of-band Virtualization
What is created
Where it is done
How it is implemented
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 13
Storage Virtualization Requires a Multi-Level Approach
Server
StorageNetwork
Storage
Path management
Volume management
Replication
Volume management - LUNs
Access control
Replication
RAID
Path redirection
Load balancing - ISL trucking
Access control - Zoning
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 14
Storage Virtualization Configuration
(a) In out-of-band implementation, the virtualized environment configuration is stored external to the data path
(b) The in-band implementation places the virtualization function in the data path
Servers
StorageArrays
VirtualizationAppliance
Out-of-Band
(a)
StorageNetwork
Servers
StorageArrays
In-Band
(b)
Storage Network
VirtualizationAppliance
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 15
Storage Virtualization Challenges
Scalability– Ensure storage devices perform appropriate requirements
Functionality– Virtualized environment must provide same or better functionality
– Must continue to leverage existing functionality on arrays
Manageability– Virtualization device breaks end-to-end view of storage infrastructure
– Must integrate existing management tools
Support– Interoperability in multivendor environment
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 16
Block-Level Storage Virtualization
Ties together multiple independent storage arrays– Presented to host as a single
storage device– Mapping used to redirect I/O on
this device to underlying physical arrays
Deployed in a SAN environment
Non-disruptive data mobility and data migration
Enable significant cost and resource optimization
Servers
Heterogeneous Storage Arrays
Virtualization Applied at SAN Level
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 17
File-Level Virtualization
Every NAS device is an independent entity, physically and logically
Underutilized storage resources
Downtime caused by data migrations
NAS Devices/Platforms
Before File-Level Virtualization
IP Network
StorageArray
FileServer
FileServer
Clients Clients
Break dependencies between end-user access and data location
Storage utilization is optimized
Nondisruptive migrations
NAS Devices/Platforms
After File-Level Virtualization
IP Network
Clients Clients
StorageArray
FileServer
FileServer
Virtualization Appliance
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 18
Lesson: Summary
Key points covered in this lesson:
Storage virtualization challenges
Storage virtualization configuration
Types of storage virtualization
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 19
Concept in Practice – EMC Invista
Inside the Intelligent Switch
Mapping
operation
Mapped I/O streams
Host Storage
EMC Invista
Input I/O stream
Intelligent Switches: Fibre Channel switches with custom hardware for enhanced processing
Capable of performing operations on data streams at line speed
Controlled by instructions from external management software (via APIs)
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 20
Invista Video
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 21
Automount
NIS LDAP
DFS
AD
Moving Files Online: A File Virtualization Example
NFS4 Root
NIS LDAP
Global Namespace
Manager
Event Log File Virtualization inserted
into I/O Client redirection
Global Namespace updated
File Virtualization Appliance
DFS
AD
Automount
NIS LDAP
Global Namespace
Manager
NFS4 root
NIS LDAP
File-datamigrationFile-datamigration
Migration complete without down time
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 22
Rainfinity Video
Click here to play the video
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 23
Lesson: Virtual Provisioning
Upon completion of this lesson, you will be able to:
Explain Virtual Provisioning
Describe and explain Thin vs. Traditional LUNs
Explain the benefits of Virtual Provisioning
Explain how to create, monitor, and manage Thin LUNs
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 24
What is Virtual Provisioning
Capacity-on-demand from a shared storage pool– Logical units presented to hosts have more capacity than physically
allocated
– Physical storage is allocated only when the host requires it
– Provisioning decisions not bound by currently available storage
Above and beyond “Thin Provisioning”– Includes management tools that make it easier to configure, use,
monitor and manage Thin Pools and Thin LUNs
AllocatedAllocated Allocated
Host Reported Capacity
Shared Storage Pool
Storage perceived by the application is larger than physically allocated storage
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 25
Traditional Provisioning Virtual Provisioning
Traditional Provisioning vs. Virtual Provisioning
1650 GB Or
1.65 TB Available Capacity
350 GB Actual Data
Storage SystemLUN 1 LUN 2 LUN 3
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 26
Virtual Provisioning – Benefits
Reduce administrative costs– Simplifies storage provisioning– Over-provisioning can eliminate challenges of expansion– Reduces time required to repeatedly add storage capacity
Reduce storage costs– Increased space efficiency for primary storage and replicas– “Storage on demand” from shared storage pool– Deploy assets as needed– Reduce levels of unused physical storage– Avoid pre-allocating physical storage to applications
Reduce operating costs– Fewer disks consume less power, cooling and floor space
Reduce downtime– Less disruptive to applications
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 27
Virtual Provisioning – Thin Pool Expansion
Adding drives to the pool non-disruptively increases available shared capacity for all Thin LUNs in pool– Drives can be added to a Thin Pool while pool is being used in
production
Allocated capacity is reclaimed by the pool when Thin LUNs are deleted– Do not defrag
Additional Disk Drives
“Test & Dev Pool 2”
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 28
Traditional vs. Thin LUNs
Use RAID Groups and traditional LUNs
When microseconds of performance matters
For the best and most predictable performance
For precise data placement
You are not as concerned about space efficiency
Use Virtual Provisioning with Thin Pools and Thin LUNs
When the best space efficiency is needed
For minimal host impact
When energy and capital savings are paramount
For applications where space consumption is difficult to forecast
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 29
Lesson Summary
Key points covered in this module:
Virtual Provisioning
Thin vs. Traditional LUNs
Benefits of Virtual Provisioning
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 30
Module Summary
Key points covered in this module:
Virtualization technologies and forms
SNIA storage virtualization taxonomy
Storage virtualization configuration
Storage virtualization challenges
Types of storage virtualization
Virtual provisioning overview
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 31
Check Your Knowledge
What are the four forms of virtualization?
Difference between in-band and out-of-band implementation.
What are the challenges of storage virtualization?
What is virtual provisioning?
© 2009 EMC Corporation. All rights reserved.
Cloud Storage InfrastructureCloud Storage Infrastructure
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 33
Challenges with Traditional Storage Approach
Not designed to scale in the multi-petabyte – Addition of new arrays for capacity enhancement
Cost and management overhead Increased time to market
Can address transactional and distributed computing – But fell short for Internet Era requirements
– Designed for Operation Within IT’s Walls
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 34
Cloud Storage Infrastructure: The Big Picture
To deal with Internet Era data growth– A massively scalable infrastructure is required
– One that offers global data distribution, self-healing, self-management, and multi-tenancy features
A Cloud approach to storage– A cost effective approach to handling internet era data growth
– Focusing on five key infrastructure requirements Infinite Scale No Boundaries Operationally Efficient Self-Management Self-Healing
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 35
Use of Cloud Computing Resources
“Cloud computing” takes hold as 69% of all internet users have either stored data online or used a web-based software application
Source: “Use of Cloud Computing Applications and Services”, Pew Internet & American Life Project, 9/12/2008
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 36
Defining Cloud Computing
“Cloud Computing is an emerging IT development, deployment and delivery model, enabling real-time delivery of products, services and solutions over the Internet (i.e. enabling cloud services)”
Services include– Software-as-a-Service (SaaS)
– Storage-as-a-Service (Staas)
– Computing-as-a-Service (CaaS)
– Hardware-as-a-Service, Data-as-a-service……
Examples:– Amazon: Elastic Compute Cloud (EC2), Simple Storage Services (S3)
– Google Apps
– Storage Cloud - Decho (Mozy Online Backup), EMC Atmos
– Salesforce.com……
Source: IDC, “Defining “Cloud Services” and “Cloud Computing”, September 2008
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 37
Cloud Services:
In cloud execution – Offsite, provided by third-party
Accessed via Internet – Not bound to corporate/private
network
Minimal/no IT skills to “implement” – Users need not have expertise
Provisioning – Self-requesting
Pricing – Fine-grained & usage-based
pricing capability
User Interface – Simple, not tied to any specific
device/platform
System Interface– Web based standard framework
Shared resources– Shared asset approach
Source: IDC, “Defining “Cloud Services” and “Cloud Computing”, September 2008
© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 38
Cloud Applications
Enterprise Solutions– Transactional data or high performance file sharing applications
Example: Amazon EC2
– Cloud storage infrastructure Example: EMC Atmos
End-user Solutions – Rich Internet applications and online service providers
Examples: Social media sites, Online photo sharing
– Online data backup Example: Mozy online backup