Upload
hui-cheng
View
2.092
Download
0
Tags:
Embed Size (px)
DESCRIPTION
Session about Openstorage with OpenStack by Bradley in the 2012 OpenStack APAC Conference
Citation preview
© Copyright Nexenta 20121
OPENSTORAGE WITH OPENSTACK
BRAD STONEGM,
NEXENTA CHINA
Enterprise Storage
• Storage is 40% of an enterprise IT’s budget• Market leaders are EMC, IBM and NetApp
Enterprise Storage Continues to Grow
Storage Trends
• Commodity components replacing specialized hardware for data storage
• Storage virtualization– Commoditize by abstracting physical attributes
• Global economic downturn putting pressure on capital and energy costs– Motivation to buy newer, more energy-efficient
hardware
“More data will be stored in the next three years than in the previous 40,000”- Berkeley’s School of Management (2010)
New use cases for dataMachine-generated files
Video surveillance
What is OpenStorage?
a) Storage software is open sourceb) No vendor lock-in; components no longer
need to all come from the same vendorc) Open data formatsd) All of the abovee) Some of the above
Top Reasons to use Open Source Software
• Avoid vendor lock-in
• Lower costs
• Competitive advantage
• Improve quality
Brief Biased History of OpenStorage
• 1991: Linux kernel publicly announced• 2004: Google MapReduce paper• 2005: linux-iscsi and open-iscsi projects merge• 2005: OpenSolaris released• 2008: Nexenta ships first commercial product• 2008: Sun FISHworks storage appliance released• 2010: OpenStack Nova released• 2010: OpenStorage Summit features storage software
vendors and commodity hardware• 2013: OpenStorage Summit in China!
NEXENTASTOR: A CASE STUDY FOR OPENSTORAGE
What is NexentaStor?
iSCSI
SAS
FC
AoE
InfiniBand
CIFS
iSCSI NFS
FC
Software-based, unified storage appliance
Leading OpenStorage solution• Runs on standard hardware
Key features:
• 128-bit architecture
• Unlimited file size & snaps
• Synchronous and asynchronous replication (including replication to OpenStack Swift)
Superior storage for virtualized environments
File and Block Access
Nexenta is a private company with an office in Beijing!
Storage Pooling
11
Discover logical disksDetermine RAID requirements
Pool-A Pool-B Create storage pools
Create datasetsAssign properties (e.g. de-dup)Share (NFS, CIFS, iSCSI, FC)
NFS iSCSI CIFS NFS
De-duplication
Block-based
• In-line de-duplication– Verify option
• In-flight de-duplication– No verify option
Existing data can easily be de-duped via NexentaStor’s auto-tier capability
FlexibilityDe-duplication options can vary- Per volume- Per dataset- Per replication service
Compression
• Compression done in-line at time of write• Enabled by default
– Leverages typically idle processing power– Can improve overall I/O performance
• Compresses only if at least 12% benefit• Many algorithms supported
– LZJB for loss-less compression– GZIP 0-9– Extensible
• Compression algorithm can be changed on-the-fly– Affects future writes
Block support
• iSCSI and FibreChannel supported– SCSI multi-pathing supported for each
• Storage efficiency– Compression– Cloning– De-duplication– Thin provisioning
• Support for variable block sizes
Technical AdvantagesDescription Limit
Number of data volumes on a system 264
Maximum size of a data volume 278 bytes
Number of file systems in a data volume 264
Maximum size of a file system 264 bytes
Number of devices in a data volume 264
Number of files in a directory 256
Maximum file size 264 bytes
Number of attributes of a file 248
Maximum size of any attribute 264 bytes
Number of snapshots of a file system 264
15
Self-healing• NexentaStor doesn’t blindly trust the data• Relies on 256-bit checksums on every block• Transparently return only the good data to the user• Use the good data to fix the bad copy
16
X
0100110101
0110110101
Prevents silent data corruption
Self-healing
Data checked beforeit is returned to user
Good copy used to fixthe bad copy of data
Triple-parity RAID• Disk capacities doubling, but disk throughput not increasing at same rate
– Result is longer time to recover from bit errors– More likely that you can be recovering from two bit errors at once– Data can then be at risk during recovery period
NexentaStor provides triple-parity RAID
Available with NexentaStor since 2009
VMDC
18Providing visibility into your VM’s storage usage
Supports:ESXXen ServerHyper-V
Advantages of VMDC:
1. Provides consistent snapshots
2. Alternative is cumbersome:Take snapshot using VMwareThen take snapshot on NexentaStor
3. Cloning is fast!
Supported Storage Protocols:NFSiSCSIFibre Channel
Uses native hypervisor snapshottingfunctions
Healthcare
Finance
Education
Technology
Internet
Media
More
A Broad set of Customers and PartnersCustomers Premier Partners
Cloud Hosting and Telecom
20
in Asia
Cloud services do not require cloud storage
OpenStorage Adoption
2009 2010 2011 2012 2013 2014
Universities
R&D
Hosting, cloud compute, private cloud, virtualization
VDI
Governments
Finance
NEXENTA AND OPENSTACK
Cloud Storage Use Cases
• Storage for cloud applications• File replication of critical data for disaster
recovery• Off-site backup for power and floorspace
benefits in the datacenter• Geographically dispersed teams that need to
write to centralized storage for long-term data access
• Long-term deep data archives
OpenStack Nova
• OpenStack– Open source cloud computing project– Started by Rackspace and NASA– Now more than 150 participating companies
• OpenStack the largest open source cloud community
• OpenStack Nova targets cloud computing– Includes a storage component
Nova Orchestrates Volume Provisioning
• Provisions LUNs• Interacts with storage systems• Assigns volumes to compute nodes• Ensures LUNs are assigned to at most one VM
at a time
Currently only iSCSI is supported by OpenStack Nova (not FibreChannel)
Simplified Nova Architecture
Rabbit MQ
Nova Manage
Nova API
Nova Compute
Nova Network
Nova Schedule
NovaDatabase
Nova VolumeNexentaStor
Nova driver(s)
Volume Controller
/etc/nova/nova.conf
Nova and NexentaStorNova Manage
Nova API
NovaDatabase
Nova VolumeNexentaStor
Nova driver(s)
Volume Controller
/etc/nova/nova.conf2. Lookup in configuration fileto determine which driver to use
3. Driver talks to NexentaStorto create volume4. NexentaStor creates volume
5. Volume Controller updatesdatabase with volume details
1. Request to create a volume
6. Request to attach volume to a VM
Virtual machine
NexentaStor cloning can beused to create a new Novavolume from a snapshot
• Implementation complete and available• Initially tested with OpenStack Diablo release• Only Netapp and Nexenta have provided Nova
storage drivers• Wiki posted:
– http://wiki.openstack.org/NexentaVolumeDriver• Next: Test with Cinder
Nexenta Nova Driver – Project Status
28 Nexenta Systems Inc. CONFIDENTIAL
What is Cloud Storage?
• Provide storage as a service• Treat data as object or chunks• Improves ability to access unstructured data• Files divided into objects and stored across
multiple systems• Defacto standard transports
– Amazon S3, Google Storage, OpenStack Swift
Benefits of Object Storage
• Scalable capacity• Relocation on demand (disaster recovery)• Access data anywhere
Cloud Storage
• OpenStack Swift contributor• OpenStack Swift
– Running Swift on NexentaStor– Technology preview downloadable from Nexenta
website• Contributed Local File System patch to Swift
– Leverage self-healing and advanced RAID of NexentaStor
NexentaStor’s Unified Architecture
HDD SSD FCiSCSI
Block Device Driver
Pooled Storage Layer
Transactional Object Layer
ZFS Volume Emulator ZFS Posix Layer
Dump Swap iSCSI FCRaw CIFSNFSZFS
BLOCK FILE
Unified Appliance
iSCSI, FibreChannel, SAS, AoE
File
Swift Container Server
Swift Account Server
Swift Object Server
Object Storage
Block
Nexenta’s LFS Swift Patch
• Modifies Swift ring builder logic• Allows a file system with Nexenta’s self-
healing to be counted as two replicas• Can save network bandwidth when initially
storing data• Can save network bandwidth by creating
replacement replicas less often
WHERE IS OPENSTORAGE HEADING?
Next Generation Cloud
• Nexenta is active in the cloud storage community
• Defining the next generation of OpenStorage– Enabling exabyte deployments!
• OpenStack Nova will be extending its capability to map generic volumes to iSCSI for guest VMs to access, not just the virtualized boot volume
• Interface between this new Volume service and Nexentastor Appliance should be unchanged
OpenStack Nova Extensions
37 Nexenta Systems Inc. CONFIDENTIAL
THANK YOU!!