Upload
ethershark1636
View
219
Download
0
Embed Size (px)
Citation preview
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 1/57
1
www.hp.com
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 2/57
Top 10 Considerations for Maximized
Storage Security, Performance, andScalability
Welcome
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 3/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 4/57
Storage is not
an afterthought.
Storage is thought.
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 5/57
• The cloud is storage• Google is storage• Amazon is storage• YouTube is storage
What is storage?
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 6/57
• 490 million unique visitors• 2.9 billion hours spent on the site each month
24 hours of videouploaded each minute
YouTube is storage
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 7/57
• The cloud is storage• Google is storage• Amazon is storage• YouTube is storage• Facebook is storage
What is storage?
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 8/57
• The cloud is storage• Google is storage• Amazon is storage• YouTube is storage• Facebook is storage• Twitter is not storage
Twitter is flow
• eBay is not storage eBay is transactions
What is storage?
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 9/57
• 600 million users• Each user shares 90 items of content per month• 9.3 billion hours spent on the site each month• 50 billion photos• Hundreds of millions of requests per second• 130 terabytes of logs each day
2 trillion objects cached
Facebook is storage
SOURCE: Robert Johnson,
Facebook Director of Engineering
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 10/57
• A megabyte? A gigabyte? A terabyte?• What about a petabyte? Or an exabyte?• What the @&#% is an exabyte?• 1 quintillion bytes• 1 billion billion bytes (that’s 1B x 1B bytes!)• What does that even mean?
How much storage do we really need?
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 11/57
• Eight bits• One character• If data were money, what
would it buy you?• Let’s say each byte is
worth a penny
One byte0 1 0 0 0 0 0 1
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 12/57
• 140 characters(or 140 bytes)
One “tweet”
Let’s say a tweet is worth
140 pennies ($1.40)
Image courtesy CBS News
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 13/57
• 1,000 bytes• A few paragraphs of text
One kilobyte
Let’s say a kilobyte is worth1,000 pennies ($10)
Image courtesy Subway
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 14/57
Data multipliers
• For those curious, I went a bit nuts checking if bytemultipliers were 1024x the previous level or 1000x.
• Every source I found, including Google’s Chief Economist, Hal Varian, said it was 1000x.
• Hard drives makers, however, often like to use the1024x multiplier
• Which brings us to megabytes…
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 15/57
• 1,000 kilobytes• A photograph or about
30 seconds of an MP3
One megabyte
Let’s say a megabyte is worth1M pennies ($10,000)
MP3 image courtesy ZDNet
1998 Toyota Camry image courtesy eBay MotorsHandsome dude in shades image courtesy your esteemed speaker
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 16/57
Fundamental transition in data use
First Last Phone Street City State ZIP
Item # Name Desc Dept QTY Cost Price
From field-based data
Even as the per-terabyte price forstorage has been dropping
regularly over the past few years,
the demand for more and morecapacity has been increasing at a
ferocious pace. More powerfulprocessors, larger addressable
RAM address spaces, andvirtualized and parallel systems
have wildly expanded the scope ofwhat’s possible for many of the
most ambitious enterprise-level ITand research projects.
And text-based data to…
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 17/57
Unstructured media is the new dataWeb Pages Reports Photographs Digital Books Music and audio
Videos Television Movies
George Clinton image courtesy CBS News
How to Train Your Dragon courtesy ParamountOther images courtesy CBS Interactive and that speaker guy
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 18/57
Field data vs. media data
• This webcast will require about 200MB of storage
• Typical name and address record is 128 bytes
First
Last
Phone
Street
City
State
ZIP
One of these1.5 million
of these
vs.
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 19/57
Field data vs. media data
Media type Storage required Approx. # address records
Address record 128 bytes 1
Facebook photo 1MB 7,000
MP3 track 3.5 MB 27,000
This webcast 200 MB 1.5 million
DVD movie 4 GB 31 million
Blu-ray movie 20 GB 156 million
In the storage space required for one Blu-ray movie,
you could store name and address datafor every working American
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 20/57
• 1,000 megabytes• A TV show episode
One gigabyte
Let’s say a gigabyte is worth 1billion pennies ($10 million)
Hawaii Five-O courtesy CBS
Maryland estate image courtesy Zillow.com
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 21/57
Media vs. text
• Each second of HD video requires more than 2,000
times more data storage than a page of text
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 22/57
• 1,000 gigabytes
• About 120 DVDsor about 20 Blu-rays
One terabyte
Let’s say a terabyte is worth1 trillion pennies ($10 billion)1/5 Bill Gatesnet worth is $10B
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 23/57
Prediction from 1981
Creative Computing magazine
December 1981, page 6
“The cost for 128 kilobytes will fall belowU$100 in the near future.”
$781,250Disclosure: I was a contributing editor
for Creative Computing at that time.
At that rate, one terabytewould have cost
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 24/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 25/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 26/57
“Put it there”
Image and song title courtesy Paul McCartney Digital Library
• Paul McCartney DigitalLibrary
• Digitizing all images,recordings, music,concerts, videos
• Millions of old tapesstored under hisrecording studio
• Saving this great
resource in digital form
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 27/57
• 1,000 terabytes
• About 20,000 Blu-rays
One petabyte
Let’s say a petabyte is worth
1 quadrillion pennies ($10 trillion)
LoC image courtesy of VisitingDC.com
Maps courtesy CBS News
The Library of Congress hascollected about 235 terabytes
of data. A petabyte is 4x that.
$10 trillionis the entire
GDP of China
and Japan…combined
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 28/57
• 1,000 petabytes
One exabyte
Let’s say an exabyte is worth
1 quintillion pennies ($10 quadrillion)
Book stack image courtesy Flickr user 0olong
$10 quadrillionis 167 times
the totalworld GDP
An exabyte can hold about5x all the printed material
in the world.
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 29/57
We started with one byte, one character, one penny
Name Bytes
Byte 1Kilobyte 1,000
Megabyte 1,000,00
Gigabyte 1,000,000,000
Terabyte 1,000,000,000,000
Petabyte 1,000,000,000,000,000
Exabyte 1,000,000,000,000,000,000
Zettabyte 1,000,000,000,000,000,000,000
Yottabyte 1,000,000,000,000,000,000,000,000
167x
If data were money
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 30/57
How much storage do we need?
• Enterprises stored more than 7 exabytes of new data
on disk drives in 2010
• Consumers stored more than 6 exabytes on PCs andlaptops.
If all words ever spoken by humans weredigitized into text, they'd consume 5 exabytes,
only one exabyte less than what
consumers generate each year.
SOURCES:McKinsey Global Institute
How much information, UC Berkeley, Peter Lyman and Hal Varian
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 31/57
TIPS FOR IMPLEMENTING STORAGE
HANDS-ON
Image courtesy Google’s containerized data center,
Located somewhere in space, somewhere in time
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 32/57
Valuable career opportunity
• U.S. has analytics and informatics staffing shortfall
• Shortage of 140,000 to 190,000 people with deepanalytical skills
• Shortage of 1.5 million managers and analysts toanalyze big data and make decisions based on their
findings
• Learn analytics, statistics, mathematics, decisionanalysis, and data mining
SOURCE: McKinsey Global Institute
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 33/57
Storage is an economic resource
• Storage is not just about the tech
• It is a resource that needs to be managed
• It's a result of a manufacturing process
• It's used as feed into a manufacturing process
• Think of it as another economic raw material• Like oil and corn, it needs to be stored, moved, mixed,
processed, distributed, grown, and cleaned.
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 34/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 35/57
• Scale across many machines
• Rather than breaking code into modulesas a way of scaling, scale horizontally• There are only so many modules
• Be flexible, move fast• Change incrementally
• Measure everything• Remember that 130TB of daily logs?
• Use small, independent teams• Give control to those who are
responsible
How to scale, according to Facebook
SOURCE: Robert Johnson,Facebook Director of Engineering
Prineville Data Center image courtesy Facebook
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 36/57
• Storage• Content and data import• Processing and analysis• Indexing
• Retrieval• Query parsing• Matching against the stored data• Presentation
Don’t forget that higher -level apps are needed
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 37/57
Facebook’s three tiers of servers
SOURCE: Robert Johnson,
Facebook Director of Engineering
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 38/57
New storage demands among consumers
• In 2010, more than 4 billion people used mobile phones
• 480 million people have smartphones – Growing at 20% per year
• If the average low-end smartphone has 8GB storage – That’s 3.85 exabytes across all smartphones
– Next year, add another 768 petabytes
• Much of this will need to be mirrored in the cloud
• There’s a sobering preview of data center demand!
SOURCES:McKinsey Global Institute
Wolfram Alpha
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 39/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 40/57
How to be fully storage buzzword compliant
• DAS: Direct-Attached storage
What we’dnormally call
“the drives”
Image courtesy Flickr user S-a-S
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 41/57
How to be fully storage buzzword compliant
• DAS: Direct-Attached storage
• NAS: Network-Attached Storage – Old-school term: file server
– Connected via TCP/IP to network
– Often FreeNAS on an old PC
– Now, “appliances” available that make file storage plug-n-go
O i
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 42/57
David’s home office NAS cluster
20TB
Media& fileserverNAS
20TBMediabackupserverNAS
Videosync
DroboBackup
NAS
All other files sync PCsand
laptops
PCsand
laptops
PCsand
laptops
PCsand
laptops
PCsand
laptops
All files sync
Cloud BackupService
CloudExchange
Server
On premiseOff-site
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 43/57
How to be fully storage buzzword compliant
• DAS: Direct-Attached storage
• NAS: Network-Attached Storage
• SAN: Storage Area network – Enterprise storage solution
– An array of storage devices live on their own network
– That network often acts as a NAS
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 44/57
How to be fully storage buzzword compliant
• DAS: Direct-Attached storage
• NAS: Network-Attached Storage
• SAN: Storage Area network
• SCSI: Small Computer System Interface – Back in the olden days, how drives
attached to Macs
– Parallel interface to drives
– SCSI is also a set of commandsand interfaces still in use today
– Multi-drop (multiple devices chain)
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 45/57
How to be fully storage buzzword compliant
• DAS: Direct-Attached storage
• NAS: Network-Attached Storage
• SAN: Storage Area network
• SCSI: Small Computer System Interface
• SAS: Serial-Attached “Scuzzy” – Point-to-point serial connection instead of parallel
– Single connection only
– Variety of different connector types
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 46/57
How to be fully storage buzzword compliant
• DAS: Direct-Attached storage
• NAS: Network-Attached Storage
• SAN: Storage Area network
• SCSI: Small Computer System Interface
• SAS: Serial-Attached “Scuzzy”• iSCSI: SCSI over Internet protocol – Allows for very long-distance connections over IP
– Core component of many SANs
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 47/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 48/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 49/57
Network-attached storage and clustering
VM1 withclustering
aware OS
VM2 withclustering
aware OS
LUNs
Clusteringaware app
iSCSIInitiator
iSCSIServer
Network
VHD
VHD
VHD
Clusteringaware app
iSCSIInitiator
Best with clustering-aware application
This could be a fullFibre Channel SAN
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 50/57
Consolidated, integrated, converged infrastructure
• Allows all resources to be shared
• Resources can be shared, used as needed
• Resources dynamically reallocated – Storage
– Networking bandwidth – Applications
– Even power and cooling
• Silos become pools
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 51/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 52/57
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 53/57
Final thought
Robert Johnson,
Facebook Director of Engineering
“Seeing something you created be usedby half a billion people is awe inspiring
and humbling.”
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 54/57
Final thought
Robert Johnson,
Facebook Director of Engineering
“Seeing something you created be usedby half a billion people is awe inspiring
and humbling.
Seeing it break is even more humbling.”
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 55/57
Please submit your questions in the field provided atthe bottom of your player console
Questions and Answers
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 56/57
The Top 10 Considerations for
Maximized Storage Security,Performance, and Scalability
Thank you
8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo
http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 57/57
www.hp.com