TSM Symposium 2013: Tivoli Storage Manager: Future Expectations – Vendor Talks
17.-20. September 2013, Hilton Hotel Gendarmenmarkt, Berlin, Germany
IBM Tape Technology and Tape Usage with TSM
© 2012 IBM Corporation© 2013 IBM Corporation
IBM DataProtection & Retention (DP&R)IBM Tape Technology and Tape Usage with TSM
IBM Data Protection&Retention
Storedata
Josef (Sepp) Weingand +49 171 5526783 - [email protected]
Infos / Find me on: http://sepp4backup.blogspot.de/ https://www.xing.com/profile/Josef_Weingandhttp://www.linkedin.com/pub/josef-weingand/2/788/300http://www.facebook.com/josef.weingand http://de.slideshare.net/JosefWeingandhttps://www.xing.com/net/ibmdataprotection
© 2013 IBM Corporation
Why Tape is not dead! - Agenda
Cheap, low TCO– Long lifetime
Green & Cool– Less Power and cooling
High capacity– Needs less floorspace– Compression included
Fast
Secure– Offline – Bit error rate are better than disk
Portable
Roadmap – Future growth
Enterprise Strategy Group: - Most Enterprises utilize a combination of Physical Tape & Disk for Back-up & Restore
– More large enterprise users have Tape & Disc installations than Midmarket
– Tape-only clients: One-third more midmarket users than large enterprise
Gartner – Confirms that most clients use disk & tape for backup and restore
© 2013 IBM Corporation
Tape Comes Full Circle At EMC World
Storage Switzerland blog, May 2012
Tape completed its journey back to ‘relevance’ at EMC World 2012. In truth its relevance has really never been lost to the data center…..
Why is EMC Embracing Tape in 2012?
…enterprise customers never stopped using tape or thought of it as irrelevant……disk as a way to augment tape, not replace it.
…..Even those who bent on replacing tape discovered that the sheer economic advantages of tape are not easy to dismiss. And, our checks with the EMC field support this turn of events.
…only real alternative for large data sets …..
….. surprise is the number of mid-range tape libraries sold to the mid-sized segment of EMC’s customer base.
…Tape is Reliable…Tape is Fast….the longer or larger the restore job, the more significant tape’s restore advantage will become.
Tape is Archivable….
EMC has learned that customers need tape to fight the battle with data growth and maintain protection of data assets…..
….EMC’s Big Advantage - It Focuses on Customer Nee
© 2013 IBM Corporation
This report is not about whether disk costs more than tape, or not; it is about having the right mix of disk and tape …, taking advantage of the strengths of both, i.e., the low-cost, high-capacity of tape and the rapid response of disk.
Regardless, for large quantities of data, tape always is much less expensive than disk and always uses much less energy and floor space, when measured on a per-petabyte ba-sis. Tape should be used whenever its some-what slower retrieval times are acceptable.
Source: http://www.lto.org/pdf/Clipper_Group-Long-Term_Storage-TCO_Analysis_of_Tape_and_Disk-May_13_2013.pdf
© 2013 IBM Corporation
Cost
Comparing DCS3700 with TS3500/LTO6
Capacity– DCS3700: 4U, 60 x 4 TB NL SAS -> Raid6= 192 TB
• 19“ Rack: 10 x DCS3700 -> 1,9 PB• 3,1 PB/m²
– TS3500 HD Frame: 1320 x 2,5 TB -> 3,3 PB• 3,7 PB/m²• With 2,5:1 Compression -> 8,2 PB• 9,1 PB/m²
– Save floor space with Tape!
Purchase €/TB– TS3500 with 12 LTO6 Drives : DCS3700 = 1:3– With Compression = 1:7
Maintenance – 1:2,6 with Compression 1:6,5
Power– 19“ Rack with DCS3700 -> 8,2 kW – 4,3 W/TB– TS3500 with 12 LTO6 -> 0,3 kW – 0,03 W/TB– Difference per Year: 7400 €/PB
Renewal / Technology Upgrade Cost– Whole Disk System needs to be replaced every 3-5 year– Only Tape Drives and maybe Cartridges needs to be replaced
• Tape Library can be used for many years (> 10 Years)
– => 1:10 – with Compression 1:27• Replacement cost with disk are at least 10 times higher than with tape!!
© 2013 IBM Corporation
Substantial Cost Advantage Tape vs. Disk through 2015
0
2
4
6
8
10
12
14
16
10 yr Archive(Clipper Gp)
5 yr Backup(ESG Study)
TCO Comparison
Disk Tape
$/GB for Storage Media1.E-03
1.E-02
1.E-01
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1990 1995 2000 2005 2010 2015Year
$/G
Byte
DRAM
NAND
HDD 2002 estimated CAGR
Tape
Credit Suisse 2008 Study
Grochowski 2003IDC 08
HDD History
Tape
Tape’s cost advantage over disk also contributes to a signification TCO advantage
© 2013 IBM Corporation 8
CPU Performance 8-10x
DRAM Performance 7-9x
Network 100x
Bus Performance 20x
Disk Drive Performance 1-2x
Tape Drive Performance 7-8x
Native Transfer Rate / MB/sec
0
50
100
150
200
250
300
1994 1996 1998 2000 2002 2004 2006 2008 2010 2012
MB
/sec Tape
Disk
History
© 2013 IBM Corporation
Tape is fast
Max single Stream Performance:–TS1140: 251 MB/sec – max 650 MB/sec–LTO6: 160 MB/sec – max 645 MB/sec–SAS 15k Raid5 (8+1) ~260 MB/sec–NL SAS 7,2k Raid6 (8+2) ~85 MB/sec–DeDup / ProtecTier ~150 MB/sec
Scalability of single Stream–Tape: needs more tape drive, but scales linear
•10 TS1140 could deliver 10 x 650 MB/sec–Disk/VTL/DeDup: scales easily, but throughput per stream is shrinking
Backup-/ Restoretime
0
20
40
60
80
100
120
140
0,1 10 1000 2000 5000 10000 20000 30000 40000 50000
File size in MB
sec
Tape
Disk/VTL
Performance Disk vs Tape
0
1000
2000
3000
4000
5000
6000
1 2 3 4 8 12 16 32 64
Number of parallel streams
0
50
100
150
200
250
300
Tape Single Stream
Disk Single Stream
Disk Throughput
Tape Throughput
© 2013 IBM Corporation
Basic Tape Recording Technology Data is recorded in linear serpentine order down
and back on the tape in groups of 16/32 channels/tracks at a time (called data wraps)
– LTO 16 tracks, TS1140 32 tracks– A tape head consists of 16 / 32 read/write heads elements – To fill a tape several wraps are needed
• TS1140: 40 Wraps, LTO6:
In order to position the head several Servo tracks are on the tape
Shingling writing technology is used
Two different ECC are used (like Raid6 on tape)
Data are verified after they are written to tape (read after write verification)
– There is always a read head behind a write head
16 Read / Write Heads2 Servo
Heads
14 different lateral offsets
Servo Band
© 2013 IBM Corporation
Servo Technology
Timing Based Servo
Encoding a ZERO
© 2013 IBM Corporation
Shingling –
Servo BandGeneration n-1 Generation n
Read Head
© 2013 IBM Corporation
Tape is secure
© 2013 IBM Corporation
Data layout on tape with deep interleaving
0Track 0
16
2
18
4
1
17
3
19
5
10
26
12
28
14
11
27
13
29
15
20
6
22
8
24
21
7
23
9
25
30
0
16
2
18
31
1
17
3
19
10
26
12
28
14
11
27
13
29
15
4
20
6
22
8
5
21
7
23
9
4
2
3
1
30 31 24 25
8
6
7
5
12
10
11
9
14
15
13
4
20
6
22
8
5
21
7
23
9
14
30
0
16
2
15
31
1
17
3
24
10
26
12
28
25
11
27
13
29
18
4
20
6
22
19
5
21
7
23
14
30
0
16
2
15
31
1
17
3
8
24
10
26
12
9
25
11
27
13
18 19 28 29
…
…
One Row
Sub Data Set #2
One Row
One Row
Along Tape
11 mm
2 dead tracks
stripe error
media defect
29
13
31
15
17
1
19
3
21
5
23
7
25
9
27
11
…
…
Acr
oss
Tap
e
One row from sub data set 30
The drive can tolerate strip errors of 11 mm length across tape
Bit error rate on tape is better than on disk– You can write 10PB – 1 EB more data on tape than disk
The drive can read Data Sets with2 entirely DEAD tracks out of 16
© 2013 IBM Corporation
http://gmailblog.blogspot.com/2011/02/gmail-back-soon-for-everyone.html…. I know what some of you are thinking: how could this happen if we have multiple copies of your data, in multiple data centers? Well, in some rare instances software bugs can affect several copies of the data. That’s what happened here. Some copies of mail were deleted, and we’ve been hard at work over the last 30 hours getting it back for the people affected by this issue.
To protect your information from these unusual bugs, we also back it up to tape. Since the tapes are offline, they’re protected from such software bugs. But restoring data from them also takes longer than transferring your requests to another data center, which is why it’s taken us hours to get the email back instead of milliseconds.
So what caused this problem? We released a storage software update that introduced the unexpected bug, which caused 0.02% of Gmail users to temporarily lose access to their email. When we discovered the problem, we immediately stopped the deployment of the new software and reverted to the old version.
Feb 2011: Google restore gmail from
tape
Hard Lessons Learned
Tape is „last line of defense“!
•Tape is offline Medium•Can‘t be delted
© 2013 IBM Corporation
„The Backup Song“
Yesterday,All those backups seemed a waste of pay.Now my database has gone away.Oh I believe in yesterday.Suddenly,There's not half the files there used to be,And there's a milestone hanging over meThe system crashed so suddenly.
I pushed something wrongWhat it was I could not say.
Now all my data's goneand I long for yesterday-ay-ay-ay.
Yesterday,The need for back-ups seemed so far away.I knew my data was all here to stay,Now I believe in yesterday.
http://www.youtube.com/watch?v=rpdiXspBALg
© 2013 IBM Corporation
Tape Technology Development
35 TB demonstration done in Jan 2011
Working on 125 TB demonstration
© 2013 IBM Corporation
© 2013 IBM Corporation
Take a look at the Bits …
(Today LTO5 )
Future TAPE200 nm x 32 nm100 Gbit/in2
Demo 2010
Tape has most potential to scale out in capacity* assuming current tape technology
© 2013 IBM Corporation
INSIC Roadmap
© 2013 IBM Corporation
© 2013 IBM Corporation
Summary of Tape Technology
Tape has a sustainable roadmap for at least another decade– 29.5 Gbit/in2 areal density demonstration shows feasibility of multiple future tape
generations
INSIC roadmap has been extended to 2022 with a predicted native cartridge capacity of 128TB
Potential for scaling tape beyond 29.5 Gb/in2 towards 100Gb/in2 and beyond
Tape has a bright future!
© 2013 IBM Corporation
Tape – yes, but how…?
Over 80%
consider tape an integral part of their backup processSource: Enterprise Strategy Group Research Report, 2010 Data Protection Trends, April 2010
„One fits all“ can not full fill all Requirements
Establish backup & restore policies by type of data– Critical data– Important application data– Data with business value
Use combination of disk & tape to balance RPO / RTO, costs
Protect data against logical corruption, physical destruction, unauthorized access
– Maintain multiple copies, geographically separated– Use different types of media
• Only the combination of different Backup-Method guarantees Security, Performance and EfficiencySecurity, Performance and Efficiency!
© 2013 IBM Corporation
Disk
TAPE DISK Disk/VTL
IBM DP&A: Smarter Backup Solution
LAN
SAN
SAN Disk
NAS
Disaster Recovery –
3. Location
CopyCopy
DB2
MoveMove
T0 CopyT0 Copy
Disk
Backup Storage
Data Classes
© 2013 IBM Corporation 25
Infos / Find me on: http://sepp4backup.blogspot.de/https://www.xing.com/profile/Josef_Weingandhttp://www.linkedin.com/pub/josef-weingand/2/788/300http://www.facebook.com/josef.weingand
© 2013 IBM Corporation 26
© 2013 IBM Corporation
Disclaimers
The performance data contained herein was obtained in a controlled environment based on the use of specific data. Actual results that may be obtained in other operating environments may vary significantly. These values do not constitute a guarantee of performance.
Product data is accurate as of initial publication and is subject to change without notice.
No part of this presentation may be reproduced or transmitted in any form without written permission from IBM Corporation.
References in this document to IBM products, programs, or services do not imply that IBM intends to make these available in all countries in which IBM operates. Any reference to an IBM program product in this document is not intended to state or imply that only IBM's program product may be used. Any functionally equivalent program may be used instead.
The information provided in this document has not been submitted to any formal IBM test and is distributed "As Is" basis without any warranty either express or implied. The use of this information or the implementation of any of these techniques is a customer responsibility and depends on the customer's ability to evaluate and integrate them into their operating environment. While each item may have been reviewed by IBM for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. Customers attempting to adapt these techniques to their own environments do so at their own risk.
© 2013 IBM Corporation
Trademarks
The following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both.
IBM, S/390, ES/3090, ES/9000, AS/400, RS/6000, MVS/ESA, OS/390, VM/ESA, VSE, TPF, OS/2, OS/400, AIX, DFSMS/MVS, DFSMS/VM, ADSTAR Distributed Storage Manager, DFSMSdfp, DFSMSdss, DFSMShsm, DFSMSrmm, FICON, ESCON, Magstar, Seascape
Other company, product, and service names mentioned may be trademarks or registered trademarks of their respective companies.
Windows NT is a registered trademark of Microsoft Corporation.