Upload
lawson-clapham
View
220
Download
1
Tags:
Embed Size (px)
Citation preview
1© Copyright 2010 EMC Corporation. All rights reserved.
Mel ShumTechnical Marketing EngineerEMC Backup Recovery Systems
EMC Data Protection for Oracle Saving Time and Money
EMC Data Domain
2© Copyright 2010 EMC Corporation. All rights reserved.
Agenda
• Problems many database administrators
face
• Overview of Oracle Recovery Manager
(RMAN) functional components• Key features of EMC Data Domain
deduplication storage systems• Impact of Data Domain deduplication in an
Oracle environment
• Customer examples
• Summary
3© Copyright 2010 EMC Corporation. All rights reserved.
Problems Many Database Administrators FaceToo many for this talk so we’ll focus on just backup and recovery
• Non-stop growth and proliferation
• Backup windows remain approximately the same
• Recovery is just as important and often
overlooked
• Limited online retention
– Increased frequency of recovery for audits,
troubleshooting, updates, etc.
• Archive (aka, ILM) becoming increasingly
important
– Some data must be retained for 5 years, 7 years, forever….
4© Copyright 2010 EMC Corporation. All rights reserved.
RMAN – What Is It?For those in the audience that don’t already know:
• Oracle’s included backup / recovery utility
– Supports full, incremental, and image backups– Retains backup information in the control file
and (optionally) a separate database catalog– Many configuration options to tailor to users’
requirements– Automatically eliminates unused data blocks
from most backups
5© Copyright 2010 EMC Corporation. All rights reserved.
Overview of RMAN Functional Components
RMAN Repository (Control File)
Target Database
6© Copyright 2010 EMC Corporation. All rights reserved.
RMAN Repository (Control File)
Target Database
RMAN Client
Overview of RMAN Functional Components
7© Copyright 2010 EMC Corporation. All rights reserved.
RMAN Repository (Control File)
Target Database
RMAN Client
Disk
Backup
Overview of RMAN Functional Components
8© Copyright 2010 EMC Corporation. All rights reserved.
Third Party Media Managers
MML API
Backup
RMAN Repository (Control File)
Target Database
RMAN Client
Disk
Backup
Overview of RMAN Functional Components
9© Copyright 2010 EMC Corporation. All rights reserved.
Third Party Media Managers
MML API
Backup
RMAN Repository (Control File)
Target Database
RMAN Client
Disk
Backup
Tape
Overview of RMAN Functional Components
10© Copyright 2010 EMC Corporation. All rights reserved.
Third Party Media Managers
MML API
Backup
RMAN Repository (Control File)
Target Database
RMAN Client
Disk
Backup
Recovery Catalog
Tape
Overview of RMAN Functional Components
11© Copyright 2010 EMC Corporation. All rights reserved.
Third Party Media Managers
MML API
Backup
RMAN Repository (Control File)
Target Database
FRA
RMAN Client
Disk
Backup
Recovery Catalog
Tape
Overview of RMAN Functional Components
12© Copyright 2010 EMC Corporation. All rights reserved.
Third Party Media Managers
MML API
Backup
RMAN Repository (Control File)
Target Database
FRA
RMAN Client
Disk
Backup
Recovery Catalog
Tape
Overview of RMAN Functional Components
13© Copyright 2010 EMC Corporation. All rights reserved.
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Weekly: Full image backups (nightly would be preferred!)
Weekly Full Backup
14© Copyright 2010 EMC Corporation. All rights reserved.
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Much more than 1 TB to
keep a few days Limits Retention
Disk
1 TB
Disk
1 TB
Disks
1 TB
Full images
Weekly: Full image backups (nightly would be preferred!)
Weekly Full Backup
15© Copyright 2010 EMC Corporation. All rights reserved.
Disks
1 TB
Disks
1 TB
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> BACKUP INCREMENTAL DATABASE ….
Daily: Incremental backup after weekly full
Target DB
1 TB
Weekly Fulls
Disks
1 TB
Daily Incremental Backup
16© Copyright 2010 EMC Corporation. All rights reserved.
1
32
.
.Disks
1 TB
1
32
.
.Disks
1 TB
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/backup/ora.weekly/%U’;RMAN> BACKUP INCREMENTAL DATABASE ….
Daily: Incremental backup with update
Target DB
1 TB
Well beyond 1TB of backup storage needed
Weekly Fulls
1
32
.
.Disks
1 TB
+ Daily Incrementals
Daily Incremental Backup
17© Copyright 2010 EMC Corporation. All rights reserved.
Before Data Domain…
18 Cabinets of IBM Tape
18© Copyright 2010 EMC Corporation. All rights reserved.
After Data Domain…
1 DD690 and 2 Expansion Shelves
19© Copyright 2010 EMC Corporation. All rights reserved.
Data Deduplication: Under The HoodStore more backups in a smaller footprint
Friday Full BackupFriday Full Backup
A B C D A E F G
BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
20© Copyright 2010 EMC Corporation. All rights reserved.
A B C D E F G
Friday Full BackupFriday Full Backup
A B C D A E F G WEEKEND FULL 1 TB 2- 4x 250 GB
Data Deduplication: Under The HoodStore more backups in a smaller footprint
BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
21© Copyright 2010 EMC Corporation. All rights reserved.
A B C D E F G H
Friday Full BackupFriday Full Backup
A B C D A E F G
Mon IncrMon Incr A B H Monday Incr 100 GB 7-10x 10 GB
WEEKEND FULL 1 TB 2- 4x 250 GB
Data Deduplication: Under The HoodStore more backups in a smaller footprint
BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
22© Copyright 2010 EMC Corporation. All rights reserved.
A B C D E F G H I
Friday Full BackupFriday Full Backup
A B C D A E F G
Mon IncrMon Incr A B H
Tues IncrTues Incr C B I
Monday Incr 100 GB 7-10x 10 GB
Tuesday Incr 100 GB 7-10x 10 GB
WEEKEND FULL 1 TB 2- 4x 250 GB
Data Deduplication: Under The HoodStore more backups in a smaller footprint
BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
23© Copyright 2010 EMC Corporation. All rights reserved.
A B C D E F G H I J
Friday Full BackupFriday Full Backup
A B C D A E F G
Mon IncrMon Incr A B H
Tues IncrTues Incr C B I
Weds IncrWeds Incr E G J
Monday Incr 100 GB 7-10x 10 GB
Tuesday Incr 100 GB 7-10x 10 GB
Wednesday Incr 100 GB 7-10x 10 GB
WEEKEND FULL 1 TB 2- 4x 250 GB
Data Deduplication: Under The HoodStore more backups in a smaller footprint
BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
24© Copyright 2010 EMC Corporation. All rights reserved.
A B C D E F G H I J
Friday Full BackupFriday Full Backup
A B C D A E F G
Mon IncrMon Incr A B H
Tues IncrTues Incr C B I
Thurs IncrThurs Incr A C K
Weds IncrWeds Incr E G J
Monday Incr 100 GB 7-10x 10 GB
Tuesday Incr 100 GB 7-10x 10 GB
K
Wednesday Incr 100 GB 7-10x 10 GB
Thursday Incr 100 GB 7-10x 10 GB
WEEKEND FULL 1 TB 2- 4x 250 GB
Data Deduplication: Under The HoodStore more backups in a smaller footprint
BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
25© Copyright 2010 EMC Corporation. All rights reserved.
Second Friday Full BackupSecond Friday Full Backup
B C D E F L G H
A B C D E F G H I J
Friday Full BackupFriday Full Backup
A B C D A E F G
Mon IncrMon Incr A B H
Tues IncrTues Incr C B I
Thurs IncrThurs Incr A C K
Weds IncrWeds Incr E G J
Monday Incr 100 GB 7-10x 10 GB
Tuesday Incr 100 GB 7-10x 10 GB
K L
Wednesday Incr 100 GB 7-10x 10 GB
Thursday Incr 100 GB 7-10x 10 GB
2nd WEEKEND FULL 1 TB 50-60x 18 GB
TOTAL 2.4 TB 7.8x 308 GB
WEEKEND FULL 1 TB 2- 4x 250 GB
Data Deduplication: Under The HoodStore more backups in a smaller footprint
BACKUP DATA LOGICAL ESTIMATED PHYSICAL REDUCTION
26© Copyright 2010 EMC Corporation. All rights reserved.
Deduplication at Backup / Recovery Speeds
• 102,400 lookups/sec.: is it already in the multi-TB
store?
– 800 MB/sec, for 8KB segment: >100K lookups per second
– If random lookups: very slow
– Each disk: 1 MB/sec
• E.g. for a 7.2KB RPM Seagate 1TB SATA drive: <120
seeks/second
• 120/second @ 8KB segment: 0.96 MB/sec/disk
– Would need 830 disks to go 800 MB/sec (like most dedupers
today)
• This is 4 full height racks of nothing but SATA disks (16 drives /
3U rack)
Same performance, in less than half a full height rack
27© Copyright 2010 EMC Corporation. All rights reserved.
SISL Scaling Architecture
• Check uniqueness with Summary
Vector
• Check in-memory fingerprint cache
• Key resultsSee: http://www.usenix.org/events/fast08/tech/full_papers/zhu/zhu.pdf
• Data Domain answer: SISL™– Stream-informed Segment Layout
includes:• Summary Vector in RAM says if segment is
new• Segment Localities minimize seeks if answer
is on disk
28© Copyright 2010 EMC Corporation. All rights reserved.
Data Integrity: Data Invulnerability ArchitectureTrust but verify – hope is not a strategy
29© Copyright 2010 EMC Corporation. All rights reserved.
Data Integrity: Data Invulnerability ArchitectureTrust but verify – hope is not a strategy
• Data verification– CheckSum– Dedupe, write to disk– Verify
30© Copyright 2010 EMC Corporation. All rights reserved.
Data Integrity: Data Invulnerability ArchitectureTrust but verify – hope is not a strategy
• Data verification– CheckSum– Dedupe, write to disk– Verify
• Self-healing file system– Cleaning– Expired data– Defrag– Verify
31© Copyright 2010 EMC Corporation. All rights reserved.
• Other– RAID-6– NVRAM– Snapshots
• Self-healing file system– Cleaning– Expired data– Defrag– Verify
Data Integrity: Data Invulnerability ArchitectureTrust but verify – hope is not a strategy
• Data verification– CheckSum– Dedupe, write to disk– Verify
32© Copyright 2010 EMC Corporation. All rights reserved.
Disk
1 TB
Disk
1 TB
Disk
1 TB
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Weekly: Full image backups
Before: Without deduplication
Weekly Full Backup – With Deduplication
33© Copyright 2010 EMC Corporation. All rights reserved.
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Weekly: Full image backups
Full
500 GB500 GB
After: With deduplication
Weekly Full Backup – With Deduplication
34© Copyright 2010 EMC Corporation. All rights reserved.
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Deduplication applied to fulls requiring much less disk
Weekly: Full image backups
Full
500 GB500 GB
After: With deduplication
Weekly Full Backup – With Deduplication
35© Copyright 2010 EMC Corporation. All rights reserved.
Target DB
1 TB
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP INCREMENTAL DATABASE ….
Daily: Incremental backup with update
500 GB Weekly Fulls
Incrementals after deduplication
Daily Incremental Backup – With Deduplication
36© Copyright 2010 EMC Corporation. All rights reserved.
Target DB
1 TB
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP INCREMENTAL DATABASE ….
Daily: Incremental backup with update
500 GB Weekly Fulls
Daily Incrementals
Incrementals after deduplication
Daily Incremental Backup – With Deduplication
37© Copyright 2010 EMC Corporation. All rights reserved.
Benefits of Using Inline Deduplication
• Daily fulls instead of incrementals• Longer online retention of full backup
images• No requirement for other backup software
plug-ins• Non disruptive introduction into RMAN
process• Simplified replication using EMC Data
Domain Replicator• Ideal location for Flashback Recovery Area• Incrementally updated backups
38© Copyright 2010 EMC Corporation. All rights reserved.
Full
Sun Wed ThuMon Tue SatFri
DB Snap
Snap
Snap
Snap
Snap
Snap
Incremental MergeEMC Data Domain combines rapid cloning and deduplication
• Results in up-to-date nightly full images available for rapid recovery
Incremental
First image backup2X storage savings
• Nightly take cumulative incremental; apply to snapshot of weekly full
39© Copyright 2010 EMC Corporation. All rights reserved.
Alternatives
• RMAN to 3rd Party Backup MML/SBT– Makes random access disk look like streaming tape. Not cost
effective– Limits the options available to the DBA for backing up, cloning,
merging, etc.– RMAN communicates through MML to agent on 3rd party backup
application media server– Can front a Data Domain system as either disk-based backup or
VTL– All RMAN I/O is via MML which presents only a DEVICE TYPE TAPE
Data Domain can work with an enterprise backup application but does not require it.
40© Copyright 2010 EMC Corporation. All rights reserved.
Oracle Customers Leveraging Data Domain
• RMAN and db2backup to NFS mounts on DD690 and DD880 systems replicating to DD690 and DD580 systems
• 4 week retention schedule, 10% average daily change rate, archive logs backed up hourly
• All database backups replicated again to SunGard
• Sustained deduplication ratios of >6:1 (includes archive logs)
CN Rail – A Large Canadian Freight Railroad
41© Copyright 2010 EMC Corporation. All rights reserved.
Oracle Customers Leveraging Data Domain
• Oracle tablespace archive for data warehouse
• Large table spaces are written to Data Domain systems and flagged as read only and used for data mining
• Sustained deduplication ratios of >7:1
Large California-based clothing retailer
42© Copyright 2010 EMC Corporation. All rights reserved.
“EMC Data Domain is just disk to me. Changing RMAN scripts to go straight to Data Domain disk was simple.”DBA Manager
Oracle RMAN to DiskNational supermarket chain testimonial
“We used to have to go through our backup team for recovery requests and 90% of our actual restore time was spent waiting on tape and administration. With Data Domain, I don't have to wait for someone else to satisfy a restore request or a tape recall.” DBA Manager
43© Copyright 2010 EMC Corporation. All rights reserved.
Summary
• How deduplication benefits Oracle/RMAN backups
• Simplification
• Savings
44© Copyright 2010 EMC Corporation. All rights reserved.
More Information…
• For more information on EMC Data Domain and Oracle, visit
http://www.datadomain.com/solutions/oracle.html
45© Copyright 2010 EMC Corporation. All rights reserved.