Upload
amazon-web-services
View
1.382
Download
2
Embed Size (px)
Citation preview
Jeff Barr
Rules for Backup and Disaster Recovery in the Cloud
Chief Evangelist
Agenda
• Prologue The need for Backup and DR
• Rules Backup and DR with AWS
• Customer Reference Ausenco and NZ Post
The need for Backup and DR
Some “natural” examples….
after Brisbane Floods – January 13th 2011 Coronation Drive, Milton, QLD.…
Photos: http://www.abc.net.au/news/specials/qld-floods/
Some “natural” examples….
after Brisbane Floods – January 13th 2011 Coronation Drive, Milton, QLD.…
Photos: http://www.abc.net.au/news/specials/qld-floods/
Some “natural” examples….
after Brisbane Floods – January 13th 2011 Coronation Drive, Milton, QLD.…
Photos: http://www.abc.net.au/news/specials/qld-floods/
Some “natural” examples….
Christchurch Earthquake - Feb 22nd 2011 Manchester & Glouchester Street, Christchurch....
Photos: http://www.abc.net.au/news/specials/christchurch-quake/
Some “natural” examples….
after Hurricane Sandy – October 29th 2012 Breezy Point, Queens, NY, USA.…
Photos: http://www.abc.net.au/news/specials/hurricane-sandy-before-after-photos/
What about “human-made” examples….
“Everything fails, all the time” Werner Vogels, CTO, Amazon.com
Backup and DR with AWS
Drivers for Backup and DR with AWS
Business and Technical Drivers with AWS….
Reduce costs
Slash DR budgets by up to 50%
Consolidate sites
Eliminate the need to run a secondary site
Reduce on-premises
Eliminate 30%+ of on-premises physical equipment
Remove aging technologies
Eliminate tape for backup and
archive
The fundamental economic model…
Utility, on-demand datacenter
Primary Site Routers
Firewalls
Network
Application Licenses
Operating Systems
Hypervisor
Servers
SAN
Primary Storage
Backup
Archive
AWS Routers
Firewalls
Network
Application Licenses
Operating Systems
Hypervisor
Servers
SAN
Snapshot Storage
Backup
Archive
Secondary site costs
You can have different DR solutions
• Easy to integrate existing vendors with DR on AWS
• Approach: One vendor/hybrid/multiple vendors
• One region/multi-regions (if you need geo-diversity)
• Different DR Architectures
Backup & Restore Pilot light
Warm standby in AWS
Multi-site solution in AWS & on-
premises
Assets will sit on a spectrum of technical complexity…
DR & business continuity
Rebuild when required from offsite backup
Run hot-hot configuration with
auto-failover
Recovery Time Objective
(RTO) How quickly you need this asset to be recovered?
e.g. 1min? 15min? 1hr? 4hrs? 1day?
Recovery Point Objective
(RPO) How ‘fresh’ the recovery must be for the asset?
e.g. zero data loss, 15mins out of date?
Backup and DR with AWS
Backup and Storage Options
Simple Storage Service Highly scalable object storage
1 byte to 5TB in size
99.999999999% durability
Elastic Block Store High performance block storage device
1GB to 1TB in size
Mount as drives to instances with
snapshot/cloning functionalities
Glacier Long term object archive
Extremely low cost per gigabyte
99.999999999% durability
Storage Options
Very fast ‘instance’ disks
Slow, rare access Fast web object storage
Storage Gateway – Connect On-Prem with the AWS Cloud
1. Local, low-latency access to the most frequently used files while storing all data in Amazon S3 (Cached-Volumes) Or 2. Scheduled off-site backups to Amazon S3 for on-premises data (Stored-Volumes)
Cost ($/GB/month)
Performance Durability
Amazon S3 0.095
Amazon Glacier 0.01
AWS Storage Gateway 0.095
(+ 125/GW)
Amazon EBS 0.10
Amazon EBS (PIOPS) 0.125
*AWS Oregon pricing
Storage Options
Backup and DR with AWS
Backup and DR Rules
1. My backup should be accessible
1. My backup should be able to scale
1. My backup should be safe
2. My backup should work with a DR policy
3. Someone should care about it
Backup Rules
VPN
Public / AWS Direct Connect
AWS Import/Export
z
Backup Rules – My backup should be accessible
GW-Cached volumes
GW-stored volumes
“Warm” storage
“Cold”
Backup Rules – My backup should be accessible
Access both via SDKs and via third-party software
S3 Glacier
Internet Web
Services API
HTTP(S)
Via SDK Via 3rd parties
• “Infinite” scale with Amazon S3 and Amazon Glacier
• Scale to multiple regions
• Seamless
• No need to provision
• Cost tiers (cheaper at scale)
Backup Rules – My backup should be able to scale
• SSL Endpoints (Amazon S3 and Amazon Glacier)
• Signed API calls
• Store encrypted files
• Server-side encryption
• Multiple copies across different data centers
• Local/cloud with AWS Storage Gateway
Backup Rules – My backup should be safe
Backup Rules – My backup should work with a DR policy
• Clear ownership
• Permissions with IAM: Users, groups roles
• Logs
• AWS support
Backup Rules – Someone should care about it
Pilot light
Stopped instances
Pilot light
Running instances
Backup and DR with AWS
A “Backup/Restore” & “Pilot Light” reference…
Remember Brisbane, QLD…..
Source: http://www.abc.net.au/news/specials/qld-floods/
Brisbane - January 13th 2011
Ausenco
Source: http://www.abc.net.au/news/specials/qld-floods/
Makhteshim Agan Industries on AWS
About Us
34
• Makhteshim Agan is the world's leader in branded off-patent crop protection solutions. This is how we help solve one of the world's greatest challenges, a sustainable and secure food supply.
• Sales on 2013 – close to 3 Billion US $ to around 105 countries
• About 40 Subsidiaries around the glob
• Each subsidiary has its own IT infrastructure
• Centralized applications and data consolidation is done at MA headquarters.
Our Main Challenges (before AWS)
35
Large number of subsidiaries, each uses it’s own on premises infrastructure • Physical Security
• Stable power (UPS and generators)
• Air Conditioning
• Hardware maintenance
• Server redundancy
• Reliable access
• Backup and disaster recovery
• Setup takes long time
The Conclusion
36
• Move to a public cloud other than on premises
• AWS was the natural choice decision
• Find a strong AWS partner to work with
• Emind Systems, an AWS Advanced Consulting Partner
• Cloud Architects
• DevOps & deployment team
• 24/7 Cloud Operation team
The Solution
37
• Secured cloud environment
• Multiple VPC across multiple regions
• Secure access over VPN
• Windows & Linux servers
• Full backup to the cloud
• Quick recovery
• Seamless expansion
• Always available, always accessible
• Flexible cost model
• Backup to cloud is fast
MA is whole more flexible now
38
• All new small subsidiaries are deployed on AWS
• Hand-in-hand with Emind’s team
• Constantly adding more services and application to the cloud
• Just in time deployment of AD-HOC global projects and services
• ASX200 company
• Head office in Brisbane
• 29 Offices in 19 countries
• 3500 Employees
Ausenco Offices
The Result
• Low effort
• Incremental rollout
• Cloud migration
• Efficient, effective usage of bandwidth
• Application/database servers
• Regionalised deployment
Backup and DR with AWS
The new HA/DR continuum…
The new HA/DR continuum…
DR with High Availability
App DR with Standby
The new HA/DR continuum…
Reducing Costs
• AWS cost reduction (e.g, S3 cost reduction on Apr 2nd 2013)
• Reduced redundancy (Amazon S3)
• Retention policy
• Hot/warm/cool/cold backup
• Reserved capacity/tiers
0–1 TB 0.095 0.076
1–50 TB 0.080 0.064
50–500 TB 0.070 0.056
500–1,000 TB 0.065 0.052
1–5 PB 0.060 0.048
5+ PB 0.055 0.037
Amazon S3 Standard
$/GB/Month
Reduced $/GB/Month
For More Information
• AWS: http://aws.amazon.com
• AWS Disaster Recovery: http://aws.amazon.com/disaster-recovery/
• AWS DR White Paper:
Thank You!
@jeffbarr