Embed Size (px)
Citation preview
The Big Cloudy ContinuitySuccessful Disaster Recovery and Business Continuity In the world of Big Data and Cloud services
Bozhidar [email protected]@gmail.com
The Big Cloudy Continuity
Perceived provider preference and abilities of cloud and continuityBig data going into cloudAdjusting Business Continuity to Big DataA new paradigm of Business Continuity
Enterprise datacenter
Fast
Very Expensive
A pain to maintain
Costly to upgrade
A lot of training
Public Cloud
Standardized
Affortable
ImmediatelyAvailable
Scalable
The Big Cloud Preferences
The Big Cloud?
Source – Forrester Q1 2013
The Continuous Cloud – the AWS example
Source – Rugerro Tonelli
The Continuous Cloud
•Generic services are replicated▫S3 Storage▫Google CloudStorage▫Azure Storage
▫Would you actually make HDFS data replicate correctly?
▫It should be possible, but early testing is required
Some big data definitions
•Big data is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications.
•Big data is one of those new, shiny labels, like SDN, DevOps and cloud computing, that is both hard to ignore and hard to understand
Mike 2.0 (2013)
Hardman (2013)
Big data sourceSaddle
Seat RailsSeatpost Clamp
Handle Bars
Shift Levers
Brake Levers
Adjusting Barrel Fork Crown
Valve Stem
Fork Blade
Hub
Front DropoutPedal
Chainring
CranksetCrank Arm
ChainChainstay
Seatpost
BrakeBrake Pad
Seatstay
Cassette
Spoke
Rear DropoutRear Derailleur
Wheel
Rim
Tire
Brake CableFrame
TubesFront Derailleur
Big data sourceWeight
VibrationTorsion
Vibration/Torsion
Speed of Shift
Force and vector of pull
Friction, Force of pull Torsion
Temperature, Pressure
Vibration
Friction
Clamp Grip,Vibration
Forcevector
Torsion
Vibration, Friciton
VibrationWeight, Vibration, Torsion
TorsionWeiight
BrakeFrictionForce of pull
WeightVibrationTorsion
Chain Allingnment
Tension
Clamp GripVibration
Shift Speed, vibration, chain alignment
VibrationTire Twist
Temperature, Pressure, Friction
TensionVibration/Torsion
Forcevector
Shift speedVibration
Why???
The Big Cloud (public flavor)
•Amazon EC2 supports Hadoop operation •Amazon Elastic MapReduce•Azure offers Hdinsight (still in preview)•Azure looking for Academic big data
projects (september 2013)•HP offers Hadoop, but also Cassandra•Google offers ComputeEngine IaaS and
BigQuery SaaS (Dremel based)•…
Plug into the Big cloud
•Initial Data delivery •Continuous Data delivery•Data integrity •Status monitoring of compute nodes•Performance (requested, delivered)
regardless of SLAs•Data access and pullout (the ultimate
lock-in preventor)
The BIA
•Assign perceived impact to business from lack of business elements for certain amount of time
•Assign perceived/required information availability
•Calculate cost of resilience of business elements
•Decide whether cost is lower than impact
E E DC A
The Big BIA• Is your Big Data insight real-time or trending?• Is it connected to current revenue?• Can you survive/operate/recover with a smaller
subset of data (recovered/recreated)?• Do you have insights on other locations (are the
current relevant questions already asked and answers are available)?
• Are the persons asking the questions available?
E E E E EA A A A A
The Usual Business continuity
•BCP ensures that critical functions of an organization available to stakeholders
•Business Continuity is delegated (at best) is the job of CISO, CIO. They delegate it to a trusted expert team.
•The team prepared documentation, systems and runs tests. They prepare reports. Auditors are happy
•Bonuses get distributed
The Usual Business continuity
•Somebody Else's Problem, or SEP can run almost indefinitely … because it utilizes a person's natural tendency to ignore things they don't easily accept…
•Any object around which a SEP is applied will cease to be noticed, because any problems one may have understanding it become Somebody Else's..
The New Business continuity• Business continuity requires a broader audience
▫Line management responsibility▫ Insight from the lowest tier upwards▫Culture of resiliency and Crisis awareness on a
company scale▫Reacting to possible crisis is embedded▫Employees avoid crisis
▫Bonuses are not distributed▫But we have a company to work at▫We all buy a spare tire for OUR car, well it’s OUR
companySource: Herbane, Elliott and Swartz
The Big Test• Is everyone testing their BCP?
•Loaded with assumptions•Script based•Best people are available•Support teams are on call/site•We ticked the box, and we are continuing as
usual•Who fixed what during the test?
The Big Test• “Plans are useless, but planning is everything” -
Dwight Eisenhower.
• Develop deep plans for as many scenarios as possible but keep them open to changes
• Categorization, reporting and alerting sequence may become moot at the point and circumstances of the actual incident
• Improvisation should be part of the process• Note improvisations and corrections, communicate
them back into the resiliency culture • Test EARLY, test often
Source: Alesi, Elliott
Take awayBig data is about supporting decisions and business up to different level. Evaluate it accordingly, reevaluate often. Understand your data!Utilize the commodity of cloud service, but understand it well before embarking on the journey. Both empower and make accountable the line structure of the company to understand and think about survival of the organizationWhen testing a BCP, test early and deep but allow for options. Feed experiences into the culture
?
Thank youSuccessful Disaster Recovery and Business Continuity In the world of Big Data and Cloud services
Bozhidar [email protected]@gmail.com
