Embed Size (px)
Citation preview
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Steffen Grunwald, Solutions Architect, AWS
21. Februar 2017
Aufbau von agilen und effizienten IT Organisationen mit DevOps
“Innovation is now recognized as the single most important ingredient in any modern economy.
In short, it is innovation – more than the application of capital and labor –that makes the world go round.”
Source: http://www.economist.com/node/1324709
2/3More than two-thirds of IT budgets go toward keeping the lights on
77%of CEOs believe security risk has increased in the last few years and 65%
believe their risk management capability is falling behind
15yrsThe average lifespan of an S&P company
dropped from 67 years in the 1920s to 15 years today
How This Affects You
You’re left without the necessary resources to pursue critical business
initiatives required to maintain a competitive advantage Your traditional IT model
lacks the agility you need to keep pace with innovative startups
Insufficient security, compliance and availabilitycan hamper your ability to compete and open the door to sophisticated, hard-to-
identify attacks
Responding requires a new model
Focus on differentiating your company
Innovate at start-up like speed
Reduce risk
“Instead of being afraid of the challenge and failure, be afraid of avoiding the challenge and doing nothing”
Soichiro Honda, Founder of Honda
2009
48
280
722
82
2011 2013 2015
AWS Pace of Innovation – new Features and Services
1017
2016
Learn more: https://aws.amazon.com/new/
“In the past voice interfaces were seen as gimmicks, or a nuisance for driving “hands-free.” The Amazon Echo and Alexa have completely changed that perception. Voice is now seen as potentially the most important interface to interact with the digitally connected world.”
Werner VogelsCTO & VP, Amazon.com
But innovation is hard…
…how can companies build an effectiveinnovation system and an environment that will foster and support human creativity and drive technological
progress?
What the heck!? I don’t recognize this
purchase.
I want to pay my
utility bill
I’m about to travel. Please don’t decline
my card!
I want to transfer
money to savings
I need to pay my
credit card bill
How do I order a Venture Card?
Scott Totman, Capital OneHead of Mobile Technology,
Payments & Innovation
“Capital One has a state of the art technology platform that allows us to quickly leverage emerging technologies, like Alexa.”
f(innovation) = (culture * structure) toolingInnovation is the product of culture and structure with the power of tooling.
f(innovation) = (culture * structure) tooling
Innovation requires culture that fosters invention.
Culture is the principal componentin velocity of innovation.
Amazon leadership principles
https://www.amazon.jobs/principles
A company of builders…builders come to build.
“We've had three big ideas at Amazon that we've stuck with for 18 years, and they're the reason we're successful:
Jeff BezosCEO, Amazon.com
Put the customer first.Invent.And be patient.”
Jeff Bezos, Amazon CEO
Focus on the customer and the long term, perspective affects everything.
We will continue to measure our programs and the effectiveness of our investments
analytically…
We will make bold rather than timid investment decisions …and we will have learned another
valuable lesson in either case.…
“Invention requires two things: the ability to try a lot of experiments, and not having to live with the collateral damage of failed experiments”
Andy Jassy, CEO, Amazon Web Services
Share and give back to innovation.
This is My Architecture Video Series
Make time for learning.
f(innovation) = (culture * structure) tooling
Good intentions are never enough, you must build structure and create innovation fostering habits.
The Amazon decision making process is data driven and relies heavily on narratives.
We always work backwards from thecustomer.
Each new idea starts with a write-up of a press release / FAQ.
This helps capture the customer perspective of the problem we are
trying to solve.
But how do we remove the bottlenecks?
A world of conflicting priorities
DevelopersPaid to change things
SecurityPaid to prevent risk
OperationsPaid to ensure stability
…and of bottlenecks
Development Testing Security Operations
Avoid future firefighting by including others early and by investing time to
paying back technical debt.
Dev[Sec]OpsDevOps is the combination of cultural philosophies, practices, and tools that increases an organization’s ability to deliver applications and services at high velocity: evolving and improving products at a faster pace than organizations using traditional software development and infrastructure management processes. This speed enables organizations to better serve their customers and compete more effectively in the market.
“When a feature or enhancement is ready, we push it out and make it instantly available to all.” – Jeff Bezos
Speed of iteration beats quality of iterationEncourage single-threaded focusEnables self-directed teamsFosters ownership & autonomy
Move Fast and Be Nimble
“If the development team is frequently called in the middle of the night, automation is the likely outcome. If operations is frequently called, the usual reaction is to grow the operations team.”
James Hamilton, Distinguished Engineer, Amazon Web Services
Amazon.comused to be a monolith…
2001
Development transformation at Amazon: 2001-2009
20092006
Monolithic vs. SOA vs. Microservices
SOACoarse-grained
MicroservicesFine-grained
MonolithicSingle Unit
Small, but not too small
Can be rewritten in 2 weeks
Owned by a small two pizza team?
Balance small and independent with complex interactions
Composable, Scalable, Polyglot, but not too much
Building Microservices – Sam Newman
Different teams/techIndependent lifecycleIndependent databaseFine grained primitivesScope and Ownership (Quality)StandardiseFungible
My Enterprise Social Media Service
Amazon Retail Platform (2009)
Chaos?
Amazon Retail Platform (2009)
OrganisedChaos.
Use broad controls that don’t stifle agility.
While all teams are autonomous, they are defined and driven by the cultural DNA (Leadership Principals) at every step.
Challenges of Microservices
Complexity in Code Base
Complexity inInteractions
Fallacies of distributed computing
• The network is reliable.• Latency is zero.• Bandwidth is infinite.• The network is secure.• Topology doesn't change.• There is one administrator.• Transport cost is zero.• The network is homogeneous.
MonitoringAuto ScalingBulkheadsCircuit breaker…
“What we need is a new approach where continuous partial failure is the normal
state of affairs.”
Michael Nygard
A measure of innovation agility
How many deployments am I performing?
How many are done out of hours?
How many suffer emergency roll backs?
“Too many to count’”“We have a quarterly release cycle”
“We minimize customer impact” “Time is irrelevant”
“We frequently catch problems too late and need to rollback from pre-release backups”
“We roll forwards not back”
Strive for continuous deployment.Use metrics and tooling to gain trust.
Continuous Delivery Benefits
Improve developer productivity
Find and address bugs quickly
Deliver updates fasterAutomate the software release process
f(innovation) = (culture * structure) tooling
“We own the customer tool”
“We own the eCommerce API”
“We own the shimblobelterproduct”
“We own the platform”
• Tooling• Deployment• Metrics
Tooling should be decentralised, encouraging self service.
It should promote best practices WITHOUT being restrictive.
It should be technology agnostic.
#1: It should be the path of least resistance.
Continuous Delivery
From check-in to production
CI/CD + Release Automation
>90% of Amazon teams
Pipelines
12 years young
Rolling Deployments (zero downtime)
Health Checking
Versioned Artifacts & Rollbacks
= 50 million deployments a year
Thousands of teams +Microservices architectures +Multiple environments +Continuous delivery?
Deployment != Epic Feature Release
Technical debt repayments (refactoring etc.).Security patching.Dependency upgrades.Security, performance, reliability, availability, cost improvements.Adapting to external changes (little and large) with no notice.Fixing defects – meh.Changing schema – agh.
Great. How does that help me?
Deployment, Administration & Monitoring
MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
ServerlessCloudWatchCloud
FormationCodeDeploy
CodeCommit
CodePipeline
CodeBuild
AWS CodePipeline automatically triggers on new commits into version control (AWS CodeCommit, GitHub, custom…)
AWS CodeBuild follows a buildspec.yml file that defines how your application should be built. Common defaults for most languages & dependency repositories. Flexibility to extend with custom Docker images.
Testing can be integrated with third party SaaS offerings, Jenkins, or a custom integration. Manual approvals are optional.
Deployment options available with AWS CodeDeploy, AWS CloudFormation, AWS Elastic Beanstalk, or custom integrations.
f(innovation) = (culture * structure) tooling
Additional Resources
https://www.amazon.co.uk/Phoenix-Project-DevOps-Helping-Business-ebook/dp/B00AZRBLHO
https://www.amazon.co.uk/DevOps-Handbook-World-Class-Reliability-Organizations-ebook/dp/B01M9ASFQ3
https://www.amazon.co.uk/Building-Microservices-Designing-Fine-Grained-Systems-ebook/dp/B00T3N7XB4
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Steffen Grunwald, Solutions Architect
[email protected], @steffeng
Thank You.
