View
228
Download
2
Category
Preview:
Citation preview
1
Presented by:
© IBM Corporation
Adopting DevOps at
Enterprise ScaleSanjeev SharmaCTO, DevOps Technical Sales and Adoption
IBM Distinguished Engineer
@sd_architect
2 © IBM Corporation
DevOps: Origins
33 © IBM Corporation
DevOps in the Enterprise: Multiple Bottlenecks
Product Owner
Senior Executives
Users Domain ExpertsAuditors
Gold Owner Support Staff
External System
Team
Operations
Staff
Team MemberTeam Lead
Team MemberTeam Member
Line-of-business
Customer
4 © IBM Corporation
DevOps approach: Apply Lean principles accelerate feedback and improve time to value
People
Process
Line-of-
businessCustomer
1
3
2
1. Get ideas into production fast
2. Get people to use it
3. Get feedback
Continuously Improve:
I. Application Delivered
II. Environment Deployed
III. Application and Environment Delivery
Process
55 © IBM Corporation
Lean & Agile are at the heart of IBM’s DevOps approach
– Balance efficiency and effectiveness to
– deliver the right things right!
Reduce work
Eliminate
bottlenecks and
wasteFast response
times
Small batch sizes
Continuous
feedback
LEAN
AGILE
Efficiency
Effectiveness
6 © IBM Corporation
Voice of the IT – Senior Application Development Executive
Steve Farley, VP Application
Development Center, Nationwide
Insurance
Carmen DeArdo, Director, Build
Technology Leader, Nationwide
Insurance
7 © IBM Corporation
More executive perspectives on DevOps
Gareth Wharton,
CTO, Hiscox
Snehal Antani,
CIO CDF & CIO EA,
GE Capital Americas
“We built software and apps,
such as our award-winning bank
– GECapitalBank.com – from
scratch in weeks to months –
instead of months to years.”
8 © IBM Corporation
Patterns of DevOps
Adoption
99 © IBM Corporation
Patterns of DevOps Adoption
Three Key Business Drivers
1. Driving Business Agility
2. Scaling for the Enterprise
3. Driving Innovation
10 © IBM Corporation
Adoption Pattern #1: Driving Business Agility
11 © IBM Corporation
Adoption Pattern #1: Scenarios
Driving Business Agility
• Continuous Delivery
• Shift Left Test
• Shift Left Ops Engagement
• ‘Lean' Application Delivery
12 © IBM Corporation
Where does DevOps Adoption Start?
ProductionDevelop Build Test DeployPlan
By the end of 2015, 75% of large organizations are
expected to have adopted agile DevOps practices (IDC)
Agile Adoption
Water-SCRUM-fall
13 © IBM Corporation
Going from Agile to DevOps
End-to-End Delivery Pipeline
14 © IBM Corporation 14
Collaborative Development
• Continuous Integration
• ‘Single Source of Truth’ – Requirements, Source Code, Tests,
Deployable assets, Software Defined Environments
• Common Dashboards to show metrics
15 © IBM Corporation 15
Deployment Automation
• Manage application
components and versions
• Manage configurations across
all environments
• Offer secure ‘self-service’ capabilities
• Increase transparency
• Ensure governance and compliancy
16 © IBM Corporation
Databases Internal
Messages
Third-party
Services
virtual components
Simultaneously test
across multiple test
stages
Dev QA
Test
Virtualization
IBM UrbanCode
Deploy
Test Automation
integrated with
Test Environments
Dynamic Infrastructure
Deploy what is ready,
virtualize the rest
Continuously test in
production-like env.
Deploy private, secure right
sized test data
Test Data Management
Rational Test Workbench
Quality Management Manage quality across the
delivery lifecycle
Shift Left Test: Deploy what is ready, Virtualize the rest
17 © IBM Corporation
Deploying Infrastructure is the biggest
bottleneck for the Delivery Pipeline
• Software Defined Environments enable
you to capture infrastructure as a software
artifact
Extending the Agile Manifesto:
Working software over comprehensive
documentation -> Working software (in
Production or production-like
environment) over comprehensive
documentation
‘Shift Left’ Ops Engagement
Application
Changes
Infrastructure
Changes
18 © IBM Corporation
‘Lean’ Delivery Pipeline
Case Study: Large Bank
Challenge:
– Developers were creating daily builds
– QA team had a 3 – 5 day cycle time
Bottlenecks Identified:
– Large Sizes of Testing Deployments
– Lack of Deployment Automation
– Ticket based manual environment provisioning
– Lack of reliable source of Test Data
Solution:
– Deployment Automation with IBM UrbanCode Deploy
– Cloud hosted ‘on-demand’ environments with IBM
UrbanCode Deploy with Patterns
– Test Automation and Service Virtualization with IBM Rational
Test Workbench
– Test Data Management with IBM Optim Test Data
Management
19 © IBM Corporation
End-to-end testing with Continuous Delivery and Test Virtualization
Databases Mainframe
applications
Third-partyServices
Rational Test Virtualization Server
Databases Mainframe
applicationsVirtualized Services
SCM Build
Deploy
Rational Test Workbench
Test
RTW
plugin
RTVS
plugin
Actual Services
Optim
plugin
Optim Test Data Management
UAT
UrbanCode Deploy
Extract Data,
Insert Data,
Convert/Mask Data
Update Data
Configure and start
Virtual Services
Deploy App and
Configure
Middleware
19
Cloud Platform
Test Data
Management
20 © IBM Corporation
Adoption Pattern #2: Scaling for the Enterprise
21 © IBM Corporation
Adoption Pattern #2: Scenarios
Scaling for the Enterprise
• Release Automation for 2-speed IT
• Standardization across the
enterprise
22 © IBM Corporation
Applications, teams and environments are “hybrid”: 2-Speed IT
Rapid iterations
Cloud
Slower iterations
Behind the firewall
AlignmentContinuous synchronization
and planning
Continuous testing
Continuous deployment
and monitoring
Plan Develop Build Test Deploy Production
Plan Develop Build Test Deploy Production
23 © IBM Corporation
• Keep track of the inventory across the entire life cycle of the release
• Control the entire release lifecycle in an easy to use view
Orchestrating Complex Releases
24 © IBM Corporation
Application Deployment to Hybrid Environments
IBM UrbanCode Deploy
with Patterns
IBM Bluemix
Cloud
Foundry
On-prem IaaS
On-prem Traditional IT
IBM Cloud OrchestratorIBM PureApplication System
IBM Cloud Manager with OpenStack
24
Virtual
Machines
DockerContainers
IBM UrbanCode Release
Systems of Engagement
Systems of Record
25 © IBM Corporation
Adopting DevOps
for 2-speed IT
Case Study: Multinational Financial Services
Provider
Challenges:
– Delivering a Business Capability with multiple services and
applications across Hybrid Environments
Bottlenecks Identified:
– Lack of Release Planning
– Inability to test when needed, as services are not available/ready
– Coordinating complex Releases, made up of deployments across
Hybrid Environments
Solution:
– Release Planning with IBM UrbanCode Release
– Deployment Automation a cross Hybrid environments with IBM
UrbanCode Deploy with Patterns
– Test Automation and Service Virtualization with IBM Rational Test
Workbench
– Rapid Deployment across distributed datacenters with Aspera
26 © IBM Corporation
IBM UrbanCode Release
Legacy Stack On-Prem Cloud
Rational Test Workbench
IBM UrbanCode Deploy with Patterns
ProvisionApplication
Infrastructure
Private Cloud
Pattern Engine
ProvisionApplication +Infrastructure
Platform as a Service(Public)
BlueMix
Infrastructure
System z and/or Distributed Applications
On-prem Customer Data Centers
ProvisionApplication +Infrastructure
IBM Cloud Orchestrator as a Service
Public Data Centers
AP
I Ga
tew
ay
CloudFoundry ‘Community’ Buildpacks
IBM DevOps
Services
APIs
APIs
Off-Prem Cloud
Infrastructure
IBM Cloud Orchestrator
Pattern Engine
ProvisionApplication +Infrastructure
Application Deployment for Hybrid environments
Aspera
27 © IBM Corporation
Adoption Pattern #3: Driving Innovation
28 © IBM Corporation
Adoption Pattern #3: Scenarios
Driving Innovation
• Rapid Delivery for
Innovation/Experimentation
• Architecting for the Cloud
29 © IBM Corporation
Innovation: Rapid Deployment and Feedback for
Experimentation
Line-of-
business Customer
1
3
2
1. Get ideas into production fast
2. Get people to use it
3. Get feedback
4. Improve and Iterate
• Canary Testing, A/B Testing
• Containerization
• Microservices
30 © IBM Corporation
Build your apps, your wayBluemix is powered by a full open cloud architecture
Bluemix supports a wide diversity of workloads by offering developers a range of
choices associated with how they build and run their apps.
App-centric runtime
environments Flexible and powerful
VMs
Portable and consistent
containers
• Pure PaaS
• Support for node.js, Java, Go,
Python, Ruby, Ruby on Rails, .php
and includes the ability to bring
your own buildpack
• Focus on your code and your data,
the platform manages the rest
• Deploy and manage VMs
consistently for dedicated and
public clouds through a single
dashboard using open source
technologies.
• A user-specific repository of
images which are trusted and
secure
• High availability of the IBM-
hosted container images
• Integrated networking and
storage
IBM Bluemix
31 © IBM Corporation
IBM Bluemix DevOps Services
Agile
Planning
Continuous
Integration
Web IDE
Hosted Git Jazz SCM
Monitoring
& Analytics
Mobile
Quality
Source Control
Plan and code
Feedback
Build and DeployContinuous Delivery
32 © IBM Corporation
Static website Web frontend User DB Queue Analytics DB
Development
VMQA server Public Cloud Contributor’s
laptop
Docker – A shipping container system for code
Mu
ltip
licit
y o
f St
acks
Mu
ltip
licit
y o
f h
ard
war
e en
viro
nm
ents
Production
ClusterCustomer Data
Center
Do
services and
ap
ps in
teract ap
pro
priately?
Can
I migrate
smo
oth
ly and
q
uickly
…that can be manipulated using
standard operations and run
consistently on virtually any
hardware platform
An engine that enables
any payload to be
encapsulated as a
lightweight, portable, self-
sufficient container…
33 © IBM Corporation
Dan the Developer
Worries about what’s
“inside” the container
• His code
• His Libraries
• His Package Manager
• His Apps
• His Data
All Linux servers look the
same
Why it works — DevOps Nirvana?
Oscar the Ops Guy
Worries about what’s “outside” the container
• Logging
• Remote access
• Monitoring
• Network config
All containers start, stop, copy, attach, migrate, etc. the same way
34 © IBM Corporation
IBM’s Delivery Pipeline for Containers
IBM Container
Image Build
Service
Image
Registry
IBM UrbanCode Deploy
with Patterns
35 © IBM Corporation
Creating a DevOps
Culture And now for the hard part…
36 © IBM Corporation
37 © IBM Corporation
It’s all about the people!
Building a DevOps Culture grounded
in lean and agile principles
• Everyone is responsible for Delivery
• Common measures of Success
• Setup a DevOps Center of Excellence
Product Owner
Senior Executives
Users Domain ExpertsAuditors
Gold Owner Support Staff
External System
Team
Operations
Staff
Team MemberTeam Lead
Team MemberTeam Member
38 © IBM Corporation
Start Here:Value Stream Mapping for
Identifying and Addressing
bottlenecks
39 © IBM Corporation
Bottlenecks in your Delivery Pipeline
Address issue of
congestion in
software delivery
1 per min 1 per min
4 per min 1 per min
4 per min 4 per min
40 © IBM Corporation
Mapping your Delivery Pipeline
Idea/Feature/Bug Fix/
EnhancementProduction
Development Build QA SIT UAT Prod
PMO
Requirements/
Analyst
Developer
CustomersLine of Business
Build
EngineerQA Team Integration Tester User/Tester Operations
Artifact Repository
Deployment Engineer
Release Management
Code Repository
Deploy
Get Feedback
Infrastructure as Code/
Cloud Patterns
Feedback
Customer or
Customer Surrogate
Metrics - Reporting/Dashboarding
Tasks
Artifacts
Bottleneck: Rigid ‘One-size-
fits-all’ Development process
Solution: Agile Transformation with
‘Risk-Value’ based Process Variants
Bottleneck: Ticket Based
Environment Provisioning
Solution: Cloud Hosted
Developer ‘Self-Service’
Bottleneck: Weekend long
Deployments that often fail
Solution: Frequent Deployment
of Small Batches of ChangeBottleneck: Late Discovery of
Architectural Fragility
Solution: Agile ‘Shift Left’
Integration Testing to early in
LifeCycle
4141 © IBM Corporation
For Dummies books:
http://ibm.co/devopsfordummies
http://ibm.co/agilefordummies
http://ibm.co/ServiceVirtualizationForDummies
http://ibm.co/ARDfordummies
DevOps Lean Assessment (Beta):
http://bit.ly/IBMLeanAssess
IBM DevOps Page:
http://ibm.com/DevOps
IBM DevOps YouTube Playlist:
http://bit.ly/1fiDOtl
ResourcesContinuing your DevOps Adoption
journey
42 © IBM Corporation 42
Questions?
43 © IBM Corporation
Acknowledgements and disclaimers
© Copyright IBM Corporation 2013. All rights reserved.
–U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
IBM, the IBM logo, ibm.com, Rational, the Rational logo, Telelogic, the Telelogic logo, Green Hat, the Green Hat logo, and other IBM products
and services are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or
both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these
symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may
also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and
trademark information” at www.ibm.com/legal/copytrade.shtml
If you have mentioned trademarks that are not from IBM, please update and add the following lines:
[Insert any special third-party trademark names/attributions here]
Other company, product, or service names may be trademarks or service marks of others.
Availability: References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries
in which IBM operates.
The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided
for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any
participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided
AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise
related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating
any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license
agreement governing the use of IBM software.All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may
have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is
intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue
growth or other results.
44 © IBM Corporation
© Copyright IBM Corporation 2013. All rights reserved. The information contained in these materials is provided for
informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be
responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these
materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or
licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.
References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in
which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s
sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or
feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM
products and services are trademarks of the International Business Machines Corporation, in the United States, other countries
or both. Other company, product, or service names may be trademarks or service marks of others.
Thank You
45 © IBM Corporation
Backup Slides
46 © IBM Corporation
End-to-end testing with Continuous Delivery and Test Virtualization
Databases Mainframe
applications
Third-partyServices
Rational Test Virtualization Server
Databases Mainframe
applicationsVirtualized Services
SCM Build
Deploy
Rational Test Workbench
Test
RTW
plugin
RTVS
plugin
Actual Services
Optim
plugin
Optim Test Data Management
UAT
UrbanCode Deploy
Extract Data,
Insert Data,
Convert/Mask Data
Update Data
Configure and start
Virtual Services
Deploy App and
Configure
Middleware
46
Cloud Platform
Test Data
Management
IBM UrbanCode Deploy:• Continuous Delivery to Dev – Test
environments• Configure Middleware and
Environments• Configure Virtual Test Servers• Inventory Management • Security Management
Challenge Addressed: • Developer Self Service for end-
to-endTesting
47 © IBM Corporation
End-to-end testing with Continuous Delivery and Test Virtualization
Databases Mainframe
applications
Third-partyServices
Rational Test Virtualization Server
Databases Mainframe
applicationsVirtualized Services
SCM Build
Deploy
Rational Test Workbench
Test
RTW
plugin
RTVS
plugin
Actual Services
Optim
plugin
Optim Test Data Management
UAT
UrbanCode Deploy
Extract Data,
Insert Data,
Convert/Mask Data
Update Data
Configure and start
Virtual Services
Deploy App and
Configure
Middleware
Deploy what is ready, virtualize the rest47
Cloud Platform
Test Data
Management
IBM Rational Workbench:
• Virtualize Services for testing
• Manage Virtualized Test
environments
• Integration testing
• Performance testing
• Security Testing with AppScan
Challenge Addressed:
• Early testing (Shift-left)
• Continuous end-to-end testing
• Remove dependencies on back-
end service availability for testing
• Remove dependencies on test
environment availability
• Virtualize expensive mainframe
services
48 © IBM Corporation
End-to-end testing with Continuous Delivery and Test Virtualization
Databases Mainframe
applications
Third-partyServices
Rational Test Virtualization Server
Databases Mainframe
applicationsVirtualized Services
SCM Build
Deploy
Rational Test Workbench
Test
RTW
plugin
RTVS
plugin
Actual Services
Optim
plugin
Optim Test Data Management
UAT
UrbanCode Deploy
Extract Data,
Insert Data,
Convert/Mask Data
Update Data
Configure and start
Virtual Services
Deploy App and
Configure
Middleware
48
Cloud Platform
Test Data
Management
IBM InfoSphere Optim:• Test Data management• Mask and provide sets of test
data for Continuous Testing
Challenge Addressed: • Test Data Management
49 © IBM Corporation
End-to-end testing with Continuous Delivery and Test Virtualization
Databases Mainframe
applications
Third-partyServices
Rational Test Virtualization Server
Databases Mainframe
applicationsVirtualized Services
SCM Build
Deploy
Rational Test Workbench
Test
RTW
plugin
RTVS
plugin
Actual Services
Optim
plugin
Optim Test Data Management
UAT
UrbanCode Deploy
Extract Data,
Insert Data,
Convert/Mask Data
Update Data
Configure and start
Virtual Services
Deploy App and
Configure
Middleware
49
Cloud Platform
Test Data
Management
IBM UrbanCode Deploy with Patterns:• Dev-Test-Prod Environment
Provisioning• Full Stack Deployment• Environment Portability
Challenge Addressed: • Full Stack Provisioning
50 © IBM Corporation
Standardization Across the enterprise: Patterns and Templates
What to deploy?
Where to deploy (Physical or Cloud Resources) -Patterns
How to deploy?
Application Blueprints in
IBM UrbanCode Deploy
with Patterns
Recommended