Embed Size (px)
DESCRIPTION
Presentation about testers in Continuous Delivery of software. By Anders Lundsgård and Peter Sandberg from Scania Connected Services. The presentation was held in Helsinki the 8th of October on Talentum Events 2014.
Citation preview
Continuous Delivery - Any need for testers?TESTING FORUM 2014
October 8 2014, Talentum Events, Helsinki Finland
?
Scania engineers
• Anders Lundsgård– 4 years as Consultant– 6 years at Scania
• Release Responsible• Integrator• Architect
• Peter Sandberg– 7 years at ABB & Ericsson– 3 years at Scania
• Test Leading• Test Automation• Scrum Master
Agile to us
theleanstartup.com
Why is it a competitive advantage to iterate fast?
Improve the ability to respond to changeKill bad idéas – FAST
It is fun!
Agile to us
Agile what?
Waterfall”Agile”
Continuous IntegrationContinuous Delivery
DevOps
Scrum equals Agile?
© Bestoutcome Ltd 2014
Scrum not always equals Agile
Project planning
Last mile
Agile what?
Waterfall”Agile”
Continuous IntegrationContinuous Delivery
DevOps
Agile teams within the Enterprise An Agile Enterprise
Continuous Delivery ReleaseQuality
Smartphone access to driver/vehicle
data
Scania Connected Services
FMP
CommunicationServers
Web Servers
Monitoring Report
Email and SMS
remiders/alarms
Fleet Management
Portal
Remote Diagnosis
Current status message every minute
Web Service Interface
FMP
MPMP
Key concepts for Continuous Delivery
• Test Driven Development• Deployment Pipeline• Continuous Integration• Feature Toggles • Configuration Management• A/B tests• Always On
• Tear the walls
Cultural changes
Technical patterns
QAQuality Assurance
Unit Tests
Integration Tests
GUI Tests
Manual Regression
Test ice-cream cone
Quality AssuranceQuality Assistance
Test Pyramid
Unit Tests
Integration Tests
GUITests
Manual ”inspection”
Our test movement
Communication via error reports Communication face to face
Tests executed in desktop environment Tests into the Deployment Pipeline
GUI-oriented tests Tests towards service layer
Test specific dev environment Same dev environment as developers
Separated test teams Embedded testers
Requirements Usability
What gives quality?
I’m Done!We are Done, Done!
Deployment Pipeline
Commit Stage Acceptance Stage Load Stage Deploy Stage
Compile Unit Test Analysis Packaging Acc. Deploy
Acc. Tests Exploraty Tests
Load Tests
Perf Tests
Staging Deploy
Prod Deploy
.....
…..
Deployment Pipeline
Commit Stage Acceptance Stage Load Stage Deploy Stage
Compile Unit Test Analysis Packaging Acc. Deploy
Acc. Tests Exploraty Tests
Load Tests
Perf Tests
Staging Deploy
Prod Deploy
.....
…..
Claim culture
Continuous Integration
• Maintain a Single Source Repository• Automate the Build• Make Your Build Self-Testing• Everyone Commits To the Mainline Every Day• Every Commit Should Build the Mainline on an Integration
Machine• Keep the Build Fast• Test in a Clone of the Production Environment• Make it Easy for Anyone to Get the Latest Executable• Everyone can see what's happening• Automate Deployment
Configuration Management
Dev Ops
Config file here and there…
Click here and there …
First script #1 and then script
#2…
Failover this and that…
Register key here and there …
First alias #1 and then alias
#2…
Release plans
Single source of truthVCS
Feature Branch
Dev Branch #1
Main
Release Branch #1
Dev Branch #2
Feature Toggle
Main
GUI
Business Logic
Database
A/B tests
A/B tests
20%of users
Always On
We are down for maintenance
Our biggest obstacle
I want change!!
I want stability.
At the end of the day it is the person who writes the code who is
responsible for whether or not it works.
CodeTest
Design Deploy
Implemented CD i 2 months!
The Software Revolution Behind LinkedIn’s Gushing Profits
- We wanted to be at the point where… as soon as they were checking in their code… it was qualified and releasable…
- We were able to scale the team to hundreds of developers.
- It was a pretty big risk the business took, to say to its engineering team, you’re going to run across a bridge and burn it behind you.
2011
Kevin Scott
Google Trends
DevOps
Continuous Delivery
The Lean Startup
Continuous Integration
Automate – All The Things
Peters tests in CI environment
Any need for testers
No! (Not as a role but as a competence)
?
Contact
• Peter Sandberg– [email protected] – @patelikestotalk
• Anders Lundsgård– [email protected]– @anderslundsgard
