Embed Size (px)
DESCRIPTION
Test automation is omnipresent these days. Still, many organisations struggle with implementation. What tools do you select, do you allow teams to pick their own effectieve solution, or do you strive for a more cetralized approach. The answer lies in a carefull balance, where you allow new fit for purpose solutions to emerge, but reduce wildgrowth in the tool landschape. This presentation explains how we deal with testautomation at DeltaLloyd. In our different departments created working solutions, that are bundled in a Delta Lloyd broad vision on test automation. In our development we have , ie the test manager of Delta Lloyd with the external consultant , looked at how we could align supply and demand. We used the analogy of the fruit basket. Fruit represents the various types of test automation solutions. With business drivers as a starting point, we did prioritze de development of test automation solutions, use piloting to test the solutions in practize. When a pilot is finished susessfully it was made availble for the the other departments. The fruit is ripe and IT managers can pick it from the fruit basket, knowing that implementation will be easy and swift. The central organization provides solution, knowledge and support. The presentation will eloborate on the model. How does it help to define the fruit, and the support towards other departments. The presentation covers a wide range from tools, via required skills, resources & processes, upto the aligment with the business. For this we define 4 groups of people, the wholesale, gardener, auctioneer and Consumer, each with its own goals and skill set. In our presentation we want to share our approach. It benefits Delta Lloyds test automation and surely can help other companies as well.
Citation preview
9 april 2014
Test automa3on in your organiza3on,
put it in a basket Ard Kramer Derk-‐Jan de Grood
2
A shared experience
Ard Kramer • Testmanager Delta Lloyd Leven • @ard_kramer
Derk-‐Jan de Grood • Principal consultant Valori • @DerkJandeGrood • hCp://djdegrood.wordpress.com/
Mission Statement
We want effec3ve usage of Test Automa3on throughout the organiza3on
3
Convert Manual to
Automated TesLng
Re-‐usage of knowlegde and
standarized approach
Tool selecLon should
lead to leading tool
Thou shall use this tool 4
5
6
Central versus/and/or Decentral approach?
7
… or restricted ?
Wildgrowth …
8
Forces and expecta3ons
TA Group
Clear decisions
TransiLon to operaLonal use
Lower iniLal threshold
Embedding in organizaLon
Ul3mate Goals (ask de business)
9
Quality Efficiency Time to Market
10
Middelen Tastbare hulpmiddelen zoals tool, templates, manuals, etc
Oplossingen ImplementaLe van middelen teneinde een doel te behalen
Dialoog Zoektocht naar de juiste oplossing. Het bij elkaar brengen van doelstelling en oplossing
Doelstelling Businessdoel zoals gedefinieerd door de business en IT managers
Groene appel: Oplossing die reeds ontwikkeld is in andere divisie
Rode appel: Niet bestaande oplossing
Time-‐to-‐Market Efficiency
Minder problemen in PRD
Businesscase Businesscase Businesscase
Consument
Veilingmeester
Tuinder
Groothandel
Implementa3e-‐fasen I: Oplossings-‐gedreven
II: Vraag gedreven
III: Oplossing en vraag gedreven
InteracLe
Aanb
od ged
reven
Vraag gedreven
11
What choice do you make?
12
What tool to put in the spotlight ?
13
There is in doing automated tests
14
Simple steps: Make visible what you will do
15
Key process
16
TI PoC Ops
We did not need to sell it…
17 Value
ApplicaLon
A
ApplicaLon B
ApplicaLon C
18
Are you ready for the real challenge…
19
Economische haalbaarheid
Technische haalbaarheid
Organisatorische
haalbaarheid
1. Welke applicaties komen in aanmerking 2. Welke Divisies willen graag aan de slag
met test automatisering 3. Opstellen prioritering (roadmap met daarin
TI, PoC en Operationele fase ingepland per divisie
4. MT besluit ter consolidatie 5. Inplannen TI sessies
Economische haalbaarheid
Technische haalbaarheid
Test Analyst Test Navigator ART team Test Navigator
ART team
Support
Operationele fase
Test Analyst
Businesscase
MT sturing
Eerste inschatting door IT/Test manager
Commitment op prioritering en roadmap
Organisatorische
haalbaarheid
Fine tunen BC op basis van PoC bevindingen
Hamerslag operationele
launch
Support door ART team
PoC (proef) fase Verkenningsfase
PoC rapport
Test Navigator In divsie
Test Navigator ART team
Business Case
21
0"
20000"
40000"
60000"
80000"
100000"
120000"
140000"
160000"
180000"
0" 5" 10" 15" 20" 25" 30" 35" 40" 45"
Totale'kosten'
Aantal'testruns'
Businescase''
Kosten"Handma4g"
Kosten"Tool"X"
Give me the 10% most cri3cal tests in your testset
NOW
22
TA#Group#
Clear#decisions#
Transi2on#to#opera2onal#use#
Lower#ini2al#threshold#
Embedding#in#organiza2on#
24
Roles and competences
25
Helpdesk
1. Locks (resources)
2. Windows 7 security settings
3. Tool configuratie: qtp licentie, alm client
registratie, qtp-> alm connectiviteit
4. Vragen mbt add ons en ondersteuning
5. Password reset
6. Licentie uitbreidingen
7. Toevoegen nieuwe gebruikers
8. Nieuwe domeinen aanmaken
9. Back up en restore procedure
10. Evt defect procedure met
gebruikmaking Hp defect module
11. Onderhoud mbt patches en nieuwe
versies (Alm en uft)
Roles and competences
26
Helpdesk
Forecasting
Sharing
Buying
Upgrading
Licence manager
Roles and competences
27
Helpdesk …. Coach Licence manager
Sharing knowledge
28
v
29
30
Other tools… Selenium Soatest VirtualisaLon NFT tesLng
Other Ini3a3ves
Projects require a
different approach
SCOPE !?!
WRAP-‐UP
31
Wrap-‐up
Thou%shall
%use%this%to
ol%
6"
32
8"
What%choise%do%you
%make?%
11"
Middelen'Tastbare"hulpmiddelen"zoals"tool,"templates,"manuals,"etc"
Oplossingen'Implementa7e"van"middelen"teneinde"een"doel"te"behalen"
Dialoog'Zoektocht"naar"de"juiste"oplossing."Het"bij"elkaar"brengen"van"doelstelling"en"oplossing"
Doelstelling'Businessdoel"zoals"gedefinieerd"door"de"business"en"IT"managers"
Groene"appel:""Oplossing"die"reeds"ontwikkeld"is"in"andere"divisie"
Rode"appel:""Niet"bestaande"oplossing"
Time2to2Market' Efficiency ''
Minder'problemen'in'PRD'
Businesscase" Businesscase" Businesscase"
Consument"
Veilingmeester"
Tuinder"
Groothandel"
Implementa=e2fasen'I:"OplossingsIgedreven"
II:"Vraag"gedreven"
III:"Oplossing""en"vraag"gedreven""
Interac7e"
Aanb
od"ged
reven"
Vraag"gedreven
"
1. Welke applicaties komen in aanmerking
2. Welke Divisies willen graag aan de slag
met test automatisering
3. Opstellen prioritering (roadmap met daarin
TI, PoC en Operationele fase ingepland
per divisie
4. MT besluit ter consolidatie
5. Inplannen TI sessies
Economische
haalbaarheid
Technische
haalbaarheid
Test%Analyst%
Test%Navigator%
ART%team%
Test%Navigator%
ART%team%
Support
Operationele fase
Test%Analyst%
Businesscase
MT sturing
Eerste inschatting
door IT/Test
manager
Commitment op
prioritering en roadmap
Organisatorische
haalbaarheid
Fine tunen BC op
basis van PoC
bevindingen
Hamerslag
operationele
launch
Support%door%
ART%team%
PoC (proef) fase
Verkenningsfase
PoC$rapport$
Test%Navigator%
In%divsie%
%
Test%Navigator%
ART%team%
TI# PoC# Ops#
TA#Group#
Clear#decisions#
Transi2on#to#opera2onal#use#
Lower#ini2al#threshold# Embedding#in#organiza2on#
12#
There%is%%%%in%doing%automated%tests%
Economische haalbaarheid
Technische haalbaarheid
Organisatorische haalbaarheid
Put it in a basket ?
33
Change needs speed, limited scope and visibility
People know
what they need
People determine succes
