Embed Size (px)
Citation preview
Wargaming Public API: Quality AssuranceThe Dark Side of the PAPI
Pavel RebrovQA Automation Engineer
Anton KapitanenkoQA Manager
1
2
2.5 years ago…
World of Tanks
methods
PAPI WG Quality Assurance
Unit
3
2 years ago…
World of Tanks
methods
DevRoom+
API Explorer
PAPI WG Quality Assurance
Unit Unit
Manual Tests
4
2 years ago…
WoT v.1methodsManual Tests
PAPI WG Quality Assurance
Unit
5
1.5-1 years ago
WoT v.1methodsManual Tests
UI Tests
Functional
Unit
AutomatedSelenium
Python (nose)
PAPI WG Quality Assurance
6
Cost of Change
PAPI WG Quality Assurance
Cost
Phase
Requirements Design Coding Testing Prod
x150
x50
x20x5x1
7PAPI WG Quality Assurance 7
Cost of ChangeCo
st
Phase
Requirements Design Coding Testing Prod
x150
x50
x20x5x1
Unit Func. UI Manual
PAPI WG Quality Assurance
8Tests
Spec
Requirement to feature workflow
PDM
Dev QA
Suite
PM
Dev QA
Scripts
Test
da
ta
Code
Unit
Tests
PM
Docs
TRUN
KST
ABLE
Req
Accept. criteriasRequirements
Accept. criteriasRequirements
DoD
PAPI WG Quality Assurance
9
Requirement to feature workflow
PM
STAB
LE QA
PRO
D
PAPI WG Quality Assurance
10
Unit
WoWP
1.5 years ago: Tests Prioritizing
Manual Tests
UI Tests
Functional
Unit
FunctionalUI
Manual
Manual Tests
UI Tests
Functional
Unit
1st Priority
2nd Priority
PAPI WG Quality Assurance
11
Now…
UI
Functional
Unit
Manual
2 years ago
Now
Developers 3 5
QA 1 2
Components 2 > 6
Methods ~15 > 100
Downtime 6 – 8 h 20 – 30 min
PAPI WG Quality Assurance
12
Future…
1) Webium — common WG automation framework
2) … Continuous Delivery Continuous Deployment
PAPI WG Quality Assurance
Thanks! Any questions?
Pavel Rebrov
QA Automation Engineer
Anton Kapitanenko
QA Manager
