SlideShare a Scribd company logo
Wargaming Public API: Quality Assurance
The Dark Side of the PAPI
Pavel Rebrov
QAAutomation Engineer
Anton Kapitanenko
QA Manager
1
2
2.5 years ago…
World of
Tanks
methods
PAPI WG Quality Assurance
Unit
3
2 years ago…
World of
Tanks
methods
DevRoom
+
API
Explorer
PAPI WG Quality Assurance
Unit Unit
Manual
Tests
4
2 years ago…
WoT v.1
methods
Manual Tests
PAPI WG Quality Assurance
Unit
5
1.5-1 years ago
WoT v.1
methods
Manual Tests
UI Tests
Functional
Unit
A
u
t
o
m
a
t
e
d
Selenium
Python (nose)
PAPI WG Quality Assurance
6
Cost of Change
PAPI WG Quality Assurance
Cost
Phase
Requirements Design Coding Testing Prod
x150
x50
x20
x5x1
7PAPI WG Quality Assurance 7
Cost of Change
Cost
Phase
Requirements Design Coding Testing Prod
x150
x50
x20
x5x1
Unit Func. UI Manual
PAPI WG Quality Assurance
Tests
Spec
8
Requirement to feature workflow
PDM
Dev QA
Suite
PM
Dev QA
Scripts
Test
data
Code
PM
DocsTRUNKSTABLE
Req
Accept. criterias
Requirements
Accept. criterias
Requirements
DoD
PAPI WG Quality Assurance
9
Requirement to feature workflow
PM
STABLE
QA
PROD
PAPI WG Quality Assurance
Unit
WoWP
10
1.5 years ago: Tests Prioritizing
Manual Tests
UI Tests
Functional
Unit
Functional
UI
Manual
Manual
Tests
UI Tests
Functional
Unit
1st Priority
2nd Priority
PAPI WG Quality Assurance
11
Now…
UI
Functional
Unit
Manual
2 years
ago
Now
Developers 3 5
QA 1 2
Components 2 > 6
Methods ~15 > 100
Downtime 6 – 8 h 20 – 30 min
PAPI WG Quality Assurance
12
Future…
1) Webium — common WG automation
framework
2) … Continuous Delivery  Continuous Deployment
PAPI WG Quality Assurance
Thanks! Any questions?
Pavel Rebrov
QAAutomation Engineer
p_rebrov@wargaming.net
Anton Kapitanenko
QA Manager
a_kapitanenko@wargaming.net

More Related Content

PDF
EFL QA: Where Are We and Where Should We Go?
PDF
Improving Untestable Code
PDF
APIdays Paris 2018 - Client Library Automation, Inside Out, Avital Tzubeli, D...
PDF
GTAC 2015
PPTX
sitHH: The test guy
PDF
Continous Delivery Toronto Presentation
PDF
Devops practice
PDF
Introducing Continuous Delivery in the Enterprise
EFL QA: Where Are We and Where Should We Go?
Improving Untestable Code
APIdays Paris 2018 - Client Library Automation, Inside Out, Avital Tzubeli, D...
GTAC 2015
sitHH: The test guy
Continous Delivery Toronto Presentation
Devops practice
Introducing Continuous Delivery in the Enterprise

What's hot (20)

PDF
Pro_Tools_Tier_1
PDF
MOPCON 2015 - Tips of Mobile Continuous Delivery
PPTX
Gradle plugins for Test Automation
PDF
Continuous Delivery for Mobile platforms (iOS and a bit of Android)
PPTX
Sonar Overview
PDF
Jump from testing to QA - TestIL 2019 (EN)
PDF
Pro_Tools_Tier_1
PPT
Agile Testing Vs V
PDF
Heidi Omar CV
PDF
Scala ♥ Graal by Flavio Brasil
PDF
Release & Iterate Faster: Stop Manual Testing
PDF
I Love APIs 2015: Getting **IT Done Workshop
PPT
Agile Testing Vs V
PDF
PDF
Go ahead outside Japan
PDF
From git to forge
PDF
Mast Technology New Product Development Specialists
PPT
PPTX
How to Slay a Battery of Tests
PDF
How to slay a battery of tests
Pro_Tools_Tier_1
MOPCON 2015 - Tips of Mobile Continuous Delivery
Gradle plugins for Test Automation
Continuous Delivery for Mobile platforms (iOS and a bit of Android)
Sonar Overview
Jump from testing to QA - TestIL 2019 (EN)
Pro_Tools_Tier_1
Agile Testing Vs V
Heidi Omar CV
Scala ♥ Graal by Flavio Brasil
Release & Iterate Faster: Stop Manual Testing
I Love APIs 2015: Getting **IT Done Workshop
Agile Testing Vs V
Go ahead outside Japan
From git to forge
Mast Technology New Product Development Specialists
How to Slay a Battery of Tests
How to slay a battery of tests
Ad

Viewers also liked (7)

ODP
F2-REST seminar april 2014
PDF
What Makes a Great Open API?
PPTX
API Governance in the Enterprise
PPTX
API Management and Kubernetes
PPTX
Fastest Growing Web API Categories: Last 6 Months
PDF
ProgrammableWeb's eSignature API Research Report
PDF
RESTful API Design, Second Edition
F2-REST seminar april 2014
What Makes a Great Open API?
API Governance in the Enterprise
API Management and Kubernetes
Fastest Growing Web API Categories: Last 6 Months
ProgrammableWeb's eSignature API Research Report
RESTful API Design, Second Edition
Ad

Similar to WGDC QA Kapitanenko-Rebrov (20)

PDF
Automated Testing in DevOps
PDF
IPv6 Development and Testing Services
PDF
Angular 2 kickstart
PPTX
2016 NIWeek - TI’s Continuous Delivery Machine for Accelerated Application De...
PPTX
Suparna - XCUITest
PDF
Presentation security automation (Selenium Camp)
DOCX
Trainmesofttech Manual testing course content
PDF
Enterprise E-commerce Webinar Series, Episode 2: Deploying and Monitoring You...
DOC
SoftwareQualityControlProfessional_12Yrs_SreekrishnaHPandit
PDF
Enterprise E-commerce Webinar #2 - Deploy & Monitor APIs
PDF
Con-way Case Study: Optimizing Application Integration Software Development L...
PDF
SonarQube와 함께하는 소프트웨어 품질 세미나 - 지속적인 코드 인스펙션 SonarQube 활용 방안
PDF
Modernizing Traditional Applications with Docker EE: From PoC to Production
PPTX
Techniques for Scaling the Netflix API - QCon SF
PPT
Fut Lsi
PDF
Manual Testing Syllabus By KRN Informatix
DOCX
Qtp basic
PPTX
AppSphere 2016 - Automate performance testing with AppDynamics using continuo...
PPTX
Project P Open Workshop
PPTX
Building a culture of quality at scale
Automated Testing in DevOps
IPv6 Development and Testing Services
Angular 2 kickstart
2016 NIWeek - TI’s Continuous Delivery Machine for Accelerated Application De...
Suparna - XCUITest
Presentation security automation (Selenium Camp)
Trainmesofttech Manual testing course content
Enterprise E-commerce Webinar Series, Episode 2: Deploying and Monitoring You...
SoftwareQualityControlProfessional_12Yrs_SreekrishnaHPandit
Enterprise E-commerce Webinar #2 - Deploy & Monitor APIs
Con-way Case Study: Optimizing Application Integration Software Development L...
SonarQube와 함께하는 소프트웨어 품질 세미나 - 지속적인 코드 인스펙션 SonarQube 활용 방안
Modernizing Traditional Applications with Docker EE: From PoC to Production
Techniques for Scaling the Netflix API - QCon SF
Fut Lsi
Manual Testing Syllabus By KRN Informatix
Qtp basic
AppSphere 2016 - Automate performance testing with AppDynamics using continuo...
Project P Open Workshop
Building a culture of quality at scale

WGDC QA Kapitanenko-Rebrov