SlideShare a Scribd company logo

Large Scale Test Automation

Download as PPTX, PDF
A
Ashot Karapetyan

This document summarizes a presentation on secrets of successful test automation. It discusses scheduling automated tests to run every night for 10-20 minutes and limiting resources to 1GB RAM, no persistent storage, and 10MB network bandwidth. Standard reports on endpoints, response times, requests, and errors are shown. Measuring UI performance includes page load time with different networks, response traffic size, request counts, and centralized monitoring. Tools mentioned include Selenium Grid, Selenoid, and Grafana for scaling acceptance tests across browsers and versions.

Technology
Related topics:
Automation Testing
1 of 31
Download to read offline
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
Secrets of Successful Test Automation Narek Arushanov - Ashot Karapetyan Barcamp 2018 Synergy International Systems
Agenda Backend Performance UI Performance Scaling Acceptance Test
Requirements 1. Periodicity 2. Resource Allocation. 3. Summary Reports 4. Centralized Monitoring.
Scheduled Execution Every night 100 rps 10-20 min
Limits 1 GB RAM No Pers. Storage 10Mb network 1 core
Tools
Percentiles
Standard Reports Service endpoint Scale rps 95p in millis Total requests count # of Errors ml LoadAllLanguages 1 100 19 59547 0 LoadLanguagesById 1 100 29 59548 0 LoadMessagesByKeys 1 100 92 59547 0 LoadMessagesByLanguage Id 1 100 13 59548 0
Fail
OK
Centralized Monitoring
Measuring UI Performance 1. Page load time with different network speed 2. Response traffic size 3. Requests count 4. Automated 5. Centralized monitoring
UI performance tools 1. sitespeed.io 2. Navigation Timing API 3. BrowserMob Proxy + Selenium
HAR file structure
{HAR} {HAR}{HAR} Graphite Database Grafana
Page Load Time
Request Count
Scaling Acceptance Test
Scaling Acceptance Tests 1. Parallel Test Execution 2. Multi-browser 3. Browser Versions
Ways to test in browsers 1. Cloud web testing platform BrowserStack Sauce Labs Testing Bot
Ways to test in browsers 1. Cloud web testing platform 2. Selenium Grid
Problems 1. Hub is crushing. 2. Different browser versions. 3. Temp folders 4. Window focus 5. etc …
Ways to test in browsers 1. Cloud web testing platform 2. Selenium Grid 3. Selenoid
How to work solenoid
How to work solenoid
Selenium Grid UI
Selenoid UI
Advantages 1. Stability 2. Tests run in isolated container 3. Run tests in different browser versions 4. Tmpfs support 5. Hot configuration reload
Resources control 1. Limit total number of sessions per host 2. Queues 3. Limit CPUs per container 4. Limit RAM per container
Cluster Solution
Cheers! www.synisys.com

More Related Content

PPTX
Web Real-time Communications
Alexei Skachykhin
 
PPTX
New Relic_Heroku_Presentation_Dreamforce11
New Relic
 
PDF
Flink Forward Berlin 2018: Shriya Arora - "Taming large-state to join dataset...
Flink Forward
 
PDF
Scalable Dynamic Data Consumption on the Web
Ruben Taelman
 
PDF
Moving RDF Stream Processing to the Client
Ruben Taelman
 
PPTX
Modernizing Cloud and Hyperconverged Infrastructure monitoring
ManageEngine, Zoho Corporation
 
PPTX
Create seamless customer experiences
ManageEngine, Zoho Corporation
 
PPTX
Deliver seamless digital experience
ManageEngine, Zoho Corporation
 
Web Real-time Communications
Alexei Skachykhin
 
New Relic_Heroku_Presentation_Dreamforce11
New Relic
 
Flink Forward Berlin 2018: Shriya Arora - "Taming large-state to join dataset...
Flink Forward
 
Scalable Dynamic Data Consumption on the Web
Ruben Taelman
 
Moving RDF Stream Processing to the Client
Ruben Taelman
 
Modernizing Cloud and Hyperconverged Infrastructure monitoring
ManageEngine, Zoho Corporation
 
Create seamless customer experiences
ManageEngine, Zoho Corporation
 
Deliver seamless digital experience
ManageEngine, Zoho Corporation
 

What's hot (19)

PPTX
Visibility-from web application interface to the database
ManageEngine, Zoho Corporation
 
PPTX
SignalR Overview
Michael Sukachev
 
PDF
Continuous Self-Updating Query Results over Dynamic Linked Data
Ruben Taelman
 
PDF
Flink Forward San Francisco 2019: Real-time Processing with Flink for Machine...
Flink Forward
 
PDF
Consul scale
Ariel Moskovich
 
PPTX
Server side scalable web performance
Per Ökvist
 
PPTX
Building the right website monitoring strategy
ManageEngine, Zoho Corporation
 
PPTX
Apinizer - Full API Lifecycle and Integration Platform
Mustafa Yildiz
 
PPTX
Real-time Communications with SignalR
Shravan Kumar Kasagoni
 
PDF
Continuously Updating Query Results over Real-Time Linked Data
Ruben Taelman
 
PPT
Intro to signalR
Mindfire Solutions
 
PPTX
Server Monitoring 101
Shovon Paulinus Rozario
 
PPTX
Cloud applications monitoring in digital transformation era
ManageEngine, Zoho Corporation
 
PDF
Introduction to SignalR
University of Hawai‘i at Mānoa
 
PPTX
signalr
Owen Chen
 
PPTX
Introduction to web socket
HarunRRayhan
 
PPTX
SignalR for ASP.NET Developers
Shivanand Arur
 
PPTX
Building Realtime Web Applications With ASP.NET SignalR
Shravan Kumar Kasagoni
 
PPTX
Analysing high throughput data in real time
Hotstar
 
Visibility-from web application interface to the database
ManageEngine, Zoho Corporation
 
SignalR Overview
Michael Sukachev
 
Continuous Self-Updating Query Results over Dynamic Linked Data
Ruben Taelman
 
Flink Forward San Francisco 2019: Real-time Processing with Flink for Machine...
Flink Forward
 
Consul scale
Ariel Moskovich
 
Server side scalable web performance
Per Ökvist
 
Building the right website monitoring strategy
ManageEngine, Zoho Corporation
 
Apinizer - Full API Lifecycle and Integration Platform
Mustafa Yildiz
 
Real-time Communications with SignalR
Shravan Kumar Kasagoni
 
Continuously Updating Query Results over Real-Time Linked Data
Ruben Taelman
 
Intro to signalR
Mindfire Solutions
 
Server Monitoring 101
Shovon Paulinus Rozario
 
Cloud applications monitoring in digital transformation era
ManageEngine, Zoho Corporation
 
Introduction to SignalR
University of Hawai‘i at Mānoa
 
signalr
Owen Chen
 
Introduction to web socket
HarunRRayhan
 
SignalR for ASP.NET Developers
Shivanand Arur
 
Building Realtime Web Applications With ASP.NET SignalR
Shravan Kumar Kasagoni
 
Analysing high throughput data in real time
Hotstar
 
Ad

Similar to Large Scale Test Automation (11)

PDF
What is Selenium Automation Testing.pdf
AnanthReddy38
 
PDF
10 Reasons Why Selenium is used for Test Automation -Infographic.pdf
AnanthReddy38
 
PDF
Proven Approaches to AI-Powered E2E Testing.pdf
Applitools
 
PDF
Automation Best Practices
Sauce Labs
 
PDF
A Test Automation Platform Designed for the Future
Applitools
 
PDF
Applitools Autonomous 2.0 Sneak Peek.pdf
Applitools
 
PPTX
How to Optimise Continuous Testing
Sauce Labs
 
PDF
What is Selenium Testing.pdf
AnanthReddy38
 
PDF
How to test performance and not die trying
Diego Cardozo
 
PDF
Selenium Testing: A Comprehensive Guide to Automated Web Testing
pCloudy
 
PDF
Understanding the Basics of Automation Testing.pdf
khushnuma khan
 
What is Selenium Automation Testing.pdf
AnanthReddy38
 
10 Reasons Why Selenium is used for Test Automation -Infographic.pdf
AnanthReddy38
 
Proven Approaches to AI-Powered E2E Testing.pdf
Applitools
 
Automation Best Practices
Sauce Labs
 
A Test Automation Platform Designed for the Future
Applitools
 
Applitools Autonomous 2.0 Sneak Peek.pdf
Applitools
 
How to Optimise Continuous Testing
Sauce Labs
 
What is Selenium Testing.pdf
AnanthReddy38
 
How to test performance and not die trying
Diego Cardozo
 
Selenium Testing: A Comprehensive Guide to Automated Web Testing
pCloudy
 
Understanding the Basics of Automation Testing.pdf
khushnuma khan
 
Ad

Recently uploaded (20)

PDF
Electronic commerce courselecture one. Pdf
OmerMohamed64
 
PPTX
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Chinchu40
 
PDF
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
PDF
Machine learning based COVID-19 study performance prediction
IAESIJAI
 
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
Dropbox
 
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
PDF
Network Security Unit 5.pdf for BCA BBA.
Serpent6
 
PPTX
A Presentation on Artificial Intelligence
memembruh336
 
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
PPTX
Tartificialntelligence_presentation.pptx
ry7r52mzb4
 
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
MatthewLewis227954
 
PDF
Approach and Philosophy of On baking technology
30anthuong17
 
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
AgnesMunisi
 
PPTX
MYSQL Presentation for SQL database connectivity
Swati270511
 
PPTX
1. Introduction to Computer Programming.pptx
bonakiduza1024
 
Electronic commerce courselecture one. Pdf
OmerMohamed64
 
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Chinchu40
 
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
Machine learning based COVID-19 study performance prediction
IAESIJAI
 
Dropbox Q2 2025 Financial Results & Investor Presentation
Dropbox
 
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
Network Security Unit 5.pdf for BCA BBA.
Serpent6
 
A Presentation on Artificial Intelligence
memembruh336
 
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
Tartificialntelligence_presentation.pptx
ry7r52mzb4
 
Group 1 Presentation -Planning and Decision Making .pptx
MatthewLewis227954
 
Approach and Philosophy of On baking technology
30anthuong17
 
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
SOPHOS-XG Firewall Administrator PPT.pptx
AgnesMunisi
 
MYSQL Presentation for SQL database connectivity
Swati270511
 
1. Introduction to Computer Programming.pptx
bonakiduza1024
 

Large Scale Test Automation

Editor's Notes

  • #2: Software engi. in test
  • #4: Response time 1s
  • #5: Response time 1s
  • #7: Locust Scalability, because you can run Locust distributed with many agents. Based on gevent simulate thousand of users in single process
  • #8: orinak 10ic 5 1s 2 3s. 3 4s nkarel estex
  • #12: poxel chart@
  • #15: Verjum asel en inch karox enq chapel
  • #21: Sakayn mer tester@ run enq talis mer development envirementum, ev chenq uzum kaxvacutyun unenanq ayl servisneric.
  • #24: Selenoid @ nuyn selenium serveri implementacian e , go lezvov grac. vor@ aveli arag e ev aveli tetev. ira hamar ka shat harmar dockerov realizacia