Firefox and web performance testing, all hands sf 2018
0 likes238 views
This document discusses Firefox Test Engineering's goals around web performance testing. It aims to help support performance efforts on Firefox properties like Firefox Accounts and Add-Ons Manager. It also wants to spark discussions around performance across teams and surface issues. The document outlines using WebPageTest and related tools like Jenkins and Docker for synthetic web performance measurements, head-to-head browser comparisons, feature-specific tests, and dataset for regression testing. It provides examples testing Reddit loading in Chrome vs Firefox and measuring a site with private browsing and tracking protection enabled in Firefox.
Firefox and web performance testing, all hands sf 2018
- 2. Firefox and Web Performance Testing Stephen Donner Firefox Test Engineering June 15, 2018
- 3. $ whoami
- 5. ● Help support (or start) performance efforts on our Web properties & services/APIs (Firefox Accounts, AMO) ● Help spark discussions around performance, among the many various teams & areas ● Help surface issues with implementations (or the outright lack, thereof) of key performance metrics & toolchains (inc. WebPageTest itself) ○ e.g. webpagetest - support Firefox for Android ● Augment and complement existing workflows & tools ● Offer a simple -- yet effective & robust -- turnkey tool for the open-source community; currently, that is: ○ WebPageTest (PHP) ○ WebPageTest-API (NodeJS) ○ Jenkins ○ Docker ○ Python ○ statsd / graphite / grafana Goals
- 6. (A few) Use-cases * Synthetic* Web-performance measurements * Head-to-head competitive browser analysis * Basic feature-specific perf. comparisons * Stack-focused benchmarking * Datasets for site-specific regression-testing * I’m sure (royal) you have more; shall we tempt the live-demo gods? * We are unable to use Real-User Measurement (RUM) due to our strong privacy & security policies
- 13. Feature-Specific Performance Comparisons Firefox (desktop, release, Windows 10) Businessweek.com ● w/Private Browsing enabled ● ...and also Tracking Protection on
- 14. For More: ● GitHub repo: https://github.com/mozilla/wpt-api ● IRC: stephend on irc.mozilla.org / Slack: sdonner ● Wikimedia WPT Performance: https://wikitech.wikimedia.org/wiki/Performance/WebPageTest
- 15. Thank you!