SlideShare a Scribd company logo
Continuous Testing
at Code.org
@bcjordan
Brian Jordan, software engineer at Code.org
Code.org
non-profit
expanding
participation in CS
Hour of Code
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
230 million tried
Hour of Code
now what?
full curricula,
district partnerships,
professional
development,
policy change
K-12 CS Curriculum
25k K-12
teachers trained
courses:
300k teachers
10mm students
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
how did Code.org
start automated testing?
development
in 2013-2014
why test?
what is Code.org's
testing context?
the context
the context
the context
the context
the context
so how do we
test all that?
how we started
Selenium testing
how our tests are
organized and run
selenium-webdriver
cucumber
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
takeaways
Build a library of
steps
Build a library of
test levels
Build a library of
annotations
@no_mobile
@no_ie9
@skip
@db_access@as_student
@eyes
who writes tests?
who/what
runs tests?
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
what challenges
did we end up facing?
challenge:
multiple browsers
solution:
selenium-webdriver
Sauce Labs
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
challenge:
testing new changes
solution:
chromedriver
sauce-connect
solution (soon):
pull request tests in CI
challenge:
interaction,
drag-and-drop
solution:
jQuery Simulate
$(selector).drag…
challenge:
visual, responsive
changes
hackathon solution?
not easy...
actual thing!
using eyes
converted feature
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
ignoring regions
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
what do tests look
like when running?
(not) wasting time
speeding up
test runs
2014:
60-90 min of tests
parallelization
at runner level
2015:
60-90 min of tests
to
20-30 min of tests
justifying
tests
the bug collection
missing button
duplicate button
Firefox getBBox()
JS % error: node build issue
Chrome 50 offsetWidth
my favorite
bug ever
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
who investigates
failures?
what about failures
pass tests?
dev of the day
[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit
what's next?
per-PR tests
managing more eyes tests
cross-browser responsive
eyes tests
github.com/tourdedave/responsive-web-testing
takeaways
start small
everybody
tests
periodically
invest in
speed-ups
code.org/help
github.com/code-dot-org
Thanks!
@bcjordan
Brian Jordan, software engineer at Code.org
code.org/help
github.com/code-dot-org
Thanks!
@bcjordan
Brian Jordan, software engineer at Code.org

More Related Content

PDF
Mastering UI automation at Scale: Key Lessons and Best Practices (By Fernando...
PDF
Mastering Test Automation: How to Use Selenium Successfully
PDF
Continuous Testing Meets the Classroom at Code.org
PDF
Selenium Tips & Tricks, presented at the Tel Aviv Selenium Meetup
PDF
How To Use Selenium Successfully
PDF
Getting Started with Selenium
PPTX
Beyond the Release: CI That Transforms Organizations
PDF
How To Use Selenium Successfully
Mastering UI automation at Scale: Key Lessons and Best Practices (By Fernando...
Mastering Test Automation: How to Use Selenium Successfully
Continuous Testing Meets the Classroom at Code.org
Selenium Tips & Tricks, presented at the Tel Aviv Selenium Meetup
How To Use Selenium Successfully
Getting Started with Selenium
Beyond the Release: CI That Transforms Organizations
How To Use Selenium Successfully

What's hot (20)

PDF
Testing Code.org's Interactive CS Curriculum
PDF
How to Use Selenium, Successfully
PDF
Selenium Best Practices with Jason Huggins
PDF
How To Use Selenium Successfully (Java Edition)
PDF
Rspec and Capybara Intro Tutorial at RailsConf 2013
PPTX
Story Testing Approach for Enterprise Applications using Selenium Framework
DOCX
Automation Frame works Instruction Sheet
PDF
Practical Tips & Tricks for Selenium Test Automation
PDF
Selenium 2 - PyCon 2011
PDF
TestingAR XX - Protractor e2e Test Framework - Introduction what we have lear...
PDF
Practical Tips & Tricks for Selenium Test Automation - Dave Haeffner
PPTX
Selenium Design Patterns
PDF
Testing with Codeception
PDF
AngularJS and Protractor
PDF
Using The Page Object Pattern
PPTX
Automated Testing using JavaScript
PPTX
Automated UI Testing Done Right (QMSDNUG)
PPTX
BDD with SpecFlow and Selenium
PDF
DevQA: make your testers happier with Groovy, Spock and Geb (Greach 2014)
PDF
Selenium Tips & Tricks
Testing Code.org's Interactive CS Curriculum
How to Use Selenium, Successfully
Selenium Best Practices with Jason Huggins
How To Use Selenium Successfully (Java Edition)
Rspec and Capybara Intro Tutorial at RailsConf 2013
Story Testing Approach for Enterprise Applications using Selenium Framework
Automation Frame works Instruction Sheet
Practical Tips & Tricks for Selenium Test Automation
Selenium 2 - PyCon 2011
TestingAR XX - Protractor e2e Test Framework - Introduction what we have lear...
Practical Tips & Tricks for Selenium Test Automation - Dave Haeffner
Selenium Design Patterns
Testing with Codeception
AngularJS and Protractor
Using The Page Object Pattern
Automated Testing using JavaScript
Automated UI Testing Done Right (QMSDNUG)
BDD with SpecFlow and Selenium
DevQA: make your testers happier with Groovy, Spock and Geb (Greach 2014)
Selenium Tips & Tricks
Ad

Viewers also liked (20)

PDF
*Webinar* Learn from the Experts: How to Boost Test Coverage with Automated V...
PPTX
Testdroid: Release Perfect Apps with Mobile Visual Testing in the Cloud
PPTX
Stc 2015 automated_accessibility_testing.ppt
PDF
Dave Haeffner's Proven Method to Grading the Quality of Selenium Tests
PPTX
Breaking the Code Handout from Tech Expo 2015
PDF
Arabic level-0-class-10
PDF
Virtual Optimizely Experience 2014 - Code.Org - How the Hour of Code is Testi...
PDF
Before i-pray
PPTX
Making the Transition from Manual to Automated Testing
PPSX
Prophet's Wudoo Described Study Supplement
PDF
Join Pinkoi!
PPT
Automated Testing vs Manual Testing
PDF
Introduction to Test Automation - Technology and Tools
PPT
Web Test Automation with Selenium
PDF
Introduction to Test Automation
PDF
Test Driven Development (TDD)
PDF
What i've learned about test automation and DevOps
PDF
Automation Testing using Selenium
PPT
How my body works
PDF
Automated vs manual testing
*Webinar* Learn from the Experts: How to Boost Test Coverage with Automated V...
Testdroid: Release Perfect Apps with Mobile Visual Testing in the Cloud
Stc 2015 automated_accessibility_testing.ppt
Dave Haeffner's Proven Method to Grading the Quality of Selenium Tests
Breaking the Code Handout from Tech Expo 2015
Arabic level-0-class-10
Virtual Optimizely Experience 2014 - Code.Org - How the Hour of Code is Testi...
Before i-pray
Making the Transition from Manual to Automated Testing
Prophet's Wudoo Described Study Supplement
Join Pinkoi!
Automated Testing vs Manual Testing
Introduction to Test Automation - Technology and Tools
Web Test Automation with Selenium
Introduction to Test Automation
Test Driven Development (TDD)
What i've learned about test automation and DevOps
Automation Testing using Selenium
How my body works
Automated vs manual testing
Ad

Similar to [Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit (20)

PDF
Tests for Every Branch Using CircleCI and Sauce Labs to Continuously Test CS ...
DOC
Yuvaraj-Resume
PDF
Kevin Nelms Baxter Resume
PPTX
From four to forty in four years - lessons from growing a team
PDF
Der Test Manager ist tot - lang lebe der Test Master
PDF
Supporting Coding and Testing
DOC
Lavina CV
DOC
Resume-UI developer
PPTX
Fullstack JavaScript Developer - E-Degree
PPTX
DevOpsDays SLC - Platform Engineers are Product Managers.pptx
ODP
Chennai Drupal Meet
PDF
Software Engineering Careers
PDF
DevOpsDays LA - Platform Engineers are Product Managers.pdf
PDF
Best Practices for React Developer Test Technical Assessment for Hiring.pdf
DOC
shekhar_rawat_Java
DOCX
AbhinavKatyayen
PPT
6.11.2013 - 2013 - Continuous Delivery - Testing for Agile Through Continuo...
DOCX
Munmi testing
DOCX
Munmi testing
DOCX
Munmi_testing
Tests for Every Branch Using CircleCI and Sauce Labs to Continuously Test CS ...
Yuvaraj-Resume
Kevin Nelms Baxter Resume
From four to forty in four years - lessons from growing a team
Der Test Manager ist tot - lang lebe der Test Master
Supporting Coding and Testing
Lavina CV
Resume-UI developer
Fullstack JavaScript Developer - E-Degree
DevOpsDays SLC - Platform Engineers are Product Managers.pptx
Chennai Drupal Meet
Software Engineering Careers
DevOpsDays LA - Platform Engineers are Product Managers.pdf
Best Practices for React Developer Test Technical Assessment for Hiring.pdf
shekhar_rawat_Java
AbhinavKatyayen
6.11.2013 - 2013 - Continuous Delivery - Testing for Agile Through Continuo...
Munmi testing
Munmi testing
Munmi_testing

More from Applitools (20)

PDF
Applitools Platform Pulse: What's New and What's Coming - July 2025
PDF
Code and No-Code Journeys: The Maintenance Shortcut
PDF
Code and No-Code Journeys: The Coverage Overlook
PDF
Creating Automated Tests with AI - Cory House - Applitools.pdf
PDF
Navigating EAA Compliance in Testing.pdf
PDF
AI-Assisted, AI-Augmented & Autonomous Testing
PDF
Code or No-Code Tests: Why Top Teams Choose Both
PDF
The ROI of AI-Powered Testing, presented by Applitools
PDF
Building No-code Autonomous E2E Tests_Applitools.pdf
PDF
Conquer 6 Testing Challenges_Applitools.pdf
PDF
Autonomous End-to-End Testing for Online Banking Applications Presented with ...
PDF
Playwright Visual Testing Best Practices, presented by Applitools
PDF
Cross-Browser and Cross-Device Testing | Applitools in Action
PDF
Advanced Debugging Techniques | Applitools in Action.pdf
PDF
AI-Powered Testing Strategies for the Seasonal Shopping Surge.pdf
PDF
Test Automation for Dynamic Applications _ Applitools in Action.pdf
PDF
Proven Approaches to AI-Powered E2E Testing.pdf
PDF
Applitools Autonomous 2.0 Sneak Peek.pdf
PDF
Building the Ideal CI-CD Pipeline_ Achieving Visual Perfection
PDF
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Applitools Platform Pulse: What's New and What's Coming - July 2025
Code and No-Code Journeys: The Maintenance Shortcut
Code and No-Code Journeys: The Coverage Overlook
Creating Automated Tests with AI - Cory House - Applitools.pdf
Navigating EAA Compliance in Testing.pdf
AI-Assisted, AI-Augmented & Autonomous Testing
Code or No-Code Tests: Why Top Teams Choose Both
The ROI of AI-Powered Testing, presented by Applitools
Building No-code Autonomous E2E Tests_Applitools.pdf
Conquer 6 Testing Challenges_Applitools.pdf
Autonomous End-to-End Testing for Online Banking Applications Presented with ...
Playwright Visual Testing Best Practices, presented by Applitools
Cross-Browser and Cross-Device Testing | Applitools in Action
Advanced Debugging Techniques | Applitools in Action.pdf
AI-Powered Testing Strategies for the Seasonal Shopping Surge.pdf
Test Automation for Dynamic Applications _ Applitools in Action.pdf
Proven Approaches to AI-Powered E2E Testing.pdf
Applitools Autonomous 2.0 Sneak Peek.pdf
Building the Ideal CI-CD Pipeline_ Achieving Visual Perfection
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton

Recently uploaded (20)

PDF
Well-logging-methods_new................
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PPTX
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
PPTX
Fundamentals of safety and accident prevention -final (1).pptx
PPTX
UNIT 4 Total Quality Management .pptx
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PPTX
OOP with Java - Java Introduction (Basics)
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
Current and future trends in Computer Vision.pptx
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
PDF
R24 SURVEYING LAB MANUAL for civil enggi
PDF
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
PPTX
Safety Seminar civil to be ensured for safe working.
PDF
composite construction of structures.pdf
PPTX
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PPT
Project quality management in manufacturing
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PPT
Mechanical Engineering MATERIALS Selection
Well-logging-methods_new................
CYBER-CRIMES AND SECURITY A guide to understanding
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
Fundamentals of safety and accident prevention -final (1).pptx
UNIT 4 Total Quality Management .pptx
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
OOP with Java - Java Introduction (Basics)
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
UNIT-1 - COAL BASED THERMAL POWER PLANTS
Current and future trends in Computer Vision.pptx
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
R24 SURVEYING LAB MANUAL for civil enggi
Unit I ESSENTIAL OF DIGITAL MARKETING.pdf
Safety Seminar civil to be ensured for safe working.
composite construction of structures.pdf
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
Embodied AI: Ushering in the Next Era of Intelligent Systems
Project quality management in manufacturing
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
Mechanical Engineering MATERIALS Selection

[Webinar] Continuous Testing Done Right: Test Automation at the World's Leading Non-profit