TuleapCon2017-Quality-Assurance-Tuleap-Enterprise
2 likes299 views
This document discusses Tuleap's strategy for finding and reducing bugs before releasing software. It focuses on releasing early and often through dogfooding on tuleap.net and my.enalean.com, leveraging development builds, and implementing extensive testing and code reviews. Every commit undergoes unit, integration, and end-to-end testing and code reviews through Gerrit. Tuleap also dogfoods its own releases through "La Valid" each month to further identify bugs. This process has helped reduce the number of bugs reported by customers over the past 12 months.
TuleapCon2017-Quality-Assurance-Tuleap-Enterprise
- 1. #TuleapCon2017 @TuleapOpenALM What do we do to find bugs before you ? Tuleap Enterprise Quality Assurance Manuel VACELET Enalean CTO
- 2. #TuleapCon2017 @TuleapOpenALM Challenge : How to produce software without (too much) bugs ● Tuleap is growing at a rapid pace ● Deal with complexity (tracker flexibility, diverse environments, performances at scale) ● Trade-off: how much do are we willing to invest to release without bugs ?
- 3. #TuleapCon2017 @TuleapOpenALM Strategy ● Release early, release often ● Dog fooding (tuleap.net & my.enalean.com) ● Leverage on dev build, backport on Tuleap Enterprise ● (a lot) of tests ● (a lot) of code reviewed
- 4. #TuleapCon2017 @TuleapOpenALM Release early, release often ● 1 release every 4 weeks ● Less code, less bugs ● We cannot break everything at once ● Reduced test & impact surface
- 5. #TuleapCon2017 @TuleapOpenALM Dog fooding ● Everyday we get a fresh Tuleap on tuleap.net and my.enalean.com ● Very efficient to spot bugs on services that we are heavily using (UI, Trackers, Git, etc) ● Less efficient for things we don’t use at all
- 6. #TuleapCon2017 @TuleapOpenALM Tuleap ‘master’ channel vs. Tuleap Enterprise ● Get the fixes, let “others” get the bugs ● Chat ● Public “request” tracker ● Tuleap-devel mailing-list
- 7. #TuleapCon2017 @TuleapOpenALM Tuleap Enterprise Software Engineering FTW ● Gerrit workflow ● Each and every commit is peer reviewed (code) and functionally tested ● Each and every commit get merged in ‘master’ ASAP (early integration) ● Each and every commit get verified against : - 5800 unit tests (php 5.3 & php 5.6) - 380 Karma tests (angular apps) - 263 REST integration tests (php 5.3 / apache & php 5.6 / nginx) - 12 SOAP integration tests - 6 end to end tests (selenium) - 1 build and run (packaging & install)
- 8. #TuleapCon2017 @TuleapOpenALM Double dog fooding with TTL ● Every 4 weeks, on Wednesday “La Valid”
- 9. #TuleapCon2017 @TuleapOpenALM On the last 12 months ● 684 requests were reported on Tuleap “Request” tracker ● 180 were reported by at least 1 customer ● 22 were regressions
- 10. #TuleapCon2017 @TuleapOpenALM So, enjoy your reliable and secured Tuleap Enterprise platform!