Fundamentals of crowdsourced testing
1 like127 views
The document discusses the importance of crowdsourced testing in software development, emphasizing that rapid releases without quality assurance can damage a brand's reputation. Traditional testing methods are outdated and inefficient, leading to the adoption of agile and devops approaches that integrate professional testers for timely and effective results. Crowdsourced testing offers scalability, speed, and flexibility, addressing the challenges of modern software development while maintaining high standards of quality.
Fundamentals of crowdsourced testing
- 2. You want to release quality software that the market and consumers want.
- 3. The problem is that the pressure to deliver is immense.
- 4. Fundamentals of Crowdsourced Testing 48% Of users are less likely to use an app again if they are unhappy with the app’s performance.
- 5. Fundamentals of Crowdsourced Testing 79% Of people are less likely to purchase from a site again if they experience performance issues.
- 6. Fundamentals of Crowdsourced Testing 88% Of consumers form negative opinions of brands if the brand has a poorly performing app.
- 7. We get it. Releasing quality software is hard. We know because we’ve been in your shoes.
- 8. Fundamentals of Crowdsourced Testing Agenda ● Who we are ● The old way ● The new way ● Automate all the things! ● Don’t automate all the things! ● Crowdsourced Testing
- 9. Fundamentals of Crowdsourced Testing Some of the biggest brands in the world trust us to guide them through the chaos.
- 10. Fundamentals of Crowdsourced Testing Introductions Nick Roberts, Head of Research and Marketing Over 15 years experience in technology and SaaS markets. Previous work includes DefenseStorm, GoDaddy, Cox Communications and more. Bethany Ward, Senior Account Manager Bethany is a Senior Account Manager at Global App Testing working with companies such as Virgin Media, Quizlet, MileIQ (Microsoft) and many others to scale their QA operations.
- 11. Fundamentals of Crowdsourced Testing The old way ● Software was built in a waterfall environment with large releases ● Developers built an application and handed it off for testing ● QA returned with results and the developers set off to fix bugs before release
- 12. Fundamentals of Crowdsourced Testing The problems with the old way ● Development was slow and clunky ● It took forever to release your software ● Quality suffered
- 13. Fundamentals of Crowdsourced Testing The New Way ● Small, iterative approaches to software development ○ Agile ○ DevOps ○ Continuous Development/Integration ● Much faster releases and growth ● Quality shifts-left
- 15. Fundamentals of Crowdsourced Testing A small problem emerges ● The pressure to release an app or a website within faster development time increases exponentially ○ Testing/QA teams are given less time to ensure bug free software is ready for release ○ Fear and uncertainty around release begins to set in ○ Poor releases risk the company's growth ● Automation is the answer!
- 16. Fundamentals of Crowdsourced Testing Automation isn’t the only answer ● Tackles the implicit-knowns ● Requires heavy infrastructure investment and maintenance ● Doesn’t address real-world situations or examples ● It does have its place ○ Automate what you can, where you can ○ Build scenarios that improve human efficiency
- 17. Fundamentals of Crowdsourced Testing Can’t we just hire more QA? ● Absolutely! And you should ● But, this doesn’t scale ● Isn’t flexible ● Doesn’t address localised needs
- 18. Fundamentals of Crowdsourced Testing Let’s Use Crowdsourced Testing! ● Addresses scalability ○ On-demand, real-world professional testers ● Addresses speed ○ Delivers results in under 48 hours ● Addresses flexibility ○ Location agnostic + fragmentation free
- 19. You don’t have to sacrifice quality for speed.
- 20. Fundamentals of Crowdsourced Testing How it works 1. You provide the test cases or plan (or we can help you write them) 2. You choose the testing type (exploratory and/or test case execution/regression testing) a. A crowd of professional testers gets to work on your tests 3. You receive reports in under 48 hours 4. You Fix the bugs a. Get them verified at no extra cost
- 21. Fundamentals of Crowdsourced Testing Testing Scaled at Speed - In just over four weeks, Global App Testing tested 5000 apps and found critical issues in over 900 of them which could have damaged Facebook’s reputation. Testing localised - To date, Global App Testing has tested in over 45 cities around the world for LiveSafe. LiveSafe requires testers to live and work in each target city to capture contextual information outside the limitations of automated testing. Testing Flexibility - By integrating Global App Testing’s crowdsourced testers into their development process, PromoFarma have been able to decrease their cycle time from monthly to every two weeks.
- 22. Fundamentals of Crowdsourced Testing Who is in your crowd? ● Professional testers around the world who: ○ Do this for a living ○ Do this on the side of their professional job ○ Are retired from testing ● Meet some of them:
- 23. Fundamentals of Crowdsourced Testing Quality of Results ● Results need to: ○ Be impactful ○ Be moderated ○ Be reproducible with clear steps ○ Be on time ○ Help improve your release processes and workflows ✓
- 24. Fundamentals of Crowdsourced Testing Can I do this myself? Isn’t this just beta testing? Build your own crowd!
- 25. Fundamentals of Crowdsourced Testing How to get started 1. Request a consultation 2. Pick a plan 3. Onboard 4. Start testing
- 26. Fundamentals of Crowdsourced Testing Questions? nick@globalapptesting.com / beth@globalapptesting.com