The future of testing in Pharo
- 1. The future of testing in Pharo Julien Delplanque julien.delplanque@inria.fr
- 2. About me • 2nd year of PhD in RMoD team • Hacking Pharo around many aspects… just for fun :-) • Hit by testing topic « by accident » This is me on discord. This is me on github and twitter. !2
- 3. The one who work on this topic right now • 2nd year of Master • Doing an internship in RMoD team for 6 months • Master thesis on the enhancements of tests in Pharo This is Dayne on discord. This is Dayne on github. Her other mentors on Github Guille Steph !3
- 4. Questions this talk addresses • What infrastructure Pharo provides for testing? • How can we enhance testing experience? !4
- 5. What infrastructure Pharo provides for testing? !5
- 6. What infrastructure Pharo provides for testing? Pharo’s SUnit SUnit-UI Jenkins- Tools System browser !6
- 7. What infrastructure Pharo provides for testing? Pharo’s SUnit SUnit-UI Jenkins- Tools System browser Custom layer for visiting, « deciding color » of results, … Custom layer for visiting, « deciding color » of results, … Custom layer for visiting, « deciding color » of results, … ≠ ≠ In fact, !7
- 8. The infrastructure we want Pharo’s SUnit SUnit-UI Jenkins- Tools System browser Common layer for visiting, « deciding color » of results, … Dr Tests Push into !8
- 9. The infrastructure we want Enhanced Pharo’s SUnit refactoredJenkins -Tools refactoredSystem browser DrTests DrTests Plugins !9
- 10. How can we enhance testing experience? !10
- 11. What can we do with tests? Runner Coverage Profile Parametrisable test Mutation testing Run examples in comment Rotten Tests Finder … Input Test cases Test cases Test cases Test cases + parameters Test cases + mutation s Comments Test cases … Outpu t Results of tests run Percentage of methods covered Time taken for each test run Results of tests run depending on parameter Mutants to be killed Comments containing failing examples Rotten tests … Managed by SUnit-UI !11
- 12. TestRunner UI Packages containing tests TestCases Results summary Failed tests Errors Run tests Profile test execution Analyse code coverage Re-run failures or errors only Export results !12
- 15. Runner Coverage Profile Parametrisable test Mutation testing Run examples in comment Rotten Tests Finder … Input Test cases Test cases Test cases Test cases + parameters Test cases + mutation s Comments Test cases … Outpu t Results of tests run Percentage of methods covered Time taken for each test run Results of tests run depending on parameter Mutants to be killed Comments containing failing examples Rotten tests … What can we do with tests? Managed by SUnit-UI Poor integration No integration !15
- 16. Proposal: Dr Tests Power-up testing experience in Pharo by: Developing and promoting DrTests as the new UI for testing ‣ Written in Spec ‣ Extensible via plugins ‣ Provides good model to configure, run and gather results from plugins !16
- 17. Dr Tests Packages under analysis Plugin inputPlugin selected Results tree Plugin-defined action(s) Start pluginLogging label Browse result !17
- 18. Mini Dr Tests Button to re-run according to configuration Go back to normal UI to configure plugins, input, etc. ➡Simplified view to use a plugin once it is configured !18
- 19. Mini Dr Tests Button’s color gives visual feedback about last result of plugin !19
- 20. Dr Tests model Plugin Configuration Plugin Result Plugin Plugin run, provides updates through announcements Created from UI or by scripting Can be queried from UI or by scripting Can specify class to use Can specify class to use !20
- 21. Conclusion !21
- 22. Vision ★Enhanced SUnit ★Uniform API for SUnit clients ★Plugin-based testing UI = Dr Tests ★More tools to handle tests = Dr Tests plugins ➡We want a testing ecosystem able to evolve !22
- 23. What’s next? Dayne is working on Dr Tests and SUnit enhancements Clothilde will work on Smart Tests soon !23
- 24. can test it! !24
- 25. You can help the effort! juliendelplanque/DrTests We are interested in your inputs and contributions! @juldelplanque juliendelplanque !25