Automation Tool Overview
- 1. Quality Assurance / Software Testing Training Automation Tools Overview
- 2. Page 2Classification: Restricted Agenda • Software Testing Tool – Overview • Advantage- Automation • Disadvantage - Automation • Grouping of Automation Tool • Functional Tool • Source Code Testing Tool • Performance Tool • Test Management Tool • Security Testing Tool
- 3. Page 3Classification: Restricted Software Testing Tool – Overview Software testing tools are of immense use to develop quality software . Automated software testing is the best way to increase the effectiveness, efficiency and coverage of your software testing. Need for automation Testing tool Manual testing is time – consuming , error prone and requires lot of infrastructure and manpower All this drawbacks can be overcome if the testing process is automated. The testing tool reduce manual testing effort to large extend and the testing can be done automatically
- 4. Page 4Classification: Restricted Advantage- Automation • Reliable: Tests perform precisely the same operations each time they are run, thereby eliminating human error • Repeatable: You can test how the software reacts under repeated execution of the same operations. • Programmable: You can program sophisticated tests that bring out hidden information from the application. • Comprehensive: You can build a suite of tests that covers every feature in your applicaation. • Reusable: You can reuse tests on different versions of an application, even if the user interface changes. • Better Quality Software: Because you can run more tests in less time with fewer resources • Fast: Automated Tools run tests significantly faster than human users. • Economical: As the number of resources for regression test are reduced.
- 5. Page 5Classification: Restricted Disadvantage - Automation It’s Not Easy! - Writing test automation scripts is not an easy task. You really need testers who are experienced in doing this otherwise it will go horribly wrong and you will end up spending even more money and time than if done manually. Automation Script Errors- If an error is made in the test automation scripts which is undetected, it could be fatal for the project since the correct testing won’t have been done. In fact you may not even realize the error until the software launches and then falls over. Scope Changes- Every project will have to implement change request management. However despite best endeavours there will still be some which get through. The problem with this is that it may require the test automation scripts to be reprogrammed or redesigned. This may be the case even when there is a minor change in the user interface of the software. Complexity- With the increase in the number of requirements (business requirements documentation and software requirements specification) that are to be tested, this leads to more and more complexity which makes the maintenance of test data extremely difficult.
- 6. Page 6Classification: Restricted Grouping of Automation Tool A wide variety of software testing tools are available to support different software , programming languages , types of testing These tools are broadly divided into the following categories : • Functional/Regression testing tool • Source code testing tool • Performance testing tool • Java testing tool • Embedded software testing tool • Test Management testing tool • Security testing tool
- 7. Page 7Classification: Restricted Functional Tool Functional tool can be used to the software application and web application such as web sites. Majority of the application involve Graphical user interface (GUI). These tool will test the GUI objects and functionality automatically This tool also called as Regression tool because whenever there are changes made in application/application / web site, all the test need to be re- run. List of Functional Testing tools : • Telerik TestStudio • HP-QuickTest Professional • Watir • TOSCA Testsuite • Selenium • Visual Studio Test Professional • Rational Functional Tester • TestComplete • TestPartner • SOA Test • TestDrive
- 8. Page 8Classification: Restricted Source Code Testing Tool Tools check the source code of the application. This is white box type of testing , Many numbers of tools are available for checking line coverage ,branch coverage and path coverage . Profilers display the number of times each line is executed . The test engineer can study the output of the profiler to find out which portion of code are not executed and then create test cases to make sure those lines of code is executed . Many tools are available to test the whether the source code is compliant to the standard guide lines and generate the metrics such as number of non- commented lines , number of commented lines , number of functions etc . There are tools available which check the portability of the code . List of source code tools are • Aqtime • Parasoft Insure++ • Telelogic Logiscope
- 9. Page 9Classification: Restricted Performance Tool These tools are used to carry performance testing or stress testing and very useful to test how the application or software works when multiple users access the application simultaneously . Application can be web site or Database. These tools simulate multiple users on a single machine and hence do not need many machines and testers to perform the performance testing. • Performance Testing Techniques: • Load testing • Stress Testing • Soak testing • Spike testing • Attributes of Performance testing : • Speed • Scalability • Stability • Reliability
- 10. Page 10Classification: Restricted List of Performance Testing tool: • Apache JMeter • HP LoadRunner • Silk Performer • WebLOAD • LoadUI • Rational Performance Tester • Testing Anywhere • CloudTest
- 11. Page 11Classification: Restricted Java Testing Tool As java programming language has become more popular in recent year , a number of tools are available exclusively for testing Java applications. These tools are used to test Java Classes List of Java tools are : • Jmeter • Jtest • Junit
- 12. Page 12Classification: Restricted Embedded Software Testing tool Embedded software is computer software, written to control machines or devices that are not typically thought of as computers. It is typically specialized for the particular hardware that it runs on and has time and memory constraints. In Embedded systems the code has to be optimized so that it occupies the minimum memory IBM - Rational Test RealTime
- 13. Page 13Classification: Restricted Test Management Tool Test Management encompasses anything and everything that we do as testers. Our day-to-day activities include: • Creating and maintaining release/project cycle/component information • Creating and maintaining the test artifacts specific to each release/cycle that we have- requirements, test cases, etc. • Establishing traceability and coverage between the test assets • Test execution support – test suite creation, test execution status capture, etc. • Metric collection/report-graph generation for analysis • Bug tracking/defect management
- 14. Page 14Classification: Restricted List of Test Management Tool: • HP ALM/Quality Center • qTest • JIRA • QMetry • TestRail • IBM Rational Quality Manager
- 15. Page 15Classification: Restricted Security Testing Tool Security testing is basically a type of software testing that’s done to check whether the application or the product is secured or not. It checks to see if the application is vulnerable to attacks, if anyone hack the system or login to the application without any authorization The six basic security concepts that need to be covered by security testing are: • Confidentiality • Integrity • Authentication • Availability • Authorization • Non-repudiation
- 16. Page 16Classification: Restricted List of Security Testing Tool : • Wireshark • Metasploit • Nessus • Acunetix • Retina • OpenVAS