Siebel test automation enchancements by areon consulting
Download as PPTX, PDF2 likes405 views
Areon Consulting has enhanced Siebel test automation by implementing features such as SQL command execution from test scripts, parameter passing between scripts, and a simplified editing process for recorded tests. These improvements aim to increase usability and performance, while also providing comprehensive test analytics through dashboards and reporting tools. Founded in 2009, Areon Consulting specializes in Oracle Siebel CRM and has successfully completed over 80 projects globally.
Siebel test automation enchancements by areon consulting
- 1. Siebel Test Automation Enhancements by Areon Consulting
- 2. Agenda • About Areon Consulting • About Siebel Test Automation • Why we enhanced Siebel Test Automation • Enhancements done: – Executing SQL Commands from Siebel Test Scripts – Passing parameters between Siebel Test Scripts – Simplified editing of recorded Test Scripts – Test Automation Business Analytics Developed
- 3. • Founded in 2009 in Kyiv, Ukraine • Oracle Siebel CRM, Oracle BI, Call Centers, Dedicated Teams • Acting globally • Siebel specialists headcount 150+ • 80+ successful projects www.areon.ua www.areondev.com About Areon Consulting
- 4. About Siebel Test Automation • Built-in Siebel Automation Framework – Record and playback UI flows – No automation scripting required – Schedule Automation Batch Runs • Test Execution Framework – Simplified set up of automation clients – Jenkins plug-in to manage distributed and parallel automation batch runs • Consolidated Test Results in Siebel – End to end Test Management – Manage Test Cases and Test Cycles – Quality Measurement and Traceability Organize Tests Plan Cycles Run Tests Analyze Results Capture Tests Advantages: • Built on Siebel, supplied with Siebel with no additional license fees • Easy to adopt by Siebel People • Visual tool, no sophisticated Java code
- 5. Why did we enhance Siebel Test Automation • We use it heavily in our Projects for our Customers • We collected tremendous experience on it • We had ideas how to improve it to achieve better usability and performance
- 6. Executing SQL from Siebel Test Scripts Problem: Siebel Test Automation itself doesn’t allow to execute SQL procedures at DB Level Example: Clean-up records after test scripts execution, change statuses etc. Solution: InvokePerl method Advantages: • Now we can execute DB operations from the test scripts; • Flexible, reusable, can invoke any required SQL code • Can be extended to execute any scripts (powershell, perl, …) 1. Include line with “InvokePerl” into test script, add perl file name and parameters (dosar Id etc) 2. Perl program that executes SQL from the file and returns results 3. Text file with SQL Code. Can take parameters passed from the test scripts
- 7. Passing parameters between Siebel Test Scripts Problem: Long End-to-end scripts contain too many steps, it’s very hard to edit and manage. Example: Long business processes that guide users through multiple modules and features (e.g. Loan Origination Flow). Solution: Split large tests into a number of smaller tests. Pass parameters from script to script using perl (developed, not supported OOTB) 1.Creating dozar with unique name 3.Get name 2.Save name 4.Result Advantages: • Now we can execute long end-to-end chains of smaller tests. • It is easier to create, debug, monitor and check the problems • Small test scripts are reusable, can me included into different big test chains and test suites
- 8. Simplified editing of recorded Test Scripts Problem: It’s very difficult to change order of step in recorded test script Example: I need to insert new step in the middle of recorded test script (for instance, perl command). In order it start to work properly I have to manually set Test Step Sequence for inserted step and all the next steps Solution: Implemented “+1” and “-1” buttons that changes Sequence of current step. Sequences of all the next stems are changed (recalculated) automatically.
- 9. Test Automation Analytics: Problem Problem: Out-of-the box Siebel Test Automation Reporting has very limited capabilities • Execution Reports are stored in the file system as archived attachments with CSV+XML+ HTML files inside • No graphical Representation • Able to see results 1-by-1 only, no aggregated results • Not possible to analyze historical data to track progress and performance
- 10. Test Automated Analytics: Solution Solution: • Created automated process for extracting information from archives and populating tables in Siebel DB • Created Siebel Testing Analytical Dashboards • Created Email Agents for daily reporting delivery Siebel DB Advantages: • Complete Test Automation Analytical Reporting • Ability to track Historical Data, Progress and Performance Archives XML Files Tables in Siebel DB Business Intelligence Dashboards and Agents
- 11. Test Automation Daily Monitoring Dashboard • Last Run - Passed/Failed Pie Chart - Passed/Failed per Functionality Diagram - Passed/Failed Scripts Table • Failed for last 3 Days - Top 5 failed scripts diagram - Failed scripts table • Failed for last 30 Days - Top 5 failed scripts diagram - Failed scripts table • History of bugs appeared and fixed • Drill-Down capabilities For detailed information on selected record
- 12. Test Automation Dynamic Analytics • Passed/Failed scripts daily Diagram • Passed/Failed scripts daily table • Last Running script statuses daily table • Allows to see test scripts that were failed but fixed on the same day • Drill-down for test script execution history • History of bugs appeared and fixed
- 13. Daily email agents for testers • Passed/Failed scripts daily table • History of bugs appeared and fixed
- 14. Daily email agents for managers • Passed/Failed scripts for last 3 Days • Common Pie Chart • Breakdown Pie Charts per Subject Areas • Detailed Table – Passed/Failed scripts grouped by subject areas