Intelligent Digital Mesh Testing
4 likes560 views
This document discusses intelligent digital testing in an environment of intelligent hyperconnectivity across domains. It outlines the benefits of AI/ML for testing, such as using AI to generate test scripts and identify bugs. An intelligent testing approach is proposed that uses a bot to identify assets, optimize test cases by eliminating duplicates, automate testing, and analyze results to predict future defects. Challenges of intelligent testing are also addressed. The business benefits are improved quality, efficiency, revenues and customer satisfaction through optimized testing coverage, quicker time to market, and data-driven insights.
Intelligent Digital Mesh Testing
- 1. By Manisha Mittal – Quality Assurance Consultant Intelligent Digital Mesh QA & Testing Copyright © 2019, Nagarro. All rights reserved.
- 2. 2 Agenda 1. Understanding intelligent hyper connected environment 2. Intelligent digital mesh across domains 3. Challenges and opportunities in Quality Assurance 4. Evolution in testing approaches 5. Benefits of AI/ML and analytics in digital mesh testing 6. Focus areas & tools for testing Intelligent apps 7. Intelligent testing landscape: Optimize test cycles 8. Intelligent testing approach 9. Challenges & Solutions 10. Business benefits of intelligent digital testing
- 3. Understanding intelligent hyper connected environment An Intelligent system that can do intelligent things with: • Technologies like Artificial Intelligence, Machine Learning, Deep Learning, Natural Language Processing • Techniques that make smart machine understand, learn, predict, adapt, operate autonomously. Digital consists of: • Virtual & Augmented Reality • Conversational platforms • eGaming, movies & music, e Ticketing, automation & Control, healthcare and e communication Mesh connects people, devices, content & services together through: • Mobile devices • Wearables • Electronic devices • Mobile testing • Device testing: Wearables, Electronic devices • Scalability and performance testing • Regulatory compliance testing • Analytics (AI/ML) validation • Intelligent test case generation Digital Assurance focus areas: 3
- 4. 4 Intelligent digital mesh across domains • Robot assisted surgeries • Personalized health monitoring using smart watchesHealthcare • Risk analytics & regulation • Managing client satisfaction • Portfolio managementFinancial • Dynamic pricing • Social media feedback analysis • Customer feedback analysisHospitality • Demand forecasting • Process optimisation • Condition MonitoringManufacturing • Recommendation engines & campaign analytics • Inventory planning • Better customer service with reduced response time Retail • Loyalty program and campaign analytics • Route planning and optimization • Better customer service by reducing response timeTravel • Smart supply and demand optimization • Power usage analytics • Customer specific pricing Energy
- 5. 5 Challenges and opportunities in quality assurance • Spread of intelligent technologies leading to significant change in our lives • With intelligent technologies increasingly disrupting the business models, small companies pose a challenge to large corporate houses • Significant increase of internet traffic with spread of mobile telephony and interconnected devices • Plethora of hardware & software devices/dependency on technology for day to day needs • Requires anyplace, anywhere, and anytime connectivity on any device and with any service
- 6. 6 Evolution in testing approaches
- 7. 7 • AI can write scripts and analyze large amounts of data sets faster • AI can handle sorting through log files, saving time and enhancing correctness in the program tremendously • AI can help in eliminating more bugs • ML approach, which will offer more reliable outcomes than traditional testing • ML analyzes customer data for a more proper understanding of the most recent products and features that customers need Benefits of AI/ML and analytics in digital mesh testing
- 8. 8 Focus areas & tools for testing Intelligent apps
- 9. 9 Intelligent testing landscape: Optimize test cycles Skills Required Test Parameters Test Goals Best Practices • Bot identifies the assets and helps generate test cases from requirements • Good grasp of statistical concepts • Capabilities in data analytics • Knowledge of computer- hardware architectures • Know-how of languages such as R, Python, Java, etc • A/B testing • Metamorphic testing • Predictive Analysis • Cognitive QA testing • Predictive QA dashboards • Intelligent QA automation • Continuous testing • Smart QA analytics • Defect Analytics • Log Analytics • Continuous Improvement • Design specific test approach • Perform usability testing • Ensure security & customer exp. • Assure range & frequency • Ensure performance • Simulate usage scenarios • Use real devices • Ensure uninterrupted data transmission & collection • Deploy network simulation tools • Increase levels of automation • Implement non-silo approach for test environment and data provisioning • Re-skill QA engineers • Improve tracking to optimize processes • Data security as per complaints
- 10. Intelligent testing approach • Bot identifies the assets and helps generate test cases from requirements. 01Identify • Bot identifies the duplicate test cases & optimizes test scenarios using AI & ML. 02Optimize • Bot automates environment setup • Bot accepts & validates coding standards, execution status • Bot integrates data from all cycles 03Automate • Bot analyses results and test performance. • Bot predicts future defects based on historical data 04Analyze 10
- 11. 11 Identify Optimize Automate Analyze • Bot identifies the assets • Helps in generating the test cases from requirements • Analysis of existing test cases, data • Combines value from different attributes along with business rules • Achieves 100% coverage of business variations of application
- 12. 12 Identify Optimize Automate Analyze • Optimize number & types of tests to achieve 100% coverage • Search, Tagging and Modeling: This model finds duplicate test cases & groups them together into what we call a cluster • Attributes & values found in these clusters are used in test optimization • Optimal set of test cases are generated which represent 100% coverage of business variations of application • Build a repository of optimized test suites that could be used repeatedly
- 13. 13 Identify Optimize Automate Analyze • Actual automation in cucumber format is generated from optimal test-set, which is integrated into automation framework • Analysis between sprints is done to get 100% coverage. It includes modifying the original set of test cases and eliminating redundant test cases • Search test data catalogue and match the data which is needed for automation • Map objects with xpath and store objects
- 14. 14 Identify Optimize Automate Analyze • AI analyzes defects and identifies the patterns of defects & helps prevent them in future • Cognitively identifies the origin of the defect in real-time & classify it as code or no code defect • Works together to reduce test cases & defects with lower cost, increase speed and quality with 100% coverage
- 15. 15 Challenges & proposed solutions
- 16. 16 Business benefits of intelligent digital testing • Predict, prevent, and automate the process using self-learning algorithms • Test suite optimization & identify of high risk areas for risk-based prioritization • Identify hotspots & automatically executing test cases Improved quality • Quicker time to market: Speed-up release of new products and services • Identify and remediate compliance gaps transparently More efficient, secure & resilient • Reduced cost of operations • Bots perform complex tasks Increased revenues and profits • Deliver services when requested • Identify and remediate compliance gaps transparently Availability & reliability • Enables organizations to quickly turn data into actionable insights for better decision making • Mitigate business and technical risks • Monitor for rapid and cost-effective scalability of operations Improve end-user satisfaction and customer loyalty • Bots are dynamic as they automatically discover and evaluate every new feature in the product • Bots analyzes the application from end user prospective and record performance • Bots builds, execute phenomenal amount of test cases within minutes Optimal test coverage
- 17. 17 THANK YOU