Testing & Improving Performance in IBM Cognos BI, Plus Automated Cognos Testing System, MotioCI
6 likes3,887 views
The document outlines a webinar by Senturus focused on improving performance issues in IBM Cognos BI, detailing a three-phase approach to testing and tuning that includes building, measuring, and learning from performance data. It emphasizes the importance of using tools like MotioCI for monitoring and stress testing, and stresses a proactive stance on performance management to avoid potential issues. Additionally, the document highlights the significance of having a multidisciplinary team and ongoing monitoring to ensure the health of the Cognos environment.
Testing & Improving Performance in IBM Cognos BI, Plus Automated Cognos Testing System, MotioCI
- 1. Plus Automated Cognos Testing System, MotioCI TESTING& IMPROVINGPERFORMANCEINIBM COGNOSBI
- 2. questions here Copyright2014Senturus,Inc. AllRightsReserved This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/ HEARTHERECORDING
- 3. RESOURCELIBRARY Senturus’ whole purpose is to make you successful with Business Analytics. Thus, we offer a series of technology-neutral webinars, training on specific software, demonstrations, and no-holds-barred reviews of new software releases. We host dozens of live webinars every year and we offer a comprehensive library of recorded webinars, demos, white papers, presentations and case studies on our website--a wealth of learning resources. Most of our content is custom created and constantly updated, so visit us often to see what’s new in the industry. www.senturus.com/resources/ 3 Copyright 2014 Senturus, Inc. All Rights Reserved
- 4. •Quick introduction •Sources of Performance Problems •A Three-Phase Approach to Testing and Tuning •About Senturus •Other Resources •Q & A Today’s Agenda 4 Copyright 2014 Senturus, Inc. All Rights Reserved
- 5. John Boyer Proven Practice Lead Motio John Peterson CEO & Co-Founder Senturus Introduction: Today’s Presenters Copyright 2014 Senturus, Inc. All Rights Reserved 5 Steve Reed-Pittman Practice Director-Systems Integration & Optimization Senturus
- 6. Where Is My Problem Coming From? SOURCESOFTROUBLE
- 7. questions here Copyright 2014Senturus,Inc. AllRightsReserved HEARTHERECORDING This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/ Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website. www.senturus.com
- 8. •Performance troubleshooting requires detective work –Gather data from systems andpeople –What changed, and when? –Consider all of the possible layers –Options for addressing performance issues vary across different Cognos versions and configurations WHERETOBEGIN?
- 9. Performance issues can originate from multiple layers: •Configuration Layer –Cognos software configuration and tuning (install/config inconsistencies, esp. in distributed environments) •Database Layer –Data warehouse schema design •Metadata Layer –Framework Manager model •Presentation Layer –Report Studio, Workspace Advanced, etc. COGNOS-SPECIFICPROBLEMAREAS
- 10. Performance issues can also originate outside of Cognos: •Network (network speed, latency) •Database server (concurrent query execution, contention with other databases hosted on the same db server or cluster) •Host server architecture (CPU, RAM, disk, virtual vs. physical infrastructure) OTHERPROBLEMAREAS
- 12. •Is your organization proactive or reactive with regard to the performance of your Cognos systems? •When trouble strikes, quick answers can be hard to find – preventing the fire is better than fighting it! •Tools can make this easier by providing: •Baseline performance data •Replicable test cases FIREPREVENTIONVS. FIREFIGHTING
- 13. •MotioCI as an iterative testing tool for determining changes in report execution performance (SLA testing) •LoadRunner scripting •Commercial and open-source application performance monitoring tools (e.g., SolarWinds, Opsview) •Built-in OS tools (e.g., Resource Monitor, perfmon) •Cognos Administration dashboards SOMETOOLOPTIONS
- 14. The risk of doing this without tools or methodology: •Lack of repeatability makes it difficult or impossible to know whether changes have made a difference •Tools enable repeatable testing for reliable performance comparisons WHYUSETOOLS?
- 15. Three-Phase Methodology for Performance Testing and Tuning KEYSTOIMPROVINGPERFORMANCE
- 16. questions here Copyright 2014Senturus,Inc. AllRightsReserved HEARTHERECORDING This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/ Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website. www.senturus.com
- 17. Solving performance issues is like playing “Whack-a-Mole”. Every time you thought you killed the beast, it will pop up again! The Key to Improving Performance A three-phase approach to successfully beat performance issues in IBM CognosThere is a need for an integrated approach in solving this problem
- 18. 1.Build 2.Measure 3.LearnJust a commodity approach? A Three-Phase Approach to Solving Performance Issues
- 19. 1.Build a)Identify all elements that can impact performance b)Set up monitoring for capturing system performance metrics c)Analyze user and system behavior d)Set up test cases using MotioCI 2.Measure a)Run test cases and metrics to capture initial baseline b)Review test results and captured metrics c)Run load test d)Analyze system behavior 3.Learn a)Implement tuning changes based on the results b)Return to step 2c c)Repeat steps until the target level of performance is achieved A Three-Phase Approach to Solving Performance Issues A tailor-made approach for IBM Cognos
- 20. What does your multi-disciplinary medical team look like? 1.Cognos knowledge a)Cognos Admin b)Cognos Architect c)Cognos Modeler 2.Infrastructure a)DBA b)Network/firewall specialist c)Hardware specialist 3.General roles a)Project management b)Senturus BI specialist •Knowledge of methodology •Knowledge of Cognos •Knowledge of MotioCI •Experience at different environments, organizations and infrastructure set ups
- 21. Tools, Techniques and Questions to Consider BUILDINGYOURTESTCASE
- 22. How to Build Your Test Case Four essential steps to being well prepared a) Identify all elements that can impact performance
- 23. How to Build Your Test Case Four essential steps to being well preparedb) Set up monitoring tools for capturing system performance metrics
- 24. How to Build Your Test Case Four essential steps to being well prepared c) Analyze user and system behavior •Who is using IBM Cognos? •When are they using it? •How long, what frequency? •What do they execute? •How often? •What is used the most? •What is used during peak time? •What is taking the most time?
- 25. Running a Stress Test with MotioCI SAMPLETESTING
- 26. questions here Copyright 2014Senturus,Inc. AllRightsReserved HEARTHERECORDING This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/ Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website. www.senturus.com
- 27. How to Build Your Test Case Four essential steps to being well prepared Set up test cases using MotioCI
- 28. •Define Test Cases Cognos Stress Test with MotioCI Cognos Reports MotioCI Test Cases
- 29. Cognos Stress Test with MotioCI •Configure Stress Test Selected Stress Test includes the Performance Test Cases created above. Configure end condition Configure login options Configure report execution options Configure ramp execution options
- 30. •Customizing a Stress Test –Ramped User Logins and Ramped Report Executions –Ramped User Logins –Ramped Report Executions –Simulated User Interactivity Cognos Stress Test with MotioCI
- 31. •Results Summary Cognos Stress Test with MotioCIStress Test Summary and Detail Results
- 32. •Results Summary Cognos Stress Test with MotioCI
- 33. •Interactive and Non-Interactive Executions by Report Cognos Stress Test with MotioCI
- 34. •Sample Reports Cognos Stress Test with MotioCI Concurrency vs. Test Failure
- 35. How to Build Your Test Case Four essential steps to being well prepared d) Set up test cases using MotioCI
- 36. How to Measure Your Test Case and Analyze the Results Executing repeatable test cases with comparable results a) Run test cases and metrics to capture initial baseline b) Review test results and captured metrics
- 37. How to Measure Your Test Case and Analyze the Results Executing repeatable test cases with comparable results c) Run load test d) Analyze system behavior
- 38. Analyzing Results and Making Changes ADJUSTMENTSANDAFTERCARE
- 39. questions here Copyright 2014Senturus,Inc. AllRightsReserved HEARTHERECORDING This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/ Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website. www.senturus.com
- 40. How to Measure Your Test Case and Analyze the Results Examining the test case results
- 41. How to Improve and Tweak the Settings Solve the bottleneck and retesta) Implement tuning changes based on the results b) Return to step 2c.
- 42. How to Measure Your Test Case and Analyze the Results Reviewing metrics from Cognos Administration server1 server2 server3 Process -Batch report service Number of configured processes 4 4 4 Number of processes high watermark 4 4 4 Process -Report service Number of configured processes 8 8 8 Number of processes high watermark 8 8 8 Request -Batch report service Number of processed requests 226 210 189 Percentage of failed requests 0.00% 0.00% 0.53% Response time high watermark 0:00:32 0:00:31 0:00:34 Seconds per successful request 0:00:26 0:00:26 0:00:27 Service time 1:36:16 1:32:13 1:24:19 Request -Report service Number of processed requests 149 105 113 Percentage of failed requests 0.00% 0.00% 0.88% Response time high watermark 0:00:07 0:00:22 0:00:20 Seconds per successful request 0:00:01 0:00:02 0:00:03 Service time 0:03:34 0:03:27 0:05:08
- 43. How to Measure Your Test Case and Analyze the Results Executing repeatable test cases and viewing final results
- 44. What is so Revolutionary About This? 1.Key problem: Performance issues are hard to tackle without reliable metrics and deep knowledge of the systems in question. 2.Without a simple and repeatable approach, troubleshooting and tuning is difficult to perform effectively: a)Unstructured troubleshooting is hard to manage, and can be both expensive and slow to produce results b)Dependencies across multiple layers aren’t always obvious c)Custom-made test cases often require lots of programming/scripting 3.MotioCI helps the project team focus on the core, repeatable test cases: test, analyze and measure improvement 4.Deep Cognos system expertise from Senturus provides multi-layer examination of the affected systems, interpretation of test results, recommendation of tuning changes, and implementation assistance when needed. The right combination of tools and expertise promotes rapid results
- 45. Aftercare Proactive monitoring of your Cognos BI environment 1.When the problems are solved, organizations need to stay healthy! 2.By constantly monitoring performance, BICC’s stay in control and on top of the quality of their BI environment: 1.Regarding performance 2.Regardingdata quality 3.Regarding IBM best practices and corporate standards
- 46. Who we are SENTURUSOVERVIEW
- 47. questions here Copyright 2014Senturus,Inc. AllRightsReserved HEARTHERECORDING This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/ Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website. www.senturus.com
- 48. Our Team: Business depth combined with technical expertise. Former CFOs, CIOs, Controllers, Directors Senturus: Business Analytics Consultants 48 Copyright 2014 Senturus, Inc. All Rights ReservedBusiness Intelligence Enterprise Planning Predictive Analytics
- 49. 700+ Clients, 1400 Projects, 13 Years 49 Copyright 2014 Senturus, Inc. All Rights Reserved
- 50. OTHERRESOURCES
- 51. One hour consulting with Systems Integration and Optimization Team in which we –Learn your organization’s performance challenges –Provide high level guidance on the state of your environment –Provide next steps toward potential resolution –No cost, no obligation Free Assessment and Recommendation 51 Copyright 2014 Senturus, Inc. All Rights Reserved.
- 52. More Information on www.senturus.com Copyright 2014 Senturus, Inc. All Rights Reserved 52
- 53. *Custom, tailored training also available* Cognos Training Options Copyright 2014 Senturus, Inc. All Rights Reserved 53
- 54. For more information about the Free Assessment or MotioCI, contact Jim Frazier Vice-President of Client Solutions Senturus jfrazier@senturus.com 650 949 2921 FOLLOWUP
- 55. questions here Copyright 2014Senturus,Inc. AllRightsReserved HEARTHERECORDING This slide deck is part of a recorded webinar. To view the FREE recording of the entire presentation and download the slide deck go to www.senturus.com/resources/testing-improving- performance-ibm-cognos-bi-motio-2/ Senturus’ comprehensive library of recorded webinars, demos, white papers, presentations and case studies is available on our website. www.senturus.com
- 56. Thank You!! www.senturus.com888-601-6010info@senturus.com Copyright2014bySenturus, Inc. ThisentirepresentationiscopyrightedandmaynotbereusedordistributedwithoutthewrittenconsentofSenturus,Inc.