Enterprise Monitoring 2018: Converged Application & Infrastructure Monitoring from a Single Pane of Glass
3 likes752 views
EG Innovations is a provider of enterprise-class performance management solutions, focused on enhancing visibility across dynamic IT environments. The document outlines the evolution of application performance management (APM) and infrastructure performance management (IPM), emphasizing the need for a unified approach to monitoring in the era of cloud and digital business services. Key challenges discussed include complexity from virtualization, lack of transparency in monitoring, and the importance of observability in ensuring effective service performance.
![© eG Innovations, Inc | www.eginnovations.com
Black Boxes and Black Holes
• Black Box monitoring is
outside-in
– Tests externally visible behavior;
i.e., Real User Monitoring
– Service Level Agreements
Monitoring distributed systems - O'Reilly Media Apr 27, 2016
“[Black box] ...Testing
externally visible
behavior as a user
would see it.”
“...white-box monitoring is
sometimes symptom-
oriented, and sometimes
cause-oriented, depending
on just how informative
your white-box is.”
• White Box monitoring is
inside-out
– Provides details about the
internal state
– Required for root-cause analysis](https://image.slidesharecdn.com/enterprise-monitoring-2018-converged-application-infrastructure-monitoring-from-a-single-pane-of-gla-180301115236/85/Enterprise-Monitoring-2018-Converged-Application-Infrastructure-Monitoring-from-a-Single-Pane-of-Glass-20-320.jpg)
Enterprise Monitoring 2018: Converged Application & Infrastructure Monitoring from a Single Pane of Glass
- 1. © eG Innovations, Inc | www.eginnovations.com Enterprise Monitoring 2018 Converged APM/IPM and the Single Pane of Glass
- 2. © eG Innovations, Inc | www.eginnovations.com Logistics § Please submit your questions at any time during the webinar using the questions panel on the GoToWebinar client. § This webinar is being recorded. You will receive a link to the recording in a few days. § A copy of this presentation is posted on Slideshare: http://www.slideshare.net/eginnovations/
- 3. © eG Innovations, Inc | www.eginnovations.com Today’s presenter John Worthington Director, Product Marketing eG Innovations John.worthington@eginnovations.com
- 4. © eG Innovations, Inc | www.eginnovations.com Who we are... eG Innovations is a provider of enterprise-class performance management products that provide complete visibility across every layer and every tier of dynamic & complex, cloud, virtual and physical IT environments to reliably deliver mission-critical business services. Founded 2001 Headquarters Singapore Employees 175 Web Site https://www.eginnovations.com Worldwide Locations/Offices
- 5. © eG Innovations, Inc | www.eginnovations.com Why customers come to us... • 75% of IT organizations are suffering from degraded business applications – IDC Research • 70% of the time, IT organizations learn about performance problems from end-users - Gartner • 31% of performance issues take more than a month to resolve or are never resolved - Forrester Why is my application slow?!!!
- 6. © eG Innovations, Inc | www.eginnovations.com What we do... eG Enterprise takes measurements at every layer of every component of an end-to-end IT service, learns the norms of all measurements, and through patented analytics automatically isolates which layer of which component is the source of an anomaly. Today we do this across any cloud deployment model and from code to bare metal. 6
- 7. © eG Innovations, Inc | www.eginnovations.com Agenda • Where We’ve Been... • Enterprise Monitoring 2018: Where Are We YOU Now? • Where Do We YOU Need To Be? • Conclusion
- 8. © eG Innovations, Inc | www.eginnovations.com WHERE HAVE WE BEEN? Converged APM/IPM and the Single Pane of Glass
- 9. © eG Innovations, Inc | www.eginnovations.com Keeping pace with complexity - Silos Hardware Network Firewall Software Hardware Network Web Server Software Website Hardware Network App Server Software A P P 1 A P P 2 A P P n Hardware Network DB Process DB Storage DB Service Network Monitor Web Monitor App Monitor DB Monitor Legacy Data Center • IT infrastructures monitored as silos – Individual tools for monitoring different applications – No view of the end-to-end service
- 10. © eG Innovations, Inc | www.eginnovations.com Keeping pace with complexity - Silos Hardware Network Firewall Software Hardware Network Web Server Software Website Hardware Network App Server Software A P P 1 A P P 2 A P P n Hardware Network DB Process DB Storage DB Service Network Monitor Web Monitor App Monitor DB Monitor Legacy Data Center USER Suppose the database is 50% slower than normal A problem in one tier can effect all the other tiers involved in service delivery 2001 • Universal Agent • Automatic thresholding • Automated diagnostics • Web transaction monitoring • Integration console Unified Monitoring ITIL© version 2 released
- 11. © eG Innovations, Inc | www.eginnovations.com Evolution to Business Service Management • Holistic view of the end user service • Correlate across network, server, application for problem diagnosis • Service topology map • Auto correlation based on dependency maps Business Service Management 2005 2007 - ITIL© version 3 released Hardware Network Firewall Software Hardware Network Web Server Software Website Hardware Network App Server Software A P P 1 A P P 2 A P P n Hardware Network DB Process DB Storage DB Service Network Monitor Web Monitor App Monitor DB Monitor Legacy Data Center Service Manager
- 12. © eG Innovations, Inc | www.eginnovations.com Keeping Pace with Complexity - Virtualization • Outside-in and Inside-out perspectives of dynamic, virtualized environments 2008 Virtualization • 360° visibility into VM performance • Industry first virtualization-aware auto- diagnosis • Broadest virtualization coverage 2008 – Agile Toronto conference “Agile Infrastructure” 2009 – DevOps begins.. Firewall Software Hardware / Physical Resources Virtual Resource Pools – Compute | Network | Storage Media Server Streaming Media App Server Software A P P 1 A P P 2 A P P n DB Process DB Storage DB Service Virtualization and Private Cloud Virtualization / Cloud Center of Excellence Slow database queries Disk Reads Excessive disk reads by the media server slow down database access Virtual infrastructures are hard to manage. Traditional management tools are not designed to handle these dynamic requirements
- 13. © eG Innovations, Inc | www.eginnovations.com Keeping Pace with Complexity – Public Cloud 2014 Cloud • SaaS Option • Public/Private/Hybrid cloud support 2012 – BSMdigest renamed APMdigest BSM Infrastructure-as-a-Service (IaaS) Platform-as-a-Service (PaaS) Public Clouds Cloud Management Software-as-a- Service (SaaS) Deployment perspective: performance management FROM the cloud Cloud service provider perspective: performance management FOR the cloud Cloud consumer perspective: performance management OF cloud hosted applications
- 14. © eG Innovations, Inc | www.eginnovations.com Digital Business Service Management • Applications ≠ Services • Digital business services include many heterogeneous components, multi-vendor devices and service providers Hardware Network Firewall Software Hardware Network Web Server Software Website Hardware Network App Server Software A P P 1 A P P 2 A P P n Hardware Network DB Process DB Storage DB Service Network Monitor Web Monitor App Monitor DB Monitor Legacy Data Center Firewall Software Hardware / Physical Resources Virtual Resource Pools – Compute | Network | Storage Media Server Streaming Media App Server Software A P P 1 A P P 2 A P P n DB Process DB Storage DB Service Virtualization and Private Cloud Virtualization / Cloud Center of Excellence Infrastructure-as-a-Service (IaaS) Platform-as-a-Service (PaaS) Public Clouds Cloud Management Software-as-a- Service (SaaS) Service Manager Digital Business Services
- 15. © eG Innovations, Inc | www.eginnovations.com Convergence of APM and IPM User experience monitoring Transaction tracing Code level visibility 2016 Converged APM/IPM • • •Saying that management consists of a monitor function and a control function is useful as a quick pneumonic, but this hides the complexity required in order to effectively manage applications (or any other object). The monitoring and control of an application is not achieved in a vacuum. - Application Performance Management (APM) in the Digital Enterprise: Managing Applications for Cloud, Mobile, IoT and eBusiness, Sturm, Rick; Pollard, Carol; Craig, Julie
- 16. © eG Innovations, Inc | www.eginnovations.com Where we’ve been... • eG Innovations is an industry leader in performance management solutions for complex, dynamic, multi-tier digital IT services 2/28/18 2001 • Universal Agent • Automatic thresholding • Automated diagnostics • Web transaction monitoring • Integration console • Service topology map • Auto correlation based on dependency maps • 360° visibility into VM performance • Industry first virtualization-aware auto-diagnosis • Broadest virtualization coverage User experience monitoring Transaction tracing Code level visibility Unified Monitoring Business Service Management 2005 2008 Virtualization 2014 Cloud 2016 Converged APM/IPM • SaaS Option • Public/Private/Hybrid cloud support • • •
- 17. © eG Innovations, Inc | www.eginnovations.com Audience Poll • What are your biggest performance management challenges today? A. Finding the root-cause of performance issues so we can prevent them from reoccurring B. Mapping business impacts of performance issues in real time C. Lack of an overall performance monitoring strategy D. Monitoring from the perspective of the end-user to help prioritize improvements
- 18. © eG Innovations, Inc | www.eginnovations.com WHERE ARE WE YOU NOW? Converged APM/IPM and the Single Pane of Glass
- 19. © eG Innovations, Inc | www.eginnovations.com 2018’s Gold Rush • Cloud is an as-a-service operating model and will require transformational change • Public Clouds SLAs are not your SLAs • People/Process capability gaps may present greatest risk 94% of Organizations Using Cloud 1 2 3 4 Hybrid Cloud 67% Public Cloud Only 22% Private Cloud Only 5% Not Using Cloud 6% In 15 months, 80% of all IT budgets will be committed to cloud apps and solutions Source: McAfee Cloud Survey 2017 Cloud Reality Check Source: RightScale 2017 State of the Cloud Report
- 20. © eG Innovations, Inc | www.eginnovations.com Black Boxes and Black Holes • Black Box monitoring is outside-in – Tests externally visible behavior; i.e., Real User Monitoring – Service Level Agreements Monitoring distributed systems - O'Reilly Media Apr 27, 2016 “[Black box] ...Testing externally visible behavior as a user would see it.” “...white-box monitoring is sometimes symptom- oriented, and sometimes cause-oriented, depending on just how informative your white-box is.” • White Box monitoring is inside-out – Provides details about the internal state – Required for root-cause analysis
- 21. © eG Innovations, Inc | www.eginnovations.com Black Boxes and Black Holes It’s not just data gravity that creates clouds as black holes-- AppsSvcs Data Gravity They’re called clouds, but they could just as well be called black holes. Amazon Web Services and those that have followed have demonstrated a voracious appetite for sucking in computing workloads How Amazon has become the black hole of the cloud world CRN Magazine, June 2017 “cloud service providers are catching on that they need to build and operate a service similarly to how an enterprise runs their services ... This transparency will help enterprises have greater confidence in the cloud ... Allan Leinwand, Chief Technology Officer - ServiceNow lack of transparency is also an issue
- 22. © eG Innovations, Inc | www.eginnovations.com Hardware Network Firewall Software Hardware Network Web Server Software Website Hardware Network App Server Software A P P 1 A P P 2 A P P n Hardware Network DB Process DB Storage DB Service Network Monitor Web Monitor App Monitor DB Monitor Legacy Data Center Firewall Software Hardware / Physical Resources Virtual Resource Pools – Compute | Network | Storage Media Server Streaming Media App Server Software A P P 1 A P P 2 A P P n DB Process DB Storage DB Service Virtualization and Private Cloud Virtualization / Cloud Center of Excellence Infrastructure-as-a-Service (IaaS) Platform-as-a-Service (PaaS) Public Clouds Cloud Management Software-as-a- Service (SaaS) Black Boxes and Black Holes Digital business services include many heterogeneous components, multi- vendor devices and service providers Business Transaction Health Create Order Create Invoice Ship Product Digital Business ServiceDigital Business Services SLA Customer Experience Infrastructure Health Application Health Applications & Desktops Managed by Customer/Partner Applications & Desktops Managed by Customer/Partner Applications & Desktops Managed by Customer/Partner 3rd Party SLA 3rd Party SLA Digital Workspace Services OLA Applications & Desktops Managed by Customer/Partner App3SLA App1SLA App2SLA In-house OLA Hardware Network Firewall Software Hardware Network Web Server Software Website Hardware Network App Server Software A P P 1 A P P 2 A P P n Hardware Network DB Process DB Storage DB Service Network Monitor Web Monitor App Monitor DB Monitor Legacy Data Center Firewall Software Hardware / Physical Resources Virtual Resource Pools – Compute | Network | Storage Media Server Streaming Media App Server Software A P P 1 A P P 2 A P P n DB Process DB Storage DB Service Virtualization and Private Cloud Virtualization / Cloud Center of Excellence Infrastructure-as-a-Service (IaaS) Platform-as-a-Service (PaaS) Public Clouds Cloud Management Software-as-a- Service (SaaS) Legacy | Private / Hybrid Cloud | Public Cloud Legacy | Private / Hybrid Cloud | Public Cloud
- 23. © eG Innovations, Inc | www.eginnovations.com Containers and microservice architectures • 'Cloud native’ refers to applications or services that are container- packaged, dynamically scheduled and micro services-oriented1 • Bare metal (physical infrastructure) and virtual machines will coexist with container technology; hyperconverged infrastructures can provide flexibility to leverage both approaches Mainframe Client-Server Web Virtualization Cloud Mobile Containers Performance expectations Increasing Velocity Hardware/Physical Resources NET WEB APP DB Legacy Hardware/Physical Resources Virtual Infrastructure APP APP APP DB Virtualized Hardware/Physical Resources Resource Management / Scheduling Containers / Packaging Service Layer Application Framework / Business Logic Cloud Native IT Operating Model Maturity Quality Gap System of Innovation System of Differentiation System of Record Digital Business Service For most organizations, technology monitoring presents a mixed bag. Digital business services are often comprised of multiple application ecosystems
- 24. © eG Innovations, Inc | www.eginnovations.com Keeping pace with complexity • The road to a ‘cloud native’ future includes more than technology • Clouds are operating models Hardware Network Firewall Software Hardware Network Web Server Software Website Hardware Network App Server Software A P P 1 A P P 2 A P P n Hardware Network DB Process DB Storage DB Service Network Monitor Web Monitor App Monitor DB Monitor Legacy Data Center Firewall Software Hardware / Physical Resources Virtual Resource Pools – Compute | Network | Storage Media Server Streaming Media App Server Software A P P 1 A P P 2 A P P n DB Process DB Storage DB Service Virtualization and Private Cloud Virtualization / Cloud Center of Excellence Infrastructure-as-a-Service (IaaS) Platform-as-a-Service (PaaS) Public Clouds Cloud Management Software-as-a- Service (SaaS) Technology People/Culture Process Relative velocity of change
- 25. © eG Innovations, Inc | www.eginnovations.com Audience poll: Where are YOU now? Level Description People Process Technology
- 26. © eG Innovations, Inc | www.eginnovations.com WHERE DO WE YOU NEED TO BE? Converged APM/IPM and the Single Pane of Glass
- 27. © eG Innovations, Inc | www.eginnovations.com Monitoring and convergence • Application complexity is increasing • Monitoring is now a critical requirement Microservices Containers Virtualization / VDI BYOD IoT Hyper-Converged Infrastructures • Organizations must adopt a service model • Services include applications and all supporting infrastructure
- 28. © eG Innovations, Inc | www.eginnovations.com “Services are important for cloud computing from both an infrastructure and an application perspective.” - WHY SERVICE ORIENTATION IS IMPORTANT FOR CLOUD COMPUTING MODELS Services context • Applications ≠ Services – Clouds deliver services – A services-oriented approach is paramount – Services provide the context needed to understand business impacts and dependencies Application Health Infrastructure HealthPublic Private Hybrid Business Transaction Health Create Order Create Invoice Ship Product Order Service Invoice Service Logistics Service Digital Business Service Legacy Data Center Private Cloud Services Public Cloud Services Cloud Deployment Models
- 29. © eG Innovations, Inc | www.eginnovations.com Visibility and transparency • Effective monitoring accelerates the DIKW cycle • DevOps’ amplifying and accelerating feedback is dependent on effective monitoring
- 30. © eG Innovations, Inc | www.eginnovations.com • Single pane of glass view for real-time visibility and situational awareness Capacity Planning & Optimization Dynamic Baselining Migration Analysis Visibility and transparency End User Experience Dashboards Real User Monitoring Business Topologies and Transaction Tracing Code-Level Correlation The Devil’s in the Details! Business Transparency Service Team Transparency Situational Awareness Persona-based Transparency
- 31. © eG Innovations, Inc | www.eginnovations.com Observability Monitoring Monitoring and observability Dev Test Stage Prod Unified monitoring solutions must cross-correlate code-level and transaction-level performance with the health of the supporting physical, virtual, container and cloud infrastructures Digital Business Services that are designed with observability in mind provide mechanisms that build telemetry into the service that can trigger self-healing through embedded analytics and automated diagnostics. Unified Monitoring
- 32. © eG Innovations, Inc | www.eginnovations.com Monitoring and observability Dev Test Stage Prod Unified Monitoring • Reach across all tiers • Depth throughout each tier • Speed of diagnosis Unified monitoring solutions must cross-correlate code-level and transaction-level performance with the health of the supporting physical, virtual, container and cloud infrastructures People Process Technology Unified monitoring is an important element of a culture of observability and transparency.
- 33. © eG Innovations, Inc | www.eginnovations.com Embedded analytics • Applying AI and observability to large data sets may not be the same as embedding analytics into a unified monitoring solution Dev Test Stage Prod Unified Monitoring • Reach across all tiers • Depth throughout each tier • Speed of diagnosis Unified monitoring is most effective when there’s a single source of actionable truth. It’s what moves us away from diagnosis-related activities, and toward collaborating on how to establish self-healing properties when that diagnosis is identified. This is not only more cost-effective, it’s a more “unifying” activity than troubleshooting.
- 34. © eG Innovations, Inc | www.eginnovations.com CONCLUSION Converged APM/IPM and the Single Pane of Glass
- 35. © eG Innovations, Inc | www.eginnovations.com Performance monitoring best practices 2018 • Digital Business Services Orientation • Understand what you’re monitoring from the eyes of the customer • Visibility/Observability • Recognize that observability and monitoring are complimentary and both are required for unified monitoring • Proactive Analytics • Analytics focused on observability drive design; monitoring is about rapidly isolating performance issues– both are needed • Single Pane of Glass • Achieving a single pane of glass for performance monitoring will require an accepted and ongoing program of work
- 36. © eG Innovations, Inc | www.eginnovations.com • eG and/or our Authorized Partners can provide Professional Services – Standard Installation support – Implementation Support • Monthly baseline analysis reporting • Knowledge transfer & training See the related Webinar How we can help IT Services Performance Summary Findings, Critical Concerns & Recommendations Trend of the previous month’s issues Areas of Improvement Action Items Status http://bit.ly/UnifiedRoadMap
- 37. © eG Innovations, Inc | www.eginnovations.com eG Enterprise A Single-Pane-of-Glass Monitoring Solution Questions?
- 38. © eG Innovations, Inc | www.eginnovations.com Thank You! www.eginnovations.com/freetrial info@eginnovations.com +1 (866) 526 6700