SlideShare a Scribd company logo
APPLICATION PERFORMANCE
MONITORING FRAMEWORK
AND EVALUATION APPROACH
2
 Components of an Application Performance
Monitoring (APM) Framework
 Approach to evaluating an APM Framework
 Example Shared Service offering
Objective/Agenda
Components of an APM Framework
4
 The APM Framework is defined by five distinct
dimensions of, or perspectives on, end-to-end
application performance.
 While each of these five perspectives are distinct
and often deployed by different stakeholders, true
insight into application performance is only gained
through interaction and interlocks between these
perspectives.
Definition of an APM Framework
5
1. End User
Experience
End to End Performance
2. Runtime
application
architecture
HW, SW and the
communication between
them
3. User-defined
transaction
profiling
Real and synthetic
transactions
4. Application
Context Monitoring
Resources consumed by the
application thru the
interaction with HW and
SW
5. Analytics
Proactive identification
and remediation of issues
either automated or
manual and Capacity
Planning
APM Framework Components
How the user
views
performance
How IT groups
view
performance
How the
business views
performance
What REAL
performance
is
What IT does
to fix
performance
issues
Key Takeaway: Framework components are additive and deployment of each
component provides additional insight into application performance
Evaluation Approach
7
 Create a current inventory of existing Application
Performance Monitoring tools in use
 Identify areas of overlapping or redundant
capabilities and gaps in APM Framework
components
 Provide options on an integrated APM Tool Suite
 Propose a set of shared service offerings for APM
 Monitoring, alerting and dashboards
Evaluation Objective
8
 Information Security Office
 Enterprise/Solution Architecture
 Technology/Infrastructure Services
 Servers, Storage, Network
 IT Service Management
 Service Desk
 Incident, Change, Problem, Release Management
 Application Support Groups
Suggested Participants
9
• Distribute overview
and pre-work
• Interviews with
Stakeholders
• Compile Interview
results
Identify Current
Situation
• Analyze inventory
against APM
Framework
components
functionality
• Evaluate against
Gartner Magic
Quadrant
• Create Map/Gap
Analysis outcome
Conduct Map/Gap
Analysis
• Outline options on
creating Integrated
APM Tool Suite
• Invest, Remain,
Replace, Retire
alternatives for
APM tools
Create Options
for APM suite
• Create a proposed
set of APM shared
service offerings
Proposed Service
Offerings
Evaluation Process
10
 Application inventory/list categorized by criticality -
Tier 1,2, 3
 Monitoring tools inventory/list for:
 Server
 Storage
 Network
 Database
 Services
 Application Framework - .Net or Java
 Transaction monitoring – real or synthetic
Pre-work from Participants
11
 Low-hanging fruit is typically found in Runtime
Application Architecture (Infrastructure Monitoring) area
– Ping, CPU, Disk and Memory
 Start with agentless monitoring as this tends to be an
easier hurdle to overcome than agent based monitoring
 Dashboards provided to customers show both their
applications and the infrastructure they are hosted on
 Crawl, walk, run - grow shared service offerings based
upon customer need/demand
Findings from Other Clients
Examples
13
Proposed APM Shared Service
Offerings
Foundational Elements
Runtime Application Architecture, Alerting and Dashboards
Application
Context
Monitoring
User Defined
Transaction
Profiling
End User
Experience
Incident
Ticketing
Tier 1
Mission Critical
Application
Context
Monitoring
User Defined
Transaction
Profiling
Tier 2
Business Critical
Incident
Ticketing
Incident
Ticketing
Tier 3
Business Important
Widespreadbusinessstoppage.
Significantexposureforcustomer’spublic
reputation.Possiblefinancialimplications
Businessstoppagebutworkaroundsexist,
Moderateexposuretocustomer’spublic
reputation.Possiblefinancialimplications
Littletonobusinessstoppage.Littletono
exposuretocustomer’spublicreputation.
Littletonofinancialimplications

More Related Content

PPT
Application Portfolio Assessment Tool
PDF
Automatic Performance Modelling from Application Performance Management (APM)...
DOC
Performance management network
PPT
The Art of Procuring Paratransit Software
PPTX
Integration strategy for large erp deployments
PPT
Application Performance Monitoring
PDF
Introduction to Total Data Driven Test Automation
DOC
Alm evaluation feedback.
Application Portfolio Assessment Tool
Automatic Performance Modelling from Application Performance Management (APM)...
Performance management network
The Art of Procuring Paratransit Software
Integration strategy for large erp deployments
Application Performance Monitoring
Introduction to Total Data Driven Test Automation
Alm evaluation feedback.

What's hot (20)

PPT
Improving ROI and Efficiencies of Software Test Case Automation
PDF
resume_BOFA
PPTX
Software engineering 4 critical analysis of waterfall model
PPTX
Himanshu
PPTX
Rational Doors Hp Quality Center Integration
PDF
Performance testing Web Application - A complete Guide
PPT
Wily Deployment
PPSX
Conviface at OAUG -11i to R12
PPTX
Multi-core Real-time Simulation of High-Fidelity Vehicle Models using Open St...
PDF
Multicentricsolutions – testing services
PPTX
Software maintenance
PPTX
Simplify 3X
PPT
Software maintenance
PDF
Software Asset Management (SAM) and License Optimization ROI Workshop
DOCX
Jeremy Gold\'s Resume
DOCX
Kusum Gupta_3.3 yrs
PPTX
Software enginnering
PPT
Bpm Camp Prashant Web App Vs Process
PPTX
Software maintenance
DOCX
Kim Renee Lewis Resume
Improving ROI and Efficiencies of Software Test Case Automation
resume_BOFA
Software engineering 4 critical analysis of waterfall model
Himanshu
Rational Doors Hp Quality Center Integration
Performance testing Web Application - A complete Guide
Wily Deployment
Conviface at OAUG -11i to R12
Multi-core Real-time Simulation of High-Fidelity Vehicle Models using Open St...
Multicentricsolutions – testing services
Software maintenance
Simplify 3X
Software maintenance
Software Asset Management (SAM) and License Optimization ROI Workshop
Jeremy Gold\'s Resume
Kusum Gupta_3.3 yrs
Software enginnering
Bpm Camp Prashant Web App Vs Process
Software maintenance
Kim Renee Lewis Resume
Ad

Similar to Infrastructure and APM Approach and Framework v.3 (20)

PDF
Vendor Analysis Template
PDF
TradeTech Architecture 2011 - Rodney Morrison, How to Achieve Success with Ap...
PDF
Webinar - Is your Web Application Performance Doomed?
PDF
2012 magic-quadrant-for-application-performance-monitoring
PDF
Ibm itsm portfolio
PDF
Why not let apm do all the heavy lifting beyond the basics of monitoring | Sw...
PPTX
Finding application problems before they impact users
PPTX
Closing the door on application performance problems
PPTX
ManageEngine - Forrester Webinar: Maximize your application performance to en...
PDF
Applications performance Management For Enterprise Applications
PPT
2011 sept 13 performance webinar with notes (5b)
PPTX
The real cost of it franken monitoring
PPTX
How to stop fingerpointing when your application is down
PPTX
Why you need Application Performance Monitoring
PPTX
How Applications Manager helps with application performance monitoring
PDF
Introducing the E.P.I.C. APM: Stimulate User-Loyalty and Differentiation
PPTX
The Need for AppOps in the Dynamic Data Center and Cloud
PDF
APM Center of Excellence Drives Improved Business Results at Itau Unibanco
PDF
What is Application Performance Management?
PPTX
The Business Justification for APM
Vendor Analysis Template
TradeTech Architecture 2011 - Rodney Morrison, How to Achieve Success with Ap...
Webinar - Is your Web Application Performance Doomed?
2012 magic-quadrant-for-application-performance-monitoring
Ibm itsm portfolio
Why not let apm do all the heavy lifting beyond the basics of monitoring | Sw...
Finding application problems before they impact users
Closing the door on application performance problems
ManageEngine - Forrester Webinar: Maximize your application performance to en...
Applications performance Management For Enterprise Applications
2011 sept 13 performance webinar with notes (5b)
The real cost of it franken monitoring
How to stop fingerpointing when your application is down
Why you need Application Performance Monitoring
How Applications Manager helps with application performance monitoring
Introducing the E.P.I.C. APM: Stimulate User-Loyalty and Differentiation
The Need for AppOps in the Dynamic Data Center and Cloud
APM Center of Excellence Drives Improved Business Results at Itau Unibanco
What is Application Performance Management?
The Business Justification for APM
Ad

Infrastructure and APM Approach and Framework v.3

  • 2. 2  Components of an Application Performance Monitoring (APM) Framework  Approach to evaluating an APM Framework  Example Shared Service offering Objective/Agenda
  • 3. Components of an APM Framework
  • 4. 4  The APM Framework is defined by five distinct dimensions of, or perspectives on, end-to-end application performance.  While each of these five perspectives are distinct and often deployed by different stakeholders, true insight into application performance is only gained through interaction and interlocks between these perspectives. Definition of an APM Framework
  • 5. 5 1. End User Experience End to End Performance 2. Runtime application architecture HW, SW and the communication between them 3. User-defined transaction profiling Real and synthetic transactions 4. Application Context Monitoring Resources consumed by the application thru the interaction with HW and SW 5. Analytics Proactive identification and remediation of issues either automated or manual and Capacity Planning APM Framework Components How the user views performance How IT groups view performance How the business views performance What REAL performance is What IT does to fix performance issues Key Takeaway: Framework components are additive and deployment of each component provides additional insight into application performance
  • 7. 7  Create a current inventory of existing Application Performance Monitoring tools in use  Identify areas of overlapping or redundant capabilities and gaps in APM Framework components  Provide options on an integrated APM Tool Suite  Propose a set of shared service offerings for APM  Monitoring, alerting and dashboards Evaluation Objective
  • 8. 8  Information Security Office  Enterprise/Solution Architecture  Technology/Infrastructure Services  Servers, Storage, Network  IT Service Management  Service Desk  Incident, Change, Problem, Release Management  Application Support Groups Suggested Participants
  • 9. 9 • Distribute overview and pre-work • Interviews with Stakeholders • Compile Interview results Identify Current Situation • Analyze inventory against APM Framework components functionality • Evaluate against Gartner Magic Quadrant • Create Map/Gap Analysis outcome Conduct Map/Gap Analysis • Outline options on creating Integrated APM Tool Suite • Invest, Remain, Replace, Retire alternatives for APM tools Create Options for APM suite • Create a proposed set of APM shared service offerings Proposed Service Offerings Evaluation Process
  • 10. 10  Application inventory/list categorized by criticality - Tier 1,2, 3  Monitoring tools inventory/list for:  Server  Storage  Network  Database  Services  Application Framework - .Net or Java  Transaction monitoring – real or synthetic Pre-work from Participants
  • 11. 11  Low-hanging fruit is typically found in Runtime Application Architecture (Infrastructure Monitoring) area – Ping, CPU, Disk and Memory  Start with agentless monitoring as this tends to be an easier hurdle to overcome than agent based monitoring  Dashboards provided to customers show both their applications and the infrastructure they are hosted on  Crawl, walk, run - grow shared service offerings based upon customer need/demand Findings from Other Clients
  • 13. 13 Proposed APM Shared Service Offerings Foundational Elements Runtime Application Architecture, Alerting and Dashboards Application Context Monitoring User Defined Transaction Profiling End User Experience Incident Ticketing Tier 1 Mission Critical Application Context Monitoring User Defined Transaction Profiling Tier 2 Business Critical Incident Ticketing Incident Ticketing Tier 3 Business Important Widespreadbusinessstoppage. Significantexposureforcustomer’spublic reputation.Possiblefinancialimplications Businessstoppagebutworkaroundsexist, Moderateexposuretocustomer’spublic reputation.Possiblefinancialimplications Littletonobusinessstoppage.Littletono exposuretocustomer’spublicreputation. Littletonofinancialimplications