In-production Application Quality Monitoring
Diagnosing Application Problems


    Kwan Thean Keong
    Senior Consultant
    Redynamics Asia
In-production Application Quality Monitoring
Objective & Key Takeaways

  Understand strategies for analyzing
  applications
  Learn how to interpret AVIcode diagnostic
  information and identify root-cause
  Walk through AVIcode Advisor reports and
  learn how to generate trend and problem
  reports
Managing Complex Applications
      End users                               How do I know I have a problem?

                                                          ?
                                               How do I isolate the problem?
                                              How do I diagnose the problem?




                                Web servers




                                                              Data servers
                  Application servers
Application Personas
                              • Build applications and verify
 • Ensure application           quality
                              • Improve application
   quality, reliability and        Developers/QA
                                functionality
   performance                • Troubleshoot critical issues and
 • Reduce Mean Time To          resolve
       Application
   Recovery (MTTR) and
   ensure customer
          Owners
   satisfaction               • Manage infrastructure and
 • Ensure that application      application delivery
                                     System
                              • Identify deviations from acceptable
   meets predefined             behavior
   Service Levels (SLA)           Administrators
                              • Isolate and coordinate problem
                                resolution
Today’s World




The GREAT WALL of
   CONFUSION
Application Monitoring Challenges
                                                                    IT Operations




         “Why? It works fine in
         staging”
 “It is your server, not my code !”
   “So how is it failing?”




                                      “How do $^%& *^!!!”
                                      “!@$#% I monitor your .NET application for
                                      “But I only know it’s unavailable whencode”
                                      availability in I know, I didn’t write the my
                                      “How should production?”
                                      customers call”




    Development
Solution: Application Monitoring

Application Real-Time Architecture              End User Experience
Discovery and Modeling                          Monitoring
•Discover and gain insight into the             •Understand how your end users
 relationships between the software              experience your application’s
 and hardware components within your             performance and quality
 application environment
                         Application Performance Analytics
                         • Optimize Resources
                         • Improve Business Processes



User-Defined Transaction Profiling              Application Component Deep
•Trace the performance of specific              Dive Monitoring
 critical business transactions across the      •Monitor the health of an application,
 application stack and infrastructure            and rapidly diagnose problems
Monitoring Your Application
Managing Applications with AVICode

        End users




                                  Web servers




                                                Data servers
                    Application servers
Key Features
 24x7 .NET application
 monitoring
 No code modification required
 End-to-end application health
 monitoring
 Real-time detection of
 performance bottlenecks and
 failures
 Intelligent analytics and reports
AVIcode simplifies the process




                    Diagnostic
                   Information



      Operations    Problem      Development
                   Resolution
Identifying Problems
 Operations Manager
  State view indicates
   application health
  Alerts indicate application
   problems
  Notifications and actions can
   be configured based on alerts
 AVIcode
  View events by time
  Create notifications for
   alerting
   directly from web console
Using SCOM for Alerting

   Alert Types
    AVIcode events
     with
     diagnostic detail
    Alerts based on app
     performance
     counter deviations
   Monitors
    Based on
     application
     performance
     counters
Event Analysis with AVICode

  Event Filtering
     Application Groups   Application Grouping
     Event Types
     Event Source
                                      Search for:
     Time and Date
                                                    Group By
  Isolate Problems by
     Problem
     Heaviest resource
     Failed Function
     Occurrence
Isolating the Problem?
 AVIcode
  Events are correlated and categorized across monitored
   application tiers to isolate the problem area
  Host metrics are correlated application events to expose
   relationships between app and resources


 Operations Manager
  Synthetic monitoring to understand application availability
  Monitor host platform/services health to understand when
   dependent services are experiencing problems
How Do we Diagnose an App Problem?

 Leverage AVIcode to diagnostic
 information to understand what the
 app/user was executing
 Determine if its an operational or
 application support issue
 Initiate incident / problem management
 processes to route information to
 appropriate teams
Analyzing Real-time Application
Events
Event Types
 Events are divided into 4 major
 categories
    Application Errors
    Performance
    Operational Info
    System Failures
 Application failures are further
 divided
 into one of three Aspects
  Application Failure
  Connectivity
  Security
Performance Events
Client-side Performance Event Breakdown
Server-side Performance Event Breakdown
Application Failure Events


   Client-side               Server-side
                              Server-side application
    JavaScript exception      exceptions
     and parameters           Categorized by app failure,
    Ajax request failures     security and connectivity
Client-side JavaScript Failure Breakdown
Server-side Failure Event Breakdown
Troubleshooting Performance Counters
Analyzing AVIcode
Application Events
Trend Analysis and Reporting
AVIcode Advisor

  Leverages AVIcode transactional
  information
  Built on SQL Reporting Services
  Multiple levels of data analysis and
  reporting for:
    Identifying application problem areas
    Measuring before/after performance
    Capacity planning and analysis
    End-user impact
  Flexible report scheduling options
Types of Reports
 Application quality
 Problem prioritization
 Application load
 Resource utilization
 Application status reporting
 Application baselining
Advisor Application
    Reporting
Application Monitoring Challenges
                                     Information Technology Operations




 “Thank you very much, you
 are a genius”




                             “Your application is having
                             performance problems and
                             here is the diagnostic
                             information”
 Development
Questions & Answers
We value your feedback!



  Please remember to complete the
  overall conference evaluation form and
  return it to the Registration Counter

More Related Content

PPTX
Aprenda mais sobre sua aplicação e seus usuários com Application Insights (DN...
PPSX
JIRA
DOC
chandrakanth
PDF
Experitest & Cigniti Co-Webinar -
DOC
Uma Peddi_ QA Lead_Analyst
PDF
Experitest & Hexaware Co-Webinar
PDF
Encontrando la Aguja en el Rendimiento de Aplicaciones
Aprenda mais sobre sua aplicação e seus usuários com Application Insights (DN...
JIRA
chandrakanth
Experitest & Cigniti Co-Webinar -
Uma Peddi_ QA Lead_Analyst
Experitest & Hexaware Co-Webinar
Encontrando la Aguja en el Rendimiento de Aplicaciones

What's hot (17)

PDF
Software QS Tag White Paper
PPTX
Android Mobile Application Testing: Human Interface Guideline, Tools
PPTX
Agile & Secure SDLC
PDF
Real User Experience Insight External
PDF
Real User Experience Insight
PPTX
Secure SDLC Framework
PDF
Cast Application Intelligence Platform
DOC
Ravi_Nelluri_QA
PDF
CAAD - Codeless Applications Development Methods and Principles
PDF
Use AppDynamics SDK to Integrate with your Applications - AppSphere16
PPTX
Presentation (software engineering)
PDF
Experitest & Capgemini Co-webinar -
PDF
AppDynamics- A sneak peak into the product that is disrupting the Application...
PPTX
Continuous delivery mobile application development
PDF
Secure Agile SDLC BSides 14 - 2017 - Raphael Denipotti
PPTX
2011 09 19 Radiss Tech Services
PDF
Eventum Presentation
Software QS Tag White Paper
Android Mobile Application Testing: Human Interface Guideline, Tools
Agile & Secure SDLC
Real User Experience Insight External
Real User Experience Insight
Secure SDLC Framework
Cast Application Intelligence Platform
Ravi_Nelluri_QA
CAAD - Codeless Applications Development Methods and Principles
Use AppDynamics SDK to Integrate with your Applications - AppSphere16
Presentation (software engineering)
Experitest & Capgemini Co-webinar -
AppDynamics- A sneak peak into the product that is disrupting the Application...
Continuous delivery mobile application development
Secure Agile SDLC BSides 14 - 2017 - Raphael Denipotti
2011 09 19 Radiss Tech Services
Eventum Presentation
Ad

Viewers also liked (9)

PDF
DevOps Toolbox: Application monitoring and insights
PDF
[Nuxeo World 2013] Workshop - Monitoring your Application
PDF
Splunk Beyond application monitoring PDF
PPTX
Multi-Platform Application Monitoring
PDF
Application Monitoring Tools
PPTX
Application Monitoring in a Post-Server World: Why Data Context is Critical
PDF
5 Best Practices for Monitoring Hive and MapReduce Application Performance
PDF
Visual Design with Data
PDF
Build Features, Not Apps
DevOps Toolbox: Application monitoring and insights
[Nuxeo World 2013] Workshop - Monitoring your Application
Splunk Beyond application monitoring PDF
Multi-Platform Application Monitoring
Application Monitoring Tools
Application Monitoring in a Post-Server World: Why Data Context is Critical
5 Best Practices for Monitoring Hive and MapReduce Application Performance
Visual Design with Data
Build Features, Not Apps
Ad

Similar to In-production Application Quality Monitoring (20)

PPTX
DevOps and the Future of IT Operations
PPTX
06 operations and feedback dap-kabel
PDF
Manage and Monitor Oracle Applications in the Cloud
PDF
Dyna Trace Whitepaper Performance
PDF
Application Assessment Techniques
PDF
Protecting your application investment white paper 0908 2
PDF
IHIC 2012 - Key note - HL7 Italia - S.Lotti - Is it really useful to have a f...
PDF
NessPRO Italy on CAST
PDF
IDC & Gomez Webinar --Best Practices: Protect Your Online Revenue Through Web...
PDF
InterConnect 2017 : Cognitive DevOps: Get Rid of the Guesswork to Improve Sof...
PPT
PCTY 2012, Overvågning af forretningssystemer i et virtuelt miljø v. Hans Ped...
PDF
Application Lifecycle Management & VSTS
PDF
Managing Complexity Across Today’s Application Delivery Chain:Six key indicat...
PPTX
How Microsoft ALM Tools Can Improve Your Bottom Line
PDF
Software Measurement for Lean Application Management
PDF
Make Your Architecture Serve Your Company’s Needs and Your Own Career Goals
PPT
Rational collaborative-lifecycle-management-2012
PDF
App first
PDF
Opposites Attract SOA, Agile, MDA
PDF
10 things ever architect should know about the Windows Azure Platform - ericnel
DevOps and the Future of IT Operations
06 operations and feedback dap-kabel
Manage and Monitor Oracle Applications in the Cloud
Dyna Trace Whitepaper Performance
Application Assessment Techniques
Protecting your application investment white paper 0908 2
IHIC 2012 - Key note - HL7 Italia - S.Lotti - Is it really useful to have a f...
NessPRO Italy on CAST
IDC & Gomez Webinar --Best Practices: Protect Your Online Revenue Through Web...
InterConnect 2017 : Cognitive DevOps: Get Rid of the Guesswork to Improve Sof...
PCTY 2012, Overvågning af forretningssystemer i et virtuelt miljø v. Hans Ped...
Application Lifecycle Management & VSTS
Managing Complexity Across Today’s Application Delivery Chain:Six key indicat...
How Microsoft ALM Tools Can Improve Your Bottom Line
Software Measurement for Lean Application Management
Make Your Architecture Serve Your Company’s Needs and Your Own Career Goals
Rational collaborative-lifecycle-management-2012
App first
Opposites Attract SOA, Agile, MDA
10 things ever architect should know about the Windows Azure Platform - ericnel

Recently uploaded (20)

PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PDF
Five Habits of High-Impact Board Members
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PDF
A comparative study of natural language inference in Swahili using monolingua...
PDF
Getting Started with Data Integration: FME Form 101
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PPTX
Modernising the Digital Integration Hub
PDF
A review of recent deep learning applications in wood surface defect identifi...
PDF
Architecture types and enterprise applications.pdf
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PPT
Module 1.ppt Iot fundamentals and Architecture
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
PPTX
observCloud-Native Containerability and monitoring.pptx
PDF
Getting started with AI Agents and Multi-Agent Systems
DOCX
search engine optimization ppt fir known well about this
PPT
What is a Computer? Input Devices /output devices
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
Five Habits of High-Impact Board Members
Final SEM Unit 1 for mit wpu at pune .pptx
Taming the Chaos: How to Turn Unstructured Data into Decisions
A comparative study of natural language inference in Swahili using monolingua...
Getting Started with Data Integration: FME Form 101
Group 1 Presentation -Planning and Decision Making .pptx
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
A contest of sentiment analysis: k-nearest neighbor versus neural network
Modernising the Digital Integration Hub
A review of recent deep learning applications in wood surface defect identifi...
Architecture types and enterprise applications.pdf
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Module 1.ppt Iot fundamentals and Architecture
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
observCloud-Native Containerability and monitoring.pptx
Getting started with AI Agents and Multi-Agent Systems
search engine optimization ppt fir known well about this
What is a Computer? Input Devices /output devices

In-production Application Quality Monitoring

  • 2. Diagnosing Application Problems Kwan Thean Keong Senior Consultant Redynamics Asia
  • 4. Objective & Key Takeaways Understand strategies for analyzing applications Learn how to interpret AVIcode diagnostic information and identify root-cause Walk through AVIcode Advisor reports and learn how to generate trend and problem reports
  • 5. Managing Complex Applications End users How do I know I have a problem? ? How do I isolate the problem? How do I diagnose the problem? Web servers Data servers Application servers
  • 6. Application Personas • Build applications and verify • Ensure application quality • Improve application quality, reliability and Developers/QA functionality performance • Troubleshoot critical issues and • Reduce Mean Time To resolve Application Recovery (MTTR) and ensure customer Owners satisfaction • Manage infrastructure and • Ensure that application application delivery System • Identify deviations from acceptable meets predefined behavior Service Levels (SLA) Administrators • Isolate and coordinate problem resolution
  • 7. Today’s World The GREAT WALL of CONFUSION
  • 8. Application Monitoring Challenges IT Operations “Why? It works fine in staging” “It is your server, not my code !” “So how is it failing?” “How do $^%& *^!!!” “!@$#% I monitor your .NET application for “But I only know it’s unavailable whencode” availability in I know, I didn’t write the my “How should production?” customers call” Development
  • 9. Solution: Application Monitoring Application Real-Time Architecture End User Experience Discovery and Modeling Monitoring •Discover and gain insight into the •Understand how your end users relationships between the software experience your application’s and hardware components within your performance and quality application environment Application Performance Analytics • Optimize Resources • Improve Business Processes User-Defined Transaction Profiling Application Component Deep •Trace the performance of specific Dive Monitoring critical business transactions across the •Monitor the health of an application, application stack and infrastructure and rapidly diagnose problems
  • 11. Managing Applications with AVICode End users Web servers Data servers Application servers
  • 12. Key Features 24x7 .NET application monitoring No code modification required End-to-end application health monitoring Real-time detection of performance bottlenecks and failures Intelligent analytics and reports
  • 13. AVIcode simplifies the process Diagnostic Information Operations Problem Development Resolution
  • 14. Identifying Problems Operations Manager  State view indicates application health  Alerts indicate application problems  Notifications and actions can be configured based on alerts AVIcode  View events by time  Create notifications for alerting directly from web console
  • 15. Using SCOM for Alerting Alert Types  AVIcode events with diagnostic detail  Alerts based on app performance counter deviations Monitors  Based on application performance counters
  • 16. Event Analysis with AVICode Event Filtering  Application Groups Application Grouping  Event Types  Event Source Search for:  Time and Date Group By Isolate Problems by  Problem  Heaviest resource  Failed Function  Occurrence
  • 17. Isolating the Problem? AVIcode  Events are correlated and categorized across monitored application tiers to isolate the problem area  Host metrics are correlated application events to expose relationships between app and resources Operations Manager  Synthetic monitoring to understand application availability  Monitor host platform/services health to understand when dependent services are experiencing problems
  • 18. How Do we Diagnose an App Problem? Leverage AVIcode to diagnostic information to understand what the app/user was executing Determine if its an operational or application support issue Initiate incident / problem management processes to route information to appropriate teams
  • 20. Event Types Events are divided into 4 major categories  Application Errors  Performance  Operational Info  System Failures Application failures are further divided into one of three Aspects  Application Failure  Connectivity  Security
  • 24. Application Failure Events Client-side Server-side  Server-side application  JavaScript exception exceptions and parameters  Categorized by app failure,  Ajax request failures security and connectivity
  • 29. Trend Analysis and Reporting
  • 30. AVIcode Advisor Leverages AVIcode transactional information Built on SQL Reporting Services Multiple levels of data analysis and reporting for: Identifying application problem areas Measuring before/after performance Capacity planning and analysis End-user impact Flexible report scheduling options
  • 31. Types of Reports Application quality Problem prioritization Application load Resource utilization Application status reporting Application baselining
  • 32. Advisor Application Reporting
  • 33. Application Monitoring Challenges Information Technology Operations “Thank you very much, you are a genius” “Your application is having performance problems and here is the diagnostic information” Development
  • 35. We value your feedback! Please remember to complete the overall conference evaluation form and return it to the Registration Counter