OSMC 2016 | Application Performance Management with Open-Source-Tooling by Mario Mann

Application Performance Management
with
Open Source Tooling

Disruptive Änderung im Nutzerverhalten
2
Ellen DeGeneres‘ Oscars selfie crashes Twitter
[Abbildung: Ellen DeGeneres]
Zusammenfassung
 2.6 Millionen Re-Tweets inerhalb 2 Stunden
 20 Minuten nicht verfügbar
[Abbildung : Twitter.com]
OSMC - Open Source Monitoring Conference

3
Das HealthCare.gov Fiasko
Zusammenfassung
[Kevin Surace, fastcompany.com; Byron Wolf, CNN]
 Eines der schlimmsten Software Projekte
 Hunderte Millionen Dollar wurden investiert
 Ausfälle und langsame Anfragen waren normal
 US-Regierung musste sich entschuldigen
 Google & RedHat mussten aushelfen
Vor dem Start wurde Skalierbarkeit und Performance nie getestet!
[Abbildung: healthcare.gov]

Otto.de
OSMC - Open Source Monitoring Conference4
 Johannes Mainusch
 Performance >3s
(2011)
 Performance <2s
(2016)
[video | https://youtu.be/luy1lL8P0KE]

Take Away
[Abbildung: http://content.hollywire.com/sites/default/files/Success-Kid.jpg]
5 OSMC - Open Source Monitoring Conference

Referenten – Mario Mann
Hintergrund
 Seit 2013 Mitarbeiter der NovaTec Consulting GmbH
 In APM Projekten im Finance- und Automotive-Bereich
Tätigkeitsschwerpunkt
 (Werkzeug-)unabhängige APM Beratung
 Freie / Open Source Alternativen für APM
 Freie / Open Source Alternativen für Lasttests
 Engagement im inspectIT Open-Source Projekt
Mario Mann
@mawtourde
http://www.linkin.com/mario-mann
mario.mann@novatec-gmbh.de

Das NovaTec APM Team
Führende unabhängige APM Beratung
 Aktuell 15 APM Berater
 Kunden: mittelständische bis große Konzerne
(Automobil, Finanzen, Versicherungen)
Unbefangenheit durch Multi-Partner Ansatz
 Partnerschaft mit den führenden APM
Software-Anbietern
 Zusammenarbeit mit neuen Innovatoren
Fördern Open-Source im APM-Bereich
 Eigenes open-source APM Werkzeug
 Bewertung und Kombination existierender
open-source Werkzeuge

Agenda
• Application Performance Management
• inspectIT – The OpenSource APM solution
• Gathering and Visualizing Timeseries Data
• Application Performance Testing & Diagnosis
• WEB Performance Analysis

Application Performance Management

Application Performance Management …
…
umfasst den gesamten
Software-Lebenszyklus
…
deckt alle
Systemebenen ab
…
erfordert Zusammenarbeit
unterschiedlicher Bereiche
… ist ein Querschnittsthema!
Anforderungen
Entwurf
EntwicklungTest
Betrieb
Netzwerk
Anwendung
System
Clients
Entwicklung
BetriebBusiness

Load Testing
Web Perf.
Testing
Performance
Modelling
Monitoring in
Production Synthetic
Monitoring
Real User
Monitoring
Root Cause
Diagnosis
Regression
Testing
APM
11
Requirements
Design
DevelopmentTesting
Operations
Network
App
System
Clients
Development
OperationsBusiness
… ist Vielseitig und Komplex!

Umfangreiche
Funktionalität
Ausgereift
Bei großen Unternehmen
im Einsatz
Kommerzielle APM Werkzeuge
Gartner‘s Magic Quadrant for Application Performance Monitoring Suites (12/2015),
Cameron Haight, Will Cappelli, Federico De Silva
http://www.dynatrace.com/en/gartner-magic-quadrant-application-performance-monitoring-2015.html
Partner

Lizenzkosten
Vendor Lock-In
Nachteile kommerzieller APM Werkzeuge
Typisches Modell: x $ pro Agent  Skalierung?
Microservices Internet of Things
[Abbildung: http://blog.wso2.com] [Abbildung: Christian Hinkelmann,http://nahverkehrhamburg.de]
Flexibilität Interoperabilität Nachhaltigkeit
Mobile Revolution
[Abbildung: https://uxmag.com]
 Anpassung an eigene
Bedürfnisse
 Fehlerbehebung
 Datenquellen
 Analysewerkzeuge
 Andere APM Werkzeuge
 Produkt eingestellt
 Strategiewechsel des
APM-Herstellers

14
Open Source Werkzeuge im APM-Bereich
Load Testing
Performance
Modeling
Web Performance
Analysis
System &
Resources Monitoring
Real User Monitoring
JRat
JMemProf
Low-Level
Performance Profiling
Monitoring &
Application Deep Dive

inspectIT
The Open Source APM solution

What is inspectIT?
pen Source
8 |2
Plattf rm
Pareto-Prinzip
• Fokus auf Hauptfunktionalität
• Erfahrung aus APM Projekten
Plattform-Prinzip
• Integration mit Werkzeugen
• Erweiterbarkeit
Die Open-Source APM Lösung
• Entwicklung seit 2005
• Open Source seit 2015

Gathering and Visualizing Timeseries
Data

What is APM About?
Estimate Business ImpactMonitor Application Health
Identify anomalies and
performance issues
Prod. EnvironmentReal Users
Request
Dashboards
Monitoring Tool
Problem Diagnosis

Gathering and Visualizing Timeseries Data
Time Series Databases
Graphing ToolsData Collectors
Custom Code
…
Persist data Query & Visualize

Dashboards

The Flaw of Averages
The Flaw of Averages: Why We Underestimate Risk in the Face of Uncertainty
Sam L. Savage, with illustrations by Jeff Danziger – http://flawofaverages.com
Gil Tene – https://www.youtube.com/watch?v=lJ8ydIuPFeU
://latencytipoftheday.blogspot.de/

Dashboards

Anomaly Detection & Alerting

Missing Business Context
CPU utilization over time
How critical is this peak in CPU utilization?
Asking the right questions:
 How are the users affected?
 Which business transactions are affected?
 Are any time-critical batch jobs affected?
11pm 0am 1am 2am 3am 4am 5am 6am
100 %
50 %
0%

Defining Business Context

Defining Business Context
Hawkular BTM

Problem Diagnosis
 Deep Dive into request execution flow necessary
 Level of Detail vs. Measurement Overhead
 Do not instrument frequently called methods (e.g. Getters, Setters, String class, etc.)
 Instrument system and component boundaries (entry and exit points)

Configuring Instrumentation

Application Performance Testing &
Diagnosis

What is Performance Testing About?
Identify & Diagnose
Performance Problems
Evaluate Application Behaviour
under Load
Test Environment
Monitoring Tool
Test Scalability of Application
 load
 e-2-e response times
 throughput
 detailed invocations
 system resource data
 deep dive information
fLoad Generator
Agent
Agent
Agent
Request
Response

0
1
2
3
1 2 3 4 5 6 7
ResponseTime
[s]
Execution Nr.
e-2-e response times
load data
detailed
measurement
data
System Under Test
Load Driver
Regression Tests

End User Experience?
[Image | http://cdn2.hubspot.net/hub/2224117/file-4141070752-jpg/blog-files/three-e1409846588737.jpg]
Satisfied Tolerating Frustrated
Performance User Actions Users
 Performance issues
 Functional Errors
 Network (Local ISPs, Mobile network carriers)
 Third party content providers
 First user action
 Last user action
 Did the visit convert?
 Did the visit bounce?
 Device
 Resolution
 Browser Versions
 Geolocation
What is Web Performance Analysis about?

Measuring End-User Experience

Real User
Testing
Synthetic
Monitoring
 Continuous external testing
 Known testing nodes
 Different Locations (ISP, Networks)
 No baseline traffic required
 Competitor Benchmark
 Availability testing (incl. 3rd Party)
e.g., every 30 mins from different nodes
Real User
Monitoring
 Real End Users
 Real Interaction
 Real traffic
External testing with all major
 browsers,
 operating systems,
 mobile devices
and real world data
QoS Validation
QoS ExpectationQoS Optimization
Anomaly
Testing and Monitoring Web Performance

[http://www.webpagetest.org/performance_optimization.php?test=160623_DF_MV7&run=1&cached=0]
webpagetest.org

webpagetest.org

39
Visueller Vergleich
http://www.webpagetest.org – Tests ausgeführt aus Dulles, VA - Chrome

40
https://dashboard.sitespeed.io/dashboard/db/compare-multiple-sites
Synthetic Testing

Be careful...

Conclusion
Monitoring &
Application Deep Dive
Load Testing
Performance
Modeling
Web Performance
Analysis
System &
Resources Monitoring
Real User Monitoring
JRat
JMemProf
Low-Level
Performance Profiling
Open-Source tools sufficiently
address APM needs!
There are lots of them for different purposes!
Combine them!

OSMC 2016 | Application Performance Management with Open-Source-Tooling by Mario Mann

More Related Content

What's hot (19)

Similar to OSMC 2016 | Application Performance Management with Open-Source-Tooling by Mario Mann (20)

Recently uploaded (20)

OSMC 2016 | Application Performance Management with Open-Source-Tooling by Mario Mann