SlideShare a Scribd company logo
Microservice Monitoring and Quality
Management for Modern Apps and
Infrastructures
Speakers
Pavlo Baron, CTO, Instana
Ravi Yadav, Partnerships Architect,
Mesosphere
Pedro Pacheco, Solutions Architect, Instana
Why Instana & DC/OS?
Pavlo Baron, CTO, Instana
Architectures Have Evolved
Host Container Middlewar
e
Microservices Business Service
Complexity + Scale Never Cease
Modern Architectures Have Evolved to a
new Level of Distribution and Scale
Mesosphere
DC/OS
DC/OS is the Foundation for
Modern Architecture Implementation
• Scheduling
• Container lifecycle management
• Location transparent resource
management
• Continuous deployment
DC/OS engineers and automates change
•Containers facilitating rapid
development and deployment
•A container allocation from DC/OS
change code, dependency,
messaging structure
Feedback! What just happened!
• What changed?
• Where did change occur?
• Was there any quality impact?
• What is the root cause?
In a system of constant change, operators
need feedback!
Polling Question #1
© 2017 Mesosphere, Inc. All Rights Reserved. 9
MESOSPHER
E DC/OS
Ravi Yadav, Partnerships Architect
PLATFORM SERVICES
CONTAINER
ORCHESTRATI
ON
CI/CD
BIG DATA
ANALYTICS
MESSAGE
QUEUE
DISTRIBUTED
DATABASE
SEARCH
BUSINESS APPS
Distributed
computing expertise.
DevOps process &
culture.
Cloud-native
technologies.
OPERATIONAL EXPERTISE
INFRASTRUCTURE
PHYSICAL VIRTUAL CLOUD
BUILDING THE MODERN
ENTERPRISE STACK
10
BUSINESS APPS
$
$
$
$
$ $
$
$
$
$
$
$
$$
$$
$ $
$
$ $
$
$
$
$
$
$
CLOUD LIMITATIONS
- LOCK-IN
- HIGH COST
- NO CONTROL
AWS
PLATFORM SERVICES
OPERATIONS & TOOLS
ADMINISTRATORS OPERATIONAL PROCESSES PROPRIETARY TECHNOLOGIES
CONTAINER
ORCHESTRATI
ON
CI/CD
BIG DATA
ANALYTICS
MESSAGE
QUEUE
DISTRIBUTED
DATABASE
SEARCH
AWS INFRASTRUCTURE (EC2)
11
BUSINESS APPS
MESOSPHERE ENTERPRISE DC/OS
CONTAINER
ORCHESTRATI
ON
CI/CD
BIG DATA
ANALYTICS
MESSAGE
QUEUE
DISTRIBUTED
DATABASE
SEARCH
PLATFORM SERVICES
RESOURCE
MANAGEMENT
OPERATIONS SECURITY MULTI-TENANCY
DATACENTER-CLOUD OPERATING
SYSTEM
APACHE MESOS
PRIVATE CLOUD AWS INFRASTRUCTURE
(EC2)
GOOGLE CLOUD MICROSOFT AZURE
MESOSPHERE
ENTERPRISE DC/OS
More than 100 services
CLOUD INDEPENDENCE
12
© 2017 Mesosphere, Inc. All Rights Reserved.
MESOSPHERE DC/OS: RUN YOUR DATACENTER AS A
GIANT COMPUTER
Deploy & run complex services with an app
store like experience
Manage your infrastructure as a single giant
computing pool
© 2017 Mesosphere, Inc. All Rights Reserved. 14
NEW UI
DC/OS
DC/OS 1.9
© 2017 Mesosphere, Inc. All Rights Reserved. 15
KEY THEMES - DC/OS 1.9
WORKLOADS
● Pods
● GPU based
scheduling
COMPLIANCE
REPORTS
● NIST-800/53
● ISO 27001
● FISMA-Mod.
● SOC-2
● HIPAA
● Alluxio
● Couchbase
● Datastax DSE
● Elastic (ELK)
● Redis
● Apache Flink
DATA SERVICES
ECOSYSTEM
OPERATIONS
● Remote Container
Shell
● Unified Metrics
● Unified Logging
● Deployment
Failure Debugging
● Upgrades &
Configuration
updates
© 2015 Mesosphere, Inc. All Rights Reserved. 16
WHY MESOSPHERE?
Unmatched Technology: DC/OS
● Containers in production at scale
● Stateful data services
● Maturity of technology
● Easy to install & run - anywhere
(cloud, physical VM)
● Evergreen platform with DC/OS services
Experts on Distributed Systems
● Experts & committers of open source
software (e.g., Mesos)
● Experience building & operating
distributed systems at scale
● Experience helping enterprises solve
real modern apps challenges
e
Polling Question #2
Host
Container
Middleware
Modern Architecture
MicroService
s
Business Service
Modern
Technology Stack
Business ServiceBusiness Service
•Interconnected with multiple
dependencies
•Many programming languages and
frameworks
• Many container vendors
• Variety of service types, micro to
macro
• Legacy components
Challenge with Monitoring Modern Architectures
Host
Middlewar
e
Microservice
Container
Custom Tracing or
APM LoggingContainer monitoringSystem monitoring
• Alerts come from technical silos
• No correlation between alerts and
business services
• Alarms don’t map to problems
• No context of situation
• Sampling/statistical based
monitoring
• Too much specialized expertise
needed to assure quality
No Alignment Between Tools
and the Modern Stack
Business Service
Misalignment = Zero Visibility
Instana’s Dynamic APM: Bringing Order to Complexity and Chaos
Host
Container
Middleware
Code Exceptions/Errors
MicroService
Business
Service
Business KPIs &
SLAs
Automatic discovery of architecture with
alignment of context:
• Vertical technical stack
• Service dependency map
• Measurement of service quality
Automatic Root Cause Analysis in 3 Seconds
Immediate exact problem
identification with full context
Data Ingestion &
Health Calculation
Sensor Data
Real-time Stream
Processing
Incident
Detection
Alerting
Dependency
Health
Metrics
Dynamic Graph
API &
CLI
Configuration
Instana Processing Pipeline
3 seconds from sensing to root cause identification
Quality of
Service
3D Map
One Agent
per Host
One Sensor per active
component
Continuous discovery
up the stack
Trace messages
between microservices Sensor Repository
Agent
Knowledge Engine
Elasticsearch
sensor
Tomcat
sensor
JVM sensor
Linux sensor
Auto Discovery
Communication
Local
Sensor Memory
&
Contextual
Compression
Immediate, Automatic and Continuous Discovery of Components and Dependencies
Demo Use Cases
Continuous and Automatic Discovery
Application Mapping
Changes Detection and Marathon Events Correlation
Root Cause Understanding
Polling Question #3
Demo

More Related Content

PDF
The Ultimate Application Monitoring Guide for Kubernetes
PDF
Managing Quality of Service for Containerized Microservice Applications
PDF
Yes Virginia, Automatic Monitoring DOES Exist
PPTX
Leverage DevOps & Agile Development to Transform Your Application Testing Pro...
PPTX
The Coming Earthquake in IIS and SQL Configuration Management
PDF
Monitoring at the Speed of DevOps
PDF
Monitoring in a Microservices World
PPTX
Scaling Enterprise DevOps with CloudBees
The Ultimate Application Monitoring Guide for Kubernetes
Managing Quality of Service for Containerized Microservice Applications
Yes Virginia, Automatic Monitoring DOES Exist
Leverage DevOps & Agile Development to Transform Your Application Testing Pro...
The Coming Earthquake in IIS and SQL Configuration Management
Monitoring at the Speed of DevOps
Monitoring in a Microservices World
Scaling Enterprise DevOps with CloudBees

What's hot (20)

PPTX
SRE 101 (Site Reliability Engineering)
PPTX
Containers: DevOp Enablers of Technical Solutions
PDF
How to plug the data gap in DevOps
PPTX
Security Implications for a DevOps Transformation
PPTX
Adopting DevOps @ Scale: Lessons learned at Hertz, Kaiser Permanente and lBM
PDF
cdSummit Austin - Jez Humble: CD Architecture
PPTX
Resilience and Security @ Scale: Lessons Learned
PDF
BACK FROM THE EDGE: INFRASTRUCTURE PROTECTION THROUGH PLATESPIN
PDF
From Gates to Guardrails: Alternate Approaches to Product Security
PDF
Achieving a Serverless Development Experience
PPTX
Splitting the Check on Compliance and Security
PDF
Code-to-Cloud Visibility: An Essential Framework for DevOps Success
PPTX
Security & DevOps- Ways To Make Sure Your Apps & Infrastructure Are Secure
PPTX
Enterprise DevOps
PPTX
Continuous Delivery and DevOps at Rabobank
PPTX
2016 State of DevOps Report Webinar
PPT
Enterprise DevOps and the Cloud
PPTX
Scaling Enterprise DevOps w/ New Relic: Nationwide’s Modernization Journey, F...
PPTX
Continuous Delivery
PDF
Barriers to Container Security and How to Overcome Them
SRE 101 (Site Reliability Engineering)
Containers: DevOp Enablers of Technical Solutions
How to plug the data gap in DevOps
Security Implications for a DevOps Transformation
Adopting DevOps @ Scale: Lessons learned at Hertz, Kaiser Permanente and lBM
cdSummit Austin - Jez Humble: CD Architecture
Resilience and Security @ Scale: Lessons Learned
BACK FROM THE EDGE: INFRASTRUCTURE PROTECTION THROUGH PLATESPIN
From Gates to Guardrails: Alternate Approaches to Product Security
Achieving a Serverless Development Experience
Splitting the Check on Compliance and Security
Code-to-Cloud Visibility: An Essential Framework for DevOps Success
Security & DevOps- Ways To Make Sure Your Apps & Infrastructure Are Secure
Enterprise DevOps
Continuous Delivery and DevOps at Rabobank
2016 State of DevOps Report Webinar
Enterprise DevOps and the Cloud
Scaling Enterprise DevOps w/ New Relic: Nationwide’s Modernization Journey, F...
Continuous Delivery
Barriers to Container Security and How to Overcome Them
Ad

Similar to Microservice Monitoring and Quality Management for Modern Apps and Infrastructures (20)

PDF
Journey to the Modern App with Containers, Microservices and Big Data
PPTX
Journey to the Modern App with Containers, Microservices and Big Data
PDF
A Journey to Modern Apps with Containers, Microservices and Big Data
PDF
Modernizing Applications with Microservices and DC/OS (Lightbend/Mesosphere c...
PDF
Elastic data services on Apache Mesos via Mesosphere’s DCOS
PDF
Container Orchestration Wars
PDF
Downtime is not an option - day 2 operations - Jörg Schad
PDF
CI/CD with Docker, DC/OS, and Jenkins
PPTX
Doing Dropbox the Native Cloud Native Way
PDF
Container Orchestration Wars (Micro Edition)
PDF
Hyperscale Computing, Enterprise Agility with Mesosphere
PPTX
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
PDF
Erlang User Conference 2016: Container Networking: A Field Report
PDF
Best Practices for Managing Kubernetes and Stateful Services: Mesosphere & Sy...
PPTX
Webinar: What's New in DC/OS 1.11
PPTX
DevOps in Age of Kubernetes
PDF
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.
PDF
Container Orchestration Wars (2017 Edition)
PPTX
Webinar: End-to-End CI/CD with GitLab and DC/OS
PDF
Containerizing couchbase with microservice architecture on mesosphere.pptx
Journey to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big Data
A Journey to Modern Apps with Containers, Microservices and Big Data
Modernizing Applications with Microservices and DC/OS (Lightbend/Mesosphere c...
Elastic data services on Apache Mesos via Mesosphere’s DCOS
Container Orchestration Wars
Downtime is not an option - day 2 operations - Jörg Schad
CI/CD with Docker, DC/OS, and Jenkins
Doing Dropbox the Native Cloud Native Way
Container Orchestration Wars (Micro Edition)
Hyperscale Computing, Enterprise Agility with Mesosphere
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
Erlang User Conference 2016: Container Networking: A Field Report
Best Practices for Managing Kubernetes and Stateful Services: Mesosphere & Sy...
Webinar: What's New in DC/OS 1.11
DevOps in Age of Kubernetes
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.
Container Orchestration Wars (2017 Edition)
Webinar: End-to-End CI/CD with GitLab and DC/OS
Containerizing couchbase with microservice architecture on mesosphere.pptx
Ad

More from Jules Pierre-Louis (15)

PDF
Diving Deeper into DevOps Deployments
PPTX
The Human Side of DevSecOps
PPTX
Sandstorm or Significant: The evolving role of context in Incident Management
PPTX
Cloud bees and forester open source is not enough
PPTX
From Monolith to Microservices – and Beyond!
PPTX
Efficient Performance Test Automation - Opitmizing the Jenkins Pipeline
PPTX
How to Build the Right Automation
PPTX
Starting and Scaling Devops
PPTX
Starting and Scaling DevOps
PPTX
The Evolution of Application Release Automation
PDF
DevOPs Transformation Workshop
PDF
Pipeline: Continuous Delivery as Code in Jenkins 2.0
PDF
7 Habits of Highly Effective Jenkins Users
PPTX
7 Habits of Highly Effective Jenkins Users
PPTX
Webinar: A Roadmap for DevOps Success
Diving Deeper into DevOps Deployments
The Human Side of DevSecOps
Sandstorm or Significant: The evolving role of context in Incident Management
Cloud bees and forester open source is not enough
From Monolith to Microservices – and Beyond!
Efficient Performance Test Automation - Opitmizing the Jenkins Pipeline
How to Build the Right Automation
Starting and Scaling Devops
Starting and Scaling DevOps
The Evolution of Application Release Automation
DevOPs Transformation Workshop
Pipeline: Continuous Delivery as Code in Jenkins 2.0
7 Habits of Highly Effective Jenkins Users
7 Habits of Highly Effective Jenkins Users
Webinar: A Roadmap for DevOps Success

Recently uploaded (20)

PDF
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
PDF
Design an Analysis of Algorithms II-SECS-1021-03
PDF
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PDF
Complete React Javascript Course Syllabus.pdf
PDF
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
PDF
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
PDF
How Creative Agencies Leverage Project Management Software.pdf
PPTX
Essential Infomation Tech presentation.pptx
PPTX
Introduction to Artificial Intelligence
PPT
Introduction Database Management System for Course Database
PPTX
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
PDF
Digital Strategies for Manufacturing Companies
PPTX
ISO 45001 Occupational Health and Safety Management System
PDF
Upgrade and Innovation Strategies for SAP ERP Customers
PDF
Wondershare Filmora 15 Crack With Activation Key [2025
PDF
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
PPT
JAVA ppt tutorial basics to learn java programming
PPTX
history of c programming in notes for students .pptx
PDF
AI in Product Development-omnex systems
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
Design an Analysis of Algorithms II-SECS-1021-03
Addressing The Cult of Project Management Tools-Why Disconnected Work is Hold...
VVF-Customer-Presentation2025-Ver1.9.pptx
Complete React Javascript Course Syllabus.pdf
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
How Creative Agencies Leverage Project Management Software.pdf
Essential Infomation Tech presentation.pptx
Introduction to Artificial Intelligence
Introduction Database Management System for Course Database
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
Digital Strategies for Manufacturing Companies
ISO 45001 Occupational Health and Safety Management System
Upgrade and Innovation Strategies for SAP ERP Customers
Wondershare Filmora 15 Crack With Activation Key [2025
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
JAVA ppt tutorial basics to learn java programming
history of c programming in notes for students .pptx
AI in Product Development-omnex systems

Microservice Monitoring and Quality Management for Modern Apps and Infrastructures

  • 1. Microservice Monitoring and Quality Management for Modern Apps and Infrastructures
  • 2. Speakers Pavlo Baron, CTO, Instana Ravi Yadav, Partnerships Architect, Mesosphere Pedro Pacheco, Solutions Architect, Instana
  • 3. Why Instana & DC/OS? Pavlo Baron, CTO, Instana
  • 4. Architectures Have Evolved Host Container Middlewar e Microservices Business Service Complexity + Scale Never Cease Modern Architectures Have Evolved to a new Level of Distribution and Scale
  • 5. Mesosphere DC/OS DC/OS is the Foundation for Modern Architecture Implementation • Scheduling • Container lifecycle management • Location transparent resource management • Continuous deployment
  • 6. DC/OS engineers and automates change •Containers facilitating rapid development and deployment •A container allocation from DC/OS change code, dependency, messaging structure
  • 7. Feedback! What just happened! • What changed? • Where did change occur? • Was there any quality impact? • What is the root cause? In a system of constant change, operators need feedback!
  • 9. © 2017 Mesosphere, Inc. All Rights Reserved. 9 MESOSPHER E DC/OS Ravi Yadav, Partnerships Architect
  • 10. PLATFORM SERVICES CONTAINER ORCHESTRATI ON CI/CD BIG DATA ANALYTICS MESSAGE QUEUE DISTRIBUTED DATABASE SEARCH BUSINESS APPS Distributed computing expertise. DevOps process & culture. Cloud-native technologies. OPERATIONAL EXPERTISE INFRASTRUCTURE PHYSICAL VIRTUAL CLOUD BUILDING THE MODERN ENTERPRISE STACK 10
  • 11. BUSINESS APPS $ $ $ $ $ $ $ $ $ $ $ $ $$ $$ $ $ $ $ $ $ $ $ $ $ $ CLOUD LIMITATIONS - LOCK-IN - HIGH COST - NO CONTROL AWS PLATFORM SERVICES OPERATIONS & TOOLS ADMINISTRATORS OPERATIONAL PROCESSES PROPRIETARY TECHNOLOGIES CONTAINER ORCHESTRATI ON CI/CD BIG DATA ANALYTICS MESSAGE QUEUE DISTRIBUTED DATABASE SEARCH AWS INFRASTRUCTURE (EC2) 11
  • 12. BUSINESS APPS MESOSPHERE ENTERPRISE DC/OS CONTAINER ORCHESTRATI ON CI/CD BIG DATA ANALYTICS MESSAGE QUEUE DISTRIBUTED DATABASE SEARCH PLATFORM SERVICES RESOURCE MANAGEMENT OPERATIONS SECURITY MULTI-TENANCY DATACENTER-CLOUD OPERATING SYSTEM APACHE MESOS PRIVATE CLOUD AWS INFRASTRUCTURE (EC2) GOOGLE CLOUD MICROSOFT AZURE MESOSPHERE ENTERPRISE DC/OS More than 100 services CLOUD INDEPENDENCE 12
  • 13. © 2017 Mesosphere, Inc. All Rights Reserved. MESOSPHERE DC/OS: RUN YOUR DATACENTER AS A GIANT COMPUTER Deploy & run complex services with an app store like experience Manage your infrastructure as a single giant computing pool
  • 14. © 2017 Mesosphere, Inc. All Rights Reserved. 14 NEW UI DC/OS DC/OS 1.9
  • 15. © 2017 Mesosphere, Inc. All Rights Reserved. 15 KEY THEMES - DC/OS 1.9 WORKLOADS ● Pods ● GPU based scheduling COMPLIANCE REPORTS ● NIST-800/53 ● ISO 27001 ● FISMA-Mod. ● SOC-2 ● HIPAA ● Alluxio ● Couchbase ● Datastax DSE ● Elastic (ELK) ● Redis ● Apache Flink DATA SERVICES ECOSYSTEM OPERATIONS ● Remote Container Shell ● Unified Metrics ● Unified Logging ● Deployment Failure Debugging ● Upgrades & Configuration updates
  • 16. © 2015 Mesosphere, Inc. All Rights Reserved. 16 WHY MESOSPHERE? Unmatched Technology: DC/OS ● Containers in production at scale ● Stateful data services ● Maturity of technology ● Easy to install & run - anywhere (cloud, physical VM) ● Evergreen platform with DC/OS services Experts on Distributed Systems ● Experts & committers of open source software (e.g., Mesos) ● Experience building & operating distributed systems at scale ● Experience helping enterprises solve real modern apps challenges e
  • 18. Host Container Middleware Modern Architecture MicroService s Business Service Modern Technology Stack Business ServiceBusiness Service •Interconnected with multiple dependencies •Many programming languages and frameworks • Many container vendors • Variety of service types, micro to macro • Legacy components
  • 19. Challenge with Monitoring Modern Architectures Host Middlewar e Microservice Container Custom Tracing or APM LoggingContainer monitoringSystem monitoring • Alerts come from technical silos • No correlation between alerts and business services • Alarms don’t map to problems • No context of situation • Sampling/statistical based monitoring • Too much specialized expertise needed to assure quality No Alignment Between Tools and the Modern Stack Business Service Misalignment = Zero Visibility
  • 20. Instana’s Dynamic APM: Bringing Order to Complexity and Chaos Host Container Middleware Code Exceptions/Errors MicroService Business Service Business KPIs & SLAs Automatic discovery of architecture with alignment of context: • Vertical technical stack • Service dependency map • Measurement of service quality
  • 21. Automatic Root Cause Analysis in 3 Seconds Immediate exact problem identification with full context
  • 22. Data Ingestion & Health Calculation Sensor Data Real-time Stream Processing Incident Detection Alerting Dependency Health Metrics Dynamic Graph API & CLI Configuration Instana Processing Pipeline 3 seconds from sensing to root cause identification Quality of Service 3D Map
  • 23. One Agent per Host One Sensor per active component Continuous discovery up the stack Trace messages between microservices Sensor Repository Agent Knowledge Engine Elasticsearch sensor Tomcat sensor JVM sensor Linux sensor Auto Discovery Communication Local Sensor Memory & Contextual Compression Immediate, Automatic and Continuous Discovery of Components and Dependencies
  • 24. Demo Use Cases Continuous and Automatic Discovery Application Mapping Changes Detection and Marathon Events Correlation Root Cause Understanding
  • 26. Demo