SlideShare a Scribd company logo
@Dynatrace
- More on http://blog.dynatrace.com
- Dynatrace Free Trial: http://bit.ly/dttrial
Mobile User Experience:
Auto Drive through
Performance Metrics
Hosted by: Andreas Grabner - @grabnerandi
Mobile User Experience:Auto Drive through Performance Metrics
Mobile User Experience:Auto Drive through Performance Metrics
Mobile User Experience:Auto Drive through Performance Metrics
Rapidly Changing
Requirements &
User Expectations
Mobile User Experience:Auto Drive through Performance Metrics
Our Goal?
Utmost Goal: Minimize Cycle Time
feature cycle time time
Customer / Market Users
Utmost Goal: Minimize Cycle Time
feature cycle time time
minimize Users
Utmost Goal: Minimize Cycle Time
feature cycle time time
This is when you
create value!
minimize
You
Release
Acceptance
Testing
Unit Testing
Performance
Testing
Coding
Reduce Lead Time
Automate & Improve Process
700 Deployments / Year
50-60 Deployments / Day
10+ Deployments / Day
Every 11.6 seconds
Inside the Amazon Numbers!
75% fewer outages since 2006
90% fewer outage minutes
~0.001% of deployments cause a problem
Instantaneous automatic rollback
Deploying every 11.6s
Challenges?
Deploy Faster!!
Fail Faster!!?
Right Focus?!
Metrics
based
Decisions!
Availability dropped to 0%
Mobile User Experience:Auto Drive through Performance Metrics
Mobile User Experience:Auto Drive through Performance Metrics
Mobile User Experience:Auto Drive through Performance Metrics
Learning from
Others
Unless you work for
Google or Microsoft 
Mobile User Experience:Auto Drive through Performance Metrics
3 Use Cases on
WHY this happened,
HOW to avoid it,
METRICS to look at
Mobile User Experience:Auto Drive through Performance Metrics
#Push
without a Plan
Mobile Landing Page of Super Bowl Ad
434 Resources in total on that page:
230 JPEGs, 75 PNGs, 50 GIFs, …
Total size of ~
20MB
Fifa.com during Worldcup
http://apmblog.compuware.com/2014/05/21/is-the-fifa-world-cup-website-ready-for-the-tournament/
Page Size
Item Size
# Objects
Mobile User Experience:Auto Drive through Performance Metrics
Don’t assume
You know the
environment
Distance Calculation Issues
480km biking
in 1 hour!
Solution: Unit Test in
Live App reports Geo
Calc Problems
Finding: Only
happens on certain
Android versions
3rd Party Issues
Impact of bad
3rd party calls
# Functional
Errors
3rd Party calls
Mobile User Experience:Auto Drive through Performance Metrics
#“Blindly”
(Re)use Existing
Components
Requirement: We need a report
Using Hibernate results in 4k+ SQL Statements to
display 3 items!
Hibernate
Executes 4k+
Statements
Individual
Execution VERY
FAST
But Total SUM
takes 6s
# SQL Executions
# of SAME SQLs
Mobile User Experience:Auto Drive through Performance Metrics
Mobile User Experience:Auto Drive through Performance Metrics
Release
Acceptance
Testing
Unit Testing
Performance
Testing
Coding
Reduce Lead Time
Automate & Improve Process
•# Images
•# Redirects
•Size of Resources
•# SQL Executions
•# of SAME SQLs
•# Items per Page
•# AJAX per Page
Remember: Metrics-based decisions
•Time Spent in API
•# Calls into API
•# Functional Errors
•3rd Party calls
•# of Domains
•Total Size
•…
Mobile User Experience:Auto Drive through Performance Metrics
Putting it into Continuous Deployment
12 0 120ms
3 1 68ms
Build 20 testPurchase OK
testSearch OK
Build 17 testPurchase OK
testSearch OK
Build 18 testPurchase FAILED
testSearch OK
Build 19 testPurchase OK
testSearch OK
Build # Test Case Status # SQL # Excep CPU
12 0 120ms
3 1 68ms
12 5 60ms
3 1 68ms
75 0 230ms
3 1 68ms
Test & Monitoring Framework Results Architectural Data
We identified a regresesion
Problem solved
Exceptions probably reason for
failed tests
Problem fixed but now we have an
architectural regression
Problem fixed but now we have an
architectural regressionNow we have the functional and
architectural confidence
Let’s look behind the
scenes
Release
Acceptance
Testing
Unit Testing
Performance
Testing
Monitor Tests
Analyze Results
Quality Gate in your Build Tool
Every 11.6 seconds
Deploy Faster!!
Without Failing!
Mobile User Experience:Auto Drive through Performance Metrics
51 @Dynatrace
Questions and/or Demo
Slides: slideshare.net/grabnerandi
Get Tools: bit.ly/dttrial
YouTube Tutorials: bit.ly/dttutorials
Contact Me: agrabner@dynatrace.com
Follow Me: @grabnerandi
Read More: blog.dynatrace.com
52 @Dynatrace
Andreas Grabner
Dynatrace Developer Advocate
@grabnerandi
http://blog.dynatrace.com

More Related Content

PPTX
Docker/DevOps Meetup: Metrics-Driven Continuous Performance and Scalabilty
PPTX
BTD2015 - Your Place In DevTOps is Finding Solutions - Not Just Bugs!
PPTX
Hugs instead of Bugs: Dreaming of Quality Tools for Devs and Testers
PPTX
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
PPTX
London WebPerf Meetup: End-To-End Performance Problems
PPTX
Web and App Performance: Top Problems to avoid to keep you out of the News
PPTX
Four Practices to Fix Your Top .NET Performance Problems
PPTX
OOP 2016 - Building Software That Eats The World
Docker/DevOps Meetup: Metrics-Driven Continuous Performance and Scalabilty
BTD2015 - Your Place In DevTOps is Finding Solutions - Not Just Bugs!
Hugs instead of Bugs: Dreaming of Quality Tools for Devs and Testers
Application Quality Gates in Continuous Delivery: Deliver Better Software Fas...
London WebPerf Meetup: End-To-End Performance Problems
Web and App Performance: Top Problems to avoid to keep you out of the News
Four Practices to Fix Your Top .NET Performance Problems
OOP 2016 - Building Software That Eats The World

What's hot (19)

PPTX
Top Java Performance Problems and Metrics To Check in Your Pipeline
PPTX
From Zero to Performance Hero in Minutes - Agile Testing Days 2014 Potsdam
PPTX
Top .NET, Java & Web Performance Mistakes - Meetup Jan 2015
PPTX
(R)evolutionize APM
PPTX
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
PPTX
Java Performance Mistakes
PPTX
Sydney Continuous Delivery Meetup May 2014
PPTX
HSPS 2015 - SharePoint Performance Santiy Checks
PPTX
How to keep you out of the News: Web and End-to-End Performance Tips
PPTX
JavaOne 2015: Top Performance Patterns Deep Dive
PPTX
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
PPTX
DevOps Pipelines and Metrics Driven Feedback Loops
PPTX
How to explain DevOps to your mom
PPTX
Metrics Driven DevOps - Automate Scalability and Performance Into your Pipeline
PPTX
DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys
PPTX
JavaOne - Performance Focused DevOps to Improve Cont Delivery
PPTX
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
PPT
Dyna trace
PDF
Nginx performance monitoring with Dynatrace
Top Java Performance Problems and Metrics To Check in Your Pipeline
From Zero to Performance Hero in Minutes - Agile Testing Days 2014 Potsdam
Top .NET, Java & Web Performance Mistakes - Meetup Jan 2015
(R)evolutionize APM
Deploy Faster Without Failing Faster - Metrics-Driven - Dynatrace User Groups...
Java Performance Mistakes
Sydney Continuous Delivery Meetup May 2014
HSPS 2015 - SharePoint Performance Santiy Checks
How to keep you out of the News: Web and End-to-End Performance Tips
JavaOne 2015: Top Performance Patterns Deep Dive
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
DevOps Pipelines and Metrics Driven Feedback Loops
How to explain DevOps to your mom
Metrics Driven DevOps - Automate Scalability and Performance Into your Pipeline
DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys
JavaOne - Performance Focused DevOps to Improve Cont Delivery
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
Dyna trace
Nginx performance monitoring with Dynatrace
Ad

Viewers also liked (20)

PDF
L'idrossitirosolo è in grado di proteggere e aumentare l'attività dei mitocon...
PDF
เรื่อง ภูกระดึง
PPT
Western New York Educational Service Council Presentation
PPTX
Art1204 we don't need another hero the art of feminism
PDF
SharePoint TechCon 2009 - 801
PDF
Alcol e psoriasi ita
PPT
Lec sequential
PDF
Hum2220 0915 syllabus
PDF
MomentReel
PDF
Hum2310 fa2014 proust questionnaire
PDF
Hum2310 sp2015 proust questionnaire
PPTX
Proposal 2014
DOC
"Green Urbanism" & "Contextualism"
PPT
Apostas desportivas betclic portugal
PPTX
KEPERCAYAAN GURU
PPTX
Beyond profit sig carbon finance
PDF
2010 Spring Newsletter
PDF
Java Tech & Tools | Just Keep Passing the Message | Russel Winder
PDF
2006 Winter Newsletter
L'idrossitirosolo è in grado di proteggere e aumentare l'attività dei mitocon...
เรื่อง ภูกระดึง
Western New York Educational Service Council Presentation
Art1204 we don't need another hero the art of feminism
SharePoint TechCon 2009 - 801
Alcol e psoriasi ita
Lec sequential
Hum2220 0915 syllabus
MomentReel
Hum2310 fa2014 proust questionnaire
Hum2310 sp2015 proust questionnaire
Proposal 2014
"Green Urbanism" & "Contextualism"
Apostas desportivas betclic portugal
KEPERCAYAAN GURU
Beyond profit sig carbon finance
2010 Spring Newsletter
Java Tech & Tools | Just Keep Passing the Message | Russel Winder
2006 Winter Newsletter
Ad

Similar to Mobile User Experience: Auto Drive through Performance Metrics (20)

PPTX
Performance Quality Metrics for Mobile Web and Mobile Native - Agile Testing ...
PPTX
Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...
PDF
DevOps: Find Solutions, Not More Defects
PPTX
London web perfug_performancefocused_devops_feb2014
PPT
Windy cityrails performance_tuning
PPT
Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa...
KEY
improving the performance of Rails web Applications
PPTX
Lights-Out Testing for Lights-On Business
PPTX
Industry Keynote at Large Scale Testing Workshop 2015
ODP
Cvcc performance tuning
PPTX
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
PDF
Lessons Learned Replatforming A Large Machine Learning Application To Apache ...
PDF
Accelerating Your Test Execution Pipeline
PDF
How to Build Single Page HTML5 Apps that Scale
PPTX
Continuous Testing 2016
PPTX
Continuous Testing
PPTX
Training Webinar: Detect Performance Bottlenecks of Applications
PPTX
STP 2014 - Lets Learn from the Top Performance Mistakes in 2013
PPTX
Accelerating Your Test Execution Pipeline
PDF
Stress Test as a Culture
Performance Quality Metrics for Mobile Web and Mobile Native - Agile Testing ...
Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...
DevOps: Find Solutions, Not More Defects
London web perfug_performancefocused_devops_feb2014
Windy cityrails performance_tuning
Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa...
improving the performance of Rails web Applications
Lights-Out Testing for Lights-On Business
Industry Keynote at Large Scale Testing Workshop 2015
Cvcc performance tuning
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
Lessons Learned Replatforming A Large Machine Learning Application To Apache ...
Accelerating Your Test Execution Pipeline
How to Build Single Page HTML5 Apps that Scale
Continuous Testing 2016
Continuous Testing
Training Webinar: Detect Performance Bottlenecks of Applications
STP 2014 - Lets Learn from the Top Performance Mistakes in 2013
Accelerating Your Test Execution Pipeline
Stress Test as a Culture

More from Andreas Grabner (16)

PPTX
KCD Munich - Cloud Native Platform Dilemma - Turning it into an Opportunity
PPTX
OpenTelemetry For GitOps: Tracing Deployments from Git Commit to Production
PPTX
Don't Deploy Into the Dark: DORA Metrics for your K8s GitOps Deployments
PPTX
Observability and Orchestration of your GitOps Deployments with Keptn
PPTX
Release Readiness Validation with Keptn for Austrian Online Banking Software
PPTX
Adding Security to your SLO-based Release Validation with Keptn
PPTX
A Guide to Event-Driven SRE-inspired DevOps
PPTX
Jenkins Online Meetup - Automated SLI based Build Validation with Keptn
PPTX
Continuous Delivery and Automated Operations on k8s with keptn
PPTX
Keptn - Automated Operations & Continuous Delivery for k8s
PPTX
Shipping Code like a keptn: Continuous Delivery & Automated Operations on k8s
PPTX
Top Performance Problems in Distributed Architectures
PPTX
Applying AI to Performance Engineering: Shift-Left, Shift-Right, Self-Healing
PPTX
Monitoring as a Self-Service in Atlassian DevOps Toolchain
PPTX
AWS Summit - Trends in Advanced Monitoring for AWS environments
PPTX
DevOps Transformation at Dynatrace and with Dynatrace
KCD Munich - Cloud Native Platform Dilemma - Turning it into an Opportunity
OpenTelemetry For GitOps: Tracing Deployments from Git Commit to Production
Don't Deploy Into the Dark: DORA Metrics for your K8s GitOps Deployments
Observability and Orchestration of your GitOps Deployments with Keptn
Release Readiness Validation with Keptn for Austrian Online Banking Software
Adding Security to your SLO-based Release Validation with Keptn
A Guide to Event-Driven SRE-inspired DevOps
Jenkins Online Meetup - Automated SLI based Build Validation with Keptn
Continuous Delivery and Automated Operations on k8s with keptn
Keptn - Automated Operations & Continuous Delivery for k8s
Shipping Code like a keptn: Continuous Delivery & Automated Operations on k8s
Top Performance Problems in Distributed Architectures
Applying AI to Performance Engineering: Shift-Left, Shift-Right, Self-Healing
Monitoring as a Self-Service in Atlassian DevOps Toolchain
AWS Summit - Trends in Advanced Monitoring for AWS environments
DevOps Transformation at Dynatrace and with Dynatrace

Recently uploaded (20)

PPTX
Materi_Pemrograman_Komputer-Looping.pptx
PDF
Design an Analysis of Algorithms II-SECS-1021-03
PPTX
ManageIQ - Sprint 268 Review - Slide Deck
PDF
AI in Product Development-omnex systems
PPT
Introduction Database Management System for Course Database
PDF
System and Network Administration Chapter 2
PPTX
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
PDF
How Creative Agencies Leverage Project Management Software.pdf
PDF
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
DOCX
The Five Best AI Cover Tools in 2025.docx
PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PDF
PTS Company Brochure 2025 (1).pdf.......
PPTX
Materi-Enum-and-Record-Data-Type (1).pptx
PPTX
ISO 45001 Occupational Health and Safety Management System
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PDF
top salesforce developer skills in 2025.pdf
PPTX
Introduction to Artificial Intelligence
PDF
Design an Analysis of Algorithms I-SECS-1021-03
PDF
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
Materi_Pemrograman_Komputer-Looping.pptx
Design an Analysis of Algorithms II-SECS-1021-03
ManageIQ - Sprint 268 Review - Slide Deck
AI in Product Development-omnex systems
Introduction Database Management System for Course Database
System and Network Administration Chapter 2
CHAPTER 12 - CYBER SECURITY AND FUTURE SKILLS (1) (1).pptx
How Creative Agencies Leverage Project Management Software.pdf
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
The Five Best AI Cover Tools in 2025.docx
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PTS Company Brochure 2025 (1).pdf.......
Materi-Enum-and-Record-Data-Type (1).pptx
ISO 45001 Occupational Health and Safety Management System
VVF-Customer-Presentation2025-Ver1.9.pptx
top salesforce developer skills in 2025.pdf
Introduction to Artificial Intelligence
Design an Analysis of Algorithms I-SECS-1021-03
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool

Mobile User Experience: Auto Drive through Performance Metrics

Editor's Notes

  • #5: On the one side we have a drastic change in how end users are interacting with services using different sorts of devices. Whether it is their smart phone, tablet, watch, car, ….
  • #6: There is rapid change in requirements and user expectations for us as service providers
  • #7: The other trend is the DevOps movements that tries to help us here. Heavily promoted and pushed by several people, organizations, books and conferences If you havent read the phoenix project please do so. Also make sure you are getting up to speed with concepts such as Continuous Delivery and doing this in an efficient way – as this is what we need to do in order to comply with the rapidly changing requirements
  • #9: Cycle time is the most relevant metric in the software delivery process. “How long would it take your organization to deploy a change that involves just one single line of code?” Mary Poppendieck
  • #10: Cycle time is the most relevant metric in the software delivery process. “How long would it take your organization to deploy a change that involves just one single line of code?” Mary Poppendieck
  • #11: Cycle time is the most relevant metric in the software delivery process. “How long would it take your organization to deploy a change that involves just one single line of code?” Mary Poppendieck
  • #12: The key goal that people want to achieve is to Reduce Lead Time. An automated build pipeline plays a huge role in it as we get rid of a lot of manual tasks that otherwise hold up the process When pushing out features faster it is important to also close the feedback loop to constantly improve the process and quality of the developed software
  • #13: Several companies changed their way they develop and deploy software over the years. Here are some examples (numbers from 2011 – 2014) Cars: from 2 deployments to 700 Flicks: 10+ per Day Etsy: lets every new employee on their first day of employment make a code change and push it through the pipeline in production: THAT’S the right approach towards required culture change Amazon: every 11.6s Remember: these are very small changes – which is also a key goal of continuous delivery. The smaller the change the easier it is to deploy, the less risk it has, the easier it is to test and the easier is it to take it out in case it has a problem.
  • #16: So – our goal is to deploy new features faster to get it in front of our paying end users or employees
  • #17: For many companies that tried this it may also meant that they fail faster
  • #18: Its also very important to keep the focus right – building and fixing those things that matter.
  • #22: We need to listen to general trends but also need to put monitoring into our product to figure whats used and what not http://fintalk.cdw.com/2015/01/08/financial-it-trends-banks-infographic-2015/
  • #46: So – we have seen a lot of metrics. The goal now is that you start with one metric. Pick a single metric and take it back to your engineering team (Dev, Test, Ops and Business). Sit down and agree on what this metric means for everyone, how to measure it and also how to report it Also remember that for most of these use cases discussed and metrics derived from it we only need a single user test. Even though we can identify performance, scalability and architectural issues – in most cases we don’t need a load test. Single user tests or unit tests are good enough
  • #47: Once we figured out how to get these measures it is time to automate the capturing but also automate quality alerting in case these metrics are showing us that we ran into one of these well known use cases.
  • #48: Here is how we do this. In addition to looking at functional and unit test results which only tell us how functionality is we also look into these backed metrics for every test. With that we can immediately identify whether code changes result in any performance, scalability or architectural regressions. Knowing this allows us to stop that build early
  • #49: Now as we know which metrics we need to look at and how to automate the capturing and detect regressions from build to build we simply add it to the continuous delivery pipeline by letting these metrics act as quality gateways. We do not let a build move forward if we already know that it has a well known problem. Here are all the benefits Only good code reaches production We eliminate time spent in later stages if we already identify problems earlier We all level up our skills and become a better team We produce better software faster -> we don’t crash the car