SlideShare a Scribd company logo
State of testing @ Microsoft
Quality and collaboration throughout
the development lifecycle
The state of testing @ Microsoft
The state of testing @ Microsoft
ALM Rangers
Passionate about ALM
Staff & Passionate experts creating open
source solutions and guidance for Microsoft’s
ALM products.
Solutions
http://aka.ms/vsarsolutions
Test Planning & Management Guide
Visual Studio Test Tooling Guides: MTM, CodedUI,
Fakes & IntelliTrace
Device Testing Guidance, HOL & Posters
WCF Load Test
The state of testing @ Microsoft
Changing world
01
The state of testing @ Microsoft
Plan
1 Monitor + Learn
ReleaseDevelop + Test
2
Development Production
4
3
The state of testing @ Microsoft
Our development vision
02
Microsoft development platform
Runtimes + Languages
.NET
C# + VB
C++
HTML/JS
Tools
Cloud
Devices
AndroidiOSWindows
Our Focus
Every Team MemberEvery App
Every app …
Every team member …
Enterprise
teams
Tools to empower Test, Feedback & Monitoring
03
Put quality at the center of
everything you do
Agile test planning and execution
Monitor & share quality status
Test Case
Management
Streamline quality
Take advantage of a toolset optimized for the
needs of testers, giving them flexibility in how
they work while at the same time keeping them
in sync with the rest of the team
Improved web-based Test Case Management
helps testers author, manage and execute test
cases using any modern web browser
Microsoft Test Manager further empowers your
testers by giving them comprehensive tools for
automated and manual testing in a desktop
application optimized for the needs of today’s
agile QA professional
Manual &
Exploratory Testing
Run, record, play back
Capture detailed records of steps performed,
behaviors observed, and the status of each test
step with the fully-instrumented and configurable
Test Runner. Pause testing at any time to report
a bug, even if it’s not directly related to the
current test case
High-fidelity defect reports go directly to the
development team, including all the technical
data needed to reproduce and resolve the error
quickly. Record tests for later playback to speed
up test sessions and enable test automation
Browser-based
Testing
Testing in the browser
Run manual tests and record test results for
each test step using a toolset optimized for the
needs of testers
The web-based test runner enables pass-fail
results, tracking of test steps, rich commenting,
and bug reporting capabilities
Feedback
Management
Actionable feedback
Once you have working software, you're ready
to get feedback from your stakeholders. You
can ask reviewers to provide videos, screenshots,
type-written comments, and ratings
Their feedback is captured into work items that
you can review and use to create a bug or
suggest a new backlog item
Quality
Dashboards
Monitor quality status
Build dashboards that provide visibility to your
team and stakeholders. Stop worrying where to
find things and instead use Visual Studio Online
or TFS to get everyone on the same page
Manage complexity and close
the loop between Dev and Ops
Lab management
Continuous delivery
Enterprise DevOps
Lab Management
Dev/Test lab environments
Automate your virtual lab environment with
Visual Studio Lab Management
Use templates to define/launch environment
configurations for consistent testing
Provision dev/test lab environments quickly for
testers and developers
Release
Management
Ship better apps, faster
Visual Studio Release Management makes it
easy to automate deployment and testing of
your applications in multiple environments
Teams can create release definitions and
automate deployment in repeatable, reliable
ways while tracking simultaneous in-flight
releases
Incorporate automated functional tests or
manual approvals in a release definition to
automate the release process all the way to
production
DEV QAINT PRODTFS
DEV QAINT PRODTFS
DEV QAINT PRODTFS
DEV QAINT PRODTFS
Full Traceability
Public CloudPrivate Cloud
Application
Insights
Usage and performance
Get a 360° view of your app that includes
availability, performance and user behavior
Use a powerful and easy-to-use experience to
track and improve the success of your application
Analyze data across dimensions and make
informed decisions about your product’s future
Azure
Dev/Test Lab
Use the cloud for your
lab
Easily construct environments with different
artifacts
Pay for what you use
Easy integration into the development tools
Azure
Performance Test
Use the cloud to test the
cloud
Easy access to the tools, so the right people
can run the tests
Pay for what you use
Test performance from multiple locations
around the world
Get the right people,
the right tools
User Acceptance Testing
Included in the VSO Basic License
Test Pro License
Included in the VSO Advanced License
Storyboarding
Free for everyone
Cloud or OnPrem
Each VSO license includes the same OnPrem
license
http://
http://
http://
http://
http://
http://

More Related Content

PPTX
Mercurial
PPTX
Windows Store Apps: Tips & Tricks
PPTX
Putting the DOT in .NET - Dev/Ops/Test
PPTX
Visual Studio: The best tool for web developers.
PPTX
Visual Studio ❤ JavaScript
PPTX
What’s new in Visual Studio 2012 & .NET 4.5
PPTX
What’s new in LightSwitch 2013?
PDF
Testing apps with MTM and Tea Foundation Service
Mercurial
Windows Store Apps: Tips & Tricks
Putting the DOT in .NET - Dev/Ops/Test
Visual Studio: The best tool for web developers.
Visual Studio ❤ JavaScript
What’s new in Visual Studio 2012 & .NET 4.5
What’s new in LightSwitch 2013?
Testing apps with MTM and Tea Foundation Service

What's hot (20)

PDF
Building cross platform applications using Windows Azure Mobile Services
PDF
VISUG: Visual studio for web developers
PDF
Use html5 to build what you want, where you want it
PPTX
Lap Around Visual Studio 2010 Ultimate And TFS 2010
PPTX
ASP.NET 5 & Unit Testing
PDF
Getting Started With Cypress
PPTX
ASP.NET & Unit Testing
PDF
Cypress testing
PPTX
Cross browser testing with browser stack
PPTX
Test at Scale within your Internal Networks with BrowserStack Local Testing
PPTX
Visual Studio Team Services Extensions by Taavi Kõosaar (@melborp)
PDF
Sexy React Stack
PDF
Ship quality mobile apps with speed [Webinar]
PPTX
WebMatrix
PPTX
Progressive Web App Testing With Cypress.io
PDF
What's new in selenium 4
PDF
Selenium Testing on Chrome - Google DevFest Armenia 2015
PPT
MSDN Live: Windows Presentation Foundations Line of Business Apps
PPTX
ASP.NET 5 Overview for Apex Systems
Building cross platform applications using Windows Azure Mobile Services
VISUG: Visual studio for web developers
Use html5 to build what you want, where you want it
Lap Around Visual Studio 2010 Ultimate And TFS 2010
ASP.NET 5 & Unit Testing
Getting Started With Cypress
ASP.NET & Unit Testing
Cypress testing
Cross browser testing with browser stack
Test at Scale within your Internal Networks with BrowserStack Local Testing
Visual Studio Team Services Extensions by Taavi Kõosaar (@melborp)
Sexy React Stack
Ship quality mobile apps with speed [Webinar]
WebMatrix
Progressive Web App Testing With Cypress.io
What's new in selenium 4
Selenium Testing on Chrome - Google DevFest Armenia 2015
MSDN Live: Windows Presentation Foundations Line of Business Apps
ASP.NET 5 Overview for Apex Systems
Ad

Viewers also liked (17)

PPTX
DevConf Survival Guide
PPTX
What is new in C# 6?
PPTX
JavaScript Toolkit
PPTX
Open Source Licensing
PPTX
Protection of Personal Information Bill (POPI)
PPTX
How to give a great presentation
PDF
About business process_bpm_bpmn_by_shincm
PDF
7 tips for more effective morning SCRUM
PDF
Microsoft + Agile
PPTX
Agile lessons learned in the Microsoft ALM Rangers
PDF
[AUG]개발자와 QA가 상생하는 테스트 프로세스
PDF
[AUG] 소프트웨어 공학 국제표준 SEMAT Essence를 칸반으로 구현
PDF
BPMN과 JIRA를 활용한 프로세스 중심 업무 혁신 실천법
PDF
[AUG] 칸반을 활용한 업무 프로세스 혁신 실천법
PDF
Aug seoul 활동 가이드라인
PDF
나는 PM이다! 33회 신철민_발표자료
PPTX
Software design principles for evolving architectures
DevConf Survival Guide
What is new in C# 6?
JavaScript Toolkit
Open Source Licensing
Protection of Personal Information Bill (POPI)
How to give a great presentation
About business process_bpm_bpmn_by_shincm
7 tips for more effective morning SCRUM
Microsoft + Agile
Agile lessons learned in the Microsoft ALM Rangers
[AUG]개발자와 QA가 상생하는 테스트 프로세스
[AUG] 소프트웨어 공학 국제표준 SEMAT Essence를 칸반으로 구현
BPMN과 JIRA를 활용한 프로세스 중심 업무 혁신 실천법
[AUG] 칸반을 활용한 업무 프로세스 혁신 실천법
Aug seoul 활동 가이드라인
나는 PM이다! 33회 신철민_발표자료
Software design principles for evolving architectures
Ad

Similar to The state of testing @ Microsoft (20)

PDF
Visual Studio ALM and DevOps Tools Walkthrough
PPT
1 Ibm Solo Pruebas 2009
PPTX
Dev ops developer (session 3)
PDF
Visual Studio Enterprise 2015 Overview atidan
PDF
DevOps Roadshow - continuous delivery and release management
PDF
2015-01-12 TechTalk - Continuous Delivery and Release Management
PPTX
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
PPSX
QA with Microsoft Test Manager and Lab Management
PDF
Microsoft ALM Support - Testing Perspective
PDF
Leveraging Open Source Automation: A Selenium WebDriver Example
PPTX
Visual Studio 2015 - Lançamento está próximo
PDF
Top Automation Testing Tools of 2025_ What’s New and What’s Next.pdf
PPTX
Implementing Azure DevOps with your Testing Project
PDF
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
PPTX
Testing with Microsoft Technologies - Kick Off Session
PDF
Agile Methodology & Software Development and Testing Lifecycles.pdf
PPTX
PPTX
Devops Automated Testing Tools
PDF
Let's banish "it works on my machine"
PDF
Understanding Automated Testing Tools for Web Applications.pdf
Visual Studio ALM and DevOps Tools Walkthrough
1 Ibm Solo Pruebas 2009
Dev ops developer (session 3)
Visual Studio Enterprise 2015 Overview atidan
DevOps Roadshow - continuous delivery and release management
2015-01-12 TechTalk - Continuous Delivery and Release Management
[DevDay 2017] Automation Testing - Speaker: Nghia Khuong - Project Manager at...
QA with Microsoft Test Manager and Lab Management
Microsoft ALM Support - Testing Perspective
Leveraging Open Source Automation: A Selenium WebDriver Example
Visual Studio 2015 - Lançamento está próximo
Top Automation Testing Tools of 2025_ What’s New and What’s Next.pdf
Implementing Azure DevOps with your Testing Project
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
Testing with Microsoft Technologies - Kick Off Session
Agile Methodology & Software Development and Testing Lifecycles.pdf
Devops Automated Testing Tools
Let's banish "it works on my machine"
Understanding Automated Testing Tools for Web Applications.pdf

More from Robert MacLean (17)

PPTX
Deno ...................................
PPTX
14 things you need to be a successful software developer (v3)
PPTX
OWASP TOP 10
PPTX
Building a µservice with Kotlin, Micronaut & GCP
PPTX
Looking at the Vue
PPTX
Kotlin 101
PPTX
Features of Kotlin I find exciting
PPTX
JavaScript Gotchas
PPTX
A Developer Day 2014 - Durban
PPTX
Hour of code - Train the trainer
PPTX
Building services for apps on a shoestring budget
PPTX
3 things your app API is doing WRONG
PPTX
PPTX
LightSwitch
PPTX
How to build a Mobile API or HTML 5 app in 5 minutes
PPTX
Techdays 2012 - What is new in .NET 4.5 & Visual Studio 2012
Deno ...................................
14 things you need to be a successful software developer (v3)
OWASP TOP 10
Building a µservice with Kotlin, Micronaut & GCP
Looking at the Vue
Kotlin 101
Features of Kotlin I find exciting
JavaScript Gotchas
A Developer Day 2014 - Durban
Hour of code - Train the trainer
Building services for apps on a shoestring budget
3 things your app API is doing WRONG
LightSwitch
How to build a Mobile API or HTML 5 app in 5 minutes
Techdays 2012 - What is new in .NET 4.5 & Visual Studio 2012

Recently uploaded (20)

PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
Cloud computing and distributed systems.
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
Big Data Technologies - Introduction.pptx
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
Digital-Transformation-Roadmap-for-Companies.pptx
Understanding_Digital_Forensics_Presentation.pptx
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Reach Out and Touch Someone: Haptics and Empathic Computing
Cloud computing and distributed systems.
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
The Rise and Fall of 3GPP – Time for a Sabbatical?
Big Data Technologies - Introduction.pptx
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
The AUB Centre for AI in Media Proposal.docx
Encapsulation_ Review paper, used for researhc scholars
Mobile App Security Testing_ A Comprehensive Guide.pdf
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Diabetes mellitus diagnosis method based random forest with bat algorithm
NewMind AI Monthly Chronicles - July 2025
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Spectral efficient network and resource selection model in 5G networks
MYSQL Presentation for SQL database connectivity
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
“AI and Expert System Decision Support & Business Intelligence Systems”

The state of testing @ Microsoft

  • 1. State of testing @ Microsoft Quality and collaboration throughout the development lifecycle
  • 4. ALM Rangers Passionate about ALM Staff & Passionate experts creating open source solutions and guidance for Microsoft’s ALM products. Solutions http://aka.ms/vsarsolutions Test Planning & Management Guide Visual Studio Test Tooling Guides: MTM, CodedUI, Fakes & IntelliTrace Device Testing Guidance, HOL & Posters WCF Load Test
  • 8. Plan 1 Monitor + Learn ReleaseDevelop + Test 2 Development Production 4 3
  • 11. Microsoft development platform Runtimes + Languages .NET C# + VB C++ HTML/JS Tools Cloud Devices AndroidiOSWindows
  • 12. Our Focus Every Team MemberEvery App
  • 14. Every team member … Enterprise teams
  • 15. Tools to empower Test, Feedback & Monitoring 03
  • 16. Put quality at the center of everything you do Agile test planning and execution Monitor & share quality status
  • 17. Test Case Management Streamline quality Take advantage of a toolset optimized for the needs of testers, giving them flexibility in how they work while at the same time keeping them in sync with the rest of the team Improved web-based Test Case Management helps testers author, manage and execute test cases using any modern web browser Microsoft Test Manager further empowers your testers by giving them comprehensive tools for automated and manual testing in a desktop application optimized for the needs of today’s agile QA professional
  • 18. Manual & Exploratory Testing Run, record, play back Capture detailed records of steps performed, behaviors observed, and the status of each test step with the fully-instrumented and configurable Test Runner. Pause testing at any time to report a bug, even if it’s not directly related to the current test case High-fidelity defect reports go directly to the development team, including all the technical data needed to reproduce and resolve the error quickly. Record tests for later playback to speed up test sessions and enable test automation
  • 19. Browser-based Testing Testing in the browser Run manual tests and record test results for each test step using a toolset optimized for the needs of testers The web-based test runner enables pass-fail results, tracking of test steps, rich commenting, and bug reporting capabilities
  • 20. Feedback Management Actionable feedback Once you have working software, you're ready to get feedback from your stakeholders. You can ask reviewers to provide videos, screenshots, type-written comments, and ratings Their feedback is captured into work items that you can review and use to create a bug or suggest a new backlog item
  • 21. Quality Dashboards Monitor quality status Build dashboards that provide visibility to your team and stakeholders. Stop worrying where to find things and instead use Visual Studio Online or TFS to get everyone on the same page
  • 22. Manage complexity and close the loop between Dev and Ops Lab management Continuous delivery Enterprise DevOps
  • 23. Lab Management Dev/Test lab environments Automate your virtual lab environment with Visual Studio Lab Management Use templates to define/launch environment configurations for consistent testing Provision dev/test lab environments quickly for testers and developers
  • 24. Release Management Ship better apps, faster Visual Studio Release Management makes it easy to automate deployment and testing of your applications in multiple environments Teams can create release definitions and automate deployment in repeatable, reliable ways while tracking simultaneous in-flight releases Incorporate automated functional tests or manual approvals in a release definition to automate the release process all the way to production
  • 28. DEV QAINT PRODTFS Full Traceability
  • 30. Application Insights Usage and performance Get a 360° view of your app that includes availability, performance and user behavior Use a powerful and easy-to-use experience to track and improve the success of your application Analyze data across dimensions and make informed decisions about your product’s future
  • 31. Azure Dev/Test Lab Use the cloud for your lab Easily construct environments with different artifacts Pay for what you use Easy integration into the development tools
  • 32. Azure Performance Test Use the cloud to test the cloud Easy access to the tools, so the right people can run the tests Pay for what you use Test performance from multiple locations around the world
  • 33. Get the right people, the right tools User Acceptance Testing Included in the VSO Basic License Test Pro License Included in the VSO Advanced License Storyboarding Free for everyone Cloud or OnPrem Each VSO license includes the same OnPrem license