SlideShare a Scribd company logo
De-mystifying & Taming the
Complexities of WCAG 2.1
Bill Tyler
June 22, 2020 Accessibility Twin Cities MeetUp
#bespokewcagchecklists SlideShare: tbd
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 2
Meet the speaker
My Super Power
β€’ Experienced β€œMature Methane”
βˆ’ UX developer & designer experience back to 1984
Education & Experience
β€’ BA in Computer Studies
β€’ Full-time accessibility professional since 2013
βˆ’ First exposure & experiences go back to 2002
β€’ W3C Invited Expert on Role-based Accessibility
When did my accessibility journey truly started
β€’ Learned a lot about the challenges of the blind through a
friend born without eyes over 20 years ago (Don Wardlow)
Bill Tyler
Principal Digital
Accessibility Engineer
btyler@optum.com
@billtyler
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 3
Approach & techniques used at UnitedHealth Group for WCAG testing
β€’ Optum Technology Accessibility Center of Excellence (A11y CoE)
β€’ 6+ yrs. of ongoing accessibility testing research & analysis
β€’ Applied to 200+ UnitedHealth Group (UHG) products
Accessibility
Center of Excellence
A brief history
4
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 5
0
15
30
45
Staff size before, during & after take-off
11
31
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 6
Growth and change over past 6+ years
β€’ Primary practice in UnitedHealth Group (UHG), Optum and UnitedHealthcare (UHC)
β€’ Started December 2013 with 2 people (including me!)
β€’ Through internal mergers and restructuring grew to 10 people (including managers)
β€’ Summer 2016 (Take-off): Complete assessments on 200+ products
βˆ’ Increased 300%: 11 to 31 over 6 months
β€’ Starting 2018 transitioned to consulting, governance, separate UHC digital accessibility
program (DAP)
β€’ Today: Maturing of Optum A11y CoE (40) and UHC DAP (5)
But still growing!
WCAG 2.1
A brief summary
7
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 8
WCAG 2.1 summary
WCAG: Web Content Accessibility Guidelines from the W3C
4 (POUR) Principles
β€’ Perceivable – 4 guidelines
β€’ Operable – 5 guidelines
β€’ Understandable – 3 guidelines
β€’ Robust – 1 guideline
78 success criteria across 3 levels
β€’ A – 30 criteria
β€’ AA – 20 criteria
β€’ AAA – 28 criteria
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 9
WCAG 2.1 conformance
Target: WCAG AA
β€’ WCAG 2.0 (2008)
βˆ’ 38 (A & AA) criteria
βˆ’ Current US Section 508 (and many others, including most existing legal cases)
β€’ WCAG 2.1 (2018)
βˆ’ 50 (A & AA) criteria
βˆ’ Started in EU (EN 301 549) some organizations such as University of Minnesota
βˆ’ UHG / ACoE Standard as of January 1, 2019
The trouble with WCAG
0
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 11
WCAG is great for learning and organizing…
…but ”one size does not fit all.”
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 12
WCAG off the rack is not really useful for testing
Principles – single-word abstractions
β€’ Great for organizing, but not for testing
Guidelines – goals
β€’ Elaborate on principles, but do not add much detail
Success Criteria – testable requirements!
β€’ Targets to be met
β€’ Basis for conformance
β€’ But the text is still not checklist or checkpoints
βˆ’ Understanding documents includes situations, techniques, failures, and more
What did we do?
Bespoke checklists
Custom tailor WCAG to our needs
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 14
Bespoke
Adjective [BRITISH]
made for a particular customer or user.
"a bespoke suit"
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 15
Why bespoke (custom tailored) checklists? – Before take-off
No budget, but lots of time
β€’ First couple years we had the luxury of time to prepare
βˆ’ We knew what was coming
β€’ With no budget for off-the-shelf tools we had to build our own checklist
β€’ Excel was the tool of choice
βˆ’ Standard issue
βˆ’ Basic database operations
βˆ’ Sorting
βˆ’ Filtering
βˆ’ Import/Export
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 16
Why bespoke (or custom) checklists? – After take-off
Little budget, no time, and nothing fit properly
β€’ Had to build and adapt on the fly using the tools at hand
β€’ Rapid ramp up (from ~3 to 200+ products) left little time for new tools
βˆ’ Time needed to hire people,
βˆ’ Not evaluate, buy, deploy and start using new tools
β€’ Still limited budget, especially for size of organization
β€’ Off-the-shelf tools were not viable
βˆ’ Incomplete automation and coverage
βˆ’ Concerns about fitting and integration into the future
βˆ’ UHG’s size and number of products were at a scale beyond most tools
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 17
Bespoke checklist benefits
β€’ Tailored – explicitly to enterprise needs
β€’ Integrated – into existing corporate tools and processes
βˆ’ Import from automated testing tool
βˆ’ Export to Governance Risk Compliance (GRC) application
β€’ Optimized – for changing accessibility program requirements
β€’ Control – multibillion dollar companies don’t like risk
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 18
Downsides? Many
β€’ Time to build
β€’ Cost and resources
β€’ Support and maintenance
Not for everyone, but the lessons and techniques can still be useful
Bespoke checkpoints
Custom tailored testing of success criteria
#bespokewcagchecklists
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 20
Checklist v1.0: One checkpoint per success criterion
Too small
β€’ Obvious, logical mapping for 38 checkpoints (WCAG 2.0)
β€’ 1:1 relationship ensured full coverage for WCAG conformance (and VPATs)
β€’ Didn’t have many projects so it seemed acceptable initially
Problem: WCAG’s variable success criteria complexity
β€’ Many criteria are much more detailed than others
β€’ SC1.1.1 Non-Text Content β‰  SC3.1.1 Language of Page
β€’ Often too broad, covering multiple different cases
β€’ SC1.3.1 Info and Relationships: covers forms, labels, tables, groupings, lists, etc.
β€’ Often difficult to describe effectively to other roles (developers, designers, authors)
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 21
Checklist v2.0 – One checkpoint for each sub-case (in success criteria)
Too large and cumbersome
β€’ Understanding documents for each criteria provide the real details useful for testing
β€’ One for each situation – standard WCAG building blocks
β€’ Add other sub-cases such from success criterion text as needed (requirements, options)
β€’ Added our best practices and priorities
β€’ Checkpoint potential count of 113, but started with 84 at take-off
Problems: Duplication, overlap, confusion, extra work
β€’ Examples
βˆ’ SC1.1.1 Non-Text Content went from 1 to 11 checkpoints
βˆ’ Multiple references to required attributes
β€’ Example: SC1.3.1 Info and Relationships, SC3.3.2 Labels or Instructions
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 22
Checklist v3.0: Reviewed, revised, rewritten, reduced
Custom tailored to our needs
β€’ Reviewed all 84 checkpoints
β€’ Revised and rewritten for clarity based on experience of growing team
β€’ Merged checkpoints to remove duplication and overlap
β€’ Removed checkpoints mapped into new versions for continuity
βˆ’ Still at least one per success criterion to ensure WCAG AA conformance testing
β€’ Reduced count by 22 from 84 to 62 (26%)
βˆ’ WCAG 2.1 (2019) added 15 making current count 76
Bespoke groupings
Custom tailored principles and guidelines
#bespokewcagchecklists
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 24
WCAG principles and guidelines are for accessibility professionals
They do not work well for product testing
β€’ Accessibility topics are not familiar to business owners, designers, authors, developers
βˆ’ Some terminology is
β€’ Particularly obscure (time-based media)
β€’ Vague or not actionable (adaptable, robust, compatible)
β€’ Difficult to find
βˆ’ Do not align with roles or features (forms, layout, presentation, semantics)
βˆ’ Some topics span success criteria, guidelines and principles
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 25
Custom groupings
Group checkpoints for your audience and their needs
β€’ Size to audience needs
βˆ’ Fewer, simpler groupings for stakeholders (8 categories)
βˆ’ More detailed groupings for testers (10-11 test groups)
β€’ Organize by subjects
βˆ’ Functional: keyboard operation, forms, tables
βˆ’ Role: presentation, content and semantics, programming
β€’ Structure to meet needs of product types
βˆ’ Emphasize key functions (error prevention and handling)
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 26
Custom groupings
Benefits
β€’ Use groups appropriate for testing and reporting needs
βˆ’ Test using groups optimized for assessments
βˆ’ Create stakeholder reports using more meaningful categories
β€’ Filter by topic (display all the table-related or image checkpoints)
βˆ’ Easier search – no need to memorize guidelines or criteria
β€’ Filtering allows easier β€œbatch setting” of values for videos, forms, tables
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 27
Custom groupings
Test groups for accessibility engineers (WCAG 2.1)
1. Keyboard / Input
2. Mobile
3. Navigation
4. Forms
5. Tables
6. Images
7. Presentation
8. Semantics
9. Content
10. Code
11. Time-Based Media (TBM)
Bespoke sort orderings
Custom tailored numbering and sequencing
#bespokewcagchecklists
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 29
WCAG order is a jumble
Principles, guidelines, criteria order are good for learning, but…
β€’ WCAG order is inefficient for testing
βˆ’ SC1.1.1 Non-text Content οƒ  GL1.2 β€œVideo” οƒ  SC1.3.1 Info and Relationships
οƒ  SC1.3.2 Meaningful Sequence οƒ  SC1.3.3 Sensory Characteristics
β€’ Must switch testing modes and techniques or constantly jump back and forth
βˆ’ SC1.3.1 Info and Relationships οƒ  GL3.3 Input Assistance
β€’ Critical issues come later
βˆ’ SC2.1.1 Keyboard Operation is the 21st criterion of WCAG 2.1, A & AA only
βˆ’ WCAG 2.0 order wasn’t great, WCAG 2.1 made it worse
βˆ’ New criteria added after originals, starting over with level A
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 30
Custom sort orders
Create a logical sequence for testing needs and efficiency in addition to WCAG
β€’ Prioritize group order
βˆ’ Common, critical groups first (such as keyboard, navigation, forms)
βˆ’ Less critical later (time-based media)
β€’ Start with showstoppers to confirm testing can proceed
βˆ’ Example: focus οƒ  keyboard operation οƒ  keyboard trap
β€’ Sort checkpoints within groups to follow more efficient testing protocol
βˆ’ Example: content images οƒ  images of text οƒ  complex images οƒ  decorative images
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 31
Checkpoint numbering tips
Encoding IDs
β€’ Mandatory IDs – row numbers become meaningless after sorting
β€’ Unique IDs for each checkpoint – duplicates will get out of order after multiple sorting
β€’ Extra digits – for consistent sorting of multiple checkpoints to a criterion or sub-case
β€’ Base on WCAG – provides quick reliable default WCAG order (after using test sort order)
β€’ Leading zeroes – for GL1.4 – 1.4.01 or 1.401
βˆ’ If not, they never sort into to the expected WCAG order
β€’ 1.4.1
β€’ 1.4.10 …
β€’ 1.4.13
β€’ 1.4.2
Bespoke severity levels
Custom tailored level indicators
#bespokewcagchecklists
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 33
A, AA and AAA don’t work well for testing
WCAG AA isn’t very meaningful for prioritizing checkpoints
It’s really all one group (all A & AA)
β€’ AAA (usually) not included
β€’ Does anyone target Level A conformance?
A and AA are too broad for processes like Agile
β€’ Severity scales typically have four levels
βˆ’ Example: MoSCoW method – Must / Should / Could / Won’t
β€’ Which are showstoppers? blockers? major or more minor barriers to use?
βˆ’ SC2.1.2 No Keyboard Trap = SC4.1.1 Parsing? Both are Level A
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 34
Custom severity levels
Sample levels
β€’ Critical Showstoppers or blockers to site access, operation and testing
β€’ High Could be very challenging to overcome, impossible for most
β€’ Medium May be very frustrating or time consuming for all
β€’ Low Might have significant impact for many
Benefits
β€’ Not forced to WCAG levels (Example: raise SC2.4.7 Visible Focus from AA to Critical)
β€’ Align to product and project needs (like minimum viable or accessible product)
β€’ Write so they cannot be optional (must include only)
β€’ Align and reference by WCAG levels as needed
Other bespoke details
Additional custom tailoring
#bespokewcagchecklists
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 36
WCAG options
WCAG version
β€’ v2.0 – only
β€’ v2.1 – complete (2.0 and 2.1)
β€’ v2.1 – supplement (new 2.1 checkpoints only)
WCAG level indicators
β€’ A – only
β€’ AA – only
β€’ AA – conformance (A & AA)
β€’ AAA – if applicable (A & AA & AAA)
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 37
WCAG options (cont.)
The Four POUR Principles
β€’ P – Perceivable
β€’ O – Operable
β€’ U – Understandable
β€’ R – Robust
Could include Guidelines
β€’ 1.1 Text Alternatives
β€’ 1.2 Time-based Media
β€’ 1.3 Adaptable
β€’ …
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 38
Custom checkpoints can be distributed by skill
Optimizing work to screen reader and visual testers
Custom checkpoints can be tailored and grouped based upon skills
β€’ Screen Reader Tester / SRT AT expert using screen reader
β€’ Visual Assistant / VA User working relying on vision, not AT
Filtering allows clear, consistent work assignments
β€’ SRT Screen Reader Tester preferred
β€’ Either Screen Reader Tester or Visual Assistant can perform equally well
β€’ Dual Both should test (AT experience very different from visual)
β€’ VA Visual Assistant preferred (usually for efficiency)
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 39
Map checkpoints to non-WCAG standards
Section 508 (1998 or β€œpre-refresh”)
β€’ Β§ 1194.21 Software Applications and Operating Systems
βˆ’ 12 criteria (a) – (l)
β€’ Β§ 1194.22 Web-based Intranet and Internet Information and Applications
βˆ’ 16 criteria (a) - (p)
β€’ Β§ 1194.24 Video or Multimedia Products
βˆ’ 5 criteria (a) – (e)
And possibly transition to future standards like AG (WCAG 3.0)
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 40
Other information for reports
β€’ Additional options can be added for checkpoints and reports to communicate benefits
Example: β€œAffects users who are…” [blind, low vision, deaf, cognitively impaired, etc.]
β€’ Accessibility tools for testing
List of tools to test checkpoint – useful for developers and designers
References links to standards and resources
β€’ Roles
List of roles that may own the issue or should be consulted about the checkpoint
βˆ’ Example: color contrast issues (SC1.4.2) likely belong to visual designer
Final fitting
Putting it all together
#bespokewcagchecklists
1
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 42
You can and must support all WCAG
β€’ Success criteria
β€’ Guidelines
β€’ Principles
β€’ Conformance
β€’ Reporting (VPAT)
How you get there is up to you.
Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 43
Custom tailor WCAG to your needs with bespoke checklists
β€’ Success Criteria οƒ  Checkpoints
βˆ’ Create as many as appropriate with minimum of 1 for each criterion
βˆ’ Structure using Understand Documents (leveraging situations, options, best practices, etc.)
β€’ Principles and Guidelines οƒ  Groupings
βˆ’ Tailor and size them to needs (and vocabulary) of target audiences
β€’ Numbering οƒ  Sort order
βˆ’ Encode IDs so they provide consistent, helpful, efficient sequences for testing
β€’ Level Indicators οƒ  Severity levels
βˆ’ Prioritize to needs of testing and delivered product
β€’ Other details as needed
Thank you.
Bill Tyler
Principal Digital Accessibility Engineer
btyler@optum.com
@billtyler
45Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum.
4

More Related Content

PDF
CSUN 2022 Role-based analysis update: WCAG 2.2
PPTX
Info dev flexibility in agile
PPTX
Introducing WCAG 2.2
PPTX
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
PPTX
Moneyball AA11y Minnebar 11.aprile.2015
PDF
Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017
PPTX
A11y by Design 2018 Rethinking Accessibility 2018-05-08
PPTX
Managing Accessibility Compliance in the Enterprise
CSUN 2022 Role-based analysis update: WCAG 2.2
Info dev flexibility in agile
Introducing WCAG 2.2
Rethinking Accessibility: Role-based Accessibility of WCAG 2.1
Moneyball AA11y Minnebar 11.aprile.2015
Rethinking Accessibility: Role-Based Analysis of WCAG 2.0 - CSUN 2017
A11y by Design 2018 Rethinking Accessibility 2018-05-08
Managing Accessibility Compliance in the Enterprise

What's hot (20)

PDF
Integrating accessibility in the organization's web development lifecycle
PPTX
Verhaert Innovation Day 2011 – Joris Vanderschrick (VERHAERT) - System Requir...
PPT
User Centered Design 101
PPTX
Formative Usability Testing in Agile: Piloting New Techniques at Autodesk
PPT
User centered Design
PDF
Introduction To Agile Refresh Savannah July20 2010 V1 4
PDF
Fad-Free Architecture
PDF
Pscad agile adoption
PPT
Agile And Open Development
PPTX
Software Development Life Cycle
PPTX
Software Architecture for Agile Development
PPT
Mobile media module part 6 - app development rev-mf
PDF
The Pre-Open Sourcing Sanity Check
PPT
JDA: Building an Open Source Center of Excellence
PPTX
Why We Need Architects (and Architecture) on Agile Projects
PPT
IUE2009 - Lessons Learned While Integrating a New IA Tool
PPT
Innovate 2013 Design on a Diet - session 2131
PPTX
SDLC Smashup
PDF
Just Married: User Centered Design and Agile
PPTX
IUE2010 ProQuest Redesign
Integrating accessibility in the organization's web development lifecycle
Verhaert Innovation Day 2011 – Joris Vanderschrick (VERHAERT) - System Requir...
User Centered Design 101
Formative Usability Testing in Agile: Piloting New Techniques at Autodesk
User centered Design
Introduction To Agile Refresh Savannah July20 2010 V1 4
Fad-Free Architecture
Pscad agile adoption
Agile And Open Development
Software Development Life Cycle
Software Architecture for Agile Development
Mobile media module part 6 - app development rev-mf
The Pre-Open Sourcing Sanity Check
JDA: Building an Open Source Center of Excellence
Why We Need Architects (and Architecture) on Agile Projects
IUE2009 - Lessons Learned While Integrating a New IA Tool
Innovate 2013 Design on a Diet - session 2131
SDLC Smashup
Just Married: User Centered Design and Agile
IUE2010 ProQuest Redesign
Ad

Similar to De-mystifying and Taming the Complexities of WCAG 2.1 (20)

PDF
How Oracle Integrates Accessibility into the Development Process
PDF
RESPONSIVE GOVERNANCE FOR EVOLUTIONARY TECHNOLOGY PLATFORMS
PDF
Agile Automotive (Final)
PPTX
Hybrid Development Workshop Presentation (San Francisco)
PDF
How to build confidence in your release cycle
Β 
PDF
The fact that your poject is agile is not (necessarily) a cost driver arlen...
Β 
PDF
Maximize Your Enterprise DevOps Efforts and Outcomes with Value Streams
PPT
Moving Up the PVC Maturity Curve in Industrial Manufacturing
PPTX
DV 2016: Mission Possible - Building a New Analytics Framework
PDF
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
PPT
AiTi Education Software Testing Session 02 a
PDF
Webinar: Ten Ways to Enhance Your Salesforce.com Application in 2013
PPTX
CSUN 2020 VPATs: For Business or Measure
PDF
Mastering BDD - Eran Kinsbruner Workshop Quest 2018
PPTX
ANI | Agile Hyderanad | Gdpr distributed team-case_study-agile conference | 2...
PPTX
Adopting Agile
PDF
Simplify Salesforce Testing with AI-Driven Codeless Tools
PDF
Lean Solutions – Agile Transformation at the United States Postal Service
PPTX
Let's focus more on Quality and less on Testing by Joel Montvelisky
PDF
0121_RESOURCE_SoftwareDevelopmentLifecycles.pdf
How Oracle Integrates Accessibility into the Development Process
RESPONSIVE GOVERNANCE FOR EVOLUTIONARY TECHNOLOGY PLATFORMS
Agile Automotive (Final)
Hybrid Development Workshop Presentation (San Francisco)
How to build confidence in your release cycle
Β 
The fact that your poject is agile is not (necessarily) a cost driver arlen...
Β 
Maximize Your Enterprise DevOps Efforts and Outcomes with Value Streams
Moving Up the PVC Maturity Curve in Industrial Manufacturing
DV 2016: Mission Possible - Building a New Analytics Framework
Introduction of TMAP to representatives of ISTQB boards in the GA week in Mar...
AiTi Education Software Testing Session 02 a
Webinar: Ten Ways to Enhance Your Salesforce.com Application in 2013
CSUN 2020 VPATs: For Business or Measure
Mastering BDD - Eran Kinsbruner Workshop Quest 2018
ANI | Agile Hyderanad | Gdpr distributed team-case_study-agile conference | 2...
Adopting Agile
Simplify Salesforce Testing with AI-Driven Codeless Tools
Lean Solutions – Agile Transformation at the United States Postal Service
Let's focus more on Quality and less on Testing by Joel Montvelisky
0121_RESOURCE_SoftwareDevelopmentLifecycles.pdf
Ad

More from Bill Tyler (6)

PPTX
Shift Left - Require Right WRT A11yTC 2023-07-31.pptx
PPTX
A11yTC MeetUp: Role-based Analysis of WCAG 2.2
PDF
Introducing ARRM: A Framework To Fight Accessibility Apathy
PDF
Introducing ARRM: A Framework to Fight Accessibility Apathy
PPTX
WCAG 2.1 Made Easier for Non-Accessibility Professionals 2019-03-15
PDF
CSUN 2018 Analyzing and Extending WCAG Beyond 3 Digits
Shift Left - Require Right WRT A11yTC 2023-07-31.pptx
A11yTC MeetUp: Role-based Analysis of WCAG 2.2
Introducing ARRM: A Framework To Fight Accessibility Apathy
Introducing ARRM: A Framework to Fight Accessibility Apathy
WCAG 2.1 Made Easier for Non-Accessibility Professionals 2019-03-15
CSUN 2018 Analyzing and Extending WCAG Beyond 3 Digits

Recently uploaded (20)

PPT
Design_with_Watersergyerge45hrbgre4top (1).ppt
PDF
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
PPTX
innovation process that make everything different.pptx
PDF
FINAL CALL-6th International Conference on Networks & IOT (NeTIOT 2025)
PDF
How to Ensure Data Integrity During Shopify Migration_ Best Practices for Sec...
PDF
Decoding a Decade: 10 Years of Applied CTI Discipline
PPTX
presentation_pfe-universite-molay-seltan.pptx
PPTX
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
DOCX
Unit-3 cyber security network security of internet system
PPTX
artificial intelligence overview of it and more
PDF
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
PPTX
INTERNET------BASICS-------UPDATED PPT PRESENTATION
PPTX
Internet___Basics___Styled_ presentation
PPTX
Introuction about ICD -10 and ICD-11 PPT.pptx
PDF
Slides PDF The World Game (s) Eco Economic Epochs.pdf
PDF
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
Β 
PDF
Sims 4 Historia para lo sims 4 para jugar
PPTX
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
PDF
Unit-1 introduction to cyber security discuss about how to secure a system
PPT
isotopes_sddsadsaadasdasdasdasdsa1213.ppt
Design_with_Watersergyerge45hrbgre4top (1).ppt
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
innovation process that make everything different.pptx
FINAL CALL-6th International Conference on Networks & IOT (NeTIOT 2025)
How to Ensure Data Integrity During Shopify Migration_ Best Practices for Sec...
Decoding a Decade: 10 Years of Applied CTI Discipline
presentation_pfe-universite-molay-seltan.pptx
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
Unit-3 cyber security network security of internet system
artificial intelligence overview of it and more
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
INTERNET------BASICS-------UPDATED PPT PRESENTATION
Internet___Basics___Styled_ presentation
Introuction about ICD -10 and ICD-11 PPT.pptx
Slides PDF The World Game (s) Eco Economic Epochs.pdf
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
Β 
Sims 4 Historia para lo sims 4 para jugar
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
Unit-1 introduction to cyber security discuss about how to secure a system
isotopes_sddsadsaadasdasdasdasdsa1213.ppt

De-mystifying and Taming the Complexities of WCAG 2.1

  • 1. De-mystifying & Taming the Complexities of WCAG 2.1 Bill Tyler June 22, 2020 Accessibility Twin Cities MeetUp #bespokewcagchecklists SlideShare: tbd
  • 2. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 2 Meet the speaker My Super Power β€’ Experienced β€œMature Methane” βˆ’ UX developer & designer experience back to 1984 Education & Experience β€’ BA in Computer Studies β€’ Full-time accessibility professional since 2013 βˆ’ First exposure & experiences go back to 2002 β€’ W3C Invited Expert on Role-based Accessibility When did my accessibility journey truly started β€’ Learned a lot about the challenges of the blind through a friend born without eyes over 20 years ago (Don Wardlow) Bill Tyler Principal Digital Accessibility Engineer btyler@optum.com @billtyler
  • 3. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 3 Approach & techniques used at UnitedHealth Group for WCAG testing β€’ Optum Technology Accessibility Center of Excellence (A11y CoE) β€’ 6+ yrs. of ongoing accessibility testing research & analysis β€’ Applied to 200+ UnitedHealth Group (UHG) products
  • 5. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 5 0 15 30 45 Staff size before, during & after take-off 11 31
  • 6. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 6 Growth and change over past 6+ years β€’ Primary practice in UnitedHealth Group (UHG), Optum and UnitedHealthcare (UHC) β€’ Started December 2013 with 2 people (including me!) β€’ Through internal mergers and restructuring grew to 10 people (including managers) β€’ Summer 2016 (Take-off): Complete assessments on 200+ products βˆ’ Increased 300%: 11 to 31 over 6 months β€’ Starting 2018 transitioned to consulting, governance, separate UHC digital accessibility program (DAP) β€’ Today: Maturing of Optum A11y CoE (40) and UHC DAP (5) But still growing!
  • 7. WCAG 2.1 A brief summary 7
  • 8. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 8 WCAG 2.1 summary WCAG: Web Content Accessibility Guidelines from the W3C 4 (POUR) Principles β€’ Perceivable – 4 guidelines β€’ Operable – 5 guidelines β€’ Understandable – 3 guidelines β€’ Robust – 1 guideline 78 success criteria across 3 levels β€’ A – 30 criteria β€’ AA – 20 criteria β€’ AAA – 28 criteria
  • 9. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 9 WCAG 2.1 conformance Target: WCAG AA β€’ WCAG 2.0 (2008) βˆ’ 38 (A & AA) criteria βˆ’ Current US Section 508 (and many others, including most existing legal cases) β€’ WCAG 2.1 (2018) βˆ’ 50 (A & AA) criteria βˆ’ Started in EU (EN 301 549) some organizations such as University of Minnesota βˆ’ UHG / ACoE Standard as of January 1, 2019
  • 11. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 11 WCAG is great for learning and organizing… …but ”one size does not fit all.”
  • 12. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 12 WCAG off the rack is not really useful for testing Principles – single-word abstractions β€’ Great for organizing, but not for testing Guidelines – goals β€’ Elaborate on principles, but do not add much detail Success Criteria – testable requirements! β€’ Targets to be met β€’ Basis for conformance β€’ But the text is still not checklist or checkpoints βˆ’ Understanding documents includes situations, techniques, failures, and more
  • 13. What did we do? Bespoke checklists Custom tailor WCAG to our needs
  • 14. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 14 Bespoke Adjective [BRITISH] made for a particular customer or user. "a bespoke suit"
  • 15. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 15 Why bespoke (custom tailored) checklists? – Before take-off No budget, but lots of time β€’ First couple years we had the luxury of time to prepare βˆ’ We knew what was coming β€’ With no budget for off-the-shelf tools we had to build our own checklist β€’ Excel was the tool of choice βˆ’ Standard issue βˆ’ Basic database operations βˆ’ Sorting βˆ’ Filtering βˆ’ Import/Export
  • 16. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 16 Why bespoke (or custom) checklists? – After take-off Little budget, no time, and nothing fit properly β€’ Had to build and adapt on the fly using the tools at hand β€’ Rapid ramp up (from ~3 to 200+ products) left little time for new tools βˆ’ Time needed to hire people, βˆ’ Not evaluate, buy, deploy and start using new tools β€’ Still limited budget, especially for size of organization β€’ Off-the-shelf tools were not viable βˆ’ Incomplete automation and coverage βˆ’ Concerns about fitting and integration into the future βˆ’ UHG’s size and number of products were at a scale beyond most tools
  • 17. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 17 Bespoke checklist benefits β€’ Tailored – explicitly to enterprise needs β€’ Integrated – into existing corporate tools and processes βˆ’ Import from automated testing tool βˆ’ Export to Governance Risk Compliance (GRC) application β€’ Optimized – for changing accessibility program requirements β€’ Control – multibillion dollar companies don’t like risk
  • 18. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 18 Downsides? Many β€’ Time to build β€’ Cost and resources β€’ Support and maintenance Not for everyone, but the lessons and techniques can still be useful
  • 19. Bespoke checkpoints Custom tailored testing of success criteria #bespokewcagchecklists
  • 20. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 20 Checklist v1.0: One checkpoint per success criterion Too small β€’ Obvious, logical mapping for 38 checkpoints (WCAG 2.0) β€’ 1:1 relationship ensured full coverage for WCAG conformance (and VPATs) β€’ Didn’t have many projects so it seemed acceptable initially Problem: WCAG’s variable success criteria complexity β€’ Many criteria are much more detailed than others β€’ SC1.1.1 Non-Text Content β‰  SC3.1.1 Language of Page β€’ Often too broad, covering multiple different cases β€’ SC1.3.1 Info and Relationships: covers forms, labels, tables, groupings, lists, etc. β€’ Often difficult to describe effectively to other roles (developers, designers, authors)
  • 21. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 21 Checklist v2.0 – One checkpoint for each sub-case (in success criteria) Too large and cumbersome β€’ Understanding documents for each criteria provide the real details useful for testing β€’ One for each situation – standard WCAG building blocks β€’ Add other sub-cases such from success criterion text as needed (requirements, options) β€’ Added our best practices and priorities β€’ Checkpoint potential count of 113, but started with 84 at take-off Problems: Duplication, overlap, confusion, extra work β€’ Examples βˆ’ SC1.1.1 Non-Text Content went from 1 to 11 checkpoints βˆ’ Multiple references to required attributes β€’ Example: SC1.3.1 Info and Relationships, SC3.3.2 Labels or Instructions
  • 22. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 22 Checklist v3.0: Reviewed, revised, rewritten, reduced Custom tailored to our needs β€’ Reviewed all 84 checkpoints β€’ Revised and rewritten for clarity based on experience of growing team β€’ Merged checkpoints to remove duplication and overlap β€’ Removed checkpoints mapped into new versions for continuity βˆ’ Still at least one per success criterion to ensure WCAG AA conformance testing β€’ Reduced count by 22 from 84 to 62 (26%) βˆ’ WCAG 2.1 (2019) added 15 making current count 76
  • 23. Bespoke groupings Custom tailored principles and guidelines #bespokewcagchecklists
  • 24. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 24 WCAG principles and guidelines are for accessibility professionals They do not work well for product testing β€’ Accessibility topics are not familiar to business owners, designers, authors, developers βˆ’ Some terminology is β€’ Particularly obscure (time-based media) β€’ Vague or not actionable (adaptable, robust, compatible) β€’ Difficult to find βˆ’ Do not align with roles or features (forms, layout, presentation, semantics) βˆ’ Some topics span success criteria, guidelines and principles
  • 25. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 25 Custom groupings Group checkpoints for your audience and their needs β€’ Size to audience needs βˆ’ Fewer, simpler groupings for stakeholders (8 categories) βˆ’ More detailed groupings for testers (10-11 test groups) β€’ Organize by subjects βˆ’ Functional: keyboard operation, forms, tables βˆ’ Role: presentation, content and semantics, programming β€’ Structure to meet needs of product types βˆ’ Emphasize key functions (error prevention and handling)
  • 26. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 26 Custom groupings Benefits β€’ Use groups appropriate for testing and reporting needs βˆ’ Test using groups optimized for assessments βˆ’ Create stakeholder reports using more meaningful categories β€’ Filter by topic (display all the table-related or image checkpoints) βˆ’ Easier search – no need to memorize guidelines or criteria β€’ Filtering allows easier β€œbatch setting” of values for videos, forms, tables
  • 27. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 27 Custom groupings Test groups for accessibility engineers (WCAG 2.1) 1. Keyboard / Input 2. Mobile 3. Navigation 4. Forms 5. Tables 6. Images 7. Presentation 8. Semantics 9. Content 10. Code 11. Time-Based Media (TBM)
  • 28. Bespoke sort orderings Custom tailored numbering and sequencing #bespokewcagchecklists
  • 29. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 29 WCAG order is a jumble Principles, guidelines, criteria order are good for learning, but… β€’ WCAG order is inefficient for testing βˆ’ SC1.1.1 Non-text Content οƒ  GL1.2 β€œVideo” οƒ  SC1.3.1 Info and Relationships οƒ  SC1.3.2 Meaningful Sequence οƒ  SC1.3.3 Sensory Characteristics β€’ Must switch testing modes and techniques or constantly jump back and forth βˆ’ SC1.3.1 Info and Relationships οƒ  GL3.3 Input Assistance β€’ Critical issues come later βˆ’ SC2.1.1 Keyboard Operation is the 21st criterion of WCAG 2.1, A & AA only βˆ’ WCAG 2.0 order wasn’t great, WCAG 2.1 made it worse βˆ’ New criteria added after originals, starting over with level A
  • 30. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 30 Custom sort orders Create a logical sequence for testing needs and efficiency in addition to WCAG β€’ Prioritize group order βˆ’ Common, critical groups first (such as keyboard, navigation, forms) βˆ’ Less critical later (time-based media) β€’ Start with showstoppers to confirm testing can proceed βˆ’ Example: focus οƒ  keyboard operation οƒ  keyboard trap β€’ Sort checkpoints within groups to follow more efficient testing protocol βˆ’ Example: content images οƒ  images of text οƒ  complex images οƒ  decorative images
  • 31. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 31 Checkpoint numbering tips Encoding IDs β€’ Mandatory IDs – row numbers become meaningless after sorting β€’ Unique IDs for each checkpoint – duplicates will get out of order after multiple sorting β€’ Extra digits – for consistent sorting of multiple checkpoints to a criterion or sub-case β€’ Base on WCAG – provides quick reliable default WCAG order (after using test sort order) β€’ Leading zeroes – for GL1.4 – 1.4.01 or 1.401 βˆ’ If not, they never sort into to the expected WCAG order β€’ 1.4.1 β€’ 1.4.10 … β€’ 1.4.13 β€’ 1.4.2
  • 32. Bespoke severity levels Custom tailored level indicators #bespokewcagchecklists
  • 33. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 33 A, AA and AAA don’t work well for testing WCAG AA isn’t very meaningful for prioritizing checkpoints It’s really all one group (all A & AA) β€’ AAA (usually) not included β€’ Does anyone target Level A conformance? A and AA are too broad for processes like Agile β€’ Severity scales typically have four levels βˆ’ Example: MoSCoW method – Must / Should / Could / Won’t β€’ Which are showstoppers? blockers? major or more minor barriers to use? βˆ’ SC2.1.2 No Keyboard Trap = SC4.1.1 Parsing? Both are Level A
  • 34. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 34 Custom severity levels Sample levels β€’ Critical Showstoppers or blockers to site access, operation and testing β€’ High Could be very challenging to overcome, impossible for most β€’ Medium May be very frustrating or time consuming for all β€’ Low Might have significant impact for many Benefits β€’ Not forced to WCAG levels (Example: raise SC2.4.7 Visible Focus from AA to Critical) β€’ Align to product and project needs (like minimum viable or accessible product) β€’ Write so they cannot be optional (must include only) β€’ Align and reference by WCAG levels as needed
  • 35. Other bespoke details Additional custom tailoring #bespokewcagchecklists
  • 36. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 36 WCAG options WCAG version β€’ v2.0 – only β€’ v2.1 – complete (2.0 and 2.1) β€’ v2.1 – supplement (new 2.1 checkpoints only) WCAG level indicators β€’ A – only β€’ AA – only β€’ AA – conformance (A & AA) β€’ AAA – if applicable (A & AA & AAA)
  • 37. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 37 WCAG options (cont.) The Four POUR Principles β€’ P – Perceivable β€’ O – Operable β€’ U – Understandable β€’ R – Robust Could include Guidelines β€’ 1.1 Text Alternatives β€’ 1.2 Time-based Media β€’ 1.3 Adaptable β€’ …
  • 38. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 38 Custom checkpoints can be distributed by skill Optimizing work to screen reader and visual testers Custom checkpoints can be tailored and grouped based upon skills β€’ Screen Reader Tester / SRT AT expert using screen reader β€’ Visual Assistant / VA User working relying on vision, not AT Filtering allows clear, consistent work assignments β€’ SRT Screen Reader Tester preferred β€’ Either Screen Reader Tester or Visual Assistant can perform equally well β€’ Dual Both should test (AT experience very different from visual) β€’ VA Visual Assistant preferred (usually for efficiency)
  • 39. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 39 Map checkpoints to non-WCAG standards Section 508 (1998 or β€œpre-refresh”) β€’ Β§ 1194.21 Software Applications and Operating Systems βˆ’ 12 criteria (a) – (l) β€’ Β§ 1194.22 Web-based Intranet and Internet Information and Applications βˆ’ 16 criteria (a) - (p) β€’ Β§ 1194.24 Video or Multimedia Products βˆ’ 5 criteria (a) – (e) And possibly transition to future standards like AG (WCAG 3.0)
  • 40. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 40 Other information for reports β€’ Additional options can be added for checkpoints and reports to communicate benefits Example: β€œAffects users who are…” [blind, low vision, deaf, cognitively impaired, etc.] β€’ Accessibility tools for testing List of tools to test checkpoint – useful for developers and designers References links to standards and resources β€’ Roles List of roles that may own the issue or should be consulted about the checkpoint βˆ’ Example: color contrast issues (SC1.4.2) likely belong to visual designer
  • 41. Final fitting Putting it all together #bespokewcagchecklists 1
  • 42. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 42 You can and must support all WCAG β€’ Success criteria β€’ Guidelines β€’ Principles β€’ Conformance β€’ Reporting (VPAT) How you get there is up to you.
  • 43. Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 43 Custom tailor WCAG to your needs with bespoke checklists β€’ Success Criteria οƒ  Checkpoints βˆ’ Create as many as appropriate with minimum of 1 for each criterion βˆ’ Structure using Understand Documents (leveraging situations, options, best practices, etc.) β€’ Principles and Guidelines οƒ  Groupings βˆ’ Tailor and size them to needs (and vocabulary) of target audiences β€’ Numbering οƒ  Sort order βˆ’ Encode IDs so they provide consistent, helpful, efficient sequences for testing β€’ Level Indicators οƒ  Severity levels βˆ’ Prioritize to needs of testing and delivered product β€’ Other details as needed
  • 44. Thank you. Bill Tyler Principal Digital Accessibility Engineer btyler@optum.com @billtyler
  • 45. 45Β© 2020 Optum, Inc. All rights reserved. Confidential property of Optum. Do not distribute or reproduce without express permission from Optum. 4