Inclusive Usability Testing — a11yTOCamp
3 likes1,505 views
Adrian Roselli's presentation on inclusive usability testing emphasizes the importance of comprehensive accessibility remediation, planning, and accommodating participants' needs. Key considerations include participant recruitment through community organizations, ensuring venue accessibility, and addressing privacy concerns related to personal health information. The process also involves using the participants' systems during testing and being respectful of their configurations and experiences.
Inclusive Usability Testing — a11yTOCamp
- 1. Inclusive Usability Testing Presented by Adrian Roselli (@aardrian) for a11yTO Camp. Slides from this talk will be available at rosel.li/a11yTOCamp.
- 2. • I’ve written some stuff, • Member of W3C, • Building for the web since 1993, • Learn more at AdrianRoselli.com, • Avoid on Twitter @aardrian. Great bedtime reading! About Adrian Roselli
- 3. Overview • Concerns • Planning • Payment • Venue • Recruitment • Accommodation • Tech • Process • Privacy
- 4. CONCERNS Photo by Save the Dream, CC BY 2.0
- 5. Concerns • Accessibility remediation must be complete.
- 6. Concerns • Accessibility remediation must be complete. • This is not accessibility testing.
- 7. Concerns • Accessibility remediation must be complete. • This is not accessibility testing. • This is not disability tourism.
- 8. Concerns • Accessibility remediation must be complete. • This is not accessibility testing. • This is not disability tourism. • Be clear on that with all stakeholders.
- 9. PLANNING Photo by Save the Dream, CC BY 2.0Photo by benjaminlansky, CC BY 2.0
- 10. Planning • Review your tests and format.
- 11. Planning • Review your tests and format. • Are they structured? Informal? Remote?
- 12. Planning • Review your tests and format. • Are they structured? Informal? Remote? • How many participants are you planning?
- 13. Planning • Review your tests and format. • Are they structured? Informal? Remote? • How many participants are you planning? • Have you budgeted for paying participants?
- 14. PAYMENT Photo by Mike Mozart, CC BY 2.0
- 15. Payment • Expect to pay participants more than you usually do.
- 16. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate:
- 17. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost,
- 18. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work,
- 19. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work, • May be underemployed.
- 20. Payment • Expect to pay participants more than you usually do. • Additional burdens to participate: • Transportation cost, • Time off work, • May be underemployed. • Gift cards that can be accepted where they shop.
- 21. VENUE Photo by Chris Waits, CC BY 2.0
- 22. Venue • It must be accessible.
- 23. Venue • It must be accessible. • Not just the building, but the entire route.
- 24. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc.
- 25. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc. • Meet them at the door.
- 26. Venue • It must be accessible. • Not just the building, but the entire route. • Bus line, transport services, etc. • Meet them at the door. • Relief area for service animals.
- 27. RECRUITMENT Photo by NASA Goddard Space Flight Center, CC BY 2.0
- 28. Recruitment • Now you can find participants!
- 29. Recruitment • Now you can find participants! • Community / support organizations:
- 30. Recruitment • Now you can find participants! • Community / support organizations: • Demographics,
- 31. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition,
- 32. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships,
- 33. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships, • Contextual support.
- 34. Recruitment • Now you can find participants! • Community / support organizations: • Demographics, • Name recognition, • Existing relationships, • Contextual support. • Let the organization recruit.
- 35. ACCOMMODATION Photo by David Luders, CC BY 2.0
- 36. Accommodation • Build extra time for every task.
- 37. Accommodation • Build extra time for every task. • Allow them to be late.
- 38. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables.
- 39. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table.
- 40. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table. • Different seating options: widths, arms, wheels, etc.
- 41. Accommodation • Build extra time for every task. • Allow them to be late. • Service animals, canes, etc. do not play well with tripods and cables. • Service animals need a clear space under the table. • Different seating options: widths, arms, wheels, etc. • A place to park scooters, chairs, etc.
- 42. TECH Photo by City University Interaction Lab, CC BY 2.0
- 43. Tech • Use the participant’s system (or community org system).
- 44. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts.
- 45. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration.
- 46. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration. • If necessary to modify, ask permission for any and every change.
- 47. Tech • Use the participant’s system (or community org system). • For mobile testing, do not use mounts. • Do not mess with the user’s configuration. • If necessary to modify, ask permission for any and every change. • Return it to the way you found it when done.
- 48. PROCESS Photo by Eelke, CC BY 2.0
- 49. Process • Be prepared to read agreements, instructions, etc. aloud.
- 50. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions.
- 51. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it.
- 52. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT.
- 53. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT. • Reassure user none of the mistakes are his/her fault.
- 54. Process • Be prepared to read agreements, instructions, etc. aloud. • Point a camera at the user and interactions. • Drive a second monitor from device and record it. • Do not interrupt the user when using AT. • Reassure user none of the mistakes are his/her fault. • Users may apologize for finding errors.
- 55. PRIVACY Photo by frankieleon, CC BY 2.0
- 56. Privacy • Some personal health information may be revealed.
- 57. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential.
- 58. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential. • Where possible, anonymize data for reporting.
- 59. Privacy • Some personal health information may be revealed. • Be prepared to treat it as confidential. • Where possible, anonymize data for reporting. • Coordinate with recruiting organization.
- 61. Inclusive Usability Testing Presented by Adrian Roselli (@aardrian) for a11yTO Camp. Slides from this talk will be available at rosel.li/a11yTOCamp.
Editor's Notes
- #5: • Save the Dream and SASOL. • National Sport Day 2017 to promote education and inclusivity through sport. • High-profile Qatari athletes and footballers from Al Sadd Football Club.
- #6: 1 of 9
- #7: 1 of 9
- #8: 1 of 9
- #9: 1 of 9
- #10: • Learning how to understand the signing of a floor plan in sign language • My teacher also forgets to give us the new reference point after each room • so I never know whether the kitchen is down the hall from the dining room or on the other side of the dining room. • It's rather confusing.
- #11: 2 of 9
- #12: 2 of 9
- #13: 2 of 9
- #14: 2 of 9
- #15: • Gift cards can be most useful when they have cash value. • Avoid cards at venues that require travel, do not support disabilities, etc. • Get cards that are more useful than just a free coffee but take $20 to get to use. • Can be used as signature guides
- #16: 3 of 9
- #17: 3 of 9
- #18: 3 of 9
- #19: 3 of 9
- #20: 3 of 9
- #21: 3 of 9
- #22: • A token effort is unacceptable • pay attention to whether or not it is truly accessible • Kutna Hora, Czech Republic
- #23: 4 of 9
- #24: 4 of 9
- #25: 4 of 9
- #26: 4 of 9
- #27: 4 of 9
- #28: • Blind Camp of Maryland Visits NASA Goddard • NASA's Goddard Space Flight Center in Greenbelt, Md. • hosted some 100 campers and volunteers from the Deaf-Blind Camp of Maryland. • Based in West River, Md., was established in 1998 • provides safe, fun, barrier-free week for people who have significant hearing and vision loss. • campers, aged 18 to 80, learned about space and NASA missions
- #29: 5 of 9
- #30: 5 of 9
- #31: 5 of 9
- #32: 5 of 9
- #33: 5 of 9
- #34: 5 of 9
- #35: 5 of 9
- #36: • May not anticipate some of the assistive tech that your users will bring. • A scooter and service dog combined will overwhelm even a spacious room.
- #37: 6 of 9
- #38: 6 of 9
- #39: 6 of 9
- #40: 6 of 9
- #41: 6 of 9
- #42: 6 of 9
- #43: • This set-up may not work • For mobile testing that the user may hold device to ear
- #44: 7 of 9
- #45: 7 of 9
- #46: 7 of 9
- #47: 7 of 9
- #48: 7 of 9
- #49: Nuthin’
- #50: 8 of 9
- #51: 8 of 9
- #52: 8 of 9
- #53: 8 of 9
- #54: 8 of 9
- #55: 8 of 9
- #56: Nuthin’
- #57: 9 of 9
- #58: 9 of 9
- #59: 9 of 9
- #60: 9 of 9