SlideShare a Scribd company logo
You will learn about . . . Conceptual framework  for Usability and . . . An inventory of methods and . . . Intro to user testing Usability –  Everyone wants it, everyone claims to have it, but just what is it?
Redengine Who Are We? Edmonton based company Operating since 1997 12 employees What We Like to Do. Web Design User Research and Testing Content Management Designing Web Based Applications
What is Usability? The technical definition: The ISO  defines usability as: “…the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use.”
Defining the Problem specified users: Who will use the system? specified goals: What tasks do they need to complete?  specified context: Where will they use the system?
The Elements of User Experience What is the purpose of this site / application? What functions will achieve these purposes? How will people move through these functions? How should these functions be presented? What visual style would best represent our brand? Diagram: Jesse James Garrett, Adaptive Path
Filling the Gap Website development needs to balance: business priorities functional requirements technical implementation Adapting a strong user-centered approach can achieve the balance.
Methods
Task Analysis Taskflows: Show users’ decision points Show when users will have to perform actions Suggest page order Show where menus, information and controls need to be included
 
Wire-frames Wire-frames are: A detailed view of the product, representing basic screen real estate Benefits: Fast and cheap A common language Easy to iterate Easy to test Retire risk at an earlier stage
 
 
 
User Testing User testing is: Task-based Observational One-on-one Designed to measure performance Benefits: Reveals how people actually use your system Helps to uncover usage patterns and break points
 
User Testing - Scope You can conduct informative user tests on: Existing site and applications HTML prototypes Redeveloped sites Wireframes and mockups Keep in mind: Restricted task movement when you have limited functioning paths
User Testing Preparation – 8 Steps Define the goals/concerns that are driving the test Determine the profile for the participants Recruit participants Select and organize tasks to test Create task scenarios Decide measures Prepare other materials Conduct a pilot and revise
1. Define the goals/concerns that are driving the test You can’t test everything Priority should be on Mission critical Common tasks Representative tasks Specific areas of concern Specific audiences
2. Determine Participant Profile You should already have audiences defined Use general research as input Segment Don’t fall into the “everybody” trap Intermediate University 26-40 Male P8 Intermediate Some college 55+ Male P7 Expert College 18-24 Female P6 Intermediate University 55+ Female  P5 Intermediate University 26-40 Female P4 Intermediate University 18-24 Male P3 Intermediate University 41-55 Male P2 Intermediate University 25-40 Male P1 Site Experience Education Age Gender
3. Recruit Participants Use research companies to recruit Invite through contests or surveys Community boards Try to schedule all participants within a narrow window of time
4. Select and Organize Tasks Usability test tasks should be derived from: Tasks that probe potential usability problems Tasks suggested by the concerns and experience of the design team Tasks that users will do with the end product Tasks should flow in the natural order in which users will do them. Tasks that are important to the evaluation should come early, as some participants may not finish all tasks.
5. Create Task Scenarios Should describe tasks in a way that takes some of the artificiality out of the test. A good scenario: Is short Is in the user’s words, not the product’s  Is unambiguous – so all participants will understand it Gives participants enough information to do the task Is directly linked to your tasks and concerns
5. Create Task Scenarios (example) You’re planning to build a new garage in the spring and you want to find out if you’ll need a permit and, if you do, how much the permit will cost. From the City home page find the information you need.  Do you need a permit to build a garage? Yes | No | Don’t know If yes, how much will it cost? _______________
6. Decide Measures Quantitative: Time to finish a task Time spent recovering from errors Number of wrong menu choices Number of errors Observations of frustration, confusion, or satisfaction Subjective: Measures may be either quantitative or qualitative
6. Measures  (example) 3.5 0 50% 50% Rate Fail Part Pass Youth (18 - 25) 4.0 0 100% 0 Rate Fail Part Pass Seniors (55+) 2.5 0 50% 50% Rate Fail Part Pass Target Audience (26 – 54) 3.1 Average Task Rating 1 Average Errors 4.9 Average Clicks 2:46 Average Time 0 Fail 63% Partial 38% Pass
7. Prepare Other Materials Legal form – informed consent for the test / nondisclosure agreement / waivers for the use questionnaires Questionnaires – pretest / post-task / post-test Training scripts – to ensure that all participants have the same level of knowledge before they begin the tasks
8. Pilot and Revise Will help you: Revise test materials and procedure Flush out “functions” that need to be enabled on prototypes Confirm length of test
User Testing - Conducting Environment should be representative Ideally use the same tester for every participant Observation, not guidance Record notes quickly after test Stopwatch, video camera, click tracker are all considerations
Can be informal or  formal Should include recommendations/solutions User Testing - Reporting While none of the test participants completely failed in this task, only three of eight were able to find both the permit application form and the fee information. Five of the 8 either failed to find any fee information, or found incorrect information. This task reveals an instance of poor content grouping. If a person is planning to build a garage they should be able to get all permit-related information in one location.  Illustration 13 demonstrates a possible approach to content grouping.
Value – Mitigate Risks 50–70% of IT projects fail to deliver expected results. According to a Standish Group study 4 of the top 10 reasons IT projects fail are directly related to poor user design. #1. Incomplete Requirements – 13.1% #2. Lack of user involvement  – 12.4% #4. Unrealistic expectations  – 9.9% #6. Changing requirements  – 8.7%   TOTAL = 44.1%
Value – The Benefits Reduced development time Iteration on simple mockups More complete picture before development begin Usage savings Fewer user errors Less training, support and documentation is required Higher adoption  Improve the quality of life  Users are more satisfied
Maximize Your Business Case
Answers and Qustions Norman Mendoza, President Redengine Inc. [email_address]   Skype or Messenger Toll Free 1.877.837.5087

More Related Content

PPT
Design for User Experience
PDF
Usability Testing and QA 12 11-15
PDF
UX Prototyping and Personas 4-25-14
PPTX
hcid2011 - Practial Tips for Designing for Inclusive UX: Kath Moonan
PPTX
UX design & redesign
PPT
Remote Usability Testing
PPTX
Usability testing tips for UX Designers
PDF
Remote usability testing and remote user research for usability
Design for User Experience
Usability Testing and QA 12 11-15
UX Prototyping and Personas 4-25-14
hcid2011 - Practial Tips for Designing for Inclusive UX: Kath Moonan
UX design & redesign
Remote Usability Testing
Usability testing tips for UX Designers
Remote usability testing and remote user research for usability

What's hot (20)

PPT
Eye tracking in usability studies
PDF
Usability Testing by Rajdeep Gupta, Misys
PDF
Usability Testing 101 - an introduction
PPTX
Usability of web application
PDF
Remote Usability Testing
PPT
Usability Engineering General guidelines
PPTX
Megan McKeever - design
PDF
Web Usability: Making Your Sites More Awesomer
PDF
Prototyping and Usability Testing your designs
PDF
Lean Usability
PPT
Patterns Revisited
PPTX
Micro Feedback – Maximum Insights? UX Camp Europe 2015, Berlin, #uxce15
PPTX
UXPA2019 Building Your Benchmark: How to Measure UX for Product Impact Over Time
PDF
Ajp preso 4
PPT
Ux research for_startups
PDF
Usability Testing and QA 10-3-14
PPTX
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
PPT
Hilton Pilot Results
PPTX
Usability for all budgets
KEY
Usability - what is it & why is it important
Eye tracking in usability studies
Usability Testing by Rajdeep Gupta, Misys
Usability Testing 101 - an introduction
Usability of web application
Remote Usability Testing
Usability Engineering General guidelines
Megan McKeever - design
Web Usability: Making Your Sites More Awesomer
Prototyping and Usability Testing your designs
Lean Usability
Patterns Revisited
Micro Feedback – Maximum Insights? UX Camp Europe 2015, Berlin, #uxce15
UXPA2019 Building Your Benchmark: How to Measure UX for Product Impact Over Time
Ajp preso 4
Ux research for_startups
Usability Testing and QA 10-3-14
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
Hilton Pilot Results
Usability for all budgets
Usability - what is it & why is it important
Ad

Viewers also liked (14)

PPS
Arquitectura
PPT
How to... Facebook Fan Page (configuración)
TXT
гительманн
PDF
William Resume.
PDF
15 Rules for Success
PDF
Artslide6
PDF
Artslide2
PDF
Artslide8
PDF
Artslide1
PPS
Fotos chocantes
PPT
Ogilvy & Mather
PPT
Estatística dos Inquéritos
DOC
Avaliação nutricional
Arquitectura
How to... Facebook Fan Page (configuración)
гительманн
William Resume.
15 Rules for Success
Artslide6
Artslide2
Artslide8
Artslide1
Fotos chocantes
Ogilvy & Mather
Estatística dos Inquéritos
Avaliação nutricional
Ad

Similar to Usability Primer - for Alberta Municipal Webmasters Working Group (20)

PPT
How to do usability testing and eye tracking
PPT
Intranet Usability Testing
PDF
How User Testing Can Inform Content - 03/19/12 Content Strategy - Minneapolis...
PPT
Usability Testing Options
PDF
DrupalCon Austin: UX Bootcamp workshop
PDF
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
PDF
Understanding The Value Of User Research, Usability Testing, and Information ...
PPT
Beginners QA Testing
PPT
From a technical writer to a usability engineer
PPTX
體驗劇場_1050524_W14_易用性測試_楊政達
PDF
Usability Testing and QA 7-18-14
PDF
Uxpin guide to_usability_testing
PDF
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...
PPTX
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
PDF
Getting Started With User Research, Presented at Agile2010
PPTX
Intro to Lean UX with UserTesting
PPTX
L7 Usability testing lecture of usability
PDF
UCD & Usability testing at the St. Augustine Campus
PDF
UCD and Usability Testing (2007)
How to do usability testing and eye tracking
Intranet Usability Testing
How User Testing Can Inform Content - 03/19/12 Content Strategy - Minneapolis...
Usability Testing Options
DrupalCon Austin: UX Bootcamp workshop
Denver Startup Week 2019: Choosing a Direction Learning How to Test Ideas and...
Understanding The Value Of User Research, Usability Testing, and Information ...
Beginners QA Testing
From a technical writer to a usability engineer
體驗劇場_1050524_W14_易用性測試_楊政達
Usability Testing and QA 7-18-14
Uxpin guide to_usability_testing
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Getting Started With User Research, Presented at Agile2010
Intro to Lean UX with UserTesting
L7 Usability testing lecture of usability
UCD & Usability testing at the St. Augustine Campus
UCD and Usability Testing (2007)

Recently uploaded (20)

PPTX
EABDM Slides for Indifference curve.pptx
PPT
E commerce busin and some important issues
PDF
Understanding University Research Expenditures (1)_compressed.pdf
PPTX
Who’s winning the race to be the world’s first trillionaire.pptx
PDF
Predicting Customer Bankruptcy Using Machine Learning Algorithm research pape...
PDF
Spending, Allocation Choices, and Aging THROUGH Retirement. Are all of these ...
PDF
Bladex Earnings Call Presentation 2Q2025
PDF
Q2 2025 :Lundin Gold Conference Call Presentation_Final.pdf
PPTX
The discussion on the Economic in transportation .pptx
PDF
Why Ignoring Passive Income for Retirees Could Cost You Big.pdf
PDF
discourse-2025-02-building-a-trillion-dollar-dream.pdf
PPTX
Introduction to Essence of Indian traditional knowledge.pptx
PPTX
4.5.1 Financial Governance_Appropriation & Finance.pptx
PDF
financing insitute rbi nabard adb imf world bank insurance and credit gurantee
PDF
Topic Globalisation and Lifelines of National Economy.pdf
PPTX
fastest_growing_sectors_in_india_2025.pptx
PDF
how_to_earn_50k_monthly_investment_guide.pdf
PDF
Dr Tran Quoc Bao the first Vietnamese speaker at GITEX DigiHealth Conference ...
PDF
NAPF_RESPONSE_TO_THE_PENSIONS_COMMISSION_8 _2_.pdf
PDF
ABriefOverviewComparisonUCP600_ISP8_URDG_758.pdf
EABDM Slides for Indifference curve.pptx
E commerce busin and some important issues
Understanding University Research Expenditures (1)_compressed.pdf
Who’s winning the race to be the world’s first trillionaire.pptx
Predicting Customer Bankruptcy Using Machine Learning Algorithm research pape...
Spending, Allocation Choices, and Aging THROUGH Retirement. Are all of these ...
Bladex Earnings Call Presentation 2Q2025
Q2 2025 :Lundin Gold Conference Call Presentation_Final.pdf
The discussion on the Economic in transportation .pptx
Why Ignoring Passive Income for Retirees Could Cost You Big.pdf
discourse-2025-02-building-a-trillion-dollar-dream.pdf
Introduction to Essence of Indian traditional knowledge.pptx
4.5.1 Financial Governance_Appropriation & Finance.pptx
financing insitute rbi nabard adb imf world bank insurance and credit gurantee
Topic Globalisation and Lifelines of National Economy.pdf
fastest_growing_sectors_in_india_2025.pptx
how_to_earn_50k_monthly_investment_guide.pdf
Dr Tran Quoc Bao the first Vietnamese speaker at GITEX DigiHealth Conference ...
NAPF_RESPONSE_TO_THE_PENSIONS_COMMISSION_8 _2_.pdf
ABriefOverviewComparisonUCP600_ISP8_URDG_758.pdf

Usability Primer - for Alberta Municipal Webmasters Working Group

  • 1. You will learn about . . . Conceptual framework for Usability and . . . An inventory of methods and . . . Intro to user testing Usability – Everyone wants it, everyone claims to have it, but just what is it?
  • 2. Redengine Who Are We? Edmonton based company Operating since 1997 12 employees What We Like to Do. Web Design User Research and Testing Content Management Designing Web Based Applications
  • 3. What is Usability? The technical definition: The ISO defines usability as: “…the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use.”
  • 4. Defining the Problem specified users: Who will use the system? specified goals: What tasks do they need to complete? specified context: Where will they use the system?
  • 5. The Elements of User Experience What is the purpose of this site / application? What functions will achieve these purposes? How will people move through these functions? How should these functions be presented? What visual style would best represent our brand? Diagram: Jesse James Garrett, Adaptive Path
  • 6. Filling the Gap Website development needs to balance: business priorities functional requirements technical implementation Adapting a strong user-centered approach can achieve the balance.
  • 8. Task Analysis Taskflows: Show users’ decision points Show when users will have to perform actions Suggest page order Show where menus, information and controls need to be included
  • 9.  
  • 10. Wire-frames Wire-frames are: A detailed view of the product, representing basic screen real estate Benefits: Fast and cheap A common language Easy to iterate Easy to test Retire risk at an earlier stage
  • 11.  
  • 12.  
  • 13.  
  • 14. User Testing User testing is: Task-based Observational One-on-one Designed to measure performance Benefits: Reveals how people actually use your system Helps to uncover usage patterns and break points
  • 15.  
  • 16. User Testing - Scope You can conduct informative user tests on: Existing site and applications HTML prototypes Redeveloped sites Wireframes and mockups Keep in mind: Restricted task movement when you have limited functioning paths
  • 17. User Testing Preparation – 8 Steps Define the goals/concerns that are driving the test Determine the profile for the participants Recruit participants Select and organize tasks to test Create task scenarios Decide measures Prepare other materials Conduct a pilot and revise
  • 18. 1. Define the goals/concerns that are driving the test You can’t test everything Priority should be on Mission critical Common tasks Representative tasks Specific areas of concern Specific audiences
  • 19. 2. Determine Participant Profile You should already have audiences defined Use general research as input Segment Don’t fall into the “everybody” trap Intermediate University 26-40 Male P8 Intermediate Some college 55+ Male P7 Expert College 18-24 Female P6 Intermediate University 55+ Female P5 Intermediate University 26-40 Female P4 Intermediate University 18-24 Male P3 Intermediate University 41-55 Male P2 Intermediate University 25-40 Male P1 Site Experience Education Age Gender
  • 20. 3. Recruit Participants Use research companies to recruit Invite through contests or surveys Community boards Try to schedule all participants within a narrow window of time
  • 21. 4. Select and Organize Tasks Usability test tasks should be derived from: Tasks that probe potential usability problems Tasks suggested by the concerns and experience of the design team Tasks that users will do with the end product Tasks should flow in the natural order in which users will do them. Tasks that are important to the evaluation should come early, as some participants may not finish all tasks.
  • 22. 5. Create Task Scenarios Should describe tasks in a way that takes some of the artificiality out of the test. A good scenario: Is short Is in the user’s words, not the product’s Is unambiguous – so all participants will understand it Gives participants enough information to do the task Is directly linked to your tasks and concerns
  • 23. 5. Create Task Scenarios (example) You’re planning to build a new garage in the spring and you want to find out if you’ll need a permit and, if you do, how much the permit will cost. From the City home page find the information you need. Do you need a permit to build a garage? Yes | No | Don’t know If yes, how much will it cost? _______________
  • 24. 6. Decide Measures Quantitative: Time to finish a task Time spent recovering from errors Number of wrong menu choices Number of errors Observations of frustration, confusion, or satisfaction Subjective: Measures may be either quantitative or qualitative
  • 25. 6. Measures (example) 3.5 0 50% 50% Rate Fail Part Pass Youth (18 - 25) 4.0 0 100% 0 Rate Fail Part Pass Seniors (55+) 2.5 0 50% 50% Rate Fail Part Pass Target Audience (26 – 54) 3.1 Average Task Rating 1 Average Errors 4.9 Average Clicks 2:46 Average Time 0 Fail 63% Partial 38% Pass
  • 26. 7. Prepare Other Materials Legal form – informed consent for the test / nondisclosure agreement / waivers for the use questionnaires Questionnaires – pretest / post-task / post-test Training scripts – to ensure that all participants have the same level of knowledge before they begin the tasks
  • 27. 8. Pilot and Revise Will help you: Revise test materials and procedure Flush out “functions” that need to be enabled on prototypes Confirm length of test
  • 28. User Testing - Conducting Environment should be representative Ideally use the same tester for every participant Observation, not guidance Record notes quickly after test Stopwatch, video camera, click tracker are all considerations
  • 29. Can be informal or formal Should include recommendations/solutions User Testing - Reporting While none of the test participants completely failed in this task, only three of eight were able to find both the permit application form and the fee information. Five of the 8 either failed to find any fee information, or found incorrect information. This task reveals an instance of poor content grouping. If a person is planning to build a garage they should be able to get all permit-related information in one location. Illustration 13 demonstrates a possible approach to content grouping.
  • 30. Value – Mitigate Risks 50–70% of IT projects fail to deliver expected results. According to a Standish Group study 4 of the top 10 reasons IT projects fail are directly related to poor user design. #1. Incomplete Requirements – 13.1% #2. Lack of user involvement – 12.4% #4. Unrealistic expectations – 9.9% #6. Changing requirements – 8.7% TOTAL = 44.1%
  • 31. Value – The Benefits Reduced development time Iteration on simple mockups More complete picture before development begin Usage savings Fewer user errors Less training, support and documentation is required Higher adoption Improve the quality of life Users are more satisfied
  • 33. Answers and Qustions Norman Mendoza, President Redengine Inc. [email_address] Skype or Messenger Toll Free 1.877.837.5087

Editor's Notes

  • #2: - The technologies that are enabling this change The cultural “snowball” that Is feeding this change After a period of relative stability, the web is beginning to innovate again. The long-awaited promise of social networking, media convergence, and demo-cratization of the web is now being enabled because of mature technology and usage. Web 2.0 collectively refers to technologies like blogs, podcasts, wikis, RSS, tagging, and much more. However, Web 2.0 is also a “gloves-off rethink” about how people and systems interact. This presentation discusses Web 2.0 trends and what action you need to take to upgrade your site.