SlideShare a Scribd company logo
Simple Usability Testing

Wayne Pau/Emerging Technologies (CD&SP)
Usability&&Testing
Anyone can do it. && Everyone should be doing it.
© 2014 SAP AG or an SAP affiliate company. All rights reserved.

2
Fast & Lightweight Usability Testing Experiment (FLUTE)
Fast & Lightweight Usability Testing Experiment (FLUTE)
AppStore && Google Play “Ratings”

4.5
1x

7x
What I don‟t know…
Donald A. Norman

Bill Buxton

VS
Everybody is a Designer!
“We are all designers – because we must be… We
manipulate the environment to better to serve our needs.” –
Norman (2004)

Not everybody is Designer!
“We are NOT all designers…a designer’s approach to creative
problem solving is very different from how computer scientist, for
example solve puzzles.” - Bill Buxton(2007)
Multivariate Testing (MVT)

Fitt‟s Law

10,000 Hours

Gaze Plot
Skeuomorphism
Index of Difficulty
Heuristic Evaluation
What I do know…
•

I can’t give you:
•
•
•
•

•

10,000 hrs of UX training (on top of your dev-tasks in 20 mins pres.)
UX Training & Experience that helps „Predict‟ User Intents, Reactions & Interactions
Discern who can or can‟t do „Design‟
Know if your specific „Design‟ will be „Effective‟

What I can give you:
•
•
•

„Method‟ to do „cheap & effective‟ Usability Testing
„Observe‟ User Intents, Reactions & Interactions *Much Easier to Do*
Provide an „Opportunities‟ for team to act on „User Feedback‟
// How to make Great Aps
if(User+Testing==TRUE)
{
Project =Great.Success();
}
Simple,
Cheap,
Effective

Usability&&Testing
© 2014 SAP AG or an SAP affiliate company. All rights reserved.

10
Camera
Monitor

Couch
© 2014 SAP AG or an SAP affiliate company. All rights reserved.

11
1. User (Bribe: 5x$5 Timmy‟s gift card)
2. Video Camera (FREE aka “Borrow”)
3. Room + Sofa (FREE aka “Borrow” again)

4. Snacks ($20 – also @ Timmy‟s)
Total $45/mth (effect == “priceless”)
Demo

YouTube Link
Real-Life SMD Usability Footage
Result (ie. small change)
// Test Every Sprint!
Usability

Usability

Usability

Test

start

Usability

Test

Test…

Test

ship

*Always* something to Test…
“The Perfect is the enemy
of Good”
- Voltaire
© 2014 SAP AG or an SAP affiliate company. All rights reserved.

16
User
Tested
App

Non- User
Tested
App
// How it ‘really’ happens

You.CARE(end.USER);
Fast & Lightweight Usability Testing Experiment (FLUTE)
Thank you
Contact information:

Wayne Pau [wayne.pau@sap.com]
Development Architect
Emerging Technologies (CD&SP)
(http://waynepau.blogspot.ca/)
© 2014 SAP AG or an SAP affiliate company. All rights reserved.

More Related Content

PDF
Democratizing Online Controlled Experiments at Booking.com - Lukas Vermeer
PPTX
Lean Launchpad - Week 3 - Experiment Day
PDF
Usability Testing | Sneak Peak
PDF
Guide Controlled Experiments
PPTX
MEMSI January 2018: DE2- What can you do for your customer? + DE 5 - Hypothes...
PDF
Lean Usability
PPTX
Lean Startup, Hardware Edition
PDF
UserZoom & UXPA Present a Webinar: Build a Better Experience
Democratizing Online Controlled Experiments at Booking.com - Lukas Vermeer
Lean Launchpad - Week 3 - Experiment Day
Usability Testing | Sneak Peak
Guide Controlled Experiments
MEMSI January 2018: DE2- What can you do for your customer? + DE 5 - Hypothes...
Lean Usability
Lean Startup, Hardware Edition
UserZoom & UXPA Present a Webinar: Build a Better Experience

What's hot (9)

PDF
User testing workshop
PPTX
Simplicity
PPTX
Building an MVP
PPTX
Blind Dates - Or the right choice of Test U sers
PDF
Front-end Culture @ Booking.com
PDF
Usability
PDF
Product management meet up post
PDF
ConnectIn Amsterdam 2014 - Beter beslissen met data - Booking.com & Netwerven
PPTX
Change three little things and create products that everybody likes - UX Indi...
User testing workshop
Simplicity
Building an MVP
Blind Dates - Or the right choice of Test U sers
Front-end Culture @ Booking.com
Usability
Product management meet up post
ConnectIn Amsterdam 2014 - Beter beslissen met data - Booking.com & Netwerven
Change three little things and create products that everybody likes - UX Indi...
Ad

Viewers also liked (13)

PPTX
Ux checklist
PPTX
UofT SMARTWEEK 2014 - UX + IoT
PPTX
Usability Testing: Targeting Mobile Devices
PPTX
A-Z of Content Marketing B is for Business
PPTX
Cdigotemplario 121226225155-phpapp01
PPS
Cueva de hang son doong
PPTX
Designing Mobile Apps with Empathy - Why to create more accessible Mobile Apps
PPTX
SAP Design Day 2016 (Montreal) - F.L.U.T.E.
PPTX
The A-Z of content marketing - A is for Audience
PPS
Islas griegas
PPTX
UofT Department of Computer Science Innovation Lab - Innovation & Team Building
PPTX
Next36 design thinking_intro_4x3_v2
PPTX
Design Thinking: User Empathy
Ux checklist
UofT SMARTWEEK 2014 - UX + IoT
Usability Testing: Targeting Mobile Devices
A-Z of Content Marketing B is for Business
Cdigotemplario 121226225155-phpapp01
Cueva de hang son doong
Designing Mobile Apps with Empathy - Why to create more accessible Mobile Apps
SAP Design Day 2016 (Montreal) - F.L.U.T.E.
The A-Z of content marketing - A is for Audience
Islas griegas
UofT Department of Computer Science Innovation Lab - Innovation & Team Building
Next36 design thinking_intro_4x3_v2
Design Thinking: User Empathy
Ad

Similar to Fast & Lightweight Usability Testing Experiment (FLUTE) (20)

PDF
Changing the game of user experience — refresh, renew, reimagine
PDF
Prototyping and Usability Testing your designs
PPTX
Hands on Usability Testing (Jonathan Rubin)
PDF
Understanding The Value Of User Research, Usability Testing, and Information ...
PPT
Changing the Game of SAP User Experience
 
PDF
10 Truths to Great Product Experiences
PDF
2012-11-26: Usability Testing As Validation
PDF
Designing for the 100%
PDF
Helping Your Company Adopt a User-Centered Process
PDF
SAP User experience strategy
PDF
Don’t Ask for Permission, Ask for Forgiveness (Thomas Schoerner Product Stream)
PDF
Why User Experience Matters 2009
PDF
Top Three Modern Product Trends
PPTX
Digital Transformation needs more than Technology
 
PDF
Designing Intuitive SharePoint Sites: The Science of "Easy to Use"
PDF
Get UX Help FlowChart
PPTX
Usability testing through the decades
PPTX
Simple Ways of Planning, Designing and Testing Usability of a Software Produc...
PPTX
THE LEAN UX - SUMMARY
PDF
Map quest 2015_denverstartupweek_spectrum
Changing the game of user experience — refresh, renew, reimagine
Prototyping and Usability Testing your designs
Hands on Usability Testing (Jonathan Rubin)
Understanding The Value Of User Research, Usability Testing, and Information ...
Changing the Game of SAP User Experience
 
10 Truths to Great Product Experiences
2012-11-26: Usability Testing As Validation
Designing for the 100%
Helping Your Company Adopt a User-Centered Process
SAP User experience strategy
Don’t Ask for Permission, Ask for Forgiveness (Thomas Schoerner Product Stream)
Why User Experience Matters 2009
Top Three Modern Product Trends
Digital Transformation needs more than Technology
 
Designing Intuitive SharePoint Sites: The Science of "Easy to Use"
Get UX Help FlowChart
Usability testing through the decades
Simple Ways of Planning, Designing and Testing Usability of a Software Produc...
THE LEAN UX - SUMMARY
Map quest 2015_denverstartupweek_spectrum

Recently uploaded (20)

PPTX
sap open course for s4hana steps from ECC to s4
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
Big Data Technologies - Introduction.pptx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
Cloud computing and distributed systems.
PDF
A comparative analysis of optical character recognition models for extracting...
PDF
cuic standard and advanced reporting.pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Machine Learning_overview_presentation.pptx
PDF
Empathic Computing: Creating Shared Understanding
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
sap open course for s4hana steps from ECC to s4
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Big Data Technologies - Introduction.pptx
“AI and Expert System Decision Support & Business Intelligence Systems”
Review of recent advances in non-invasive hemoglobin estimation
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Cloud computing and distributed systems.
A comparative analysis of optical character recognition models for extracting...
cuic standard and advanced reporting.pdf
Programs and apps: productivity, graphics, security and other tools
20250228 LYD VKU AI Blended-Learning.pptx
Machine Learning_overview_presentation.pptx
Empathic Computing: Creating Shared Understanding
Unlocking AI with Model Context Protocol (MCP)
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton

Fast & Lightweight Usability Testing Experiment (FLUTE)

  • 1. Simple Usability Testing Wayne Pau/Emerging Technologies (CD&SP)
  • 2. Usability&&Testing Anyone can do it. && Everyone should be doing it. © 2014 SAP AG or an SAP affiliate company. All rights reserved. 2
  • 5. AppStore && Google Play “Ratings” 4.5 1x 7x
  • 6. What I don‟t know… Donald A. Norman Bill Buxton VS Everybody is a Designer! “We are all designers – because we must be… We manipulate the environment to better to serve our needs.” – Norman (2004) Not everybody is Designer! “We are NOT all designers…a designer’s approach to creative problem solving is very different from how computer scientist, for example solve puzzles.” - Bill Buxton(2007)
  • 7. Multivariate Testing (MVT) Fitt‟s Law 10,000 Hours Gaze Plot Skeuomorphism Index of Difficulty Heuristic Evaluation
  • 8. What I do know… • I can’t give you: • • • • • 10,000 hrs of UX training (on top of your dev-tasks in 20 mins pres.) UX Training & Experience that helps „Predict‟ User Intents, Reactions & Interactions Discern who can or can‟t do „Design‟ Know if your specific „Design‟ will be „Effective‟ What I can give you: • • • „Method‟ to do „cheap & effective‟ Usability Testing „Observe‟ User Intents, Reactions & Interactions *Much Easier to Do* Provide an „Opportunities‟ for team to act on „User Feedback‟
  • 9. // How to make Great Aps if(User+Testing==TRUE) { Project =Great.Success(); }
  • 10. Simple, Cheap, Effective Usability&&Testing © 2014 SAP AG or an SAP affiliate company. All rights reserved. 10
  • 11. Camera Monitor Couch © 2014 SAP AG or an SAP affiliate company. All rights reserved. 11
  • 12. 1. User (Bribe: 5x$5 Timmy‟s gift card) 2. Video Camera (FREE aka “Borrow”) 3. Room + Sofa (FREE aka “Borrow” again) 4. Snacks ($20 – also @ Timmy‟s) Total $45/mth (effect == “priceless”)
  • 13. Demo YouTube Link Real-Life SMD Usability Footage
  • 14. Result (ie. small change)
  • 15. // Test Every Sprint! Usability Usability Usability Test start Usability Test Test… Test ship *Always* something to Test…
  • 16. “The Perfect is the enemy of Good” - Voltaire © 2014 SAP AG or an SAP affiliate company. All rights reserved. 16
  • 18. // How it ‘really’ happens You.CARE(end.USER);
  • 20. Thank you Contact information: Wayne Pau [wayne.pau@sap.com] Development Architect Emerging Technologies (CD&SP) (http://waynepau.blogspot.ca/) © 2014 SAP AG or an SAP affiliate company. All rights reserved.