Tom Freestone
                                Senior Developer
                        Brigham Young University


 June 10-15, 2012

Growing Community;
Growing Possibilities
   Define Usability
    ◦ What is and is not
      usability?
   Discuss the
    principles of user-
    centered design
   Designing and
    implementing a
    usability test


                           2012 Jasig Sakai Conference   2
   Not
    ◦ Not ascetics (e.g.
      Branding)
    ◦ Accessibility
   Is
    ◦ Helping users to
      figure out how to get
      what they need             You can't always get what you
                                  want
                                  But if you try sometimes well
                                  you just might find
                                  You get what you need
                                  (Rolling Stones – You Can’t Always Get What
                                  You Want)

                                                    2012 Jasig Sakai Conference   3
[1]                        [4][2]




      2012 Jasig Sakai Conference   4
2012 Jasig Sakai Conference   5
   Jj   JJ
         2012 Jasig Sakai Conference   6
   Something of both
    actual and
    perceived
    properties
             [3]




                        2012 Jasig Sakai Conference   7
   Gulf of Execution
    ◦ Describes the gap
      between user’s
      mental model for
      action and the means
      to execute the goal [4]
   Satisfice
    ◦ combining satisfy
      with suffice
    ◦ find the best option
      available [5]


                                2012 Jasig Sakai Conference   8
   Gulf of Evaluation                                      [5]

    ◦ Difficulty assessing
      the state of the
      system and how well
      the system supports
      the discovery and the
      interpretation of
      state [4]




                              2012 Jasig Sakai Conference         9
   2010 Social Networking
    ◦ 28 % of senior citizens use
      social networking
   2010 Internet
    ◦ 50 % of all Senior Citizens are
      online.
   2010 Cell Phones
    ◦ Senior Citizens less likely to
      send a text then their younger
      counterparts [6]

Reason
    ◦ The lack of intention to use
      computers is mainly driven by
      the perception that using
      computers is a difficult and
      complex task that requires a
      lot of effort to master [7]



                                        2012 Jasig Sakai Conference   10
   Users are :
    ◦ In a hurry and want
      to save time
    ◦ Don’t read, they scan
    ◦ Good at matching
      things to task at
      hand

    ◦ If the user thinks it is
      “too hard” they are
      not going to use it as
      often (if at all).


                 2012 Jasig Sakai Conference   11
   If you don’t know
    what your portal
    is then its users
    don’t have the
    time to figure it
    out for you

    ◦ You need a Tag
      Line              myBYU is your BYU core information, your
                        way.




                                                  2012 Jasig Sakai Conference   12
   What is the portal?
   What does the
    portal have?
   What can I do in the
    portal?
   Why am I in the
    portal (instead of
    somewhere else)?



                           2012 Jasig Sakai Conference   13
   Portal needs to tell
    me what it is and
    why I care

   Site Hierarchy

   Search




                           2012 Jasig Sakai Conference   14
   Portals are
    expensive real
    estate
    ◦ Everybody wants a
      piece
   Too many cooks to
    spoil the broth
   One size fits all




                          2012 Jasig Sakai Conference   15
   Focus Groups
                                                                                  ◦ Good sampling of users’
                                                                                    opinions
                                                                                  ◦ 5-10 people
                                                                                 Web Analytics
                                                                                  ◦ Numbers kill The Good
                                                                                    Idea Fairies *
                                                                                  ◦ Metrics
                                                                                      Browser Types/Resolutions
                                                                                      Bounce Rate
                                                                                      Repeat Visitors
                                                                                      Engagement
                                                                                 uPortal 4 Event
* An evil mythical creature that whispers advice and ideas without data
into the ears to leadership, causing hundreds unnecessary changes                 Tracking
and countless wasted man-hours every year.
[http://www.facebook.com/pages/The-Good-Idea-Fairymilitary/234595846556002]




                                                                                               2012 Jasig Sakai Conference   16
   It depends …
   myBYU
    ◦ Start-over
    ◦ Legacy system needed
      to retire
   Trade-offs
    ◦ User Stress   (Gulf of
                               Would you tell
     Execution)                me, please, which way I ought

    ◦ Break what works         to go from here?'
                               `That depends a good deal on
                               where you want to get to,'
   Soft Roll-out              said the Cat.
                               `I don't much care where--'
                               said Alice.
                               `Then it doesn't matter which
                               way you go,' said the Cat.
                               (Lewis Carroll. Alice’s
                               Adventures in Wonderland)

                                  2012 Jasig Sakai Conference   17
   Will Not
    ◦ Best Color Scheme
    ◦ Whether Users like
      tabs or pull-downs
    ◦ Which design is
      better than the other

   Will
    ◦ Will tell you if users
      can use your portal
    ◦ You may be surprised


                               2012 Jasig Sakai Conference   18
   Methodical, Iterative
    Process
    ◦ Scientific Method
        Ask a Question
        Background Research
        Hypothesis
        Experiment
        Record Observations
        Analyze Data
        Draw Conclusions
    ◦ Fair Test
      1 Variable Changing
   Good design is not
    random.


                   2012 Jasig Sakai Conference   19
   Set-up
    ◦   Computers
    ◦   Recording Software
    ◦   Microphones
    ◦   Cameras
    ◦   Test Staff
   Test Subjects
    ◦ 10-20 people
         Need to Pay Them
    ◦ Non-Disclosure
      Agreements



                             2012 Jasig Sakai Conference   20
   Test Administrator
    will ask subject to
    do a task(s)
   Typically, users will
    explain their
    actions while they
    complete the task
   Test(s) can be
    watched in an
    adjacent room

              2012 Jasig Sakai Conference   21
Design and Usability Center
             Bentley University
             http://usability.bentley.edu/eye-tracking
Scan Paths




                            Heat Maps




                                             2012 Jasig Sakai Conference   22
   Pros
    ◦ A professional is
      totally worth it.
   Cons
    ◦ Cost
    ◦ Of course, you need
      to have a lab.




                            2012 Jasig Sakai Conference   23
   Typical Setup
    ◦ Laptop
    ◦ Place
      Cubical/Conference
       Room
      Table at Student Union
       (with a bag of candy)
    ◦ A Good Listener
    ◦ Notepad
    ◦ Cameras (Overrated)



                2012 Jasig Sakai Conference   24
   Performance
    ◦ How long to complete
      task?
   Accuracy
    ◦ How many mistakes were
      made trying to complete
      task?
   Recall
    ◦ Does person remember
      task after a period of time?
   Stickiness
    ◦ How long does a person
      spend using UI?
   Emotional Response
    ◦ What is user’s mood while
      completing task?



                     2012 Jasig Sakai Conference   25
   Classic Card Sorting
    ◦ Setup
      3x5 cards with a set of                                    [6]

       things such as
       registration, HR, …
      Paper
    ◦ Task
      Have user put cards into
       a logical order by placing
       them on a piece of paper
       with a category

    ◦ Great for finding
      information hierarchy



                                    2012 Jasig Sakai Conference   26
   Trunk Test
    ◦ Steve Krug, Don’t Make
      Me Think [7]
   Task
    ◦ Print screenshot of
      portal
    ◦ Hold at screen shot at
      arms length
    ◦ Circle the answers to
      following questions:
        What is this?
        Where am I?
        How can I search?
        …



                               2012 Jasig Sakai Conference   27
   “Hall Testing”
   Set-up
    ◦ Laptop
    ◦ 3-4 Random Willing
      People

   Hall Testing
    assumes there will
    be lots of
    iterations.

                           2012 Jasig Sakai Conference   28
   Don’t skip usability
    testing because you
    don’t have
    resources

   Be Methodical

   Use a formal lab if
    you can


                           2012 Jasig Sakai Conference   29
   Understand what
    your portal is and is
    not.

   Users do not want
    to have think to use
    your portal




              2012 Jasig Sakai Conference   30
2012 Jasig Sakai Conference   31

More Related Content

PPTX
Apps storesandbrowsers
PPTX
Rapid deployment models for uPortal
PDF
Understanding your Audience Through Numbers
PPTX
Identity Management: Using OIDC to Empower the Next-Generation Apps
PPT
OAuth 2.0 & Security Considerations
PDF
認証技術、デジタルアイデンティティ技術の最新動向
PDF
Intro to API Security with Oauth 2.0
PPTX
Getting to Know the FIDO Specifications - Technical Tutorial
Apps storesandbrowsers
Rapid deployment models for uPortal
Understanding your Audience Through Numbers
Identity Management: Using OIDC to Empower the Next-Generation Apps
OAuth 2.0 & Security Considerations
認証技術、デジタルアイデンティティ技術の最新動向
Intro to API Security with Oauth 2.0
Getting to Know the FIDO Specifications - Technical Tutorial

Similar to 06-13-2012 Can anyone use our portal? (20)

PPTX
Effective models of Innovation Adoption in Higher Education
KEY
Induction Day 2010 Advice: Getting What You Came for in graduate school
PDF
iPersonas: Inclusive requirements for your personas
PPTX
Microsoft Garage - Accelerating Innovation
PDF
The Glass Class at AWE 2015
PDF
2012 Usability Conference
PDF
Introduction To Usability
PPTX
IxDA Chicago Mobile Site by Svetlin Denkov
PPTX
IxDA Chicago Mobile Site - Designing for Users...but Who Are They?
PDF
Web Usability July 2011
PPTX
Visual tools for the sp ia sp intersections - nov 2014
PDF
Irl Web Strategy
PDF
Get Smart: The Present and Future of Data Discovery
PPTX
Sps indy paradigm-final
PDF
BIAZA Customer-centric websites by Paul Randall
PPTX
Ux bootcamp small
KEY
IWE - Designing for everyone, anywhere, at anytime
PDF
Consumer Internet Lessons for Enterprise Product Managers
PPTX
Lead 705 ppt 5
PDF
Online Community Manager, Yes it's really a job 2010
Effective models of Innovation Adoption in Higher Education
Induction Day 2010 Advice: Getting What You Came for in graduate school
iPersonas: Inclusive requirements for your personas
Microsoft Garage - Accelerating Innovation
The Glass Class at AWE 2015
2012 Usability Conference
Introduction To Usability
IxDA Chicago Mobile Site by Svetlin Denkov
IxDA Chicago Mobile Site - Designing for Users...but Who Are They?
Web Usability July 2011
Visual tools for the sp ia sp intersections - nov 2014
Irl Web Strategy
Get Smart: The Present and Future of Data Discovery
Sps indy paradigm-final
BIAZA Customer-centric websites by Paul Randall
Ux bootcamp small
IWE - Designing for everyone, anywhere, at anytime
Consumer Internet Lessons for Enterprise Product Managers
Lead 705 ppt 5
Online Community Manager, Yes it's really a job 2010
Ad

Recently uploaded (20)

PPTX
Custom Battery Pack Design Considerations for Performance and Safety
PDF
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PPT
Module 1.ppt Iot fundamentals and Architecture
PPT
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
PPTX
Modernising the Digital Integration Hub
PDF
The influence of sentiment analysis in enhancing early warning system model f...
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PDF
CloudStack 4.21: First Look Webinar slides
PDF
Enhancing plagiarism detection using data pre-processing and machine learning...
PDF
“A New Era of 3D Sensing: Transforming Industries and Creating Opportunities,...
PDF
Getting started with AI Agents and Multi-Agent Systems
PPTX
Build Your First AI Agent with UiPath.pptx
PPTX
TEXTILE technology diploma scope and career opportunities
PPTX
2018-HIPAA-Renewal-Training for executives
PDF
Developing a website for English-speaking practice to English as a foreign la...
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PPT
What is a Computer? Input Devices /output devices
Custom Battery Pack Design Considerations for Performance and Safety
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
Final SEM Unit 1 for mit wpu at pune .pptx
Module 1.ppt Iot fundamentals and Architecture
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
Modernising the Digital Integration Hub
The influence of sentiment analysis in enhancing early warning system model f...
Taming the Chaos: How to Turn Unstructured Data into Decisions
CloudStack 4.21: First Look Webinar slides
Enhancing plagiarism detection using data pre-processing and machine learning...
“A New Era of 3D Sensing: Transforming Industries and Creating Opportunities,...
Getting started with AI Agents and Multi-Agent Systems
Build Your First AI Agent with UiPath.pptx
TEXTILE technology diploma scope and career opportunities
2018-HIPAA-Renewal-Training for executives
Developing a website for English-speaking practice to English as a foreign la...
Convolutional neural network based encoder-decoder for efficient real-time ob...
Consumable AI The What, Why & How for Small Teams.pdf
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
What is a Computer? Input Devices /output devices
Ad

06-13-2012 Can anyone use our portal?

  • 1. Tom Freestone Senior Developer Brigham Young University June 10-15, 2012 Growing Community; Growing Possibilities
  • 2. Define Usability ◦ What is and is not usability?  Discuss the principles of user- centered design  Designing and implementing a usability test 2012 Jasig Sakai Conference 2
  • 3. Not ◦ Not ascetics (e.g. Branding) ◦ Accessibility  Is ◦ Helping users to figure out how to get what they need  You can't always get what you want But if you try sometimes well you just might find You get what you need (Rolling Stones – You Can’t Always Get What You Want) 2012 Jasig Sakai Conference 3
  • 4. [1] [4][2] 2012 Jasig Sakai Conference 4
  • 5. 2012 Jasig Sakai Conference 5
  • 6. Jj JJ 2012 Jasig Sakai Conference 6
  • 7. Something of both actual and perceived properties [3] 2012 Jasig Sakai Conference 7
  • 8. Gulf of Execution ◦ Describes the gap between user’s mental model for action and the means to execute the goal [4]  Satisfice ◦ combining satisfy with suffice ◦ find the best option available [5] 2012 Jasig Sakai Conference 8
  • 9. Gulf of Evaluation [5] ◦ Difficulty assessing the state of the system and how well the system supports the discovery and the interpretation of state [4] 2012 Jasig Sakai Conference 9
  • 10. 2010 Social Networking ◦ 28 % of senior citizens use social networking  2010 Internet ◦ 50 % of all Senior Citizens are online.  2010 Cell Phones ◦ Senior Citizens less likely to send a text then their younger counterparts [6] Reason ◦ The lack of intention to use computers is mainly driven by the perception that using computers is a difficult and complex task that requires a lot of effort to master [7] 2012 Jasig Sakai Conference 10
  • 11. Users are : ◦ In a hurry and want to save time ◦ Don’t read, they scan ◦ Good at matching things to task at hand ◦ If the user thinks it is “too hard” they are not going to use it as often (if at all). 2012 Jasig Sakai Conference 11
  • 12. If you don’t know what your portal is then its users don’t have the time to figure it out for you ◦ You need a Tag Line myBYU is your BYU core information, your way. 2012 Jasig Sakai Conference 12
  • 13. What is the portal?  What does the portal have?  What can I do in the portal?  Why am I in the portal (instead of somewhere else)? 2012 Jasig Sakai Conference 13
  • 14. Portal needs to tell me what it is and why I care  Site Hierarchy  Search 2012 Jasig Sakai Conference 14
  • 15. Portals are expensive real estate ◦ Everybody wants a piece  Too many cooks to spoil the broth  One size fits all 2012 Jasig Sakai Conference 15
  • 16. Focus Groups ◦ Good sampling of users’ opinions ◦ 5-10 people  Web Analytics ◦ Numbers kill The Good Idea Fairies * ◦ Metrics  Browser Types/Resolutions  Bounce Rate  Repeat Visitors  Engagement  uPortal 4 Event * An evil mythical creature that whispers advice and ideas without data into the ears to leadership, causing hundreds unnecessary changes Tracking and countless wasted man-hours every year. [http://www.facebook.com/pages/The-Good-Idea-Fairymilitary/234595846556002] 2012 Jasig Sakai Conference 16
  • 17. It depends …  myBYU ◦ Start-over ◦ Legacy system needed to retire  Trade-offs ◦ User Stress (Gulf of Would you tell Execution) me, please, which way I ought ◦ Break what works to go from here?' `That depends a good deal on where you want to get to,'  Soft Roll-out said the Cat. `I don't much care where--' said Alice. `Then it doesn't matter which way you go,' said the Cat. (Lewis Carroll. Alice’s Adventures in Wonderland) 2012 Jasig Sakai Conference 17
  • 18. Will Not ◦ Best Color Scheme ◦ Whether Users like tabs or pull-downs ◦ Which design is better than the other  Will ◦ Will tell you if users can use your portal ◦ You may be surprised 2012 Jasig Sakai Conference 18
  • 19. Methodical, Iterative Process ◦ Scientific Method  Ask a Question  Background Research  Hypothesis  Experiment  Record Observations  Analyze Data  Draw Conclusions ◦ Fair Test  1 Variable Changing  Good design is not random. 2012 Jasig Sakai Conference 19
  • 20. Set-up ◦ Computers ◦ Recording Software ◦ Microphones ◦ Cameras ◦ Test Staff  Test Subjects ◦ 10-20 people  Need to Pay Them ◦ Non-Disclosure Agreements 2012 Jasig Sakai Conference 20
  • 21. Test Administrator will ask subject to do a task(s)  Typically, users will explain their actions while they complete the task  Test(s) can be watched in an adjacent room 2012 Jasig Sakai Conference 21
  • 22. Design and Usability Center Bentley University http://usability.bentley.edu/eye-tracking Scan Paths Heat Maps 2012 Jasig Sakai Conference 22
  • 23. Pros ◦ A professional is totally worth it.  Cons ◦ Cost ◦ Of course, you need to have a lab. 2012 Jasig Sakai Conference 23
  • 24. Typical Setup ◦ Laptop ◦ Place  Cubical/Conference Room  Table at Student Union (with a bag of candy) ◦ A Good Listener ◦ Notepad ◦ Cameras (Overrated) 2012 Jasig Sakai Conference 24
  • 25. Performance ◦ How long to complete task?  Accuracy ◦ How many mistakes were made trying to complete task?  Recall ◦ Does person remember task after a period of time?  Stickiness ◦ How long does a person spend using UI?  Emotional Response ◦ What is user’s mood while completing task? 2012 Jasig Sakai Conference 25
  • 26. Classic Card Sorting ◦ Setup  3x5 cards with a set of [6] things such as registration, HR, …  Paper ◦ Task  Have user put cards into a logical order by placing them on a piece of paper with a category ◦ Great for finding information hierarchy 2012 Jasig Sakai Conference 26
  • 27. Trunk Test ◦ Steve Krug, Don’t Make Me Think [7]  Task ◦ Print screenshot of portal ◦ Hold at screen shot at arms length ◦ Circle the answers to following questions:  What is this?  Where am I?  How can I search?  … 2012 Jasig Sakai Conference 27
  • 28. “Hall Testing”  Set-up ◦ Laptop ◦ 3-4 Random Willing People  Hall Testing assumes there will be lots of iterations. 2012 Jasig Sakai Conference 28
  • 29. Don’t skip usability testing because you don’t have resources  Be Methodical  Use a formal lab if you can 2012 Jasig Sakai Conference 29
  • 30. Understand what your portal is and is not.  Users do not want to have think to use your portal 2012 Jasig Sakai Conference 30
  • 31. 2012 Jasig Sakai Conference 31

Editor's Notes

  • #5: [1] M. Boer, "Honda Develops New Technology to Help Prevent Traffic Jams," Inhabitat, http://inhabitat.com/honda-develops-new-technology-to-help-prevent-traffic-jams/. [Accessed 6/8/2012][2] R. Leishman, “www.clipartOf.com”. [Accessed 6/8/2012]
  • #8: [3] D. Norman,  The Design of Everyday Things, Edition of book, New York, NY: Basic Books, Inc, 1988.
  • #9: [4] Simon, H. A. (1956). "Rational choice and the structure of the environment". Psychological Review, Vol. 63 No. 2, 129-138. (page 129: "Evidently, organisms adapt well enough to ‘satisfice’; they do not, in general, ‘optimize’."; page 136: "A ‘satisficing’ path, a path that will permit satisfaction at some specified level of all its needs."
  • #10: [5] Y. Nestoridis, " Windows 8 Hotkeys,"  , http://yorgonestoridis.com/windows-8/windows-8-hotkeys/. [Accessed 6/8/2012]
  • #11: [6] http://tommytoy.typepad.com/tommy-toy-pbt-consultin/2011/02/senior-citizens-slowly-adapt-to-the-digital-age-using-computers-and-cell-phones.html [Viewed 6/9/2012][7] Suntanto P. (2006). Senior Citizens Acceptance of Information Systems. IEE Transactions on Engineering Management
  • #27: [6] D. Spencer, T. Warfel, "Card sorting: a definitive guide ,"  Boxes and Arrows,http://www.boxesandarrows.com/view/card_sorting_a_definitive_guide. [Accessed 6/8/2012]
  • #28: [7] S. Krug, "Street Signs and Breadcrumbs," Don't Make Me Think, 2nd ed., Berkeley, CA: New Riders, p. 85-94, 2006.