SlideShare a Scribd company logo
Altered State of Consciousness:  Confessions of Instructional Designers  Who Conduct Usability Testing   Wachovia Human Resources – Michael Rukstelis & Yun Zhou
What’s in it for me? Steer “live” tests in three different phases Learn the key skills to apply to your job Hear about our test findings and lessons learned Receive helpful templates and tools Participate in interactive discussions
Designer vs. User What the user really needs What the designer thinks the user needs How the design looks to the user How the user thinks it is intended to work Source:  http://www.jroller.com/resources/behrangsa
Usability Testing Real end user engagement Representative prototype  “ Try out” or “Test drive” Design validation/improvement
Our Case Study A two-hour web-based training program that educates new managers at Wachovia Bank to: Identify situations that involve HR policies/assistance Locate, understand, and apply HR policies/assistance Recognize and address the challenges in applying policies Master a problem solving strategy
The Challenge How do you design a web-based training that has a high degree of complexity, while making the learning program as meaningful and as easy to use as possible?
You are in the driver seat! Put yourself in the role of the user. Be yourself and react to what you see. Think out loud  as you go  Be candid and critical Don't be concerned about getting it wrong!
First Prototype
First Prototype Analysis Visibility Feedback Predictability
First Test Findings Key Findings : The design interfered with the learning objectives. The problem-solving methodology was more important than originally conceived. Remedies : Improve visual appeal. Make more visible what users are expected of. Accentuate the problem-solving methodology through a more apparent learning sequence.
Second Prototype
Second Prototype Test Test Room Observer Room Mirror user facilitator observer
Second Test Findings Improved visual appeal and navigation Intuitive layout Unintuitive labels and metaphor Consequence: Users challenged the intended sequence, jumping around. Progress through the scenario slowed. Users became distracted, exhausted, and learned less.
Implications: The Two Lenses Ease of Use Ease of Learning  
Third Prototype
Third Test Findings   Clearer direction of users’ action More purpose to users’ reading Decreased distraction/guessing around Better focus on content Improved pace  Improved achievements of learning objectives  
What Have We Learned?
What Have We Learned? Why adopt usability practices to design e-Learning?   Bridges the gap between the designer and user Teaches us a common language with the user Increases the visibility of design Decreases unintended distraction 5.  Shapes the learning methodology
What Have We Learned? Usability testing engages your true end user. It is a powerful practice to help design and fine tune the e-learning program until it functions to support learning successfully.
Questions and Comments?
Thank You for Being Here!

More Related Content

PPTX
Using the Test Centre Tool: an opportunity to inform learning and teaching
PPT
Ettc Workshop Using A Prs System
PPTX
Predictive dashboard elements
PPT
YCSD teachers
PPT
Evaluation and usability - ACPET e Mentor session
PPTX
Presentation10
PPTX
QM Standards 1 & 7: Course Beginnings and Syllabi
PPTX
Designing, developing, and evaluating a real time student dashboard
Using the Test Centre Tool: an opportunity to inform learning and teaching
Ettc Workshop Using A Prs System
Predictive dashboard elements
YCSD teachers
Evaluation and usability - ACPET e Mentor session
Presentation10
QM Standards 1 & 7: Course Beginnings and Syllabi
Designing, developing, and evaluating a real time student dashboard

What's hot (19)

PPTX
QM Standards 2, 3, & 4: Objectives and Alignment
PPTX
Designing Authentic, Quality Assessments
PDF
Examining the effect of a real time student dashboard on student behavior and...
PPTX
M enabling assessment for learning presentation
PPT
How To Pass
 
PPS
How To Pass
 
PPTX
Jessica perry assignment3
PPTX
Assessment: Managing Tests, Projects, and Grade Center
PPT
Mulligan97 (1)
PPT
E Assessment Presentation Ver2 June 2008
PPTX
SMAR TPACK for Digital Learning Design
PPTX
Using real-time dashboards to improve student engagement in virtual learning ...
PPTX
Introduction to Module 7
PPT
Supporting Faculty in the Virtual Classroom
PPT
April 1 ppt preso ola
PDF
The RISE Framework: Using learning analytics for the continuous improvement o...
PPTX
Ideate : Generating Ideas/Selection
PPTX
Forward thinking feedback at UEA
PPT
Liane Bryson, Katie Hughes & James Towner Rhetoric & Writing
QM Standards 2, 3, & 4: Objectives and Alignment
Designing Authentic, Quality Assessments
Examining the effect of a real time student dashboard on student behavior and...
M enabling assessment for learning presentation
How To Pass
 
How To Pass
 
Jessica perry assignment3
Assessment: Managing Tests, Projects, and Grade Center
Mulligan97 (1)
E Assessment Presentation Ver2 June 2008
SMAR TPACK for Digital Learning Design
Using real-time dashboards to improve student engagement in virtual learning ...
Introduction to Module 7
Supporting Faculty in the Virtual Classroom
April 1 ppt preso ola
The RISE Framework: Using learning analytics for the continuous improvement o...
Ideate : Generating Ideas/Selection
Forward thinking feedback at UEA
Liane Bryson, Katie Hughes & James Towner Rhetoric & Writing
Ad

Viewers also liked (10)

PDF
Bimmer club
PPT
Ispi Presentation Script 920
PDF
Wp seidman 03
PDF
D1047 us compplanbook
PDF
Wp seidman 05
PDF
Wp seidman 02
PPTX
Геоинформационная платформа EverGIS
PDF
PDF
Wp seidman 07
PDF
Art 200807 chiropractic_products
Bimmer club
Ispi Presentation Script 920
Wp seidman 03
D1047 us compplanbook
Wp seidman 05
Wp seidman 02
Геоинформационная платформа EverGIS
Wp seidman 07
Art 200807 chiropractic_products
Ad

Similar to Ispi presentation script 920 (20)

PPTX
TajdgosvsuzkavsiandgakjxjndhsjsbsbsksnsP.pptx
PDF
Formative Evaluation for Educational Product Development
PDF
ilide.info-course-2-start-the-ux-design-process-pr_058625d4638e3a4266b4ff0085...
ODP
Usability
PPTX
Usability methods to improve EMRs
PDF
Session 1 Introduction to Instructional System Design.pdf
PPTX
ADDIE model of Instructional-Design.pptx
PPT
Tech. Writing Usability Presentation
PPTX
Usability
PPT
Usability Primer - for Alberta Municipal Webmasters Working Group
PDF
Guide to interactive assessments development services.pdf
PPTX
11 - Evaluating Framework in Interaction Design_new.pptx
PPT
Creating Assessments
PDF
Prototyping and Usability Testing your designs
PPS
User Research Techniques by Vikram Rao, RSA
PPTX
Training_and_Development_pptx.pptx
PPTX
Evaluation
PPTX
ADDIE- An Instructional Systems Design Model
PPT
25 march introducing design methods
PPT
25 march introducing design methods
TajdgosvsuzkavsiandgakjxjndhsjsbsbsksnsP.pptx
Formative Evaluation for Educational Product Development
ilide.info-course-2-start-the-ux-design-process-pr_058625d4638e3a4266b4ff0085...
Usability
Usability methods to improve EMRs
Session 1 Introduction to Instructional System Design.pdf
ADDIE model of Instructional-Design.pptx
Tech. Writing Usability Presentation
Usability
Usability Primer - for Alberta Municipal Webmasters Working Group
Guide to interactive assessments development services.pdf
11 - Evaluating Framework in Interaction Design_new.pptx
Creating Assessments
Prototyping and Usability Testing your designs
User Research Techniques by Vikram Rao, RSA
Training_and_Development_pptx.pptx
Evaluation
ADDIE- An Instructional Systems Design Model
25 march introducing design methods
25 march introducing design methods

Recently uploaded (20)

PDF
Facade & Landscape Lighting Techniques and Trends.pptx.pdf
PDF
Urban Design Final Project-Context
PDF
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
PPTX
Wisp Textiles: Where Comfort Meets Everyday Style
PPTX
Special finishes, classification and types, explanation
PPT
pump pump is a mechanism that is used to transfer a liquid from one place to ...
PPTX
Tenders & Contracts Works _ Services Afzal.pptx
PPT
EGWHermeneuticsffgggggggggggggggggggggggggggggggg.ppt
PPTX
AD Bungalow Case studies Sem 2.pptxvwewev
PPTX
DOC-20250430-WA0014._20250714_235747_0000.pptx
PPTX
12. Community Pharmacy and How to organize it
PPTX
Entrepreneur intro, origin, process, method
PDF
The Advantages of Working With a Design-Build Studio
PPTX
rapid fire quiz in your house is your india.pptx
DOCX
The story of the first moon landing.docx
PPTX
building Planning Overview for step wise design.pptx
PPTX
ANATOMY OF ANTERIOR CHAMBER ANGLE AND GONIOSCOPY.pptx
DOCX
actividad 20% informatica microsoft project
PDF
Key Trends in Website Development 2025 | B3AITS - Bow & 3 Arrows IT Solutions
PPT
UNIT I- Yarn, types, explanation, process
Facade & Landscape Lighting Techniques and Trends.pptx.pdf
Urban Design Final Project-Context
GREEN BUILDING MATERIALS FOR SUISTAINABLE ARCHITECTURE AND BUILDING STUDY
Wisp Textiles: Where Comfort Meets Everyday Style
Special finishes, classification and types, explanation
pump pump is a mechanism that is used to transfer a liquid from one place to ...
Tenders & Contracts Works _ Services Afzal.pptx
EGWHermeneuticsffgggggggggggggggggggggggggggggggg.ppt
AD Bungalow Case studies Sem 2.pptxvwewev
DOC-20250430-WA0014._20250714_235747_0000.pptx
12. Community Pharmacy and How to organize it
Entrepreneur intro, origin, process, method
The Advantages of Working With a Design-Build Studio
rapid fire quiz in your house is your india.pptx
The story of the first moon landing.docx
building Planning Overview for step wise design.pptx
ANATOMY OF ANTERIOR CHAMBER ANGLE AND GONIOSCOPY.pptx
actividad 20% informatica microsoft project
Key Trends in Website Development 2025 | B3AITS - Bow & 3 Arrows IT Solutions
UNIT I- Yarn, types, explanation, process

Ispi presentation script 920

  • 1. Altered State of Consciousness: Confessions of Instructional Designers Who Conduct Usability Testing Wachovia Human Resources – Michael Rukstelis & Yun Zhou
  • 2. What’s in it for me? Steer “live” tests in three different phases Learn the key skills to apply to your job Hear about our test findings and lessons learned Receive helpful templates and tools Participate in interactive discussions
  • 3. Designer vs. User What the user really needs What the designer thinks the user needs How the design looks to the user How the user thinks it is intended to work Source: http://www.jroller.com/resources/behrangsa
  • 4. Usability Testing Real end user engagement Representative prototype “ Try out” or “Test drive” Design validation/improvement
  • 5. Our Case Study A two-hour web-based training program that educates new managers at Wachovia Bank to: Identify situations that involve HR policies/assistance Locate, understand, and apply HR policies/assistance Recognize and address the challenges in applying policies Master a problem solving strategy
  • 6. The Challenge How do you design a web-based training that has a high degree of complexity, while making the learning program as meaningful and as easy to use as possible?
  • 7. You are in the driver seat! Put yourself in the role of the user. Be yourself and react to what you see. Think out loud as you go Be candid and critical Don't be concerned about getting it wrong!
  • 9. First Prototype Analysis Visibility Feedback Predictability
  • 10. First Test Findings Key Findings : The design interfered with the learning objectives. The problem-solving methodology was more important than originally conceived. Remedies : Improve visual appeal. Make more visible what users are expected of. Accentuate the problem-solving methodology through a more apparent learning sequence.
  • 12. Second Prototype Test Test Room Observer Room Mirror user facilitator observer
  • 13. Second Test Findings Improved visual appeal and navigation Intuitive layout Unintuitive labels and metaphor Consequence: Users challenged the intended sequence, jumping around. Progress through the scenario slowed. Users became distracted, exhausted, and learned less.
  • 14. Implications: The Two Lenses Ease of Use Ease of Learning  
  • 16. Third Test Findings   Clearer direction of users’ action More purpose to users’ reading Decreased distraction/guessing around Better focus on content Improved pace Improved achievements of learning objectives  
  • 17. What Have We Learned?
  • 18. What Have We Learned? Why adopt usability practices to design e-Learning?   Bridges the gap between the designer and user Teaches us a common language with the user Increases the visibility of design Decreases unintended distraction 5. Shapes the learning methodology
  • 19. What Have We Learned? Usability testing engages your true end user. It is a powerful practice to help design and fine tune the e-learning program until it functions to support learning successfully.
  • 21. Thank You for Being Here!