SlideShare a Scribd company logo

Navigating a 3D Avatar using a Single Switch

Eelke Folmer, profile picture
Eelke Folmer

The document describes research into navigating a 3D avatar using a single switch input. It discusses challenges people with disabilities face in gaming due to limited control inputs. The researchers aim to develop a more efficient scanning system to generate continuous and mixed inputs for avatar navigation using a single switch. They describe different scanning techniques and parameters to evaluate in a simulator, such as switch control type, inclusion of mixed inputs, dwell time, and selection set ordering.

TechnologyEducation
Related topics:
virtual-worlds
1 of 57
Download to read offline
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
Navigating a 3D Avatar using a Single Switch Eelke Folmer, Fangzhou Liu, Barrie Ellis - FDG’11, Bordeaux Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Interaction ★2D ★3D ★Text ★Visual Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Users with Disabilities “ The eiffel tower was built in ...” Screen reader Assistive Technology Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
“Gamers” with Disabilities “ ...........” Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Severe Motor Impairments Quadriplegics one handed eye tracker quad controller switch controller Player Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Adapted Controllers 1 analog ? 2-5 analog more 13 buttons 5-7 binary Ability mapping 1 analog less 1 binary Human Computer Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Switch Controller jellybean sip/puff pinch Severe Motor/Cognitive impairments Sturdy / Cheap No calibration / easy to use Binary input (on/off) Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Input Reduction ? Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Input Reduction ? Automate Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Input Reduction ? Automate Remove Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Input Reduction ? Automate Remove Scanning Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Scanning 101 scanning rate A B C Selection Set Input generated Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Scanning 101 09 scanning rate A B C C Selection Set Activate Input generated Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Scanning Pattern A E B A B C D E F G C G H I F D E Cartesian Polar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Scanning Pattern A E B A B C D E F G C G H I F D E Cartesian Polar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Scanning Pattern A E B A B C D E F G C G H I F D E Cartesian Polar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Scanning Control hold to scan A B C Not always possible Unable to hold switch (Arthritis) Sip and puff Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Scanning Control release to select A B C C Not always possible Unable to hold switch (Arthritis) Sip and puff Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Discrete Selections Text Entry H E L L O Web Navigation Menu Navigation Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Avatar Navigation 400ms 600ms 600ms 800ms Selection set [FORWARD,LEFT,RIGHT,BACK] Types of input: Continuous [FORWARD] for 300ms Mixed [FORWARD + TURN RIGHT] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate [Forward] [Forward] [Forward] 100 ms 3 switch activations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate [Forward] 200 ms 1 switch activations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate [Forward] 200 ms 1 switch activations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Mixed Inputs Approximation [Forward+Le1] 200 ms Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Mixed Inputs Approximation [Forward+Le1] 200 ms [Forward] [Le1] 200 ms 2 SA Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Mixed Inputs Approximation [Forward+Le1] 200 ms [Forward] [Le1] 200 ms 2 SA [Forward] [Le1] [Forward] [Le1] 100 ms 4 SA Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Navigating an avatar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Navigating an avatar [Forward] [Le1] [Forward] [Le1] [Forward] [Right] [Forward] [Forward] [Forward] [Right] [Right] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Navigating an avatar Slow Cumbersome Unnatural [Forward] [Le1] [Forward] [Le1] [Forward] [Right] [Forward] [Forward] [Forward] [Right] [Right] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Research Question Can we develop a more efficient scanning system that can generate continuous and mixed inputs? Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Improved Scanning Control Continuous input [Forward] Discrete [Forward] [Forward] [Forward] [Forward] hold release hold and release [Forward] less efficient more efficient Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Generating Mixed Inputs ★Extending selection set [Forward, Le%, Right, Back, Forward+Right, Forward+Le%, Back +Le%, Back+Right] [Forward+Le1] ★Multistep selection [Forward, Le%, Right, Back] dynamically generated [Forward] [Cancel, Le%, Right] [Le1] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Selection set order [Forward] [Forward, Le%, Right, Back] cost RT [Back, Le%, Right, Forward] wait wait wait 3SR+RT More frequently used inputs should be at the front of the selection set Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Parameters to Compare control Discrete vs Hold and Release 2 mixing Extension vs Multistep dia 100,200....1,000 ms 10 selection [Forward, Le%, Right, Back] 24 sets [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Parameters to Compare control Discrete vs Hold and Release 2 mixing Extension vs Multistep dia 100,200....1,000 ms 10 ~400k selection [Forward, Le%, Right, Back] 24 sets [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Characterizing Avatar Navigation Forward 873 Forward+Left 220 Left 293 Left+Forward 167 Forward 675 Second Life Key Logger 8 Able bodied users Focus on grounded navigation Navigated in SL Environment for 8 minute Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Keystroke frequency be the Table 1: Characteristics of Avatar Navigation. rearran Input Single Multi Total Time of occu FORWARD 74.9 - 46.8 79.4 RIGHT 10.6 - 6.6 6.1 LEFT 12.7 - 8.0 7.0 4.4 BACK 1.9 - 1.2 1.8 Adding FORWARD+RIGHT - 46.7 17.5 10.3 facilita FORWARD+LEFT - 52.4 19.6 8.9 BACK+RIGHT - 0.5 0.19 0.12 1. E se BACK+LEFT - 0.5 0.19 0.21 total 100% 100% 100% 100% 2. M F key that is held the longest (86.92% of single & multi) of the 4,300 keystrokes totalLEFT are used m total time participants held keys. RIGHT and Single: 62.6% comprise 46.21% and ca less frequently in single strokes but Multi: 37.4% 52.71% of multistrokes. This confirms our assumption that Each s multistrokes are primarily used to adjust the course of an Player-Game Interaction Research ciency avatar. BACK is rarely used. We consider the collected data Reno University of Nevada, to be representative of 3D navigation behavior in general to scan Thursday, June 30, 2011
keystroke length min: 26ms max: 30,606ms average: 804 ms (δ=1,404)   Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Parameters to Compare update control Discrete vs Hold and Release 2 mixing Extension vs Multistep 40 dia 25, 50,....1,000 ms selection [Forward, Le%, Right, Back] 7 sets total 24 sets [Forward, Le%, Right, Back, 120 Forward+Right, Forward + Le%] [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Parameters to Compare update control Discrete vs Hold and Release 2 mixing Extension vs Multistep 40 dia 25, 50,....1,000 ms selection [Forward, Le%, Right, Back] 7 sets total 24 ~3.3 M sets [Forward, Le%, Right, Back, 120 Forward+Right, Forward + Le%] [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Simulator Simulator Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Simulator keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Simulator keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 [Forward, Le1, Right, Back] selection sets Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Simulator keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Simulator 25<i<1,000, i+=25 dia keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Simulator 25<i<1,000, i+=25 dia keystrokes Forward 873 average per stroke: Forward+Left 220 ★time (ms) Left 293 Simulator ★switch activations Left+Forward 167 Forward 675 ★error (ms) [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Simulator 25<i<1,000, i+=25 SR = 1,000ms dia RT = 650ms keystrokes Forward 873 average per stroke: Forward+Left 220 ★time (ms) Left 293 Simulator ★switch activations Left+Forward 167 Forward 675 ★error (ms) [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Results Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Results Discrete Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Results Hold and release approximates keystrokes the best. H&R [Multistep] Significantly faster p<.01 »time: 1,539 ms per stroke »error: 122 ms (~35 cm) H&R 2.4x slower than keyboard Discrete [Extended] »time: 3,442 ms per stroke »error: 114 ms (~32 cm) H&R [Extended] Significant fewer errors p<.01 »time: 2,444 ms per stroke »error: 0 ms Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Demo / Implementation Human Computer Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Limitations User error modeling is limited assume user has perfect timing skills »selection accuracy >90% but not 100% correction may be difficult --> extended set model error using Bayesian noise & error correction strategies. switch users may develop different behavior -- >remove [Back] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Future Work Other VW functions »Object interaction User studies with switch users Real time response environments (FPS/ Racing game) Hold and Release integrated in console OS as HUD Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Questions Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
Questions ? Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011

More Related Content

PPT
Supplemental sonification of bingo
Eelke Folmer
 
KEY
Spatial Gestures using a Tactile-Proprioceptive Display
Eelke Folmer
 
KEY
Textsl: a screen reader accessible virtual world client for second life
Eelke Folmer
 
PPTX
Pet n-punch
Eelke Folmer
 
PDF
SEEK-N-TAG: A Game for Labeling and Classifying Virtual World Objects
Eelke Folmer
 
PPTX
syntherella feedback synthesizer
Eelke Folmer
 
PPT
VI-Tennis: a Vibrotactile/Audio Exergame for Players who are Visually Impaired
Eelke Folmer
 
PDF
Real-time Sensory Substitution to Enable Players who are Blind to Play Video ...
Eelke Folmer
 
Supplemental sonification of bingo
Eelke Folmer
 
Spatial Gestures using a Tactile-Proprioceptive Display
Eelke Folmer
 
Textsl: a screen reader accessible virtual world client for second life
Eelke Folmer
 
Pet n-punch
Eelke Folmer
 
SEEK-N-TAG: A Game for Labeling and Classifying Virtual World Objects
Eelke Folmer
 
syntherella feedback synthesizer
Eelke Folmer
 
VI-Tennis: a Vibrotactile/Audio Exergame for Players who are Visually Impaired
Eelke Folmer
 
Real-time Sensory Substitution to Enable Players who are Blind to Play Video ...
Eelke Folmer
 

Recently uploaded (20)

PPTX
TLE Review Electricity (Electricity).pptx
JayPolicarpio2
 
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
KodekX
 
PPTX
cloud_computing_Infrastucture_as_cloud_p
mainakbhattacharya20
 
PDF
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
PDF
A comparative analysis of optical character recognition models for extracting...
IAESIJAI
 
PDF
DP Operators-handbook-extract for the Mautical Institute
LeonelMejiaLarios
 
PDF
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
SandeepSingh286037
 
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
SandeepSingh286037
 
PDF
A novel scalable deep ensemble learning framework for big data classification...
IAESIJAI
 
PPTX
OMC Textile Division Presentation 2021.pptx
JahangirAlam816069
 
PPTX
A Presentation on Touch Screen Technology
memembruh336
 
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
PDF
Encapsulation theory and applications.pdf
gurumoop
 
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
PPTX
SOPHOS-XG Firewall Administrator PPT.pptx
AgnesMunisi
 
PPTX
A Presentation on Artificial Intelligence
memembruh336
 
PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Microsoft Dynamics
 
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
MatthewLewis227954
 
PDF
A comparative study of natural language inference in Swahili using monolingua...
IAESIJAI
 
TLE Review Electricity (Electricity).pptx
JayPolicarpio2
 
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
KodekX
 
cloud_computing_Infrastucture_as_cloud_p
mainakbhattacharya20
 
MIND Revenue Release Quarter 2 2025 Press Release
MIND CTI
 
A comparative analysis of optical character recognition models for extracting...
IAESIJAI
 
DP Operators-handbook-extract for the Mautical Institute
LeonelMejiaLarios
 
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
Agricultural_Statistics_at_a_Glance_2022_0.pdf
SandeepSingh286037
 
Building Integrated photovoltaic BIPV_UPV.pdf
SandeepSingh286037
 
A novel scalable deep ensemble learning framework for big data classification...
IAESIJAI
 
OMC Textile Division Presentation 2021.pptx
JahangirAlam816069
 
A Presentation on Touch Screen Technology
memembruh336
 
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
Encapsulation theory and applications.pdf
gurumoop
 
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Libreria ERP
 
SOPHOS-XG Firewall Administrator PPT.pptx
AgnesMunisi
 
A Presentation on Artificial Intelligence
memembruh336
 
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Microsoft Dynamics
 
Group 1 Presentation -Planning and Decision Making .pptx
MatthewLewis227954
 
A comparative study of natural language inference in Swahili using monolingua...
IAESIJAI
 
Ad

Featured (20)

PDF
2024 Trend Updates: What Really Works In SEO & Content Marketing
Search Engine Journal
 
PDF
Storytelling For The Web: Integrate Storytelling in your Design Process
Chiara Aliotta
 
PDF
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
OECD Directorate for Financial and Enterprise Affairs
 
PDF
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
SocialHRCamp
 
PDF
2024 State of Marketing Report – by Hubspot
Marius Sescu
 
PDF
Everything You Need To Know About ChatGPT
Expeed Software
 
PDF
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
 
PDF
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
PDF
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
 
PDF
Skeleton Culture Code
Skeleton Technologies
 
PDF
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
 
PDF
Content Methodology: A Best Practices Report (Webinar)
contently
 
PPTX
How to Prepare For a Successful Job Search for 2024
Albert Qian
 
PDF
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 
PDF
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
 
PDF
5 Public speaking tips from TED - Visualized summary
SpeakerHub
 
PDF
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
 
PDF
Getting into the tech field. what next
Tessa Mero
 
PDF
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
 
PDF
How to have difficult conversations
Rajiv Jayarajah, MAppComm, ACC
 
2024 Trend Updates: What Really Works In SEO & Content Marketing
Search Engine Journal
 
Storytelling For The Web: Integrate Storytelling in your Design Process
Chiara Aliotta
 
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
OECD Directorate for Financial and Enterprise Affairs
 
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
SocialHRCamp
 
2024 State of Marketing Report – by Hubspot
Marius Sescu
 
Everything You Need To Know About ChatGPT
Expeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
 
Skeleton Culture Code
Skeleton Technologies
 
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
contently
 
How to Prepare For a Successful Job Search for 2024
Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
SpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
 
Getting into the tech field. what next
Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
 
How to have difficult conversations
Rajiv Jayarajah, MAppComm, ACC
 
Ad

Navigating a 3D Avatar using a Single Switch

  • 1. Navigating a 3D Avatar using a Single Switch Eelke Folmer, Fangzhou Liu, Barrie Ellis - FDG’11, Bordeaux Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 2. Interaction ★2D ★3D ★Text ★Visual Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 3. Users with Disabilities “ The eiffel tower was built in ...” Screen reader Assistive Technology Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 4. “Gamers” with Disabilities “ ...........” Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 5. Severe Motor Impairments Quadriplegics one handed eye tracker quad controller switch controller Player Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 6. Adapted Controllers 1 analog ? 2-5 analog more 13 buttons 5-7 binary Ability mapping 1 analog less 1 binary Human Computer Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 7. Switch Controller jellybean sip/puff pinch Severe Motor/Cognitive impairments Sturdy / Cheap No calibration / easy to use Binary input (on/off) Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 8. Input Reduction ? Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 9. Input Reduction ? Automate Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 10. Input Reduction ? Automate Remove Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 11. Input Reduction ? Automate Remove Scanning Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 12. Scanning 101 scanning rate A B C Selection Set Input generated Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 13. Scanning 101 09 scanning rate A B C C Selection Set Activate Input generated Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 14. Scanning Pattern A E B A B C D E F G C G H I F D E Cartesian Polar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 15. Scanning Pattern A E B A B C D E F G C G H I F D E Cartesian Polar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 16. Scanning Pattern A E B A B C D E F G C G H I F D E Cartesian Polar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 17. Scanning Control hold to scan A B C Not always possible Unable to hold switch (Arthritis) Sip and puff Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 18. Scanning Control release to select A B C C Not always possible Unable to hold switch (Arthritis) Sip and puff Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 19. Discrete Selections Text Entry H E L L O Web Navigation Menu Navigation Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 20. Avatar Navigation 400ms 600ms 600ms 800ms Selection set [FORWARD,LEFT,RIGHT,BACK] Types of input: Continuous [FORWARD] for 300ms Mixed [FORWARD + TURN RIGHT] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 21. Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 22. Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate [Forward] [Forward] [Forward] 100 ms 3 switch activations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 23. Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 24. Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate [Forward] 200 ms 1 switch activations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 25. Continuous input approximation [Forward, Le1, Right, Back] selection set [Forward] 300ms input to generate [Forward] 200 ms 1 switch activations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 26. Mixed Inputs Approximation [Forward+Le1] 200 ms Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 27. Mixed Inputs Approximation [Forward+Le1] 200 ms [Forward] [Le1] 200 ms 2 SA Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 28. Mixed Inputs Approximation [Forward+Le1] 200 ms [Forward] [Le1] 200 ms 2 SA [Forward] [Le1] [Forward] [Le1] 100 ms 4 SA Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 29. Navigating an avatar Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 30. Navigating an avatar [Forward] [Le1] [Forward] [Le1] [Forward] [Right] [Forward] [Forward] [Forward] [Right] [Right] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 31. Navigating an avatar Slow Cumbersome Unnatural [Forward] [Le1] [Forward] [Le1] [Forward] [Right] [Forward] [Forward] [Forward] [Right] [Right] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 32. Research Question Can we develop a more efficient scanning system that can generate continuous and mixed inputs? Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 33. Improved Scanning Control Continuous input [Forward] Discrete [Forward] [Forward] [Forward] [Forward] hold release hold and release [Forward] less efficient more efficient Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 34. Generating Mixed Inputs ★Extending selection set [Forward, Le%, Right, Back, Forward+Right, Forward+Le%, Back +Le%, Back+Right] [Forward+Le1] ★Multistep selection [Forward, Le%, Right, Back] dynamically generated [Forward] [Cancel, Le%, Right] [Le1] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 35. Selection set order [Forward] [Forward, Le%, Right, Back] cost RT [Back, Le%, Right, Forward] wait wait wait 3SR+RT More frequently used inputs should be at the front of the selection set Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 36. Parameters to Compare control Discrete vs Hold and Release 2 mixing Extension vs Multistep dia 100,200....1,000 ms 10 selection [Forward, Le%, Right, Back] 24 sets [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 37. Parameters to Compare control Discrete vs Hold and Release 2 mixing Extension vs Multistep dia 100,200....1,000 ms 10 ~400k selection [Forward, Le%, Right, Back] 24 sets [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 38. Characterizing Avatar Navigation Forward 873 Forward+Left 220 Left 293 Left+Forward 167 Forward 675 Second Life Key Logger 8 Able bodied users Focus on grounded navigation Navigated in SL Environment for 8 minute Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 39. Keystroke frequency be the Table 1: Characteristics of Avatar Navigation. rearran Input Single Multi Total Time of occu FORWARD 74.9 - 46.8 79.4 RIGHT 10.6 - 6.6 6.1 LEFT 12.7 - 8.0 7.0 4.4 BACK 1.9 - 1.2 1.8 Adding FORWARD+RIGHT - 46.7 17.5 10.3 facilita FORWARD+LEFT - 52.4 19.6 8.9 BACK+RIGHT - 0.5 0.19 0.12 1. E se BACK+LEFT - 0.5 0.19 0.21 total 100% 100% 100% 100% 2. M F key that is held the longest (86.92% of single & multi) of the 4,300 keystrokes totalLEFT are used m total time participants held keys. RIGHT and Single: 62.6% comprise 46.21% and ca less frequently in single strokes but Multi: 37.4% 52.71% of multistrokes. This confirms our assumption that Each s multistrokes are primarily used to adjust the course of an Player-Game Interaction Research ciency avatar. BACK is rarely used. We consider the collected data Reno University of Nevada, to be representative of 3D navigation behavior in general to scan Thursday, June 30, 2011
  • 40. keystroke length min: 26ms max: 30,606ms average: 804 ms (δ=1,404)   Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 41. Parameters to Compare update control Discrete vs Hold and Release 2 mixing Extension vs Multistep 40 dia 25, 50,....1,000 ms selection [Forward, Le%, Right, Back] 7 sets total 24 sets [Forward, Le%, Right, Back, 120 Forward+Right, Forward + Le%] [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 42. Parameters to Compare update control Discrete vs Hold and Release 2 mixing Extension vs Multistep 40 dia 25, 50,....1,000 ms selection [Forward, Le%, Right, Back] 7 sets total 24 ~3.3 M sets [Forward, Le%, Right, Back, 120 Forward+Right, Forward + Le%] [Forward, Le%, Right, Back, Forward+Right, 40,320 Forward+Le%, Back+Le%, Back+Right] [Forward, Le%, Right, Back] [Cancel, Input, Input] 144 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 43. Simulator Simulator Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 44. Simulator keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 45. Simulator keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 [Forward, Le1, Right, Back] selection sets Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 46. Simulator keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 47. Simulator 25<i<1,000, i+=25 dia keystrokes Forward 873 Forward+Left 220 Left 293 Simulator Left+Forward 167 Forward 675 [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 48. Simulator 25<i<1,000, i+=25 dia keystrokes Forward 873 average per stroke: Forward+Left 220 ★time (ms) Left 293 Simulator ★switch activations Left+Forward 167 Forward 675 ★error (ms) [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 49. Simulator 25<i<1,000, i+=25 SR = 1,000ms dia RT = 650ms keystrokes Forward 873 average per stroke: Forward+Left 220 ★time (ms) Left 293 Simulator ★switch activations Left+Forward 167 Forward 675 ★error (ms) [Forward, Le1, Right, Back] [Forward, Back, Right, Le1] [Back, Le1, Forward, Right] [......] selection sets permutations Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 50. Results Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 51. Results Discrete Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 52. Results Hold and release approximates keystrokes the best. H&R [Multistep] Significantly faster p<.01 »time: 1,539 ms per stroke »error: 122 ms (~35 cm) H&R 2.4x slower than keyboard Discrete [Extended] »time: 3,442 ms per stroke »error: 114 ms (~32 cm) H&R [Extended] Significant fewer errors p<.01 »time: 2,444 ms per stroke »error: 0 ms Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 53. Demo / Implementation Human Computer Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 54. Limitations User error modeling is limited assume user has perfect timing skills »selection accuracy >90% but not 100% correction may be difficult --> extended set model error using Bayesian noise & error correction strategies. switch users may develop different behavior -- >remove [Back] Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 55. Future Work Other VW functions »Object interaction User studies with switch users Real time response environments (FPS/ Racing game) Hold and Release integrated in console OS as HUD Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 56. Questions Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011
  • 57. Questions ? Player-Game Interaction Research University of Nevada, Reno Thursday, June 30, 2011