SlideShare a Scribd company logo
OTASCE Map: A Mobile Map Tool
with Customizable Audio-Tactile
Cues for the Visually Impaired
Masaki Matsuo1, Takahiro Miura2, Ryosuke Ichikari2,
Karimu Kato1, Takeshi Kurata1,2
1) University of Tsukuba, Japan.
2) Nat’l Inst. of Advanced Industrial Science and Technology (AIST), Japan.
Abstract
ver.0.1
๏OTASCE Map (Oto-Tactile
SCapE Map) that can
represent real-world route
information
Preferred combination of audio-tactile stimuli varies
depending on the degree of a user's disability.
๏Evaluated preferred combinations
of voice/sound/vibration (n=5):
๏Blind: sound + voice + vibration
๏Low vision: single effect
(voice or vibration)
ver.1.0
Outline
• Background and Objective
• Design of the audio-tactile map viewer
• Evaluation of map viewer
• Conclusion and Future work
• After presentation
• Questions and discussions
• Demonstration of OTASCE Map
Background 1
• Several navigation methods for the visually impaired
• Turn-by-turn navigation
• Orientation in relation to points of interest (POIs) near the
starting point or destination of the route
• Learning routes before going out
4
Background 2
• Examples of Various Navigational Aids:
• NavCog: Indoor turn-by-turn navigation system that
enables users to walk easily to destination in building
using audio information.
• BlindSquare: Orientation information systems that delivers
detailed points of interest (POIS) and intersections using
speech and sounds.
5
Background 3
• Examples of Route Learning Systems:
• Method of conveying terrain information for the
visually impaired using tactile and sound information
• Tactile maps: presents graphic information using
raised surfaces
• AR tactile map: recognizes the movement of the
fingertip on the map and informs the information of
the touched location through speech.
6
Problems
• Few map applications feature flexible and customizable kinds
of audio and tactile stimuli.
• Few smartphone applications represent route information from
the starting point to the destination through tactile information.
7
Objective
• To investigate the most useful combinations
of audio-tactile cues for visual impairments.
• Developed an audio-tactile map viewer that can
represent real-world route information and POIs
near the route.
• Improved the viewer with customizable audio-
tactile cues based on feedback from test users at
workshops.
• This app is expected to be used to learn routes
before going out.
8
Outline
• Background and Objective
• Design of the audio-tactile map viewer
• Evaluation of map viewer
• Conclusion and Future work
Design of the audio-tactile map viewer
• The OTASCE Map presents 2D maps using auditory and
tactile stimuli.
• Difference from previous studies
• Customizable audio-tactile cues
• Available for general-purpose devices
• implemented on iPhone
10
Demonstration of
OTASCE map
operated by visually
impaired people
11
How to use
• User experience:
• Operate by trace the touch screen
• Feedback by Sound effects , voice information, vibration pattern
• Screen objects:
• Points Vertices and branches in a route
• Line Lines on the route
12
Two guidance functions
• Free-touch function
• The user can touch routes and POI freely.
• Route-guidance function
• The user can grasp roughly the shape of the route from
the starting point to the destination.
13
Outline
• Background and Objective
• Design of the audio-tactile map viewer
• Evaluation of map viewer
• Conclusion and Future work
Workshop with visually impaired people
• Objective:
• To investigate the most useful combinations of audio-tactile cues for
people with visual impairments including low vision and blindness.
• Participants
• 3 blind, 2 low vision
• Evaluation procedure
• Repeat the audio-tactile effects customizing and map touching
• Explain and discuss their preferred combinations of audio-tactile cues
• Share / discuss customization results
• Survey about usability
15
Views of the system used for workshop
16
Participants of the workshop
17
3 blind &
2 low vision
Video of
customized
results by the
blind
18
Video of
customized
results by the
low vision
19
Two types of
audio-tactile
patterns
designed
based on
the results of
the workshop
20
Summary
• We designed the OTASCE Map viewer for presenting maps and routes
to visually impaired people using customizable audio-tactile effects.
• We found that the preferred combination of audio-tactile
stimuli varies depending on the degree of a user's disability:
• blind participants tend to prefer a combination of two or
more kinds of cues
• while participants with low vision preferred to use only a
single cue.
21
• This app is expected to be used to help the users learn
routes before going out and grasp surrounding POIs.
Future work
• Our final goal
• To develop an audio-tactile mapping tool that allows
blind people to grasp, modify, and create 2D figures
like maps in the real-world. 22
• Future work
• Evaluating two types of audio-tactile patterns quantitatively with a
larger study
• Creating a tutorial mode
• Publishing the OTASCE Map apps
• Extension to mapping tool: prototyping a map-creation tool that
implements combinations of audio-tactile effects and voice cues.
Thank you!
Please check the Twitter
for the OTASCE Map release announcement.
@mmatsuo10
https://twitter.com/mmatsuo10

More Related Content

PPTX
My Italy:Design and usability evaluation of an M-Tourism prototype
PPTX
Smart Stick with GPS Navigation and Sensor Detection
PPTX
Smart blind
PPTX
Apple smart watches
PPTX
PDF
Research hockey team (1)
PPTX
THE THIRD EYE-Presentation
ODP
digital_imagery
My Italy:Design and usability evaluation of an M-Tourism prototype
Smart Stick with GPS Navigation and Sensor Detection
Smart blind
Apple smart watches
Research hockey team (1)
THE THIRD EYE-Presentation
digital_imagery

Similar to OTASCE Map: A Mobile Map Tool with Customizable Audio-Tactile Cues for the Visually Impaired (20)

PPT
"Open Touch/Sound Maps" mobile application - Map access to the blind/visually...
PPTX
Spatial Mental Models and Navigation Support Apps for People who are Blind – ...
PDF
“Designing Assistive Technology: A Personal Experience of Trial and Error “
PDF
Haptimap in a_nutshell_2011_for_aegis
PPTX
Wayfinding without visual cues
PDF
An Immersive Map Exploration System Using Handheld Device
PDF
From open geographical data to tangible maps: improving the accessibility of ...
PDF
47 haptic maps ntu
PDF
Geological Society Higher Education Network (HEN 2012) meeting - 18 Jan 2012 ...
DOC
Mapping, Tourism & Disability or "The Jasmine Streetcorner"
PPTX
Team 546 Final oap report
PPTX
Using Common Senses: Programmatic Accessibility for Exhibits
PPT
Study of Tactile interactions for visually disabled and hearing impaired
PPT
Usability & Accessibility of Mobile Mobile Communication/Navigation Devices
PDF
2b7 making location based services
PPT
Study of Tactile interactions for visually disabled and hearing impaired
PPTX
Recall - Evaluation of route learning software on Android for people with dis...
PDF
Methodologies and evaluation of electronic travel aids for the visually impai...
PPTX
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
PPTX
Electronic travel aid
"Open Touch/Sound Maps" mobile application - Map access to the blind/visually...
Spatial Mental Models and Navigation Support Apps for People who are Blind – ...
“Designing Assistive Technology: A Personal Experience of Trial and Error “
Haptimap in a_nutshell_2011_for_aegis
Wayfinding without visual cues
An Immersive Map Exploration System Using Handheld Device
From open geographical data to tangible maps: improving the accessibility of ...
47 haptic maps ntu
Geological Society Higher Education Network (HEN 2012) meeting - 18 Jan 2012 ...
Mapping, Tourism & Disability or "The Jasmine Streetcorner"
Team 546 Final oap report
Using Common Senses: Programmatic Accessibility for Exhibits
Study of Tactile interactions for visually disabled and hearing impaired
Usability & Accessibility of Mobile Mobile Communication/Navigation Devices
2b7 making location based services
Study of Tactile interactions for visually disabled and hearing impaired
Recall - Evaluation of route learning software on Android for people with dis...
Methodologies and evaluation of electronic travel aids for the visually impai...
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
Electronic travel aid
Ad

More from Kurata Takeshi (20)

PPTX
ISO/IEC JTC 1/WG 9 (MAR) Convenor Report
PPTX
人間拡張から人間社会拡張へ(HARCS2024講演資料。産業技術総合研究所 蔵田武志)
PDF
Preliminary Evaluation of Inspection Assistance Methods Using VR Simulating P...
PPTX
De jure standardization at ISO/IEC JTC 1/SC 24 and ISMAR
PDF
Pre-Post Analysis on Multi-Skill Development using Flow Line Data at Expressw...
PDF
遠隔ヘルスケアのための多感覚XR-AI技術基盤 ~リハビリ・特定保健指導から人的資本経営支援まで~
PDF
人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
PDF
Project progress on XR-AI platform for tele-rehab and health guidance
PDF
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
PPTX
HARC: Human Augmentation Research Center
PDF
Work Pattern Analysis with and without Site-specific Information in a Manufac...
PDF
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
PPTX
Standards and projects of SC 24/WG 9 on Metaverse and Interverse
PDF
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
PDF
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
PPTX
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
PPTX
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
PPTX
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
PPTX
国際標準化におけるAR/MR用語の使われ方
PDF
XRに基づく遠隔リハの研究・事業事例調査報告
ISO/IEC JTC 1/WG 9 (MAR) Convenor Report
人間拡張から人間社会拡張へ(HARCS2024講演資料。産業技術総合研究所 蔵田武志)
Preliminary Evaluation of Inspection Assistance Methods Using VR Simulating P...
De jure standardization at ISO/IEC JTC 1/SC 24 and ISMAR
Pre-Post Analysis on Multi-Skill Development using Flow Line Data at Expressw...
遠隔ヘルスケアのための多感覚XR-AI技術基盤 ~リハビリ・特定保健指導から人的資本経営支援まで~
人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
Project progress on XR-AI platform for tele-rehab and health guidance
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
HARC: Human Augmentation Research Center
Work Pattern Analysis with and without Site-specific Information in a Manufac...
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
Standards and projects of SC 24/WG 9 on Metaverse and Interverse
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
国際標準化におけるAR/MR用語の使われ方
XRに基づく遠隔リハの研究・事業事例調査報告
Ad

Recently uploaded (20)

PDF
737-MAX_SRG.pdf student reference guides
PDF
Categorization of Factors Affecting Classification Algorithms Selection
PPTX
Software Engineering and software moduleing
PPT
INTRODUCTION -Data Warehousing and Mining-M.Tech- VTU.ppt
PPT
Total quality management ppt for engineering students
PDF
22EC502-MICROCONTROLLER AND INTERFACING-8051 MICROCONTROLLER.pdf
PPTX
Graph Data Structures with Types, Traversals, Connectivity, and Real-Life App...
PPTX
communication and presentation skills 01
PPTX
ASME PCC-02 TRAINING -DESKTOP-NLE5HNP.pptx
PDF
null (2) bgfbg bfgb bfgb fbfg bfbgf b.pdf
PDF
BIO-INSPIRED ARCHITECTURE FOR PARSIMONIOUS CONVERSATIONAL INTELLIGENCE : THE ...
PDF
Improvement effect of pyrolyzed agro-food biochar on the properties of.pdf
PPTX
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
PDF
Exploratory_Data_Analysis_Fundamentals.pdf
PDF
distributed database system" (DDBS) is often used to refer to both the distri...
PDF
Influence of Green Infrastructure on Residents’ Endorsement of the New Ecolog...
PPTX
Current and future trends in Computer Vision.pptx
PDF
Artificial Superintelligence (ASI) Alliance Vision Paper.pdf
PDF
PREDICTION OF DIABETES FROM ELECTRONIC HEALTH RECORDS
PPTX
Fundamentals of safety and accident prevention -final (1).pptx
737-MAX_SRG.pdf student reference guides
Categorization of Factors Affecting Classification Algorithms Selection
Software Engineering and software moduleing
INTRODUCTION -Data Warehousing and Mining-M.Tech- VTU.ppt
Total quality management ppt for engineering students
22EC502-MICROCONTROLLER AND INTERFACING-8051 MICROCONTROLLER.pdf
Graph Data Structures with Types, Traversals, Connectivity, and Real-Life App...
communication and presentation skills 01
ASME PCC-02 TRAINING -DESKTOP-NLE5HNP.pptx
null (2) bgfbg bfgb bfgb fbfg bfbgf b.pdf
BIO-INSPIRED ARCHITECTURE FOR PARSIMONIOUS CONVERSATIONAL INTELLIGENCE : THE ...
Improvement effect of pyrolyzed agro-food biochar on the properties of.pdf
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
Exploratory_Data_Analysis_Fundamentals.pdf
distributed database system" (DDBS) is often used to refer to both the distri...
Influence of Green Infrastructure on Residents’ Endorsement of the New Ecolog...
Current and future trends in Computer Vision.pptx
Artificial Superintelligence (ASI) Alliance Vision Paper.pdf
PREDICTION OF DIABETES FROM ELECTRONIC HEALTH RECORDS
Fundamentals of safety and accident prevention -final (1).pptx

OTASCE Map: A Mobile Map Tool with Customizable Audio-Tactile Cues for the Visually Impaired

  • 1. OTASCE Map: A Mobile Map Tool with Customizable Audio-Tactile Cues for the Visually Impaired Masaki Matsuo1, Takahiro Miura2, Ryosuke Ichikari2, Karimu Kato1, Takeshi Kurata1,2 1) University of Tsukuba, Japan. 2) Nat’l Inst. of Advanced Industrial Science and Technology (AIST), Japan.
  • 2. Abstract ver.0.1 ๏OTASCE Map (Oto-Tactile SCapE Map) that can represent real-world route information Preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability. ๏Evaluated preferred combinations of voice/sound/vibration (n=5): ๏Blind: sound + voice + vibration ๏Low vision: single effect (voice or vibration) ver.1.0
  • 3. Outline • Background and Objective • Design of the audio-tactile map viewer • Evaluation of map viewer • Conclusion and Future work • After presentation • Questions and discussions • Demonstration of OTASCE Map
  • 4. Background 1 • Several navigation methods for the visually impaired • Turn-by-turn navigation • Orientation in relation to points of interest (POIs) near the starting point or destination of the route • Learning routes before going out 4
  • 5. Background 2 • Examples of Various Navigational Aids: • NavCog: Indoor turn-by-turn navigation system that enables users to walk easily to destination in building using audio information. • BlindSquare: Orientation information systems that delivers detailed points of interest (POIS) and intersections using speech and sounds. 5
  • 6. Background 3 • Examples of Route Learning Systems: • Method of conveying terrain information for the visually impaired using tactile and sound information • Tactile maps: presents graphic information using raised surfaces • AR tactile map: recognizes the movement of the fingertip on the map and informs the information of the touched location through speech. 6
  • 7. Problems • Few map applications feature flexible and customizable kinds of audio and tactile stimuli. • Few smartphone applications represent route information from the starting point to the destination through tactile information. 7
  • 8. Objective • To investigate the most useful combinations of audio-tactile cues for visual impairments. • Developed an audio-tactile map viewer that can represent real-world route information and POIs near the route. • Improved the viewer with customizable audio- tactile cues based on feedback from test users at workshops. • This app is expected to be used to learn routes before going out. 8
  • 9. Outline • Background and Objective • Design of the audio-tactile map viewer • Evaluation of map viewer • Conclusion and Future work
  • 10. Design of the audio-tactile map viewer • The OTASCE Map presents 2D maps using auditory and tactile stimuli. • Difference from previous studies • Customizable audio-tactile cues • Available for general-purpose devices • implemented on iPhone 10
  • 11. Demonstration of OTASCE map operated by visually impaired people 11
  • 12. How to use • User experience: • Operate by trace the touch screen • Feedback by Sound effects , voice information, vibration pattern • Screen objects: • Points Vertices and branches in a route • Line Lines on the route 12
  • 13. Two guidance functions • Free-touch function • The user can touch routes and POI freely. • Route-guidance function • The user can grasp roughly the shape of the route from the starting point to the destination. 13
  • 14. Outline • Background and Objective • Design of the audio-tactile map viewer • Evaluation of map viewer • Conclusion and Future work
  • 15. Workshop with visually impaired people • Objective: • To investigate the most useful combinations of audio-tactile cues for people with visual impairments including low vision and blindness. • Participants • 3 blind, 2 low vision • Evaluation procedure • Repeat the audio-tactile effects customizing and map touching • Explain and discuss their preferred combinations of audio-tactile cues • Share / discuss customization results • Survey about usability 15
  • 16. Views of the system used for workshop 16
  • 17. Participants of the workshop 17 3 blind & 2 low vision
  • 19. Video of customized results by the low vision 19
  • 20. Two types of audio-tactile patterns designed based on the results of the workshop 20
  • 21. Summary • We designed the OTASCE Map viewer for presenting maps and routes to visually impaired people using customizable audio-tactile effects. • We found that the preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability: • blind participants tend to prefer a combination of two or more kinds of cues • while participants with low vision preferred to use only a single cue. 21 • This app is expected to be used to help the users learn routes before going out and grasp surrounding POIs.
  • 22. Future work • Our final goal • To develop an audio-tactile mapping tool that allows blind people to grasp, modify, and create 2D figures like maps in the real-world. 22 • Future work • Evaluating two types of audio-tactile patterns quantitatively with a larger study • Creating a tutorial mode • Publishing the OTASCE Map apps • Extension to mapping tool: prototyping a map-creation tool that implements combinations of audio-tactile effects and voice cues.
  • 23. Thank you! Please check the Twitter for the OTASCE Map release announcement. @mmatsuo10 https://twitter.com/mmatsuo10

Editor's Notes

  • #2: Hello everyone. Thank you all very much for coming today. My name is Masaki Matsuo. I’d like to talk to you about OTASCE Map: a mobile map tool with customizable audio-Tactile cues for the visually impaired.
  • #3: This slide shows abstract of our study. We designed this audio-tactile map viewer for presenting routes to the visually impaired using customizable audio-tactile effects. We named our map viewer OTASCE map for Oto-Tactile scape map. Otasce means "help" in Japanese. We conducted a workshop test combination of audio-tactile effects using OTASCE map. As a result we found that the preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability: blind users tended to prefer a combination of two or more kinds of cues while low vision users preferred to use only a single cue.
  • #4: This is a brief outline of my presentation. First, I would like to talk about the Background and objective of this study. Second, I would like to discuss design of Otasce map. Third, I would like to talk about the evaluation of Otasce map. And finally, Conclude and talk briefly about future plans. First, I’d like to start with some background information.
  • #5: Navigation methods for the visually impaired can be broadly divided into three categories. The first is Turn-by-turn navigation. The second is Orientation in relation to points of interest near the starting point or destination of the route. The third is learning routes before going out.
  • #6: Examples of Various Navigational Aids: NavCog is an indoor navigation system that enables users to walk easily to a destination in a building using audio information. BlindSquare is Orientation information system. This app delivers detailed points of interest (POIS) and intersections using voice and sound effects.
  • #7: Examples of Route Learning Systems: Many methods for conveying terrain information to the visually impaired have used either sound or tactile information. Tactile maps present graphic information using raised surfaces. The AR tactile map recognizes the movement of the fingertip on the map and informs the information of the touched location through speech. Space saving is possible because braille is not used, and more information can be stored than regular tactile maps.
  • #8: The problems is Few map applications feature flexible and customizable kinds of audio and tactile stimuli. In addition, Few smartphone applications represent route information from the starting point to the destination through tactile information.
  • #9: Therefore, We sought to discover the most useful combinations of audio and tactile cues for blind and visually impaired people. First, we developing an audio and tactile map viewer that can represent real-world route information and POI near the route. and we improved the viewer with customizable audio-tactile cues based on feedback from test users at workshop. We expect this app to be used for learning routes before going out.
  • #10: Next, I'd like to talk about design of the audio-tactile map viewer.
  • #11: The OTASCE map viewer presents 2D figures like maps using auditory and tactile stimuli. The difference from the previous study is that audio haptic cues can be customized and available on general-purpose devices. The viewer is implemented on an iPhone.
  • #12: Watch a video showing how to use the OTASCE map. The mouse icon indicates the user's finger. The user is touching the screen. This sound indicates the route. This sound indicates the POI. The user is tracing a route from the starting point to the destination.
  • #13: The user is given cues about the route and points of interest (POIs) as they touch the map on the screen. The user can customize the audio-tactile effects with different combinations of sound effects, voice cues, and vibration patterns. The effects convey information about points and lines on the displayed map.
  • #14: As shown in the previous video, the user can use two types of operating functions. The first is Free-touch function. The user can touch routes and POI freely. The second is Route-guidance function. This function presents the user's upcoming direction of travel on the route by guiding their finger to the starting point, stating the direction to turn at each branch points, and finally guiding the finger to the destination. The user can preview the route from the starting point to the destination.
  • #15: Let’s continue and move on to the workshop.
  • #16: We conducted a test combination of audio-tactile effects with visually impaired people using OTASCE Map. First, we asked participants to touch and trace a route in OTASCE Map. Then we asked participants to repeatedly adjust and check audio-tactile effects corresponding to various objects on the map. Subsequently, we asked participants to discuss their preferred combinations of audio-tactile cues. Finally, they answered surveys about usability.
  • #17: This slide shows screenshots of the map viewer app. This screen shot of the left side shows the settings menu screen. This menu is compatible with Voiceover features included in iOS. Also, the right side shows the Audio-tactile map. After customizing the effects, users can test the audio-tactile presentation by touching the map.
  • #18: As shown slide on the five participants (3 blind and 2 people with low vision) participated in the workshop. Except for one blind person, all participants had experience in using map and navigation applications while walking outside.
  • #19: This is an example Video of customized results by blind participants. 3 blind participants preferd a combination of two or more effects, including sound effects, voice cues, and vibrations. All the blind participants were accustomed to distinguishing sound effects.
  • #20: This is an example Video of customized results by low vision participants with low vision tended to select only a single type of cue; one selected voice while the other selected vibration. Participants with low vision were not accustomed to detecting differences in sounds.
  • #21: We created two types of audio-tactile patterns designed based on the results of the workshops. First is voice + vibration for low vision users Second is voice + vibration + sound effect for blind users
  • #22: Let me summarize the point of my presentation. We designed the OTASCE Map viewer for presenting maps and routes to visually impaired people using customizable audio-tactile effects. From a workshop we found that the preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability: blind users tend to prefer a combination of two or more kinds of cues while low vision users preferred to use only a single cue. This app is expected to be used to learn routes before going out and to help the users grasp surrounding POI.
  • #23: In the future, We plan to evaluate two types of audio-tactile patterns quantitatively with a larger study. Therefore, we will create a tutorial mode to teach users how to operate the map viewer efficiently. To this end, we plan to publish OTASCE Map apps. In addition, we are currently developing a prototype mapping tool that creates 2D maps in the real-world. our goal is to develop an audio-tactile mapping tool that will allow blind people to grasp, modify, and create 2D figures.
  • #24: Please check the Twitter for the OTASK Map release announcement. Thank you all very much for listening. I would like to close my presentation.