IRJET- Gesture Drawing Android Application for Visually-Impaired People
0 likes27 views
The document describes a proposed Android application to help visually impaired people make phone calls and send messages with their current location independently. The application uses gesture drawing, haptic feedback, and audio feedback to allow users to store contacts along with assigned gestures and then make calls or send messages by drawing the gestures. When gestures are drawn correctly, haptic and audio feedback are provided to confirm the action to the user. The proposed application aims to provide an easier alternative to searching contact lists manually and does not require visual feedback.
![International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 06 Issue: 03 | Mar 2019 www.irjet.net p-ISSN: 2395-0072
© 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 6557
7. CONCLUSION
This form is very efficient and helpful for visually impaired
people to make a call. The project primarily focuses on
storing the information of the gesture for each individual
contact in the database and warningduringdrawinga wrong
gesture or an unknown gesture. The calling is done using
haptic touch and call along with an audio output. This
algorithm provides an haptic output or a vibration as an
output once each step during the call is performed. This
helps identify if the right gesture is drawn or not. The
database should be updated each time. Using SQL Database,
the data can be easily retrieved and displayed.
REFERENCES
[1] Eric Boyer, “Continuous Auditory Feedback For
Sensorimotor Learning”, ISMES Project-IRCAM University
paris Descartes, May 2015
[2] R Suganya, “An Audio Based Application to Aid Visually
Impaired Users”, Imperial Journal Of Interdisciplinary
Research (IJIR) VOL-3, Issue-6, 2017
[3] Tousif Ahmed, Roberto Hoyle, Kay Connelly, David
Crandall, Apu Kapadia, “Privacy Concerns and Behaviors of
People with Visual Impairments”, SIGCHI ACM Special
Interest Group on Computer-HumanInteraction,Conference
on Human Factors in Computing Systems, No.18, April 2015
[4] Ernesto Granado,FlavioQuizhpi,JulioZambrano,William
Colmenares, “Remote Experimentation Using a Smartphone
Application with Haptic Feedback”, IEEE Global Engineering
Education Conference (EDUCON), April 2016
[5] Danielle Bragg, Cynthia Bennett, Katharina Reinecke,
Richard Ladner, “A LargeInclusiveStudyofHumanListening
Rates”, ACM CHIConference onHumanFactorsinComputing
Systems, No.21, April 28
[6] Riky Subrata, Albert Y. Zomaya, “Dynamic Location
Management for Mobile Computing”, Parallel Computing
Research Laboratory, Department of Electrical and
Electronic Engineering,Vol.22, Issue 1–4, Jan 2003.](https://image.slidesharecdn.com/irjet-v6i3669-190905104857/85/IRJET-Gesture-Drawing-Android-Application-for-Visually-Impaired-People-3-320.jpg)
IRJET- Gesture Drawing Android Application for Visually-Impaired People
- 1. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 03 | Mar 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 6555 GESTURE DRAWING ANDROID APPLICATION FOR VISUALLY-IMPAIRED PEOPLE Shamya Fathima P1, Yuvarani G2, Dr. S. Roselin Mary3 1,2Student, Department of Computer Science & Engineering, Anand Institute of Higher Technology, Kazhipattur, Chennai, Tamil Nadu, India 3Head of the Department, Department of Computer Science & Engineering, Anand Institute of Higher Technology, Kazhipattur, Chennai, Tamil Nadu, India ---------------------------------------------------------------------***---------------------------------------------------------------------- Abstract - Technology as it finds its wide range of application in every field is not an exception even inthefieldof Mobile Technology. One may think of a technology that reduces the burdens of a blind person by using mobile applications in a similar way that aids the clear-sighted people. The Viewable content yields an enjoyable and powerful way for people to communicate, still it also creates challenges for people with low vision or blindness. With only the visual feedback, the user especiallyablindperson would be unable to recognize the action that takes place followingtheir input. To help solve this issue, this work targets on the likelihood of using added auditory feedback and haptic feedback to aid in drawing of trajectory-basedfingergestures. A mechanism that uses haptic rendering and contact detection is to be implemented in the proposed system. Hence, together with the current algorithm in use, a voice outputand limited haptic output is expected to reach a higher drawing recognition accuracy for trajectory-based finger gestures. Key Words: haptic, auditory feedback, trajectory-based finger gestures 1. INTRODUCTION There are manyinformationaccessproblemsexperiencedby visually impaired peoplethatarenowpresentlybeingsolved with computers. Although computer users generally rely heavily on visual feedback (with the graphical userinterface playing an important part ininteractions),userswithlittle or no vision must rely on other modalities to access the same information. Screen readers have proved to be a successful solution for reading out texts in the screen. Dynamic Braille displays perform a similar function for situations where more discreet communication is required. The goal of the work described here is to examine techniques to enable users to be notified of the action that follows their input. Gesture has the potential to be a useful alternative control mechanism for blind and visually impaired users. A gesture can be performed with any device that allows continuous interaction such as a mouse and can be used to perform a wide range of control actions within an interface. The user would perform the gesturewhichthesystem would recognize, and perform the appropriate actions. 1.1 Objective • The primeobjectiveof“GestureDrawingApplication for visually-impaired people” is to develop a full-fledged androidapplicationwhichwouldenableblindpeopletomake calls and send a message of their current locationviaatouch- screen mobile. • It is expected to achieve an higher accuracy in drawing trajectory-based finger gestures. • The application also aims at achieving high-level performance in par with finger-attached pen. • The audio and haptic feedback as a successful task completion sign is expected to significantly reduce fat-finger issue while drawing gestures. 1.2 Scope • It possibly has the capacity to solve many problems of voice recognition applications such as inaccuracy, slowness and interpretation of unusual voices. • In addition, this application has increasedtheusers’ ability to dial phone numbers more independently and less stressfully. • It keeps gestures to a minimum, it does not rely on physical keys, and it takes the technologiesofscreenreaders and haptics one step further. 2. PROBLEM STATEMENT Accessing and using a smartphone is a different experience with a visual impairment or blindness and the preference of applications may also vary accordingly. This paper presents the development of a new android mobile application which is designed to help blind and visually-impaired people make phone calls and message current location to contacts/family/friends. It is developed to facilitateentering information to touch screen mobile phones by blind people. The application also involves limited haptic feedback and auditory feedback as a form of confirmation to user. This application is advantageous through its innovative concept, its simplicity and ability to use more independently and less stressfully.
- 2. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 03 | Mar 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 6556 3. EXISTING SYSTEM The Existing technique of mobile calls require searching the contact list in phone memory. It requires manual search & call. A visually impaired person –will be unabletoutilizethis facility. A search-based algorithm is not suitable for visually impaired people to make calls. It also does not provide visually impaired people with a global perception of the surrounding environment and nearby events or a way- finding capability. 3.1 Drawbacks The Existing technique of mobilecallsrequiressearchingthe contact list in phone memory. It requires manual search &call. A visually impaired personwill beunabletoutilize this facility. A search-based algorithm is not suitable for visually impaired people to make calls. It also does not provide visually impaired people with a global perception of the surrounding environment and nearby events or a way- finding capability. 4. PROPOSED SYSTEM The proposed system is aimed at integrating rich information through sense of touch and auditory means to add to the information provided by visual means. It primarily uses touch & call - haptic technology wherecalling is done by drawing patterns or gestures. Once a blind user stores the contact details such as name and number of the contact along with the associated gesture with the help of someone, the user can then independently start using the application to make calls. In case of emergency,ifuser wants to notify or gain help from friends, he/she can send a message of the current location to saved contact by drawing the gesture. It sends a message with the current location of user in latitude and longitude. When the application is opened, a haptic feedback will be observed giving user the confidence that the right app is opened. The same is also observed when Home button is pressed. An audio output is heard every time a call or message is being performed, thus giving the user a conformanceoftheactionperformed.Other functions of the proposed system include the facilities to delete and rename a contact. 4.1 Advantages • The main goal of our work is integrating rich information through sense of touch and auditory means to add to the information provided by visual means. • Low time consuming • Effective for visually-impaired people. • Does not requires manual searching. 5. TECHNOLOGY 5.1 Haptic Technology • The algorithm allows visually impaired people to use android mobile for call, where different design pattern applied for each contacts in contactlist.Thisputdemands on the haptic algorithm. Not search based algorithm. • Uses touch and call with haptic feedback for each task ending for notifying the user of successful completion. 6. EXPERIMENTAL DESIGN OF PROPOSED DESIGN
- 3. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 03 | Mar 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 6557 7. CONCLUSION This form is very efficient and helpful for visually impaired people to make a call. The project primarily focuses on storing the information of the gesture for each individual contact in the database and warningduringdrawinga wrong gesture or an unknown gesture. The calling is done using haptic touch and call along with an audio output. This algorithm provides an haptic output or a vibration as an output once each step during the call is performed. This helps identify if the right gesture is drawn or not. The database should be updated each time. Using SQL Database, the data can be easily retrieved and displayed. REFERENCES [1] Eric Boyer, “Continuous Auditory Feedback For Sensorimotor Learning”, ISMES Project-IRCAM University paris Descartes, May 2015 [2] R Suganya, “An Audio Based Application to Aid Visually Impaired Users”, Imperial Journal Of Interdisciplinary Research (IJIR) VOL-3, Issue-6, 2017 [3] Tousif Ahmed, Roberto Hoyle, Kay Connelly, David Crandall, Apu Kapadia, “Privacy Concerns and Behaviors of People with Visual Impairments”, SIGCHI ACM Special Interest Group on Computer-HumanInteraction,Conference on Human Factors in Computing Systems, No.18, April 2015 [4] Ernesto Granado,FlavioQuizhpi,JulioZambrano,William Colmenares, “Remote Experimentation Using a Smartphone Application with Haptic Feedback”, IEEE Global Engineering Education Conference (EDUCON), April 2016 [5] Danielle Bragg, Cynthia Bennett, Katharina Reinecke, Richard Ladner, “A LargeInclusiveStudyofHumanListening Rates”, ACM CHIConference onHumanFactorsinComputing Systems, No.21, April 28 [6] Riky Subrata, Albert Y. Zomaya, “Dynamic Location Management for Mobile Computing”, Parallel Computing Research Laboratory, Department of Electrical and Electronic Engineering,Vol.22, Issue 1–4, Jan 2003.