Input! Input! How creative use of input functions in devices helps people with a disability.

Editor's Notes

• #3: DESCRIBE IMAGEOur devices aren’t unlike Robot Number 5 who is alive! We need to constantly give them input for them to perform functions for us.
• #4: Ambient input – information your device senses and utilises to perform a function, such as temperature, location and movement.Alternate device capabilities – using capabilities like the camera to input information and interactSpeech input – voice recognition of natural language commands to get a device to do something
• #5: DESCRIBE IMAGEDescribe Uber and how it works.Be creative with the sources of information to minimise physical and cognitive effort to get the info into the device! This is of great use to someone with motor, cognitive or visual impairment.
• #6: Australian Communication Exchange (ACE), a not‐for‐profit organisation which, for 17 years, has been at the forefront of communication solutions for Deaf, hearing and speech impaired Australians, is pioneering technology to make culture and the arts accessible for everyone. READ 1 & 2 & 3So how does it work?
• #7: Steps:In the National Gallery of Victoria, it uses small blue tooth modules to trigger audio and audio description tracks for those with a vision impairment
• #9: DESCRIBE IMAGETelstra is working with developer, b2cloud, to address vision and hearing impairment through assistive applications for Google Glass.The ‘vision impaired’ app, as b2cloud brands it, utilises a system of audio descriptions to explain objects in front of the user using image recognition technology from Silicon Valley’s Tap Tap See.The technology requires the wearer to place both hands on an object, and commands it by saying, “Okay Glass, what’s this?” after which Google Glass takes a photo, and the app processes the image before providing an audio description.The ‘hearing impaired’ app transcribes speech for those who are deaf or hard of hearing to allow for smoother conversation. It does so by using either content from a typist transcribing, or from direct voice recognition input.
• #10: DESCRIBE IMAGEOriginally a kickstarter project Ubi (short for Ubiqitous computer) currently still in beta, allows for interaction with a computer without using a screen.The Ubi processes natural language to understand requests from a human and then pulls data from various Internet sources. People can easily build voice-driven interactions and connect devices and services through the Ubi Portal. The device is equipped with temperature, humidity, air pressure and ambient light sensors to provide feedback on the environment around it.It integrates with other home based technology such as Nest thermostats and smoke alarms.There is huge potential for the Ubi to assist those who have visual, hearing, or mobility impairments by utilisingits indicator lights and talk-to-activate functionality.
• #11: DESCRIBE IMAGESWe are facing a future where touch could be relegated to the back seat, so to speak…Leap motion completely does away with the need for a touch interface. It allows pointing and directional input by moving your hands in the air above the sensor. It can track each hand and all 10 fingers individually at 290 frames per second. That’s fast!Beaumont College in Lancaster is working on improving software accessibility using Leap. They are creating custom gesture recognition to support to allow students a unique ability to make their own gestures. Other ideas are virtual buttons and swipe gesture recognition…all with the flexibility to work with a personas disability, not against it.