![Dynamics and Interaction Steven Strachan, Roderick Murray-Smith Hamilton Institute, NUI Maynooth & Department of Computing Science, University of Glasgow [email_address] http://www.dcs.gla.ac.uk/~rod http://www.dcs.gla.ac.uk/~rod/Videos.html With John Williamson, Parisa Eslambolchilar, Andy Crossan, Vuokko Lantz, James Kelly, Stephen Brewster, Andrew Ramsay May 2007](https://image.slidesharecdn.com/steven-strachan-dynamics-and-interaction-27389/85/Steven-Strachan-Dynamics-and-Interaction-1-320.jpg)
Steven Strachan - Dynamics and Interaction
- 1. Dynamics and Interaction Steven Strachan, Roderick Murray-Smith Hamilton Institute, NUI Maynooth & Department of Computing Science, University of Glasgow [email_address] http://www.dcs.gla.ac.uk/~rod http://www.dcs.gla.ac.uk/~rod/Videos.html With John Williamson, Parisa Eslambolchilar, Andy Crossan, Vuokko Lantz, James Kelly, Stephen Brewster, Andrew Ramsay May 2007
- 2. Dynamics & Interaction group Led by Roderick Murray-Smith Two-campus group. Based in The Hamilton Institute & The University of Glasgow Dr Murray-Smith spent 7 years at Daimler-Benz research in Berlin, followed by M.I.T. and Technical University of Denmark. Exploring the overlap between control theory, machine learning, probabilistic reasoning and human-computer interaction design. Leading group in novel forms of interaction design for mobile interaction. Act as consultants for Nokia, Samsung and Microsoft. Current staff: Dr. Steven Strachan (NUIM) Dr. John Williamson (GU) Andrew Ramsay (GU) Stephen Hughes (GU)
- 3. Control in HCI? More and more devices are incorporating inertial sensing… What new kinds of interface can we develop with this new sensing capability? Think of user and device as being in a loop of control…
- 4. From ‘look-and-feel’ to ‘ handling qualities’? Moving from discrete event -based systems like this: To continuous control like this?
- 5. Dynamics & Statistics in HCI? Why introduce dynamics – is that not harder? We can only control what we can perceive . Dependent on feedback, so upper limits on the speed of change of display. Large steps in entropy are unnatural & error-prone Dynamics allows us to slip in ‘intelligence’ which couldn’t be done with a static interaction technique Why uncertain interaction? Uncertainty in user’s mind about what to do next, and system uncertain about user’s intentions. With mobile devices, interaction with the user is now continuous instead of discrete, and input devices are noisier. ‘ Honest’ interfaces Can lead to smoother interaction, with user behaviour regularised appropriately (e.g. K ö rding & Wolpert)
- 6. Mobile Sensing: MESH hardware description Built by MLE Palpable Machines group. Modality Enhancing Sensor-pack for Handhelds Designed for the IPAQ range of pocket PCs Physical design same as the PCMCIA expansion jacket Triple-Axis acceleration sensing MEMS Accelerometers Orientation sense and gesture capture High Fidelity Vibrotactile Display Sample based, Non-Volatile sample storage,Audio bus-driven option Actuator – VBW32 rewound Triple-axis magnetometer Orthogonal Magneto-Resistive elements Capacitive sensing GPS
- 7. Next sensor pack.. SHAKE Our next generation pack… Bluetooth, wireless and compact Accelerometers, gyros, magnetometers and haptic feedback. Use for head, device or bimanual gestures.
- 8. Multimodal feedback from active inquiry Model-based interaction design – physical interaction with abstract concepts
- 9. Shoogle - Informative Shaking Shake the phone to feel (and hear) content discreetly Only produces feedback when stimulated Simple physical model of objects in a box Movement from accelerometers Impact with edges produces sound and vibration VIDEO
- 10. BodySpace Using constraints in the environment
- 11. BodySpace With MLE Palpable machines group – Jussi Angesleva, Ian Oakley, Sile O’Modhrain
- 12. Example Application Gesture controlled music player Volume is controlled at the hip. Track switching is controlled at the ear. VIDEO
- 14. gps Tunes Whereable computing…. Location-Aware audio feedback Quickening useful – don’t want user to run back and forth to get gradient! Use tilt and bearing to get rapid exploration
- 15. GPS Navigation Problem GPS is useful but inaccurate Inaccuracy varies in a complex way Reflections, shadowing, poor coverage Could use hybrid positioning General problem – accurate representation of belief and trustworthiness
- 16. Uncertain Display Poor displays lead to poor control Norman's example of The Royal Majesty “ precise” position
- 17. Uncertainty in GPS Navigation Represent and display the true uncertainty of the navigation system – make it “honest” realistic display should regularise control behaviour Incorporate models environment models user models Monte Carlo sampling is a convenient statistical technique for dealing with uncertainty
- 18. Particle GPS Browsing Map browsing; include uncertainty about where we are Project forward, find likely locations in the future. Show all the possible places we might be, given a map of the area User can scan around and project further into the future with inertial control. Target points are sonified. Video Demonstration
- 19. Relevance to the mobile internet… Mobile devices are by definition ‘mobile’. Traditional methods of interaction with the internet are not good in this mobile domain. We should acknowledge our current location or context and use this to our advantage. Introduce the location-aware internet…
- 20. Scenario…
- 21. Scenario… you are here
- 22. Scenario… you are here you are here
- 23. Scenario… you are here you are here you are here
- 24. Scenario… you are here you are here
- 25. Scenario… you are here you are here
- 26. Social interactions?… Real-time interaction with people in your social network…
- 27. Outlook Dynamics allow intelligence to be sandwiched into an interface ‘ look-and-feel’ of an interface, ‘noisy channel’, or in control terms, the ‘adaptive handling qualities’? The mobile internet has the potential to become a highly-interactive, embodied and location-aware internet…