DataTiles: a modula platform for mixed physical and digtial interactions (Rekimoto, CHI2001)
- 1. DataTiles ： A Modular Platform for Mixed Physical and Graphical Interactions April 4, 2001 Jun Rekimoto * Brygg Ullmer † Haruo Oba * * Sony CSL Interaction Laboratory † MIT Media Laboratory
- 2. Motivation Flexible interface platform for controlling digital information Merging two UI paradigms Graphicsl UIs & Physical/Tangible UI Visual+Physical “construction kit” for end users
- 3. Some historical ancestors… “ Denshi (electronic) Block” (‘70s) Japan Railload “MARS” terminal (‘70s) “ Triangles” (Gorbet/Orth/Ishii, 1998) “ AlgoBlock” (Suzuki/Kato, 1995) “ Intelligent Beermats” (Frazer, 1982)
- 4. DataTiles
- 5. Transparent objects (tiles) as information modules -> tight coupling of input & output Integration of Physical manipulation & graphical information Used as Home-Computer interfaces, Collaboration supports, Internet-”Toys” DataTiles
- 7. Tile Classes Application Tiles Portal (Remote) Tiles Parameter Tiles Container Tiles Stores information Specific Services, Applications Connects to real-world objects (places, people, devices) Visualizes & Controls other connected tiles
- 8. video
- 9. DataTiles basic interaction style Pen Sensitive LCD Display (“Tray”) ID-Reader tagged transparent object RFID RFID Grooves Printed Information Input devices (Pen, etc.) Input Graphical Output
- 10. Interacting with DataTiles Interaction Techniques Tile placement, reconfiguration, removal Pen manipulations on each tile (as GUI) Physical manipulators (e.g., dial) Inter-tile pen gestures Tile adjacency communications between tiles Parameter flow: Query Parameters, Time points Data-flow: Image, movie, sound
- 11. Printed & Grooved Tiles = + + = printed information: high resolution, static displayed information: low resolution, dynamic grooved widget: passive haptic feedback combined:
- 13. Examples of Tile Combinations Container Paint Portal WebCam print image real printer Application Tile Container Tile Portal Tile Container Movie Movie Movie Parameters Baseball TimeWheel Scribble time point parameter tile parameter tile query parameters
- 14. Visual Feedback of tile connection types Inter-tile pen gestures Movie TimeMachine Weather Simple connection Menu for choosing Connection types Mail Fax Animation indicating streamed media transmission Wall Screen A People Container Invokes one-shot transmission PhotoAlbum Container Remote Portal Suspends streamed transmission
- 15. System Configuration PC (Sony VAIO LX) Windows 2000 Pentium III (866MHz) Java JDK1.3 LCD Display with built-in pen tablet RFID tags (TIRIS) RFID reader (TIRIS) RFID multiplexer + PC interface (PIC16F873) RS232C Switches 12 antenna coils （ 100ms / ID) RFID reader coils
- 16. Sensor Configuration LCD display Back light Pen digitizer Wire to the RF reader Acrylic tile cover glass 6mm RF tag RFID reader coils Wire to the RFID reader RFID tag Reader coil
- 17. Implementation (software) The System dynamically loads and activates a corresponding Java Class for each tile ID. Each Java program also dynamically checks nearby tile classes and interfaces. public class WebCamTile extends Tile implements ImageCreateInterface , TimeMachineInterface , … { …… …… } …… Tile t = getLeftTile(); if (t instanceof TimeMachineInterface ) { … .. } … .
- 18. User Experiences Data manipulation by physical layout Many users were willing to explore various types of tile combinations. Some of them were beyond our expectation. Visual feedback was essential Effects of tiles’ graspable capability Users could always take control (e.g., remove a music tile to stop it) Suitable for multi-user activities
- 19. Applications Interfaces to Networked Information Portal to Information services Information Appliances Control Remote Collaboration Media Construction Environments Movie/Music Editing, Video Jockey (Networked) Game Environment Education Tools, Toys Support of Collaborative Work, Decision making Simulation, database visualization
- 20. Summary DataTiles: A platform environment with mixed Physical-Graphical Interactions Future Work Study of Physical Language “Grammar” Other configuration method (e.g, stacking) Active (CPU embedded) tiles with sensors