Multimodal Localization as the Key for Ambient Intelligent Applications
2 likes844 views
The document discusses ambient intelligence (AMI) and its evolution in terms of technology integration and consumer electronics, emphasizing the importance of localization techniques for intelligent applications. It outlines various localization methods and presents a scenario illustrating the practical applications of AMI in home environments. The document suggests that effective multimodal localization is essential for the success of ambient intelligent applications in everyday life.
Multimodal Localization as the Key for Ambient Intelligent Applications
- 1. Multimodal Localization as the Key for Ambient Intelligent Applications prof. dr. Maarten Weyn maarten.weyn@uantwerpen.be
- 2. 1maarten.weyn@uantwerpen.be Ambient Intelligence “Ambient Intelligence (AmI) is a vision of how ICTs will shape our future. It depicts a world of seamless intelligent environments, designed to understand and adapt to the presence of people and free them from manual control of their surroundings“ (Gunnarsdóttir and Arribas-Ayllon, 2011)
- 3. 2maarten.weyn@uantwerpen.be Ambient Intelligence 1998 From Devices to ‘Ambient Intelligence’: The Transformation of Consumer Electronics (Zelkha and Epstein, 1998, Philips). 1999 The AmI vision drove the Europeans view on electronics research, engineering and materials sience. 2003 ISTAG, FP6
- 4. 3maarten.weyn@uantwerpen.be Ambient Intelligence Now? “We would expect to be witnessing the emergence of enduring principles and of a growing body of research findings and solved challenges. Instead, much of the research effort still seems to be devoted to the creation, very often from scratch, of technologies and systems for enabling the scenarios described in the AmI vision” (José et al, 2010)
- 6. 5maarten.weyn@uantwerpen.be Ambient Intelligence started out as... A technology integrator
- 7. 6maarten.weyn@uantwerpen.be Ambient Intelligence started out as... • “The AmI vision was originally one of maximizing the potential of consumer electronics, telecommunications, materials science and computing, to support ‘people and objects to interact with their environment in a seamless, trustworthy, and natural manner” (Aarts and de Ruyter, 2009) • Laid-back rather than lean-forward mode • “Computing should ‘move from an explicit, instructional model to an implicit, anticipatory one’ with context aware, personalized, adaptive and anticipatory machine intelligence (Gunnarsdóttir and Arribas-Ayllon, 2011)
- 8. 7maarten.weyn@uantwerpen.be Ambient Intelligence is moving towards becoming... An innovation framework
- 9. 8maarten.weyn@uantwerpen.be Ambient Intelligence and Responsibility
- 10. 9maarten.weyn@uantwerpen.be Localization localization - a determination of the place where something is; "he got a good fix on the target“ - Princeton University, Farlex Inc
- 13. 12maarten.weyn@uantwerpen.be Localization Techniques • Triangulation - Multi-lateration • Time of Flight (ToF) • Time of Arrival (ToA) • Time Difference of Arrival (TDoA) • Round Trip Time (RTT) • Attenuation - Angulation • Proximity • Scene Analysis - Image Analysis - RF Pattern Matching Accurate Clocks Line of Sight Synchronization Path loss Obstacles Fingerprinting Environmental Changes
- 14. 13maarten.weyn@uantwerpen.be ScenarioEllen returns home after a long day's work. At the front door she is recognized by an intelligent surveillance camera, the door alarm is switched off, and the door unlocks and opens. When she enters the hall the house map indicates that her husband Peter is at an art fair in Paris, and that her daughter Charlotte is in the children's playroom, where she is playing with an interactive screen. The remote children surveillance service is notified that she is at home, and subsequently the on-line connection is switched off. When she enters the kitchen the family memo frame lights up to indicate that there are new messages. The shopping list that has been composed needs confirmation before it is sent to the supermarket for delivery. There is also a message notifying that the home information system has found new information on the semantic Web about economic holiday cottages with sea sight in Spain. She briefly connects to the playroom to say hello to Charlotte, and her video picture automatically appears on the flat screen that is currently used by Charlotte. Next, she connects to Peter at the art fair in Paris. He shows her through his contact lens camera some of the sculptures he intends to buy, and she confirms his choice. In the mean time she selects one of the displayed menus that indicate what can be prepared with the food that is currently available from the pantry and the refrigerator. Next, she switches to the video on demand channel to watch the latest news program. Through the 'follow me' she switches over to the flat screen in the bedroom where she is going to have her personalized workout session. Later that evening, after Peter has returned home, they are chatting with a friend in the living room with their personalized ambient lighting switched on. They watch the virtual presenter that informs them about the programs and the information that have been recorded by the home storage server earlier that day.
- 15. 14maarten.weyn@uantwerpen.be ScenarioEllen returns home after a long day's work. At the front door she is recognized by an intelligent surveillance camera, the door alarm is switched off, and the door unlocks and opens. When she enters the hall the house map indicates that her husband Peter is at an art fair in Paris, and that her daughter Charlotte is in the children's playroom, where she is playing with an interactive screen. The remote children surveillance service is notified that she is at home, and subsequently the on-line connection is switched off. When she enters the kitchen the family memo frame lights up to indicate that there are new messages. The shopping list that has been composed needs confirmation before it is sent to the supermarket for delivery. There is also a message notifying that the home information system has found new information on the semantic Web about economic holiday cottages with sea sight in Spain. She briefly connects to the playroom to say hello to Charlotte, and her video picture automatically appears on the flat screen that is currently used by Charlotte. Next, she connects to Peter at the art fair in Paris. He shows her through his contact lens camera some of the sculptures he intends to buy, and she confirms his choice. In the mean time she selects one of the displayed menus that indicate what can be prepared with the food that is currently available from the pantry and the refrigerator. Next, she switches to the video on demand channel to watch the latest news program. Through the 'follow me' she switches over to the flat screen in the bedroom where she is going to have her personalized workout session. Later that evening, after Peter has returned home, they are chatting with a friend in the living room with their personalized ambient lighting switched on. They watch the virtual presenter that informs them about the programs and the information that have been recorded by the home storage server earlier that day.
- 19. 18maarten.weyn@uantwerpen.be Market Driven • One technology to rule them all? • Multi-modality to rule them all!
- 23. 22maarten.weyn@uantwerpen.be AmI Student Projects • https://www.youtube.com/watch?v=oZEcFYYP LkQ • http://www.youtube.com/watch?v=8Zk499VtE a0 • http://www.youtube.com/watch?v=6GOJ_0Vt 2u4&feature=youtube_gdata_player
- 29. 28maarten.weyn@uantwerpen.be Multimodal Localization as the Key for Ambient Intelligent Applications “Location information will become as indispensable as time information!”