SlideShare a Scribd company logo
Politecnico di Torino
                                 Dip. Automatica e Informatica
Final PhD Presentation @ DAUIN                 Torino, Italy




             The Role of Semantic Web Technologies
                            in Smart Environments


                                                Faisal Razzak
My PhD work
         User Intelligible Goals
         • Domotic Effects
           • Modeling
           • Evaluation
           • Enforcement
           • Optimization in Energy Management domain


         Semantic Data Exchange
         • Linked Open Dynamic Data -- LO(D)D
         • Semantic Energy Information Publishing Framework (SEIPF)




         Other Works – Internet of Things
         • Spamming the Internet of Things (IoT)
         • Web of Domotics (WoD)
         • Eye Tracking Systems (Cogain Project)




2           Presentation @DAUIN, Politecnico di                       Razzak
                        Torino, Italy
User Intelligible goals




3      Presentation @DAUIN, Politecnico di   Razzak
                   Torino, Italy
Motivation
       Users pour their personalities in order to use and
        transform their personal environments (2006).
         Resulted in “Programmable smart/ personal
           environments”.




              Davidoff, Scott, Min Lee, Charles Yiu, John Zimmerman, and Anind Dey. "Principles of smart home
              control." UbiComp 2006: Ubiquitous Computing (2006): 19-34




    4                               Presentation @DAUIN, Politecnico di                                         Razzak
                                                Torino, Italy
Motivation
       IST Advisory group published a draft titled „Ambient
        Intelligence: From vision to reality‟. In order to build
        intelligence, we need to innovate abstract concepts and
        models to address human centric expressions of
        personal style. (2003)
       A series of workshops and interviews, concluded that
        designers work top-down and like to start from abstract
        descriptions. (2008)
           The need for abstract models to address human centric
            expressions
                 1)   Ducatel, K., M. Bogdanowicz, F. Scapolo, J. Leijten, and J. C. Burgelman. "Ambient
                      intelligence: From vision to reality." IST Advisory Group Draft Rep., Eur. Comm(2003).
                 2)   van Doorn, Mark, Arjen de Vries, and Emile Aarts. "End-User Software Engineering of
                      Smart Retail Environments: The Intelligent Shop Window." Ambient Intelligence(2008):
                      157-174.



    5                               Presentation @DAUIN, Politecnico di                                        Razzak
                                                Torino, Italy
The Issues
       The issue of Device centric vision?
       The question of Enforcement?
       The question of Evaluation (monitoring)?
       Can there be a unified model?




    6                  Presentation @DAUIN, Politecnico di   Razzak
                                   Torino, Italy
Domotic Effects Framework

                                         Domotic Effects model Human
                                          intelligible state and goal.
                                      •   It provides AMI designers with
                                          an abstraction layer that
                                          enables defining generic goals
                                          inside the environment, in a
                                          declarative way.
                                      •    The high-level nature allows
                                          the residents to program their
                                          personal, office or work spaces
                                          as they see fit.
                                      •   Simple       Effect   (SE)   and
    DogEffects Ontology                   Complex Effect (CE)


7                 Presentation @DAUIN, Politecnico di              Razzak
                              Torino, Italy
Boolean Application Domain




8           Presentation @DAUIN, Politecnico di   Razzak
                        Torino, Italy
Energy Application Domain




9           Presentation @DAUIN, Politecnico di   Razzak
                        Torino, Italy
Example: Boolean Application Domain




10          Presentation @DAUIN, Politecnico di   Razzak
                        Torino, Italy
Example: Energy Application Domain




11          Presentation @DAUIN, Politecnico di   Razzak
                        Torino, Italy
How to put it simply?
               Enforcement            ?          Evaluation

     Users’ Goals                                             Devices




                          Users

12                  Presentation @DAUIN, Politecnico di           Razzak
                                Torino, Italy
More Details
     Mathematical             Enforcement                  Evaluation
     Formulation              Architecture                Architecture




                                 Results




13                  Presentation @DAUIN, Politecnico di                  Razzak
                                Torino, Italy
Enforcement




16            Presentation @DAUIN, Politecnico di   Razzak
                          Torino, Italy
Evaluation – Zero Delay Simulation




17          Presentation @DAUIN, Politecnico di   Razzak
                        Torino, Italy
Is it Applicable? -- Evaluation
    Evaluation
        In one experiment, results showed that for an iteration the
         presence of 1500 CEs with the maximum level of 177 can
         be evaluated in 118 ms (averaged over 150 times).
        In another experiment results showed that for a single
         device change, the presence of 1400 CEs with the
         maximum level of 272 can be evaluated in 258 ms.
        The goal was in less than 1 or 2 seconds.




    18                   Presentation @DAUIN, Politecnico di   Razzak
                                     Torino, Italy
Is it Applicable? -- Enforcement
    Six use cases
      Secure Home
      Home Illumination
      Morning Wakeup
      Isolated Kitchen
      Room Illumination
      Air Passage across Home

    All possible combination of use cases, i.e., 64
    In summary, the implemented enforcement module was able to
     resolve to devices in less than 100 ms.
      The goal was in less than 1 or 2 seconds.




    19                 Presentation @DAUIN, Politecnico di   Razzak
                                   Torino, Italy
An enforcement with minimal power
consumption
                                                  Formulation

                                  Results
                                  Compared against
                                   
                                  Enumeration approach.
                                For 90% of iterations the
                                  result of power
                                  consumption was better
                                  or at least equal (in case
                                  of minimal).
                                The heuristic solution
                                  time was between 1 to
                                  2 seconds for all cases.
                                  Even for cases with
                                  more than 100,000
                                  (enumerated)
20
                                  solutions.
                 Presentation @DAUIN,                     Razzak
                Politecnico di Torino, Italy
User Intelligible goals – Domotic Effects
(Papers)
    Published (ISI-Journal)

        Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User
         Intelligible Goals in Smart Home Environments." IEEE Transactions on Smart
         Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135, ISSN - 1949-3053


    Submitted (ISI-Journal)
        Fulvio Corno and Faisal Razzak: SAT Based enforcement of Domotic Effects in
         Smart Environments


        Fulvio Corno and Faisal Razzak: Monitoring of Smart Environments using
         Domotic Effects


    Currently Writing
        Dario Bonino, Fulvio Corno and Faisal Razzak: Modeling Intelligible Effects in
         Smart Homes

    22                         Presentation @DAUIN, Politecnico di                 Razzak
                                           Torino, Italy
An Alternate View
    Semantic web technologies provide both strong
     structural representation and semantics.

                              AGAINST

    Semantic web technologies provide only strong
     structural representation.
    Semantics comes from context (User and current
     settings).




    24              Presentation @DAUIN, Politecnico di   Razzak
                                Torino, Italy
Semantic Data Exchange




25         Presentation @DAUIN, Politecnico di   Razzak
                       Torino, Italy
Context
                Smart Sensing and Measuring Environments

Smart Homes                    Sensor and
                                                                 Smart Factories
              Smart Grid       Actuator Networks
                                                  Environment monitoring
     Social mobile applications



                                Smart Appliances




                      Affordable and efficient sensors



26                         Presentation @DAUIN, Politecnico di               Razzak
                                       Torino, Italy
Context

               Smart Sensing and Measuring Environments



                                 Smart Appliances
                                                                  acceleration
                                       acceleration               compass
                                       compass                    GPS
                                       air pressure               proximity
                                        temperature               microphone
 energy                                       light               camera
 (active, reactive, rev
                                                                  BT Scan
 erse, kVAr, ...)


                          Affordable and efficient sensors


27                          Presentation @DAUIN, Politecnico di           Razzak
                                        Torino, Italy
Context

                  Smart Sensing and Measuring Environments




                                Smart Appliances


                       Affordable and efficient sensors


     Motion
                                                RFID
                   Smoke                                         Pressure
                            Gyroscope

      Proximity                                                             2D codes


28                         Presentation @DAUIN, Politecnico di                  Razzak
                                       Torino, Italy
Motivation
                                          Applications need to access
                                           information from multiple
 Application     Application               environments
                                          Standard way to publish
                                           and consume information
Environ    Environ     Environ              About accessible
 ment       ment        ment                  environments
                                            About available

Applian    Applian     Applian
                                              applicances, sensors and
 ces        ces         ces                   their characteristics
                                            About the actual data
                                              measured by sensors
sensors    sensors     sensors


29                   Presentation @DAUIN, Politecnico di          Razzak
                                 Torino, Italy
Other Approaches
    Handling Temporal Data (Time Ontology)
    RDF Streaming Engines (C-SPARQL,
     SPARQLStream, EP-SPARQL)




     1.   http://www.w3.org/TR/owl-time/
     2.   D. Anicic, P. Fodor, S. Rudolph, N. Stojanovic, EP-SPARQL: a unified language for event processing and stream
          reasoning, in: Proceedings of the 20th international conference on World wide web, ACM, 2011, pp. 635–644.
     3.   D. Barbieri, D. Braga, S. Ceri, E. Della Valle, M. Grossniklaus, C-SPARQL: SPARQL for continuous querying, in:
          Proceedings of the 18th international conference on World wide web, ACM, 2009, pp. 1061–1062.
     4.    S. Groppe, J. Groppe, D. Kukulenz, V. Linnemann, A SPARQL engine for streaming RDF data, in: Signal-Image
          Technologies and Internet-Based System, 2007. Third International IEEE Conference on, IEEE, 2007, pp. 167–
          174.
     5.    D. Le-Phuoc, M. Dao-Tran, J. Xavier Parreira, M. Hauswirth, A native and adaptive approach for unified
          processing of linked streams and linked data, The Semantic Web–ISWC 2011 (2011) 370–388.




    30                                   Presentation @DAUIN, Politecnico di                                         Razzak
                                                     Torino, Italy
Approach
                                          Applications need to access
     Adopt Semantic Web                    information from multiple
     «Linked Open Data                     environments
      (LOD)» approach                     Standard way to publish
                                           and consume information
  Static information:                       About accessible
 Can be encoded in RDF                        environments
  according to a public
                                            About available
        Ontology
                                              applicances, sensors and
                                              their characteristics
  Dynamic information:                      About the actual data
    New approach to                           measured by sensors
represent streams of RDF
         events

31                   Presentation @DAUIN, Politecnico di          Razzak
                                 Torino, Italy
32   Presentation @DAUIN, Politecnico di   Razzak
                 Torino, Italy
Producer                                                           Consumer
                    Application                                                         Application




                      Publisher         Publishes                        Views &            Subscribe
                      Compone                                                                   r
                         nt                                                                 Compone
                                                          PID
                                                                                               nt
                                                        Document         Subscribe
                                                                         s to
                          E                                              Channels
                                                                                                E



                          E                                                                     E
Smart Environment




                              E           E              Channel 1            E                 E

                                      E             E    Channel2        E              E
                                  Transport Mechanism (3rd party Cloud based Service)


   33                   Presentation @DAUIN, Politecnico di                                   Razzak
                                    Torino, Italy
General LO(D)D Architecture
           Smart                                      Static
        Environment                                information
                       Producer publishes
                      Application                      about
E                                                     sensor
                                                     streams

               G monitors
    F




    34                      Presentation @DAUIN, Politecnico di   Razzak
                                        Torino, Italy
General LO(D)D Architecture
           Smart                                          Static
        Environment                                    information
                           Producer publishes
                      E   Application                      about
E                     F                                   sensor
                      G                                  streams
                  E

               G monitors                      describes
    F
                                       E            Sensor
                               G               E
                                                     data
                                       F            channel
                                   G                Sensor
                           updates             F
                                                     data
                                                    channel
                                           G
                                                    Sensor
                                                     data
                                                    channel

    35                        Presentation @DAUIN, Politecnico di    Razzak
                                          Torino, Italy
General LO(D)D Architecture
           Smart                                          Static            subscribes
        Environment                                    information
                           Producer publishes
                      E   Application                      about                        Consumer
E                     F                                   sensor                    E   Application
                      G                                  streams
                  E

               G monitors                      describes
    F                                                                                   Consumer
                                                                            E
                                                                                    E
                                       E            Sensor                              Application
                               G               E                            E
                                                     data
                                       F            channel
                                   G                Sensor              G
                                                                                        Consumer
                           updates             F                                        Application
                                                     data                       F
                                                    channel             receives
                                           G                        G
                                                    Sensor
                                                     data
                                                    channel

    36                        Presentation @DAUIN, Politecnico di                           Razzak
                                          Torino, Italy
Proposed solutions
 Producer             Open source libraries and API to enable
Application
      Consumer         application to interact with LO(D)D data
     Application
                      RDF document with meta-data (PID)
     Static             Publisher information
  information
                        List of channels, their source data, their
      about
     sensor              datatypes, and subscription URI/key
    streams           RDF «fragments» representing each event
          E             Contains: event#, sensor id, timestamp,
          F
          G              value, unit of measure
      E
                      Uses publish-subscribe pattern as transport
                       mechanism for distributing RDF fragments
     Sensor
      data
     channel

37                       Presentation @DAUIN, Politecnico di    Razzak
                                     Torino, Italy
Publisher Information Document (PID)
    According to lightweight «Publisher» ontology
    Contains declarations of all channels handled by this publisher
     – all needed static information
    Gives information to subscribe to channels
    Created by            <RDF:Description RDF:about="&Publisher;energymtr">
     publisher API           <publisher:Location RDF:datatype="&xsd;string">
                               Torino, Italia</publisher:Location>
    Published
     over http               <publisher:subscribekey>sub-xxxxxx-
                           42904d46dEEEEE
                             </publisher:subscribekey>

                              <publisher:channelName>Energy Meters
                              </publisher:channelName>

                             <RDF:type RDF:resource="&Publisher;Channel"/>
                           </RDF:Description>

    38                    Presentation @DAUIN, Politecnico di        Razzak
                                      Torino, Italy
Event data fragments
    Individual data points encoded in RDF
    Self-consistent information (e.g. Unit of measure)
    Standard syntax and semantics
    Application-independent representation
    Compact
                        <rdf:Description RDF:about = "&publisher;emergymtrChan1">
     encodings            <publisher:MeterNumber RDF:datatype="&xsd;int">
                          231 </publisher:MeterNumber>
     available
                              <publisher:Unit RDF:datatype="&xsd;string" >
                              http://purl.oclc.org/NET/muo/ucum/unit/power-level/
                              bel-kilowatt</publisher:Unit>

                              <publisher:hasTimeStamp RDF:datatype="&xsd;dateTime">
                              2012-02-02T13:06:41.056Z </publisher:hasTimeStamp>

                              <publisher:hasCurrentValue RDF:datatype ="&xsd;double">
                              0.3 </publisher:hasCurrentValue>
                            </RDF:Description>




    39                        Presentation @DAUIN, Politecnico di                       Razzak
                                          Torino, Italy
Cloud based Transport mechanism
    Provides the updates to subscribers whenever
     publishers update data
        New RDF fragments are sent to the cloud service
    Maintains list of subscribers
    Handles logic to provide transport from Publisher to
     many Subscriber in real time
    It makes the Publisher a “light-weight component”
        Publisher is independent from the number of connected
         subscribers

                                                               ...and others
                                                pubsubhubbub


    40                  Presentation @DAUIN, Politecnico di           Razzak
                                    Torino, Italy
Experiment
                   Building Infrastructure
                   Politecnico di Torino
                                                 poliEnergy
                                                     PID

                            Publishes                                                  C
                                                                                       P
            P



• 126 Electrical
    Meters.                                                                           poliEnergy
• Take reading                                                                        Aggregator
                                                                                          PID
   every 15
    minutes
                                                                          • Aggregates
                                                                         reading into 3
                                                                             ranges.
                                                                      • Publishes using 3
                                             C                              channels

42                              Presentation @DAUIN, Politecnico di                   Razzak
                                            Torino, Italy
Other Works
         Spamming the Internet of Things
             Faisal Razzak "Spamming the Internet of Things: A Possibility and its
              probable Solution." Procedia Computer Science 10 (2012): 658-665.
               MobiWIS 2012 in Canada.
         Semantic Web Technologies‟ role in Smart Environments
             Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments."
              P. Herrero et al. (Eds.): OTM 2012 Workshops, LNCS 7567, pp. 54–58,
              2012.
               OTM Workshops 2012 (Rome)
         Semantic Energy Information Publishing Framework
     1.       Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine
              understandable exchange of energy consumption information in intelligent
              domotic environments." Energy and Buildings 43, no. 6 (2011): 1392-
              1402.
         Web of Domotics
     1.   Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart
          environments through linked data." In Systems Man and Cybernetics
43                         Presentation @DAUIN, Politecnico di                   Razzak
          (SMC), 2010 IEEE International Conference on, IEEE, pp. 2922-2929.
                                        Torino, Italy
Publications
     International Journals
     1.     Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User Intelligible Goals in Smart
            Home Environments." IEEE Transactions on Smart Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135,
            ISSN - 1949-3053


     2.     Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine understandable exchange of
            energy consumption information in intelligent domotic environments." Energy and Buildings 43, no.
            6 (2011): 1392-1402.

     Proceedings
     1.   Fulvio Corno and Faisal Razzak. "Publishing LO (D) D: Linked Open (Dynamic) Data for Smart Sensing
          and Measuring Environments." Procedia Computer Science 10 (2012): 381-388.


     2.   Faisal Razzak "Spamming the Internet of Things: A Possibility and its probable Solution." Procedia
          Computer Science 10 (2012): 658-665.


     3.   Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments." P. Herrero et al. (Eds.): OTM
          2012 Workshops, LNCS 7567, pp. 54–58, 2012.


     4.   Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart environments through
          linked data." In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on,
          IEEE, pp. 2922-2929. 2010.


44   5.   Emiliano Castellina, Faisal Razzak, and Fulvio Corno. "Environmental di
                                       Presentation @DAUIN, Politecnico Control Application Compliant Razzak
                                                     Torino, Italy
          with COGAIN Guidelines." COGAIN2009 Proceedings (2009): 31.
Acknowledgement
    My work in PhD (till now) would not have been possible
     without the knowledge and guidance of following people:
      Prof. Fulvio Corno
      Dr. Emiliano Castellina (now with Reply)
      Dr. Dario Bonino
      Muhammad Sanaullah
      And all the teachers who taught PhD courses.




    45                                                         Razzak
Thank you all & Any Questions?

Reference
    s




                  Faisal Razzak (raja.faisal@gmail.com)
                                 Skype: faisal.razzak27
    Presentations: http://www.slideshare.net/konware

  Profile: http://polito.academia.edu/FaisalRazzak
  LinkedIn: http://it.linkedin.com/pub/faisal-razzak/50/511/421/

More Related Content

PDF
Performance Comparison of Digital Image Watermarking Techniques: A Survey
PDF
delna's journal
PDF
International Journal for Research in Applied Science & Engineering
PDF
M0262076085
PDF
Adaptive Video Watermarking and Quality Estimation
PDF
IRJET- Review on Raspberry Pi based Assistive Communication System for Blind,...
PDF
Survey on Different Methods of Digital Audio Watermarking
Performance Comparison of Digital Image Watermarking Techniques: A Survey
delna's journal
International Journal for Research in Applied Science & Engineering
M0262076085
Adaptive Video Watermarking and Quality Estimation
IRJET- Review on Raspberry Pi based Assistive Communication System for Blind,...
Survey on Different Methods of Digital Audio Watermarking

What's hot (19)

PDF
A GENERIC FRAMEWORK FOR DEVICE PAIRING IN UBIQUITOUS COMPUTING ENVIRONMENTS
PDF
Deep learning seminar report
PDF
Van der kamp.2011.gaze and voice controlled drawing
PDF
PDF
IEEE ECE main projects list 2012 13
PDF
A Robust Deinterlacing Multiple Image Watermarking Technique in Discrete Wave...
PPT
robust image watermarking
PDF
IDSA Midwest Conference - Mind the Gap
PDF
Presentation on DSP-Research Areas- National Conference in VLSI &amp; Communi...
PDF
Audio Watermarking and Steganography
PPTX
Ubiquitous Computing and Context-Aware Services
PDF
DWT-DCT-SVD Based Semi Blind Image Watermarking Using Middle Frequency Band
PDF
IRJET- Data Leakage Detection using Cloud Computing
PDF
Wav2Pix: Speech-conditioned face generation using Generative Adversarial Netw...
PPTX
Sign Language Recognition based on Hands symbols Classification
PPTX
Watermarking
PDF
IRJET- A Reliable and Robust Video Watermarking Scheme Over Cloud
PDF
A Novel Digital Watermarking Technique for Video Copyright Protection
PPTX
Color-plus-Depth Level-of-Detail in 3D Tele-immersive Video: A Psychophysical...
A GENERIC FRAMEWORK FOR DEVICE PAIRING IN UBIQUITOUS COMPUTING ENVIRONMENTS
Deep learning seminar report
Van der kamp.2011.gaze and voice controlled drawing
IEEE ECE main projects list 2012 13
A Robust Deinterlacing Multiple Image Watermarking Technique in Discrete Wave...
robust image watermarking
IDSA Midwest Conference - Mind the Gap
Presentation on DSP-Research Areas- National Conference in VLSI &amp; Communi...
Audio Watermarking and Steganography
Ubiquitous Computing and Context-Aware Services
DWT-DCT-SVD Based Semi Blind Image Watermarking Using Middle Frequency Band
IRJET- Data Leakage Detection using Cloud Computing
Wav2Pix: Speech-conditioned face generation using Generative Adversarial Netw...
Sign Language Recognition based on Hands symbols Classification
Watermarking
IRJET- A Reliable and Robust Video Watermarking Scheme Over Cloud
A Novel Digital Watermarking Technique for Video Copyright Protection
Color-plus-Depth Level-of-Detail in 3D Tele-immersive Video: A Psychophysical...
Ad

Similar to The Role of Semantic Web Technologies in Smart Environments (20)

PDF
IRJET- A Real Time Yolo Human Detection in Flood Affected Areas based on Vide...
PDF
Enacting Emergent Configurations in the IoT through Domain Objects
PDF
Rajat Bandejiya(14uec076)Lusip (Smart Campus) Report
PDF
IRJET- Alternate Vision Assistance: For the Blind
PPTX
Towards application development for the internet of things updated
PDF
IRJET- Object Detection and Recognition for Blind Assistance
PDF
Exploring Advanced Deep Learning Projects.pdf
PPTX
Grasping the Future: Virtual Hands Control for Fine Motor Tasks
PPTX
Approximate Semantic Matching of Heterogeneous Events
PDF
Orban Widetag
PPTX
Enabling High Level Application Development In The Internet Of Things
PDF
Shaspa
PDF
Control the computer with your eyes
PDF
Iswc2008
PDF
DYNAMIC ENERGY MANAGEMENT USING REAL TIME OBJECT DETECTION
PDF
ScilabTEC 2015 - Irill
PDF
Software Preservation: challenges and opportunities for reproductibility (Sci...
PPTX
Unlocking the Future: Exploring the Power of Digital Twin Technology
PDF
Discussion materials for Internet of Things and Smart Cities - Vespucci 2016 ...
PPTX
Silent sound technology NEW
IRJET- A Real Time Yolo Human Detection in Flood Affected Areas based on Vide...
Enacting Emergent Configurations in the IoT through Domain Objects
Rajat Bandejiya(14uec076)Lusip (Smart Campus) Report
IRJET- Alternate Vision Assistance: For the Blind
Towards application development for the internet of things updated
IRJET- Object Detection and Recognition for Blind Assistance
Exploring Advanced Deep Learning Projects.pdf
Grasping the Future: Virtual Hands Control for Fine Motor Tasks
Approximate Semantic Matching of Heterogeneous Events
Orban Widetag
Enabling High Level Application Development In The Internet Of Things
Shaspa
Control the computer with your eyes
Iswc2008
DYNAMIC ENERGY MANAGEMENT USING REAL TIME OBJECT DETECTION
ScilabTEC 2015 - Irill
Software Preservation: challenges and opportunities for reproductibility (Sci...
Unlocking the Future: Exploring the Power of Digital Twin Technology
Discussion materials for Internet of Things and Smart Cities - Vespucci 2016 ...
Silent sound technology NEW
Ad

More from Faisal Razzak (6)

PPTX
LO(D)D ant2012
PPTX
Recommendations for selection process automation in systematic reviews
PPT
2nd year PHD Report
PPTX
WoD: Application for Ageing Society
PPTX
Web of Domotics Poster
PDF
RFID Protocols and Privacy Models for RFID
LO(D)D ant2012
Recommendations for selection process automation in systematic reviews
2nd year PHD Report
WoD: Application for Ageing Society
Web of Domotics Poster
RFID Protocols and Privacy Models for RFID

The Role of Semantic Web Technologies in Smart Environments

  • 1. Politecnico di Torino Dip. Automatica e Informatica Final PhD Presentation @ DAUIN Torino, Italy The Role of Semantic Web Technologies in Smart Environments Faisal Razzak
  • 2. My PhD work User Intelligible Goals • Domotic Effects • Modeling • Evaluation • Enforcement • Optimization in Energy Management domain Semantic Data Exchange • Linked Open Dynamic Data -- LO(D)D • Semantic Energy Information Publishing Framework (SEIPF) Other Works – Internet of Things • Spamming the Internet of Things (IoT) • Web of Domotics (WoD) • Eye Tracking Systems (Cogain Project) 2 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 3. User Intelligible goals 3 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 4. Motivation  Users pour their personalities in order to use and transform their personal environments (2006).  Resulted in “Programmable smart/ personal environments”. Davidoff, Scott, Min Lee, Charles Yiu, John Zimmerman, and Anind Dey. "Principles of smart home control." UbiComp 2006: Ubiquitous Computing (2006): 19-34 4 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 5. Motivation  IST Advisory group published a draft titled „Ambient Intelligence: From vision to reality‟. In order to build intelligence, we need to innovate abstract concepts and models to address human centric expressions of personal style. (2003)  A series of workshops and interviews, concluded that designers work top-down and like to start from abstract descriptions. (2008)  The need for abstract models to address human centric expressions 1) Ducatel, K., M. Bogdanowicz, F. Scapolo, J. Leijten, and J. C. Burgelman. "Ambient intelligence: From vision to reality." IST Advisory Group Draft Rep., Eur. Comm(2003). 2) van Doorn, Mark, Arjen de Vries, and Emile Aarts. "End-User Software Engineering of Smart Retail Environments: The Intelligent Shop Window." Ambient Intelligence(2008): 157-174. 5 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 6. The Issues  The issue of Device centric vision?  The question of Enforcement?  The question of Evaluation (monitoring)?  Can there be a unified model? 6 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 7. Domotic Effects Framework  Domotic Effects model Human intelligible state and goal. • It provides AMI designers with an abstraction layer that enables defining generic goals inside the environment, in a declarative way. • The high-level nature allows the residents to program their personal, office or work spaces as they see fit. • Simple Effect (SE) and DogEffects Ontology Complex Effect (CE) 7 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 8. Boolean Application Domain 8 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 9. Energy Application Domain 9 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 10. Example: Boolean Application Domain 10 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 11. Example: Energy Application Domain 11 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 12. How to put it simply? Enforcement ? Evaluation Users’ Goals Devices Users 12 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 13. More Details Mathematical Enforcement Evaluation Formulation Architecture Architecture Results 13 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 14. Enforcement 16 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 15. Evaluation – Zero Delay Simulation 17 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 16. Is it Applicable? -- Evaluation  Evaluation  In one experiment, results showed that for an iteration the presence of 1500 CEs with the maximum level of 177 can be evaluated in 118 ms (averaged over 150 times).  In another experiment results showed that for a single device change, the presence of 1400 CEs with the maximum level of 272 can be evaluated in 258 ms.  The goal was in less than 1 or 2 seconds. 18 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 17. Is it Applicable? -- Enforcement  Six use cases  Secure Home  Home Illumination  Morning Wakeup  Isolated Kitchen  Room Illumination  Air Passage across Home  All possible combination of use cases, i.e., 64  In summary, the implemented enforcement module was able to resolve to devices in less than 100 ms.  The goal was in less than 1 or 2 seconds. 19 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 18. An enforcement with minimal power consumption Formulation  Results Compared against  Enumeration approach.  For 90% of iterations the result of power consumption was better or at least equal (in case of minimal).  The heuristic solution time was between 1 to 2 seconds for all cases. Even for cases with more than 100,000 (enumerated) 20 solutions. Presentation @DAUIN, Razzak Politecnico di Torino, Italy
  • 19. User Intelligible goals – Domotic Effects (Papers)  Published (ISI-Journal)  Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User Intelligible Goals in Smart Home Environments." IEEE Transactions on Smart Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135, ISSN - 1949-3053  Submitted (ISI-Journal)  Fulvio Corno and Faisal Razzak: SAT Based enforcement of Domotic Effects in Smart Environments  Fulvio Corno and Faisal Razzak: Monitoring of Smart Environments using Domotic Effects  Currently Writing  Dario Bonino, Fulvio Corno and Faisal Razzak: Modeling Intelligible Effects in Smart Homes 22 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 20. An Alternate View  Semantic web technologies provide both strong structural representation and semantics. AGAINST  Semantic web technologies provide only strong structural representation.  Semantics comes from context (User and current settings). 24 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 21. Semantic Data Exchange 25 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 22. Context Smart Sensing and Measuring Environments Smart Homes Sensor and Smart Factories Smart Grid Actuator Networks Environment monitoring Social mobile applications Smart Appliances Affordable and efficient sensors 26 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 23. Context Smart Sensing and Measuring Environments Smart Appliances acceleration acceleration compass compass GPS air pressure proximity temperature microphone energy light camera (active, reactive, rev BT Scan erse, kVAr, ...) Affordable and efficient sensors 27 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 24. Context Smart Sensing and Measuring Environments Smart Appliances Affordable and efficient sensors Motion RFID Smoke Pressure Gyroscope Proximity 2D codes 28 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 25. Motivation  Applications need to access information from multiple Application Application environments  Standard way to publish and consume information Environ Environ Environ  About accessible ment ment ment environments  About available Applian Applian Applian applicances, sensors and ces ces ces their characteristics  About the actual data measured by sensors sensors sensors sensors 29 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 26. Other Approaches  Handling Temporal Data (Time Ontology)  RDF Streaming Engines (C-SPARQL, SPARQLStream, EP-SPARQL) 1. http://www.w3.org/TR/owl-time/ 2. D. Anicic, P. Fodor, S. Rudolph, N. Stojanovic, EP-SPARQL: a unified language for event processing and stream reasoning, in: Proceedings of the 20th international conference on World wide web, ACM, 2011, pp. 635–644. 3. D. Barbieri, D. Braga, S. Ceri, E. Della Valle, M. Grossniklaus, C-SPARQL: SPARQL for continuous querying, in: Proceedings of the 18th international conference on World wide web, ACM, 2009, pp. 1061–1062. 4. S. Groppe, J. Groppe, D. Kukulenz, V. Linnemann, A SPARQL engine for streaming RDF data, in: Signal-Image Technologies and Internet-Based System, 2007. Third International IEEE Conference on, IEEE, 2007, pp. 167– 174. 5. D. Le-Phuoc, M. Dao-Tran, J. Xavier Parreira, M. Hauswirth, A native and adaptive approach for unified processing of linked streams and linked data, The Semantic Web–ISWC 2011 (2011) 370–388. 30 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 27. Approach  Applications need to access Adopt Semantic Web information from multiple «Linked Open Data environments (LOD)» approach  Standard way to publish and consume information Static information:  About accessible Can be encoded in RDF environments according to a public  About available Ontology applicances, sensors and their characteristics Dynamic information:  About the actual data New approach to measured by sensors represent streams of RDF events 31 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 28. 32 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 29. Producer Consumer Application Application Publisher Publishes Views & Subscribe Compone r nt Compone PID nt Document Subscribe s to E Channels E E E Smart Environment E E Channel 1 E E E E Channel2 E E Transport Mechanism (3rd party Cloud based Service) 33 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 30. General LO(D)D Architecture Smart Static Environment information Producer publishes Application about E sensor streams G monitors F 34 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 31. General LO(D)D Architecture Smart Static Environment information Producer publishes E Application about E F sensor G streams E G monitors describes F E Sensor G E data F channel G Sensor updates F data channel G Sensor data channel 35 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 32. General LO(D)D Architecture Smart Static subscribes Environment information Producer publishes E Application about Consumer E F sensor E Application G streams E G monitors describes F Consumer E E E Sensor Application G E E data F channel G Sensor G Consumer updates F Application data F channel receives G G Sensor data channel 36 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 33. Proposed solutions Producer  Open source libraries and API to enable Application Consumer application to interact with LO(D)D data Application  RDF document with meta-data (PID) Static  Publisher information information  List of channels, their source data, their about sensor datatypes, and subscription URI/key streams  RDF «fragments» representing each event E  Contains: event#, sensor id, timestamp, F G value, unit of measure E  Uses publish-subscribe pattern as transport mechanism for distributing RDF fragments Sensor data channel 37 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 34. Publisher Information Document (PID)  According to lightweight «Publisher» ontology  Contains declarations of all channels handled by this publisher – all needed static information  Gives information to subscribe to channels  Created by <RDF:Description RDF:about="&Publisher;energymtr"> publisher API <publisher:Location RDF:datatype="&xsd;string"> Torino, Italia</publisher:Location>  Published over http <publisher:subscribekey>sub-xxxxxx- 42904d46dEEEEE </publisher:subscribekey> <publisher:channelName>Energy Meters </publisher:channelName> <RDF:type RDF:resource="&Publisher;Channel"/> </RDF:Description> 38 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 35. Event data fragments  Individual data points encoded in RDF  Self-consistent information (e.g. Unit of measure)  Standard syntax and semantics  Application-independent representation  Compact <rdf:Description RDF:about = "&publisher;emergymtrChan1"> encodings <publisher:MeterNumber RDF:datatype="&xsd;int"> 231 </publisher:MeterNumber> available <publisher:Unit RDF:datatype="&xsd;string" > http://purl.oclc.org/NET/muo/ucum/unit/power-level/ bel-kilowatt</publisher:Unit> <publisher:hasTimeStamp RDF:datatype="&xsd;dateTime"> 2012-02-02T13:06:41.056Z </publisher:hasTimeStamp> <publisher:hasCurrentValue RDF:datatype ="&xsd;double"> 0.3 </publisher:hasCurrentValue> </RDF:Description> 39 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 36. Cloud based Transport mechanism  Provides the updates to subscribers whenever publishers update data  New RDF fragments are sent to the cloud service  Maintains list of subscribers  Handles logic to provide transport from Publisher to many Subscriber in real time  It makes the Publisher a “light-weight component”  Publisher is independent from the number of connected subscribers ...and others pubsubhubbub 40 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 37. Experiment Building Infrastructure Politecnico di Torino poliEnergy PID Publishes C P P • 126 Electrical Meters. poliEnergy • Take reading Aggregator PID every 15 minutes • Aggregates reading into 3 ranges. • Publishes using 3 C channels 42 Presentation @DAUIN, Politecnico di Razzak Torino, Italy
  • 38. Other Works  Spamming the Internet of Things  Faisal Razzak "Spamming the Internet of Things: A Possibility and its probable Solution." Procedia Computer Science 10 (2012): 658-665. MobiWIS 2012 in Canada.  Semantic Web Technologies‟ role in Smart Environments  Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments." P. Herrero et al. (Eds.): OTM 2012 Workshops, LNCS 7567, pp. 54–58, 2012. OTM Workshops 2012 (Rome)  Semantic Energy Information Publishing Framework 1. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine understandable exchange of energy consumption information in intelligent domotic environments." Energy and Buildings 43, no. 6 (2011): 1392- 1402.  Web of Domotics 1. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart environments through linked data." In Systems Man and Cybernetics 43 Presentation @DAUIN, Politecnico di Razzak (SMC), 2010 IEEE International Conference on, IEEE, pp. 2922-2929. Torino, Italy
  • 39. Publications International Journals 1. Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User Intelligible Goals in Smart Home Environments." IEEE Transactions on Smart Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135, ISSN - 1949-3053 2. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine understandable exchange of energy consumption information in intelligent domotic environments." Energy and Buildings 43, no. 6 (2011): 1392-1402. Proceedings 1. Fulvio Corno and Faisal Razzak. "Publishing LO (D) D: Linked Open (Dynamic) Data for Smart Sensing and Measuring Environments." Procedia Computer Science 10 (2012): 381-388. 2. Faisal Razzak "Spamming the Internet of Things: A Possibility and its probable Solution." Procedia Computer Science 10 (2012): 658-665. 3. Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments." P. Herrero et al. (Eds.): OTM 2012 Workshops, LNCS 7567, pp. 54–58, 2012. 4. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart environments through linked data." In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on, IEEE, pp. 2922-2929. 2010. 44 5. Emiliano Castellina, Faisal Razzak, and Fulvio Corno. "Environmental di Presentation @DAUIN, Politecnico Control Application Compliant Razzak Torino, Italy with COGAIN Guidelines." COGAIN2009 Proceedings (2009): 31.
  • 40. Acknowledgement  My work in PhD (till now) would not have been possible without the knowledge and guidance of following people:  Prof. Fulvio Corno  Dr. Emiliano Castellina (now with Reply)  Dr. Dario Bonino  Muhammad Sanaullah  And all the teachers who taught PhD courses. 45 Razzak
  • 41. Thank you all & Any Questions? Reference s Faisal Razzak (raja.faisal@gmail.com) Skype: faisal.razzak27 Presentations: http://www.slideshare.net/konware Profile: http://polito.academia.edu/FaisalRazzak LinkedIn: http://it.linkedin.com/pub/faisal-razzak/50/511/421/

Editor's Notes

  • #3: Blue – Explained ,,,, White --- Not Explained