SlideShare a Scribd company logo
Institute for Web Science & Technologies – WeST
Semantics Perspective
on
Physical-Cyber-Social
Computing
Steffen Staab,
With research work from WeST Team
Steffen Staab 2Semantics Perspective
Prelude: Web Observatory
Collect PCSC data & ground truth!
Where is our PCSC observatory?
Understanding
 Collecting
 Describing
 Analyzing
 Modeling
 Predicting
 Repeating!
Steffen Staab 3Semantics Perspective
And now for something completely different...
Where is our PCSC observatory?
Institute for Web Science & Technologies – WeST
Semantics Perspective
on
Physical-Cyber-Social
Computing
Steffen Staab,
With research work from WeST Team
Steffen Staab 5Semantics Perspective
Physical-Cyber-Social Computing
Physical
Sensors
Social
Computing
Cyber
Understanding
And here some miracle M occurs!
Let‘s analyse this in more detail!
Steffen Staab 6Semantics Perspective
Physical-Cyber-Social Computing
Physical
Sensors
Social
Computing
Cyber
Understanding
And here some miracle M1
occurs
Another miracle M2 occurs
Steffen Staab 7Semantics Perspective
Physical-Cyber-Social Computing
Physical
Sensors
Social
Computing
Cyber
View
Semantic integration Semantic interfaces
Integration Model Understanding
Semantic
Institute for Web Science & Technologies – WeST
Semantic Integration
Steffen Staab 9Semantics Perspective
Semantic Integration
 Ontology definition
 Ontology mapping
 Programming with ontologies! (often forgotten part!)
 Established, but still not known too well
 Too much myth?
Steffen Staab 10Semantics Perspective
Semantic Integration: refering to a story by Alan Rector
Steffen Staab 11Semantics Perspective
Semantic Integration: refering to a story by Alan Rector
FeverElecHeatElemmeasuringTempPhysSensor
Complex concept
Institute for Web Science & Technologies – WeST
Semantic Models
Also a way to do integration!!!!
Steffen Staab 13Semantics Perspective
Person sensors
Physical
Sensors
Situational
Context
Environment s.
Tool (car...)
Group
Social
Computing
Social
Context
Role
...
Cyber
Steffen Staab 14Semantics Perspective
Person sensors
Physical
Sensors
Situational
Context
Environment s.
Tool (car...)
Group
Social
Computing
Social
Context
Role
...
Text
Cyber Networks Media
Actions/Transactions
Semantic
Represen.
Pragmatic
interpretat.
Steffen Staab 15Semantics Perspective
Meaning: Contextualization of Topics - MGTM
 Flickr photos of food, having tags
 Geographical Topic Models
 Spatial context improves content analysis
Steffen Staab 16Semantics Perspective
Neighbour Topic Exchange
Steffen Staab 17Semantics Perspective
Neighbour Topic Exchange
Steffen Staab 18Semantics Perspective
Neighbour Topic Exchange
Can be generalized to other features than geolocation:
• Time (also cyclic time)
• Temperature
• ....
Steffen Staab 19Semantics Perspective
Meaning: Understanding Context – EU Live+Gov
Urban Maintenance (Buitenbeter)
 Citizens reporting infrastructure damages
 Text+Image+Sensor readings submitted by citizen
• Activity recognition: walking, cycling,..
• Higher level context: shopping, commuting,...
Steffen Staab 20Semantics Perspective
Meaning: Linking of content - EU EPPICS
Use Case: Water management
 Floods of the river Po (Italy)
 Observations:
 Physical:
• Water level sensors
• Smartphone geo positions (where do people drive?)
 Social & content
• What do people tweet
(„road blocked“, „went there and there“)
 Challenges:
 Linking data
 Correlating data („level X blocks road Y“)
Institute for Web Science & Technologies – WeST
Semantic Views
Steffen Staab 22Semantics Perspective
Relevance in "typical" social network graph
Steffen Staab 23Semantics Perspective
Relevance: Retrieving Node A's news stream
Steffen Staab 24Semantics Perspective
Relevance: Retrieving Node A's news stream
Steffen Staab 25Semantics Perspective
Meaning: Turning sensing of attention into
semantics
 Tagging by sensing
 Interestingness
 Content tags to
regions
Institute for Web Science & Technologies – WeST
Conclusion
Steffen Staab 27Semantics Perspective
Challenges in Semantics4PCS-computing
 Sensor ontology (SSN)
 Better understanding of what does not work
 Better understanding of whether the problem is in the
ontology or in the modeling!
 Abstraction and contextualization from
 lowest level interpretation („34734893“)
 to mid level interpretation
• „deviating from the norm by twice standard deviation“
• „cycling“ „running“
 To high level interpretation
• „broad flooding“
• „shopping“ „commuting“
Steffen Staab 28Semantics Perspective
Conclusion: Semantics in PCS-Computing
 Representing contextualized facts
 Extended provenance
-> who, where, when,...
 Understanding context
 More than sensor readings
-> Reporting
 Using context
 Influences semantics
 Influences use of semantics (pragmatics)
-> Actions!
Steffen Staab 29Semantics Perspective
Some of many open questions
 Which context is most useful when?
 What are good models for higher level interpretations?
 Notion of pragmatics?
Which data is good for which purpose?
Institute for Web Science & Technologies – WeST
Thank you!
Steffen Staab 31Semantics Perspective
References
1. R. Pickhardt, T. Gottron, A. Scherp, S. Staab, Jonas Kunze. Efficient Graph Models for Retrieving Top-k
News Feeds from Ego Networks. In: SocialCom 2012 – Proceedings of the 2012 IEEE Fourth
International Conference on Social Computing, Amsterdam, NL, September 3-6, 2012.
2. Tina Walber, Chantal Neuhaus, Ansgar Scherp, Steffen Staab, Ramesh Jain. Creation of Individual
Photo Selections: Read Preferences from the Users' Eyes. In: Proceedings of ACM Multimedia 2013,
Barcelona, October 2013.
3. C. Kling et al. Detecting Non-Gaussian Geographical Topics in Tagged Photo Collections. Tech Report.
4. http://liveandgov.eu/

More Related Content

PDF
IEEE Projects for CSE
PPTX
Towards Cyber-Physical System technologies over Apache VCL
PPT
Physical-Cyber-Social Data Analytics & Smart City Applications
PDF
Assesing the Use of Continous-Time and Timed-Triggered Models for Developing ...
PPT
Sensors1(1)
PPTX
Semantic Sensor Networks and Linked Stream Data
PDF
Franck Rebillard, Professeur Université Paris 3
PDF
Prerquisite for Data Sciecne, KDD, Attribute Type
IEEE Projects for CSE
Towards Cyber-Physical System technologies over Apache VCL
Physical-Cyber-Social Data Analytics & Smart City Applications
Assesing the Use of Continous-Time and Timed-Triggered Models for Developing ...
Sensors1(1)
Semantic Sensor Networks and Linked Stream Data
Franck Rebillard, Professeur Université Paris 3
Prerquisite for Data Sciecne, KDD, Attribute Type

Similar to Semantics Perspective on Physical-Cyber-Social Computing (20)

PDF
Data socialscienceprogramme
PDF
Why Data Science is a Science
PDF
Big data, Behavioral Change and IOT Architecture
PPTX
Ingredients for Semantic Sensor Networks
PDF
Time for Events -- Presentation to New Economic School / Center for the Study...
 
PPTX
AAG_2011
PPTX
07 Network Visualization
PDF
NG2S: A Study of Pro-Environmental Tipping Point via ABMs
PDF
Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015
PDF
Data Science in 2016: Moving Up
PDF
Computer And Information Science Roger Lee
PPTX
Web and Complex Systems Lab @ Kno.e.sis
PDF
Visual Analysis Of Multilayer Networks Fintanrenoust Benjaminarchambault Dani...
PDF
Big Data and IOT
PPTX
Term Paper Presentation
PPTX
15 Network Visualization and Communities
PDF
Introduction
PPTX
Era ofdataeconomyv4short
PPTX
Measuring and Predicting Departures from Routine in Human Mobility by Dirk Go...
PPT
Smart Cities: How are they different?
Data socialscienceprogramme
Why Data Science is a Science
Big data, Behavioral Change and IOT Architecture
Ingredients for Semantic Sensor Networks
Time for Events -- Presentation to New Economic School / Center for the Study...
 
AAG_2011
07 Network Visualization
NG2S: A Study of Pro-Environmental Tipping Point via ABMs
Data Science in 2016: Moving up by Paco Nathan at Big Data Spain 2015
Data Science in 2016: Moving Up
Computer And Information Science Roger Lee
Web and Complex Systems Lab @ Kno.e.sis
Visual Analysis Of Multilayer Networks Fintanrenoust Benjaminarchambault Dani...
Big Data and IOT
Term Paper Presentation
15 Network Visualization and Communities
Introduction
Era ofdataeconomyv4short
Measuring and Predicting Departures from Routine in Human Mobility by Dirk Go...
Smart Cities: How are they different?
Ad

More from Steffen Staab (20)

PDF
Towards Scientific Foundation Models (Invited Talk)
PPTX
Investigating Fairness of Decision Making
PPTX
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
PPTX
Knowledge graphs for knowing more and knowing for sure
PPTX
Symbolic Background Knowledge for Machine Learning
PPTX
Soziale Netzwerke und Medien: Multi-disziplinäre Ansätze für ein multi-dimens...
PPTX
Web Futures: Inclusive, Intelligent, Sustainable
PPTX
Eyeing the Web
PPTX
Concepts in Application Context ( How we may think conceptually )
PDF
Storing and Querying Semantic Data in the Cloud
PPTX
Semantics reloaded
PPTX
Ontologien und Semantic Web - Impulsvortrag Terminologietag
PPTX
Opinion Formation and Spreading
PPTX
The Web We Want
PPTX
10 Jahre Web Science
PPTX
(Semi-)Automatic analysis of online contents
PPTX
Programming with Semantic Broad Data
PPTX
Text Mining using LDA with Context
PPTX
Wwsss intro2016-final
PPTX
10 Years Web Science
Towards Scientific Foundation Models (Invited Talk)
Investigating Fairness of Decision Making
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Knowledge graphs for knowing more and knowing for sure
Symbolic Background Knowledge for Machine Learning
Soziale Netzwerke und Medien: Multi-disziplinäre Ansätze für ein multi-dimens...
Web Futures: Inclusive, Intelligent, Sustainable
Eyeing the Web
Concepts in Application Context ( How we may think conceptually )
Storing and Querying Semantic Data in the Cloud
Semantics reloaded
Ontologien und Semantic Web - Impulsvortrag Terminologietag
Opinion Formation and Spreading
The Web We Want
10 Jahre Web Science
(Semi-)Automatic analysis of online contents
Programming with Semantic Broad Data
Text Mining using LDA with Context
Wwsss intro2016-final
10 Years Web Science
Ad

Recently uploaded (20)

PPTX
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
PDF
Complications of Minimal Access Surgery at WLH
PDF
TR - Agricultural Crops Production NC III.pdf
PPTX
Pharmacology of Heart Failure /Pharmacotherapy of CHF
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PPTX
Cell Structure & Organelles in detailed.
PPTX
Pharma ospi slides which help in ospi learning
PPTX
master seminar digital applications in india
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
Basic Mud Logging Guide for educational purpose
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
Business Ethics Teaching Materials for college
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
Complications of Minimal Access Surgery at WLH
TR - Agricultural Crops Production NC III.pdf
Pharmacology of Heart Failure /Pharmacotherapy of CHF
Supply Chain Operations Speaking Notes -ICLT Program
Cell Structure & Organelles in detailed.
Pharma ospi slides which help in ospi learning
master seminar digital applications in india
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
Basic Mud Logging Guide for educational purpose
human mycosis Human fungal infections are called human mycosis..pptx
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
Business Ethics Teaching Materials for college
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Microbial diseases, their pathogenesis and prophylaxis
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
102 student loan defaulters named and shamed – Is someone you know on the list?

Semantics Perspective on Physical-Cyber-Social Computing

  • 1. Institute for Web Science & Technologies – WeST Semantics Perspective on Physical-Cyber-Social Computing Steffen Staab, With research work from WeST Team
  • 2. Steffen Staab 2Semantics Perspective Prelude: Web Observatory Collect PCSC data & ground truth! Where is our PCSC observatory? Understanding  Collecting  Describing  Analyzing  Modeling  Predicting  Repeating!
  • 3. Steffen Staab 3Semantics Perspective And now for something completely different... Where is our PCSC observatory?
  • 4. Institute for Web Science & Technologies – WeST Semantics Perspective on Physical-Cyber-Social Computing Steffen Staab, With research work from WeST Team
  • 5. Steffen Staab 5Semantics Perspective Physical-Cyber-Social Computing Physical Sensors Social Computing Cyber Understanding And here some miracle M occurs! Let‘s analyse this in more detail!
  • 6. Steffen Staab 6Semantics Perspective Physical-Cyber-Social Computing Physical Sensors Social Computing Cyber Understanding And here some miracle M1 occurs Another miracle M2 occurs
  • 7. Steffen Staab 7Semantics Perspective Physical-Cyber-Social Computing Physical Sensors Social Computing Cyber View Semantic integration Semantic interfaces Integration Model Understanding Semantic
  • 8. Institute for Web Science & Technologies – WeST Semantic Integration
  • 9. Steffen Staab 9Semantics Perspective Semantic Integration  Ontology definition  Ontology mapping  Programming with ontologies! (often forgotten part!)  Established, but still not known too well  Too much myth?
  • 10. Steffen Staab 10Semantics Perspective Semantic Integration: refering to a story by Alan Rector
  • 11. Steffen Staab 11Semantics Perspective Semantic Integration: refering to a story by Alan Rector FeverElecHeatElemmeasuringTempPhysSensor Complex concept
  • 12. Institute for Web Science & Technologies – WeST Semantic Models Also a way to do integration!!!!
  • 13. Steffen Staab 13Semantics Perspective Person sensors Physical Sensors Situational Context Environment s. Tool (car...) Group Social Computing Social Context Role ... Cyber
  • 14. Steffen Staab 14Semantics Perspective Person sensors Physical Sensors Situational Context Environment s. Tool (car...) Group Social Computing Social Context Role ... Text Cyber Networks Media Actions/Transactions Semantic Represen. Pragmatic interpretat.
  • 15. Steffen Staab 15Semantics Perspective Meaning: Contextualization of Topics - MGTM  Flickr photos of food, having tags  Geographical Topic Models  Spatial context improves content analysis
  • 16. Steffen Staab 16Semantics Perspective Neighbour Topic Exchange
  • 17. Steffen Staab 17Semantics Perspective Neighbour Topic Exchange
  • 18. Steffen Staab 18Semantics Perspective Neighbour Topic Exchange Can be generalized to other features than geolocation: • Time (also cyclic time) • Temperature • ....
  • 19. Steffen Staab 19Semantics Perspective Meaning: Understanding Context – EU Live+Gov Urban Maintenance (Buitenbeter)  Citizens reporting infrastructure damages  Text+Image+Sensor readings submitted by citizen • Activity recognition: walking, cycling,.. • Higher level context: shopping, commuting,...
  • 20. Steffen Staab 20Semantics Perspective Meaning: Linking of content - EU EPPICS Use Case: Water management  Floods of the river Po (Italy)  Observations:  Physical: • Water level sensors • Smartphone geo positions (where do people drive?)  Social & content • What do people tweet („road blocked“, „went there and there“)  Challenges:  Linking data  Correlating data („level X blocks road Y“)
  • 21. Institute for Web Science & Technologies – WeST Semantic Views
  • 22. Steffen Staab 22Semantics Perspective Relevance in "typical" social network graph
  • 23. Steffen Staab 23Semantics Perspective Relevance: Retrieving Node A's news stream
  • 24. Steffen Staab 24Semantics Perspective Relevance: Retrieving Node A's news stream
  • 25. Steffen Staab 25Semantics Perspective Meaning: Turning sensing of attention into semantics  Tagging by sensing  Interestingness  Content tags to regions
  • 26. Institute for Web Science & Technologies – WeST Conclusion
  • 27. Steffen Staab 27Semantics Perspective Challenges in Semantics4PCS-computing  Sensor ontology (SSN)  Better understanding of what does not work  Better understanding of whether the problem is in the ontology or in the modeling!  Abstraction and contextualization from  lowest level interpretation („34734893“)  to mid level interpretation • „deviating from the norm by twice standard deviation“ • „cycling“ „running“  To high level interpretation • „broad flooding“ • „shopping“ „commuting“
  • 28. Steffen Staab 28Semantics Perspective Conclusion: Semantics in PCS-Computing  Representing contextualized facts  Extended provenance -> who, where, when,...  Understanding context  More than sensor readings -> Reporting  Using context  Influences semantics  Influences use of semantics (pragmatics) -> Actions!
  • 29. Steffen Staab 29Semantics Perspective Some of many open questions  Which context is most useful when?  What are good models for higher level interpretations?  Notion of pragmatics? Which data is good for which purpose?
  • 30. Institute for Web Science & Technologies – WeST Thank you!
  • 31. Steffen Staab 31Semantics Perspective References 1. R. Pickhardt, T. Gottron, A. Scherp, S. Staab, Jonas Kunze. Efficient Graph Models for Retrieving Top-k News Feeds from Ego Networks. In: SocialCom 2012 – Proceedings of the 2012 IEEE Fourth International Conference on Social Computing, Amsterdam, NL, September 3-6, 2012. 2. Tina Walber, Chantal Neuhaus, Ansgar Scherp, Steffen Staab, Ramesh Jain. Creation of Individual Photo Selections: Read Preferences from the Users' Eyes. In: Proceedings of ACM Multimedia 2013, Barcelona, October 2013. 3. C. Kling et al. Detecting Non-Gaussian Geographical Topics in Tagged Photo Collections. Tech Report. 4. http://liveandgov.eu/