semantics perspective on physical-cyber-social computing
DESCRIPTION
Presentation at Dagstuhl Workshop on Physical-Cyber-Social Computing, Sept/Oct 2013TRANSCRIPT
![Page 1: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/1.jpg)
Institute for Web Science & Technologies – WeST
Semantics Perspective on
Physical-Cyber-Social Computing
Steffen Staab,
With research work from WeST Team
![Page 2: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/2.jpg)
Steffen Staab 2Semantics Perspective
Prelude: Web Observatory
Collect PCSC data & ground truth!
Where is our PCSC observatory?
Understanding Collecting Describing Analyzing Modeling Predicting Repeating!
![Page 3: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/3.jpg)
Steffen Staab 3Semantics Perspective
And now for something completely different...
Where is our PCSC observatory?
![Page 4: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/4.jpg)
Institute for Web Science & Technologies – WeST
Semantics Perspective on
Physical-Cyber-Social Computing
Steffen Staab,
With research work from WeST Team
![Page 5: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/5.jpg)
Steffen Staab 5Semantics Perspective
Physical-Cyber-Social Computing
Physical Sensors
Social Computing
CyberUnderstanding
And here some miracle M occurs!
Let‘s analyse this in more detail!
![Page 6: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/6.jpg)
Steffen Staab 6Semantics Perspective
Physical-Cyber-Social Computing
Physical Sensors
Social Computing
Cyber
Understanding
And here some miracle M1 occurs
Another miracle M2 occurs
![Page 7: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/7.jpg)
Steffen Staab 7Semantics Perspective
Physical-Cyber-Social Computing
Physical Sensors
Social Computing
Cyber
View
Semantic integration Semantic interfaces
Integration Model UnderstandingSemantic
![Page 8: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/8.jpg)
Institute for Web Science & Technologies – WeST
Semantic Integration
![Page 9: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/9.jpg)
Steffen Staab 9Semantics Perspective
Semantic Integration
Ontology definition Ontology mapping Programming with ontologies! (often forgotten part!)
Established, but still not known too well Too much myth?
![Page 10: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/10.jpg)
Steffen Staab 10Semantics Perspective
Semantic Integration: refering to a story by Alan Rector
![Page 11: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/11.jpg)
Steffen Staab 11Semantics Perspective
Semantic Integration: refering to a story by Alan Rector
FeverElecHeatElemmeasuringTempPhysSensor
Complex concept
![Page 12: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/12.jpg)
Institute for Web Science & Technologies – WeST
Semantic Models
Also a way to do integration!!!!
![Page 13: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/13.jpg)
Steffen Staab 13Semantics Perspective
Person sensorsPhysical Sensors
Situational Context
Environment s.
Tool (car...)
GroupSocial Computing
Social Context
Role
...
Cyber
![Page 14: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/14.jpg)
Steffen Staab 14Semantics Perspective
Person sensorsPhysical Sensors
Situational Context
Environment s.
Tool (car...)
GroupSocial Computing
Social Context
Role
...
Text
Cyber Networks Media
Actions/Transactions
Semantic Represen.
Pragmatic interpretat.
![Page 15: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/15.jpg)
Steffen Staab 15Semantics Perspective
Meaning: Contextualization of Topics - MGTM
Flickr photos of food, having tags Geographical Topic Models Spatial context improves content analysis
![Page 16: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/16.jpg)
Steffen Staab 16Semantics Perspective
Neighbour Topic Exchange
![Page 17: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/17.jpg)
Steffen Staab 17Semantics Perspective
Neighbour Topic Exchange
![Page 18: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/18.jpg)
Steffen Staab 18Semantics Perspective
Neighbour Topic Exchange
Can be generalized to other features than geolocation:• Time (also cyclic time)• Temperature• ....
![Page 19: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/19.jpg)
Steffen Staab 19Semantics Perspective
Meaning: Understanding Context – EU Live+Gov
Urban Maintenance (Buitenbeter) Citizens reporting infrastructure damages
Text+Image+Sensor readings submitted by citizen• Activity recognition: walking, cycling,..• Higher level context: shopping, commuting,...
![Page 20: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/20.jpg)
Steffen Staab 20Semantics Perspective
Meaning: Linking of content - EU EPPICS
Use Case: Water management Floods of the river Po (Italy)
Observations: Physical:
• Water level sensors• Smartphone geo positions (where do people drive?)
Social & content• What do people tweet
(„road blocked“, „went there and there“)
Challenges: Linking data Correlating data („level X blocks road Y“)
![Page 21: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/21.jpg)
Institute for Web Science & Technologies – WeST
Semantic Views
![Page 22: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/22.jpg)
Steffen Staab 22Semantics Perspective
Relevance in "typical" social network graph
![Page 23: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/23.jpg)
Steffen Staab 23Semantics Perspective
Relevance: Retrieving Node A's news stream
![Page 24: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/24.jpg)
Steffen Staab 24Semantics Perspective
Relevance: Retrieving Node A's news stream
![Page 25: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/25.jpg)
Steffen Staab 25Semantics Perspective
Meaning: Turning sensing of attention into semantics
Tagging by sensing Interestingness Content tags to
regions
![Page 26: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/26.jpg)
Institute for Web Science & Technologies – WeST
Conclusion
![Page 27: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/27.jpg)
Steffen Staab 27Semantics Perspective
Challenges in Semantics4PCS-computing
Sensor ontology (SSN) Better understanding of what does not work Better understanding of whether the problem is in the
ontology or in the modeling!
Abstraction and contextualization from lowest level interpretation („34734893“) to mid level interpretation
• „deviating from the norm by twice standard deviation“• „cycling“ „running“
To high level interpretation• „broad flooding“ • „shopping“ „commuting“
![Page 28: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/28.jpg)
Steffen Staab 28Semantics Perspective
Conclusion: Semantics in PCS-Computing
Representing contextualized facts Extended provenance
-> who, where, when,...
Understanding context More than sensor readings
-> Reporting
Using context Influences semantics Influences use of semantics (pragmatics)
-> Actions!
![Page 29: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/29.jpg)
Steffen Staab 29Semantics Perspective
Some of many open questions
Which context is most useful when?
What are good models for higher level interpretations?
Notion of pragmatics? Which data is good for which purpose?
![Page 30: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/30.jpg)
Institute for Web Science & Technologies – WeST
Thank you!
![Page 31: Semantics Perspective on Physical-Cyber-Social Computing](https://reader038.vdocuments.mx/reader038/viewer/2022110115/54c661b14a79591e088b4576/html5/thumbnails/31.jpg)
Steffen Staab 31Semantics Perspective
References
1. R. Pickhardt, T. Gottron, A. Scherp, S. Staab, Jonas Kunze. Efficient Graph Models for Retrieving Top-k News Feeds from Ego Networks. In: SocialCom 2012 – Proceedings of the 2012 IEEE Fourth International Conference on Social Computing, Amsterdam, NL, September 3-6, 2012.
2. Tina Walber, Chantal Neuhaus, Ansgar Scherp, Steffen Staab, Ramesh Jain. Creation of Individual Photo Selections: Read Preferences from the Users' Eyes. In: Proceedings of ACM Multimedia 2013, Barcelona, October 2013.
3. C. Kling et al. Detecting Non-Gaussian Geographical Topics in Tagged Photo Collections. Tech Report.
4. http://liveandgov.eu/