social life networks: ontology-based recognition
DESCRIPTION
Social Life Networks: Ontology-based Recognition. Ramesh Jain Contact: [email protected]. Relevant Trends. Social Networks and their role in communication Micro-blogs becoming major source of News. Internet of Things is emerging. More than 75% of the world poulation owns a mobile phone. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/1.jpg)
1© Ramesh Jain
Social Life Networks: Ontology-based Recognition
Ramesh Jain
Contact: [email protected]
![Page 2: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/2.jpg)
2© Ramesh Jain
Relevant Trends• Social Networks and their role in
communication• Micro-blogs becoming major source of
News.• Internet of Things is emerging.• More than 75% of the world poulation
owns a mobile phone.
![Page 3: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/3.jpg)
3© Ramesh Jain
Social Networks
Connecting People
![Page 4: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/4.jpg)
4© Ramesh Jain
From Micro Events to Situations
From Tweets to Revolutions
![Page 5: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/5.jpg)
5© Ramesh Jain
Middle 3 Billion
The World as seen through Mobile Phones
Top 1.5 Billion
Bottom 2 Billion
Middle of the Pyramid (MOP):
Ready, BUT …
Most attention by Technologists – so far.
Not Ready
![Page 6: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/6.jpg)
6© Ramesh Jain
Connecting People And
Resources
Social Life Networks
Aggregation and
Composition
Situation Detection
Alerts
Queries
Information
![Page 7: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/7.jpg)
7© Ramesh Jain
Swine flu social image and its segmentation
into ‘high’ and ‘low ’activity zones.
![Page 8: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/8.jpg)
8© Ramesh Jain
Situational controller
• Goal • Macro Situation • Rules
Micro evente.g. “Arrgggh, I
have a sore throat”
(Loc=New York, Date=12/09/10)
Macro situation
Control Action“Please visit nearest CDC
center at 4th St immediately”
Date=12/09/10
Alert Level=High
Level 1 personal threat + Level 3 Macro threat -> Immediate action
Situational Recommendation System
![Page 9: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/9.jpg)
9© Ramesh Jain
Real Time Situation Analysis
Less abstraction,
More detail
More abstraction,
Less detailCharacterizations
Transformations
Level 1: S-t-t Data
Level 2: S-t-t aggregatee.g. Emage
Level 3: Events
Properties
Properties
Properties
Representations
Level 0: Raw data e.g. tweets, cameras, traffic, weather, RSS,
check-ins, www
Situation Recognition
![Page 10: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/10.jpg)
10© Ramesh Jain
Bits and Bytes
Alphanumeric Characters
Lists, Arrays, Documents, Images …
Transformations
![Page 11: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/11.jpg)
11© Ramesh Jain
Semantic GapThe semantic gap is the lack of coincidence
between the information that one can extract from the visual data and the interpretation that the same data have for a user in a given situation. A linguistic description is almost always contextual, whereas an image may live by itself.
Content-Based Image Retrieval at the End of the Early YearsFound in: IEEE Transactions on Pattern Analysis and Machine Intelligence Arnold Smeulders , et. al., December 2000
![Page 12: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/12.jpg)
12© Ramesh Jain
Models bridge the Semantic Gap.
![Page 13: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/13.jpg)
13© Ramesh Jain
Models
• A model in science is a physical, mathematical, or logical representation of a system of entities, phenomena, or processes. Basically a model is a simplified abstract view of the complex reality.
• Models in software allow scientists to leverage computational power to simulate, visualize, manipulate and gain intuition about the entity, phenomenon or process being represented
![Page 14: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/14.jpg)
14© Ramesh Jain
OntologyAn ontology is a formal representation of
knowledge as a set of concepts within a domain, and the relationships between those concepts. It is used to reason about the entities within that domain, and may be used to describe the domain.
From http://en.wikipedia.org/wiki/Ontology_(information_science)
![Page 15: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/15.jpg)
15© Ramesh Jain
Descriptions
The purpose of description is to re-create, invent, or visually present a person, place, event, or action so that the reader may picture that which is being described.
![Page 16: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/16.jpg)
16© Ramesh Jain
Ontologies have been used mostly for description of
domain knowledge.
![Page 17: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/17.jpg)
17© Ramesh Jain
Recognition
Recognition is identification of something already known
![Page 18: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/18.jpg)
18© Ramesh Jain
Thomas O. Binford. Image understanding: intelligent systems. In Image Understanding Workshop Proceedings, volume 1, pages 18-31, Los Altos, California, February 1987.
![Page 19: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/19.jpg)
19© Ramesh Jain
Creating R-OntologyUpper Ontology
Domain Ontology-n
Augmented Ontology-1
… Augmented Ontology-n
…Context-1 Context-n
Domain Ontology-1
Augmented Ontology-1 …
Augmented Ontology-n
…Context-n
….…
Trip to HuangshanTrip to
Beijing
Visiting Summer palace
visiting forbidden
city
visiting Yellow
Mountain
visiting Huangshan
Geopark….…
![Page 20: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/20.jpg)
20© Ramesh Jain
Recognition using R-Ontology
Model Data
Ontology
Augmented Ontology Model for Recognition
(Upper and Domain)
Context
(time, loc, visual , ….)
clustering
Match/Classification
![Page 21: Social Life Networks: Ontology-based Recognition](https://reader036.vdocuments.mx/reader036/viewer/2022062323/5681637d550346895dd45b92/html5/thumbnails/21.jpg)
21© Ramesh Jain
Conclusion
• Ontology for a specific situation augmented with available contextual information.
• Augmented Ontology used for recognition of situation from multiple sources of data.
• Ontology allow explicit specification of models that could be modified using context information to provide very flexible models to bridge the semantic gap.