description of some multimedia ontologies [email protected] rapha ë l troncy thursday 1 st of...
TRANSCRIPT
![Page 1: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/1.jpg)
Description of some multimedia ontologies
Raphaël Troncy
Thursday 1st of December, 2005
![Page 2: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/2.jpg)
Multimedia OntologiesMultimedia ontologies can be related to
many works, standards, communities …Focus here on MPEG-7 ... as a whole
ISO Standard composed of 11 parts but it is still growing …
DDL = XML Schema + small extensionsDescriptors and Description Schemes
1182 elements, 417 attributes, 377 complex types in the schema (MDS + Visual + Audio parts)
40 Classification Schemes
![Page 3: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/3.jpg)
Agenda
DSTC's ProposalJane Hunter & Suzanne Little (ABC model)
TUC's ProposalChrisa Tsinaraki (DELOS)
INA's ProposalAntoine Isaac & Raphaël Troncy
DMAG/MTG's ProposalRoberto Garcia & Oscar Celma
![Page 4: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/4.jpg)
DSTC's Proposal (summary)1st proposal chronologically
MPEG-7 ontology developed in RDFS, then converted into DAML+OIL and now OWL
Contains 60 classes and 40 propertiesOWL Full ontology
Cover the upper level of the MDSsegments and decompositionagent, role, place, time and instrumentbasic visual descriptors
Available at: http://maenad.dstc.edu.au/slittle/mpeg7.owl
![Page 5: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/5.jpg)
TUC's ProposalSoftware Engineering Framework
aiming to facilitate Knowledge-based MPEG-7 Multimedia Application Development Being developed in TUC/MUSIC
Consists of:An Ontological InfrastructureMethodologies for Interoperability between
MPEG-7 and OWLAn underlying MPEG-7 RepositoryTools implementing the DS-MIRF approach
![Page 6: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/6.jpg)
DS-MIRF Ontological Infrastructure
OWL Application Ontologies
Fully captures the MPEG-7 MDS
...
...
OWL Upper Ontology
“Fill the blanks” left from the MPEG-7
MDS for Application Support
Typed Relationships
Semantic User Preferences
Application Ontology X
...
OWL Domain Ontologies
Extend the Upper Ontology and the Application Ontologies with
Domain Knowledge
Soccer Domain Ontology
F1 Domain Ontology
Domain Ontology X
...
![Page 7: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/7.jpg)
DS-MIRF Ontological InfrastructureAn Upper Ontology that fully
captures the MPEG-7 MDS and a part of the MPEG-7 VisualBeing extended to capture the MPEG-21
DIA ArchitectureTransformation Rules to transform
OWL Ontologies and OWL/RDF metadata into MPEG-7 documentsImplemented in the GraphOnto Ontology
and Metadata Editor
![Page 8: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/8.jpg)
TUC's Ontology Definition Methodology Manual definition based on the following rules:
MPEG-7 Simple Datatype Representation: Integration of the XML Schema simple datatypes (rdfs:Datatype)
MPEG-7 Complex Type Representation: Homonym OWL ClassesAttributes & Simple Type Elements: Datatype PropertiesComplex Type Elements: Object PropertiesSubclassing:
Simple Types: Datatype property with rdf:ID “type_nameContent” – where type_name is the type of the supertype
Complex Types: rdfs:subclassOfConstraints: OWL Restrictions
MPEG-7 Classification Scheme Representation: Individuals of the MDS type “ClassificationSchemeType”
![Page 9: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/9.jpg)
TUC's Proposal (summary)Cover the full standard
Contains 420 classes and 175 properties for the MDS part
OWL DLCover also the CSs
The 40 CSs have been translated into simple OWL hierarchy
Available at: http://elikonas.ced.tuc.gr/ontologies/av_semantics.zip
![Page 10: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/10.jpg)
INA's Proposal Different uses of AV Document Descriptions
Archival and description of documents from a cultural heritage point of view: INA
Exchanging program identification and characterization for interactive TV: TV-Anytime
Diffusion of program information (news agencies): ProgramGuideML
Storing and sharing AV content descriptions (automatic extraction results): MPEG-7 standard
![Page 11: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/11.jpg)
Can we find an AV core ontology?
There are many common needs amongst observed applicationsCharacterization of programs and sequencesDecomposition of programs and sequencesAbility to introduce description of the
activities that constitute the context of AV documents (roles of people involved, ways production and broadcast are achieved)
These concepts are close to a "neutral" archival viewpoint
![Page 12: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/12.jpg)
C.O. content
Concerning AV objects:distinction sequence/programdecomposition and qualification of those objectslink to external world themes and entities (content
description)
Underlying use patterns for elicited categories
Theme-relatedEntities
Channel, Live,Daily...
ProgrambroadcastRelation[hasBroadcaster,hasPeriodicity...]
thematicRelation[hasTheme, shows,
refersTo...]
Sequence
partOf
partOf
Productor, Zoom...productionRelation
[hasAuthor,hasFilmingFeature...]
![Page 13: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/13.jpg)
Example:
Upper-level categorization of sequences
![Page 14: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/14.jpg)
Example:Upper-level categorization of program
![Page 15: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/15.jpg)
INA's Proposal (summary) Cover the MDS upper part, and partially
the audio and visual partsContains 610 classesOWL DL
Cover also (partially) the CSsadapted to TV Anytime (and
ProgramGuideML)adapted to INA's needs
Linked to the DOLCE ontology Available at: http://www.cwi.nl/~troncy
/MPEG-7/
![Page 16: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/16.jpg)
DMAG/MTG's Proposal
Reuse MPEG-7 implicit semantics.XML Semantic Web:
XSD2OWL: schema to ontology.XML2RDF: XML instance data to RDF
instances.Tested as integration base for:
MusicBrainz, Simac, Music Vocabulary, etc.
![Page 17: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/17.jpg)
XMLSchema to OWL Mappings
sequencechoice
@maxOccurs@minOccurs
extension@base|restriction@base
complexType//element
complexType|group|attributeGroup
element@type
element@substitutionGroup
element|attribute
XML Schema
owl:intersectionOfowl:unionOf
owl:maxCardinalityowl:minCardinality
rdfs:subClassOf
owl:Restriction
owl:Class
rdfs:range
rdfs:subPropertyOf
rdf:Propertyowl:DatatypePropertyowl:ObjectProperty
OWL
![Page 18: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/18.jpg)
DMAG/MTG's Proposal (summary)
Cover the whole MPEG-7 + the upper level of the Classification SchemesContains 2372 classes and 975 propertiesOWL Full
Available at: http://dmag.upf.edu/ontologies/mpeg7ontos/
![Page 19: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/19.jpg)
Questions ?
![Page 20: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/20.jpg)
Towards an harmonization of these multimedia ontologies
Raphaël Troncy
Thursday 1st of December, 2005
![Page 21: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/21.jpg)
Preliminary resultsCurrent state:
Proposals are made individually, for specific research project
The OWL files contains some errorsCorrected versions available for DSTC and
DMAG/MTG ontologies
Different conceptualizations have been obtained … even if they start from the same MPEG-7 schema
No MPEG-7 endorsement
![Page 22: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/22.jpg)
(Personal) Idea: Three step processAligning pair-wise ontologies
Visual part of aceMedia vs DMAG vs TUCMDS part of Hunter vs DMAG vs TUC vs INACSs part of DMAG vs TUC vs INA
Merging and fusingRe-engineering (manually) !
Current proposals are based on automatic translation rules from XSD to OWL (except INA)
Does NOT go beyond what XML Schema can express
![Page 23: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/23.jpg)
Open Issues OWL DL vs OWL Full Real modularization of MPEG-7
upper part, visual, audio, CSsrequires breaking some existing
relationships ! Do we have to capture all MPEG-7 ?
people, agent, role, place are not multimedia-specific
Are there more multimedia ontologies currently developed ?Proton: http://proton.semanticweb.org/Boemie: re-use the aceMedia ontologies (MDO, VDO)
![Page 24: Description of some multimedia ontologies Raphael.Troncy@cwi.nl Rapha ë l Troncy Thursday 1 st of December, 2005](https://reader035.vdocuments.mx/reader035/viewer/2022062720/56649f0c5503460f94c1f89f/html5/thumbnails/24.jpg)
Questions ?