Introduction to the Special Issue on MPEG-7

報告人 : 薛智豪

Outline

What is MPEG-7?Why MPEG-7?Overview of MPEG-7 StandardDescription tools DescriptionsDescriptorsApplications

What is MPEG-7?

"Multimedia Content Description Interface”Providing meta-data for multimediaSupport as broad a range of applications as possible.Why not MPEG-5/6 ?

What is MPEG-7?

What is MPEG-7?

Why MPEG-7?

“found, retrieved, accessed, filtered and managed. ”Past: poverty of the digital multimedia sources

-> Simplicity of the access mechanismsNow: growing amount of audiovisual information

-> Difficult to identifying and managing.

Description production

Standard description

Description consumption

Scope of MPEG -7

Normative part of MPEG-7 standard

Overview of MPEG-7 Standard

Description tools

Description tools

Descriptions

Text Image Voice

Low level description

FontTypefaceParagraph

ColorGrainShape

ToneTimbre

High level description

CategoryPropertyThinking

Implications

Object

KeywordEmotions

Descriptors

Visual Descriptors

• Color Descriptors• Texture Descriptors• Shape Descriptors• Motion Descriptors for Video

Descriptors

Region-based Descriptor

Descriptors

Contour-Based Descriptor• It is based on Curvature Scale-Space

(CSS) representation

Descriptors

Contour-Based Descriptor

Descriptors

Region-based VS Contour-Based

Descriptors

Camera Motion Descriptor

Track left

Track right

Boom up

Boom down

Dollybackward

Dollyforward

Pan right

Pan left

Tilt up

Tilt downRoll

Applications

Applications

Pull• Client Queries -> Descriptions

repository -> Matched Ds

Push• Filter descriptions -> Programmed

actions

References

http://www.cmlab.csie.ntu.edu.tw/mpeg4workshop/MPEG7%20Introduction.files/frame.htmhttp://mpeg.telecomitalialab.com/standards/mpeg-7/mpeg-7.htmhttp://newmodel.pixnet.net/blog/post/24882372-mpeg-7http://debut.cis.nctu.edu.tw/~ching/The_Essential_Of_My_Reading/TechnicalIssue/%5BTechniqueIssue%5D%20Matching%20Shapes%20With%20Self-Intersections.htmlhttp://en.wikipedia.org/wiki/MPEG-7