Audio and Video Database Management Techniques

www.company.com

AGENDA

• Introduction to Multimedia DBMS

• Elements of Multimedia DBMS

• Audio/ Video

• Multimedia DBMS Characteristics

• Multimedia Objects

• Text Data

• Audio

• Video

• Video database

• Properties and Objects

• Video Content

• Video Library

www.company.com

AGENDA

•Query Language

•Video Functions

•Video Query Language

•Video Data Management

• Metadata

• Text

• Video Parsing

• Video Indexing

• Video Retrieval

•Multimedia Database Components

•Multimedia Database Applications

•Conclusion

www.company.com

What is Multimedia DBMS

• Definition of Multimedia

• Elements Of Multimedia :

Multimedia

Text

Graphic

Sound

Animation

Video

Introduction to Multimedia

DBMS

Topic 1

www.company.com

Audio / Sound

What is Audio/Sound?

Types Of Audio Speech Music Sound Effects

Operations On Audio File Opening Existing File Playing a File Playing selected portion Saving File

Subtopic

Elements of Multimedia

www.company.com

Video

What is Video?

Operations On Video File :• Importing Clips

• Timeline Structure

• Playback of Clips

• Trimming Of Clips

• Splitting a Clip

Subtopic

Elements of Multimedia

www.company.com

• Characteristics Of Multimedia Database

• Large sizes

• Real-time nature

• Raw nature of information

Topic

Multimedia DB Characteristics

2

Characteristics

www.company.com

• Audio Data :• Example

• normal voice digitized at 8 KHz 8 bits/sample 64 Kb/s of data.

• CD quality digitized at 44.1 KHz 16 bits/sample 1.4 Mb/s of data.

• Video Data :

• Video Frame

• Pixel Size

• Quality of Frame

Topic

Multimedia DB Objects

3

www.company.com

Video Database

• Retrieving a Specified video

• Identifying and Retrieving video segments

Example- “Find all video John appears with gun”

Topic 4

Video DB

www.company.com

• Organizing video.

• Index all associations.

• Example –Consider movie, sound of music.

-Inanimate Object like piano

-Animate Object Duck, birds

-Activity Singing and Dancing

Cont…..

www.company.com

Properties and Objects

• Property- Name , Value

• Property Instance- Type, Color, Age

• Object Scheme- Frame Dependent, Independent

• Object Instance- Object id, Structure,Statement

• Activity schema- Number of activity

• Activity/Event- Name , values

Video DB Properties &

Objects

Topic 5

www.company.com

Video Content

• Suppose v is a video

• Let framenum (v)

• v=(OBJ,AC,Z)

-where ,

OBJ- finite set of Object

AC- finite set of Activity

Z- Maps OBJ and AC associate with frame video

Topic 6

Video Contents

www.company.com

Video Library

• A Video Library, VidLib, consist of finite set of 5 tuples

(Vid_Id, VidContent, framenum, plm, R)

7Topic

Video Library

www.company.com

Query Languages for Video Data

• Segment Retrievals

• Object Retrievals

• Activity Retrievals

• Property-based Retrievals

Topic 8

Query Languages

www.company.com

Video Functions

• FindVideoWithObject(o)

• FindVideoWithActivity(a)

• FindVideoWithActivityAndProperty(a,p,z)

• FindVideoWithObjectAndProperty(o,p,z)

Topic 9

Video Functions

www.company.com

Cont….

• FindObjectInVideo(v,s,e)

• FindActivityInVideo(v,s,e)

• FindActivityAndPropertyInVideo(v,s,e)

• FindObjectAndPropertyInVideo(v,s,e)

www.company.com

Video Query Languages

• “Find all videos and their relevant segments from video library VidLib1 that contain Sachin Tendulkar.”

Query-

SELECT Vid:[s,e]

FROM video: VidLib1

WHERE (Vid,s,e) IN FindVideoWithObject( Sachin Tendulkar)

Topic 10

Video Query Languages

www.company.com

Video consists of:

• Text

• Audio

• Images

All change over time

• Metadata-based method

• Text-based method

• Audio-based method

• Content-based method

Topic

Video Data Management

11

www.company.com

•Video is retrieved based on metadata

•Examples • Title

• Author

• Producer

• Director

• Date

• types of video.

Subtopic

Metadata Based Method

1

www.company.com

• Video retrieved based on associated subtitles (text)

• Examples• Transcripts

• subtitles

Subtopic

Text Based Method

2

www.company.com

• Video is indexed and retrieved based on associated soundtracks

• Speech recognition is applied if necessary.

Subtopic

Audio Based Method

3

www.company.com

• There are two approaches for content-based video retrieval:

• Treat video as a collection of images

• Divide video sequences into groups of similar frames

Subtopic

Content Based Method

4

www.company.com

• Video Parsing• Manipulation of whole video for breakdown

into key frames.

• Video Indexing• Retrieving information about the frame for

indexing in a database.

• Video Retrieval and browsing• Users access the database through queries

or through interactions.

Subtopics of Video Data Mangement

www.company.com

• User query interface

• Allow users to query by:

content, example, time, spatial

• Query interface can provide suggestive inputs so as to ease the process of querying.

Topic

Multimedia DB Components

12

www.company.com

• There are a number of fields where multimedia could be of use.

• Applications are:-• Business

• Education

• Entertainment

• Home

• Public Places

Topic

Applications of Multimedia

13

www.company.com

• For Multimedia applications Audio and Video plays an Important role

• From this seminar we have studied audio and video database techniques

Topic

Conclusion

14

www.company.com

THANK YOU