efficient multimedia query by-content from mobile devices

1Efficient multimedia query-by-content from mobile devices

.



Example of a communication sequence

between a mobile device and a server using

query streaming.


The General query input format of MQF


The General query output format of MQF


Example instantiation of MQF with a simple query

<mqf>

<queryId>if_123</queryId>

<from>client.uri</from>

<query stream=“true”>

<replyType>image/jpeg</replyType>

<item queryLevel=“example”>

<mpeg7:MediaData64>

AaBbCc/==

</mpeg7:MediaData64>

</item>

</query>

</mqf>

Initial communication from the client using query streaming features of MQF.

<mqf>

<queryId>id_123</queryId>

<from>server.uri</from>

<replies>

<reply>

<item>http://server/image1.jpg</item>

<index>1</index>

</reply>

<reply>

<item>http://server/image2.jpg</item>

<index>2</index>

</reply>

</replies>

</mqf>

Server reply to the example

Server

Reply

Server

Reply

<query>

<item queryLevel=“exact”>

<dc:Creator>John Doe</dc:Creator>

</item>

</query>

Client refinement: adding a term to the query.


Efficient multimedia query-by-content from mobile devices 23

Transmission/Storage Medium

IP MP4Delivery

Layer

Multiplex

MPEG-2 ATM ...

Multiplexed Streams

DemultiplexMultiplex

Schema

streams

Description

streams

Compression

Layer

Elementary Streams

Multimedia

streams

Upstream

Data

Application

APIs

Defines Describe

Reconstruction

Description

Decoder

Schema

Decoder

BiM or Textual

Parsing

BiM or Textual

Decoding

MPEG-7 Architecture

Block diagram showing FRUs and FUUs to retrieve fragments of XML.



Results of Table 4 show the total files size of the server replies is reduced to approximately 9.1% when compared to the results of Table 3 without BiM compression.

Audio Query Scenario

1. The user sends a sample of a song to the server.

2. The server replies that it has 100 possible matches for the song since the

example provided by the user was not of sufficient length or contains

noise.

3. The client asks the server what is the genres ( types ) contained in the

result set using an FRU query.

4. The server replies using FUU: rock, country and classical.

5. The user sends an additional query term using FRU: the genre is country.

6. The server finds exactly one match for the given criteria.


The client sends an audio example.

The server replies that there are 100 possible matches found.


The result set that is kept in the server.

The FRU request to retrieve the genres in the result set.

The FUU replies from the FRU

The additional term to be added to the initial query.



Thank you for your kind attention

efficient multimedia query by-content from mobile devices

Education