an rss feed auditory aggregator using earcons

16
Audio Mostly : 6th Conference on Interaction with Sound Listen to your Portfolio Beat Athina Bikaki Andreas Floros

Upload: andreas-floros

Post on 14-Jul-2015

196 views

Category:

Technology


0 download

TRANSCRIPT

Audio Mostly : 6th Conference on Interaction with Sound

Listen to your Portfolio Beat

Athina Bikaki Andreas Floros

Which technologies we combined to build a state-of-the-art RSS auditory aggregator to monitor real-time stock information?

Web technologies for information exchange.Data representation of real-time stock data through sonification.Binaural technology to achieve spatialization of information.

Audio Mostly : 6th Conference on Interaction with Sound

What is RSS?RSS is a lightweight XML format.

What does RSS look like?

Why use RSS feeds? The benefits of using an RSS aggregator.

Audio Mostly : 6th Conference on Interaction with Sound

Text-to-speech Data Sonification◦ Audification◦ Earcons◦ Model-Based Sonification◦ Parameter Mapping Sonification

Binaural Rendering of audio signals

Audio Mostly : 6th Conference on Interaction with Sound

How to pick a good stock group?◦ Investment options

How to properly sonify periodic data values?◦ Earcons

How to position the audio feeds in 3D space? ◦ Orchestration

Audio Mostly : 6th Conference on Interaction with Sound

Build a robust RSS-feed auditory aggregator

Audio Mostly : 6th Conference on Interaction with Sound

Take the example of oil companies group

Audio Mostly : 6th Conference on Interaction with Sound

Audio Mostly : 6th Conference on Interaction with Sound

Selection of two informational data feeds, XOM and MRO. How can we setup the system to maximize the user’s perception?

• Use of different gender voices• Use of different audio source location• Use of different start time

Selection of two numerical data feeds, XOM and MRO. Now, how can we setup the system to aid the user recognize the stock trends?

Choose a different timbre (woodwinds, strings, brass) Choose a different register (low, middle, high) Use dynamics to present the volatility of the stock quote Vary the notes number and values in the measureWe kept the tempo and the rhythm fixed

Audio Mostly : 6th Conference on Interaction with Sound

Note values in the measure Stock Value Change(%)

+ + + |SVC| ≥ 1.5

+ + 0.8 < |SVC| < 1.5

+ 0.2 < |SVC| ≤ 0.8

|SVC| ≤ 0.2

Audio Mostly : 6th Conference on Interaction with Sound

Audio Mostly : 6th Conference on Interaction with Sound

How to position the different sound sources in space?

• Choose the layout of the system

(horizontal and vertical location)• Make use of male–female voices

alternatively• Make use of different musical

instruments for earcon sonic

construction and keep them in a safe

distance that they do not blend• Group components with similar

attributes (position them in the similar

direction)

Audio Mostly : 6th Conference on Interaction with Sound

Why the second example fails?◦ Requires knowledge of how to use the musical

parameters to setup the system. ◦ Selection of inappropriate setup spatial

parameters.

Little training is needed if the earcons are well designed.

Audio Mostly : 6th Conference on Interaction with Sound

Audio Mostly : 6th Conference on Interaction with Sound

2.5

4

3.9

5

3.9

4.1

0 1 2 3 4 5

Tests

M.V.

Earcon-Speech-Earcon-Speech-Earcon-Speech

Earcon-Earcon-Speech-Earcon-Earcon-Speech

Earcon-Speech-Earcon-Speech

Earcon-Earcon-Earcon (Pitch)

Earcon-Earcon-Earcon (Timbre)

Speech-Speech-Speach

The proposed RSS-feed sonification approach achieves adequate performance in terms of perceptual accuracy of the transmitted content

A new spatially shaped auditory display can be used to monitor RSS stock market data effectively. Earcons provide a simple, easy to memorize method to sonify simple stock data values. Binaural rendering gives flexibility to the RSS aggregator. Training on the earcons interpretation is prerequisite for the user.

Audio Mostly : 6th Conference on Interaction with Sound

The end

Audio Mostly : 6th Conference on Interaction with Sound