uxd multimedia output

16
Kan Janneke even de klas verlaten?

Upload: rolfhro

Post on 25-May-2015

464 views

Category:

Education


2 download

TRANSCRIPT

Page 1: UXD Multimedia output

Kan Janneke even de klas verlaten?

Page 2: UXD Multimedia output

Kunnen deze twee even naar buiten?

Page 3: UXD Multimedia output

Attentie

Page 4: UXD Multimedia output

Multimodal output

Page 5: UXD Multimedia output

Real life multimodal use Sequential: Exclusive

-Sequential use of modalities that are not linked together in the same task. For example, recording speech and then closing all the unnecessary windows with a mouse.

Sequential: Alternate

The use of modalities is sequential, but they are linked together in the same task. For example, pointing an object with a

mouse and giving a voice command to copy it.

Parallel: Concurrent

The use of modalities is parallel, but they are not linked together. Usually the hardest kind of multimodal systems, but may

result in a better efficiency with some training. For example, driving a car while speaking in a mobile phone

Parallel: Synergistic

The use of modalities is parallel and they are linked together. For example, pointing and speech command at the same time.

[Nigay and Coutaz] 

Page 6: UXD Multimedia output

Multimodal versus Multimedia

Multimodal systems use more than one sense/mode of interaction e.g. visual and aural senses: a text processor may speak the words as well as printing them to the screen

Multimedia systems use a number of different media to communicate information e.g. an e-learning system may use video, animation, text and still images and use speech and non-speech

Interaction with these systems The combination of human output

channels effectively increases the bandwidth of the human-machine channel (e.g., Oviatt, 1999)

Page 7: UXD Multimedia output

“Bandwith” in computer game history

Examples

text based adventures

adding graphics

print

Sound and space

3 d space

3d audio

haptic

Page 8: UXD Multimedia output

Multimodal output

-Visual: Text, pictures, signs, color

-Audio: Verbal, non-verbal, signals

-Olfactory: Smell

-Haptic (combination of movement and tactile)

Page 9: UXD Multimedia output

Signs

Page 10: UXD Multimedia output

Signs (sound)

Page 11: UXD Multimedia output

Smell

Page 12: UXD Multimedia output
Page 13: UXD Multimedia output

Haptic

Haptic torch

Page 14: UXD Multimedia output

Synchronisation and space

example

Page 15: UXD Multimedia output

Multimodal interaction and multisenory feedback can exert significant cognitive demands on users. Attention is selective and has limited capacity. Short term memory also has limitations. Consider human ability when designing the interface, essential for control and learning affordances 

Classic example

Convention communication

Confusion...

Page 16: UXD Multimedia output

Questions?...

Any? Who dares?