s ensing m y d evice and c ontextual a wareness: m y n ew d imensions of c ommunication

1 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

Sensing My Device and Contextual

Awareness: My New Dimensions of

Communication

Roope Takala

Nokia Research Center


• Sensing the context and the user

• Communicating

• Input

• Sensing the user and enabling his interaction.

• Output

• Multimodality in output relies on coherent Visual,

Audible and Tactile feedback

Contextual Awareness and Tangibility in Personal Communications


• Environmental sensors• Temperature

• Pressure • Sound

• acceleration

• Touch sensing• Touch screens/pads

• Movement

• Sensing other devices• Bluetooth

• RFID

• Inductive

• Merging non sensor data• Date / Time

• Network type / cell

Sensors and Signals


My Personal IDENTITY for the situation

Situation based Applications

Suggesting My AUTOMATION for the

situationNon-intrusive USER INTERFACE for the situation

Access to

WHAT I NEED in the situationAdjusting My

COMMUNICATION to the situationMy Personal

SECURITY for the situationVersatile

INTERACTION for the situationCasual

INTERACTION for the situation


• Keys

• Touch sensitive

surfaces

• Stylus sensitive

surfaces

• Tilting and turning

• Analog pointing devices

• Digital pointing devices

• Rotating dials

Tangible Input Methods


• Visual • Larger more colorfull

displays

• Audible• Beeps, clicks

• Polyphonic sound

• MIDI output

• HAPTICS and TANGIBLE UI’s

• Breaking down the problem

• Practical research tools• Some tools for developing and

testing user experience and the

technologies.

Research towards Tactility


Haptics a key element of Tangibility


DIP3

System is a basic setup designed to run UI simulations on PDP

Basic PDP setup with:Color display (Calypso display update speed ~1.2fps)

(faster display units with Pica monocrome displays are also

available)Joystick, resistive keypadVibra motor, audio, cameraSerial cable (or BT) link to PC where the

simulation is runMaestro UI simulator compatible

Stable generic phone simulation.


OLIVE : Secure Wireless IPv6 Terminal

OLIVE implements a wireless Internet handheld terminal optimized for web applications. The terminal utilizes WLAN for the wireless access, MobileIPv6 for mobility management, IPSEC for encryption and RFID for user identification.

Key Features:Jappla2 engine with OMAP 120MHz, SDRAM 64MB / Flash 16MB,

Bluetooth.

Nokia D211 WLAN/GPRS

13.56MHz RFID reader

4 inch color VGA touch screen display

MobileIPv6 and IPSec on Montavista LINUX

IPv6

WLANRFID

VoIP MobileIPv6IPsec

Home agent

Application server


Rocinante

Rocinante is a demonstration of a generic media phone. Focus is on testing media phone related HW components and developing SW.

User Interface:PDP based user inteface board incl.: Control keys, Camera, HF-

speaker, and microphone.3.5’’ Transflective TFT-LCD, 53.6mm x 71.5mm, 240 x 320 pixels;

260K colors

Engine (Jappla2(TI OMAP)) :Operating system: LinuxMCU: ARM925 / 120 MHz / 120MIPSDSP: TI C55x / 120MHz / 220MIPSPCM Audio codecMemory: SDRAM 64MB / Flash

Expandability:Compact Flash Connector, Multi Media Card Connector, Bluetooth,

WLAN, Pop-Port™

Size 160 x 70 x 28 mm


User & technology views on devices

Application needsForm-Factor needs

FeasibleMobile Devices

User

Sensor Technology

Mechanical structures

SW systems

Technology


True multimodal input and feedback is on its’ way

Summary

Adaptability of technology

to new applications

Tactile feel and feedback

All user interfaces have

some historical carry over

Usable for multiple applications


Thank You

Questions?

s ensing m y d evice and c ontextual a wareness: m y n ew d imensions of c ommunication

Documents