sentient computing ubiquitous computing vision computing devices everywhere access to applications...

19
Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing vision Ubiquitous Computing made context-aware Physical context used for automatic control Sensors and space are part of computing systems

Post on 19-Dec-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Sentient Computing

Ubiquitous Computing visionComputing devices everywhere

Access to applications anywhere

Whatever is on hand is available

Sentient Computing visionUbiquitous Computing made context-aware

Physical context used for automatic control

Sensors and space are part of computing systems

Page 2: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Programming With Space

The componentsNotions and representations of physical space

Data and computational models

Sensor information

User interface the real world

Page 3: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Components for Programming With Space

Devices

Platforms

Sensors

Networks

+Architecture

Conduits

Page 4: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Components for Programming With Space

Devices

Platforms

Sensors

+Architecture

Page 5: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Sensors: Location Information

Containment– GSM, UMTS, broadband radio– Active badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active bat

Page 6: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Sensors: Location Information

Containment– GSM, UMTS, Broadband Radio– Active Badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active bat

Page 7: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Containment: Active Badge

Infra-Red Network 10 meter range

diffuse

room-scale location

Page 8: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Sensors: Location Information

Containment– GSM, UMTS, Broadband Radio– Active Badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active Bat

Page 9: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Sensors: Location Information

Containment– GSM, UMTS, broadband radio– Active badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active bat

Page 10: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Ultrasonic Location System

Mobile transmitter (Bat)

Fixed receiversCeiling

Active BatsUltrasonic transponder

Measure pulse time-of-flight

Radio synchronised

Page 11: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

DSP Ceiling Array

25,000 MIPS to cover AT&T Laboratories Cambridge!

Page 12: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Components for Programming With Space

Devices

Platforms

Sensors

Networks

+Architecture

Conduits

Page 13: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Telephone318

Computer“Pumpkin”

Computer“Papaya” Person

“Mike”

Person“Pete”

Representing the Real World

Model real world as collection of objects

Computer“Plantain”

Person“Andy”

Follow-mePhonebook

MobileDesktop

Telephone241

Telephone217

CTIswitch

Resourcemonitor

Keyboardmonitor

Locationservice

Applications

Software objects

Sensors

– Objects maintain state using sensor data

– Applications query relevant sets of objects

Page 14: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Data Model Visualisation

Page 15: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Spatial Monitoring

Vague spatial facts formalised as geometric containment and overlapping relationships between spaces

X

M

‘X is holding the microphone M’‘X can be seen by

camera B but not by camera A’

A

B

X

Page 16: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Spatial Indexing

Generates all positive/negative overlapping or containment events

thro

ug

hp

ut

(‘00

0 u

pd

ates

s-1)

1

3

2

4

population (‘000)10 20 30

non-overlapping spaces

overlapping spaces

Page 17: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Putting It All Together

Move user’s desktop to screen in front of them

Visible

A

Visib

le

B

Visible

C

Callbacks

Registration+ve Containment (Andy)-ve Overlapping (Andy)

-ve Overlapping(Andy,”Visible B”)

CLEAR DESKTOP FROM B

-ve Overlapping(Andy,”Visible A”)

CLEAR DESKTOP FROM A

+ve Containment(Andy,”Visible B”)

MACHINE B: NOT IN USEMOVE DESKTOP TO B

+ve Containment(Andy,”Visible C”)MACHINE C: IN USE NO ACTION

Page 18: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Example Applications

Corporate memoryRecord me / what’s around me

Annotate multimedia stream

Camera field-of-view

Flat display

Compositedisplay

“Plonk-and-play” systemsSpatial configuration determines logical

configuration

No need to know device IDs

Automatic personalisation

Page 19: Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing

Sentient Computing: New User Interfaces

Non-user interfaces!

Objects and people are cursors in the real-world of icons

Aural and visual feedback