bokode siggraph 2009

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode:

ankit mohan, grace woo, shinsaku hiura,quinn smithwick, ramesh raskar

camera culture group, MIT media lab

imperceptible visual tags for camera based interaction from a distance

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

ideal barcodeinvisible to the human eye;

easily decodable by a machine.

Bokode

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

visible light barcodesspace

[UPC Code, QR Code, Data Matrix Code, Shot Code,

Microsoft Tag, …]

angle

Bokode – this paper

standard camera focused at infinity

+

time

[IR remote, Sony ID CAM]

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

barcode(spatial)

camera

sensor

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

camera

sensorbarcode(space)

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

camera

sensor

image much smaller;refocus if distance changes

barcode(space)

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

camera

sensorBokode(angle)

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

camera

sensor

“ahh… circle of confusion circle of information”- Kurt Akeley

Bokode(angle)

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

fb

generate directionally encoded information

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

camera

fb

capture directionally encoded information

fc

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

camera

fb

fc

magnification = fc /fb (microscope);

focus always at infinity

infinity-corrected microscope

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

datamatrix code(42,245,123)

Bokode: any barcode pattern

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

tiled datamatrix codes

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

id = (42,245,123)

identity from Bokode

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

prototype – assembled

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

led: 120° view angle, 1350mcd

pattern: 15µm resolution

lenslet: f=8mm, Φ=3mm

cost: ~$5

prototype – exploded

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

motion blur(50mm f/8;

~2cm motion)

focus blur(85mm f/1.8;infinity focus)

capturing Bokodes

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

street-view tagging

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

cell-phone cameraclose to the Bokode

(10,000+ bytes of data)

capturing Bokodes

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

camera

fb

fc

smaller aperture less of Bokode imaged

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

camera

fb

fc

smaller aperture less of Bokode imaged

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

camera

fb

fc

less distance more of Bokode imaged

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

less distance more of Bokode imaged

Bokode

camera

fb

fc

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

fb

Bokode image depends on camera angle

camera

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

Bokode

fb fc

Bokode image depends on camera anglecamera

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

camera

x

y id=42x=9y=5

id=42x=9y=6

id=42x=9y=7

id=42x=7y=5

id=42x=7y=6

id=42x=7y=7

id=42,x=8,y=7

id=42,x=8,y=5

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

id = (42,10,7)

digital angle from Bokode

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

ARToolKit[Kato and Billinghurst 1999]

ARTag[Fiala 2005] skew of marker

traditional AR markers

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskarangle estimation robustness

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskarretro-reflector for passive Bokode

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

wide field of view Bokode via Krill eye

compound superposition optics [Hiura et al. 2009]

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

• overlapping Bokodes

• auto-exposure / motion blur

• angular range (+/-20°)

• thickness holographic Bokode25°20°15°10°0°

limitations / future work

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

barcode RFID Bokodeencoding spatial rf modulation angular

decoder camera dedicated reader

camera

geometry no no yes

physical size ~ cm ~ cm ~ mm

cost ~ free ~ $0.05 ~ $0.05(currently $5)

range ~ cm ~ cm ~ m (with large aperture lens)

line of sight yes no yes

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

user interaction applications

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

tabletop/surface interactionstylus based interaction• identity• position• angle

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

multi-user interaction

Bokode laser pointers

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

• barcodes using angular coding & decoding• generating Bokodes

• capturing Bokodes

• digital angle + pose

• AR, motion capture, UI

conclusions

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

acknowledgements

meng heng touch, donald eng, daniel taub paula aguilera, eugene wu

andy lippmanmasahiko inami frank moss

MIT media lab camera culture bokode.com mohan, woo, hiura, smithwick, raskar

• barcodes using angular coding & decoding• generating Bokodes

• capturing Bokodes

• digital angle + pose

• AR, motion capture, UI

http://bokode.com