hybrid project or

8/2/2019 Hybrid Project Or

1/52

Johnny Lee, Scott Hudson, Paul Dietz

Carnegie Mellon University

Mitsubishi Electric Research Labs

UIST 2007 Newport, RI

Hybrid Infrared and Visible LightProjection for Location Tracking


2/52

Hybrid Projection

infrared visibleone projector

But, why?


3/52

Projector-Based Location Discovery [Lee, UIST04]

Light sensors

Electronics & computer

Projector


4/52

Projector-Based Location Discovery

calibration free:- no computer vision- no alignment- no manual input

Scalable and robust


5/52

Moveable Surfaces

[Lee, UIST 2005]

- calibration free- no external tracker- interactive content


6/52

Drawbacks

Location Discovery [04] Moveable Surfaces [05]

Caustic B&W patternsMomentary movement

Incremental tracking


7/52

Ideally

Full-screenLocation Patterns

Full-screenApplication Content


8/52

Hybrid Projection

infrared visible

for the computer for the human

one projector


9/52

Infrared & Visible Projection

Infrared Visible

9


10/52


Infrared Visible

10


11/52


Infrared Visible

11


12/52


Infrared Visible

12


13/52


Infrared Visible

13


14/52


Infrared Visible

14


15/52


Infrared Visible

15


16/52


Infrared Visible

16


17/52


Infrared Visible

17


18/52


Infrared Visible

18


19/52

How?


20/52

Light Source: Lamps

Xenon Arc Lamp


21/52

Light Technologies


22/52

More Efficient and Better Lifespan

Products emerging on market this year, 2007


23/52

IR and Visible Light LEDs 1000 LEDs/mm2University of Strathclyde, Institute of Photonics


24/52

DMD LED ArrayLens

Projection optics


25/52

Our Dev Kit: 180 binary images/sHigh-Speed Dev Kit: 16,500 binary images/sProduction Unit: +50,000 binary images/s

1024x768 area = 20 binary images60Hz tracking = 2.4% duty cycle of production DMDRequired changes to commercial designs would be minimal.


26/52

Demo of CapabilityUses a second projector for visible content


27/52

Inherent Multi-Stylus Tracking


28/52

Non-Planar and Discontinuous Surfaces


29/52

Static IR Patterns


30/52

Concept ApplicationsSimulated using external tracking (calibration)


31/52

[Siggraph 2004]

Hand-held projection with photosensitive tags


32/52

Foldable Interactive Displays [submitted to CHI]


33/52

Acknowledgements

Johnny Chung Lee

[email protected]

Funded in part by the NationalScience Foundation under grantsIIS-0121560 and IIS-0325351

Funded in part by

Mitsubishi Electric Research Labs


34/52

Other ways to make invisible patterns

Other non-visible wavelengths

Steganography

Color shifting

Noise encoding

Bit Timing Synchronization may be difficult


35/52

Camera-Based Tracking

Requires calibration

Requires markers for segmentation IR sensors + transmitter is less power than 4 IR LEDs

Does not provide ID

Limitation on the number of points

Limitation on tracking rate

Limitation on scene/target complexity

Resolution is not as scalable

Less optically robust Optical path geometry and variable illumination


36/52

Projector vs Camera Tracking

Sensors provide point ID Independent of scene/surface complexity


37/52

Space-Labeling Projectors

11 Infrared LED slide projectors

Potentially Low-cost

Per axis: 500Hz tracking at 10-bits

Outdoor motion tracking

37


38/52

Binary Gray

0000

0001

0010

0011

0100

0101

0110

0111

1000

1001

1010

1011

1100

1101

1110

1111

0000

0001

0011

0010

0110

0111

0101

0100

1100

1101

1111

1110

1010

1011

1001

1000


39/52

Binary Gray

0000

0001

0010

0011

0100

0101

0110

0111

1000

1001

1010

1011

1100

1101

1110

1111

0000

0001

0011

0010

0110

0111

0101

0100

1100

1101

1111

1110

1010

1011

1001

1000


40/52

Binary Gray


41/52

Binary Gray


42/52

Binary Gray


43/52

Binary Gray


44/52

Binary Gray


45/52

Binary Gray


46/52

Binary Gray


47/52

Binary Gray


48/52

Binary Gray


49/52

Binary Gray


50/52

Binary Gray


51/52

Binary Gray


52/52

Pixart Chip

1024x768 resolution100Hz tracking4 points

Only 4 pointsHigh power LED points

hybrid project or

Documents