proseminar: anwendungen für augmented reality application in teaching: the luminous room xinxing...

Proseminar: Anwendungen für Augmented Reality

Application in Teaching: The Luminous Room

Xinxing Feng

July.05.2005

05.July.2005 Proseminar AR: The Luminous Room 2

Outline Introduction Example Applications

Illuminating Light Distributed Illuminating Light Urp(with Seep)

Getting Pixels in and out Display Capture I/O Bulb

Luminous Room Vision Techniques Seeing Spots Software Support: glimpser Toolkits: voodoo and dee-voodoo

Conclusion

05.July.2005 Proseminar AR: The Luminous Room 3

Introduction The Luminous Room

was built by

Tangible Media Group of

the MIT Media Laboratory I/O Bulb

two-way information: a projector a video camera

05.July.2005 Proseminar AR: The Luminous Room 4

Outline Introduction Example Applications

Illuminating Light Distributed Illuminating Light Urp(with Seep)

Getting Pixels in and out Display Capture I/O Bulb

Luminous Room Vision Techniques Seeing Spots Software Support: glimpser Toolkits: voodoo and dee-voodoo

Conclusion

05.July.2005 Proseminar AR: The Luminous Room 5

1. Illuminating Light Designed as a effective tool for optical engineers

05.July.2005 Proseminar AR: The Luminous Room 6

1. Illuminating Light (cont.) Holography

hologram-recording layout simulation physical optics &

digital light beams

Video

05.July.2005 Proseminar AR: The Luminous Room 7

2. Distributed Illuminating Light Distribution scheme The toolkit dee-voodoo Two modes of distributed

operation Each workspace is a

“window” onto a continuous optics workbench.

“I-see-what-you-see”.All workspaces are instances of the same underlying space.

Video

05.July.2005 Proseminar AR: The Luminous Room 8

3. Urp A system for urban planning (Stadtplanung)

shadows of buildings sunlight reflection from the glassface of the buildings

05.July.2005 Proseminar AR: The Luminous Room 9

3. Urp (cont.) Measurement Wind simulation based on Seep

The direction and length of those segments correspond to instant direction and intensity of the wind at the position.

Video

05.July.2005 Proseminar AR: The Luminous Room 10

Outline Introduction Example Applications

Illuminating Light Distributed Illuminating Light Urp(with Seep)

Getting Pixels in and out Display Capture I/O Bulb

Luminous Room Vision Techniques Seeing Spots Software Support: glimpser Toolkits: voodoo and dee-voodoo

Conclusion

05.July.2005 Proseminar AR: The Luminous Room 11

Display & Capture Three basic ways to enable display at an

architectural surface: hoary CRT, flat-panel display projection E-ink

Basic schemes for capture and spatial tracking: tethered tagging scheme electronic non-contact tagless scheme optical non-contact tagless scheme electronic non-contact tagging scheme

05.July.2005 Proseminar AR: The Luminous Room 12

I/O Bulb Scheme: camera-in and projector-out

I/O Bulb Prototype

05.July.2005 Proseminar AR: The Luminous Room 13

I/O Bulb (cont.) Different size of I/O Bulbs:

large scale small scale medium scale

Ceiling-mounted gimbal (Kardanring) Desk lamp system

Fixed conference

table system

05.July.2005 Proseminar AR: The Luminous Room 14

Outline Introduction Example Applications

Illuminating Light Distributed Illuminating Light Urp(with Seep)

Getting Pixels in and out Display Capture I/O Bulb

Luminous Room Vision Techniques Seeing Spots Software Support: glimpser Toolkits: voodoo and dee-voodoo

Conclusion

05.July.2005 Proseminar AR: The Luminous Room 15

See Spots Object-independent tagging scheme Reliable isolation from unpredictable

background. Dots self-luminous? LEDs? Maxim: objects used by Luminous Room

applications should be passive. Retroreflective dots: 3M ScotchLite

05.July.2005 Proseminar AR: The Luminous Room 16

Outline Introduction Example Applications

Illuminating Light Distributed Illuminating Light Urp(with Seep)

Getting Pixels in and out Display Capture I/O Bulb

Luminous Room Vision Techniques Seeing Spots Software Support: glimpser Toolkits: voodoo and dee-voodoo

Conclusion

05.July.2005 Proseminar AR: The Luminous Room 17

Software Support: glimpser

low-level vision technique: identifies colored dots in its input finder: locate a specific-sized region of some particular color.

05.July.2005 Proseminar AR: The Luminous Room 18

Geometric parsing toolkit: voodoo voodoo analyzes each unorganized per-frame collection of

color dots into a list of unique patterns. Two parameters:1. the distance between each pair of dots

2. the angle through each triplet, along with the dots’ color sequence

05.July.2005 Proseminar AR: The Luminous Room 19

Toolkit: dee-voodoo

I/OBulb A

I/OBulb B

dee-voodoo dee-voodoo-------TCP/IP--------

05.July.2005 Proseminar AR: The Luminous Room 20

Conclusion the Luminous Room

Getting Pixels in and out: Display & Capture, I/O Bulb Luminous Room Vision Techniques : color-dot patterns Software Support: glimpser, toolkits: voodoo and dee-voodoo Example Applications: Illuminating Light, Distributed Illuminating

Light, Urp

future improvements Increasing the resolution of the I/O Bulb Minimizing the ambiguity of the real and virtual objects Extension to 3D

05.July.2005 Proseminar AR: The Luminous Room 21

http://tangible.media.mit.edu/projects/iobrush/

Bonus Video