vr21 augmented reality - tu-freiberg.de · augmented reality virtuelle realität ... ar toolkit –...
TRANSCRIPT
Virtuelle Realität
1
Part 21:
Augmented Reality
Virtuelle RealitätWintersemester 2006/07
Prof. Bernhard Jung
Prof. B. Jung Virtuelle Realität, WS 2006/07
Overview
Introduction to Augmented RealityAugmented Reality DisplaysExamplesAR Toolkit – an open source software library for building AR applications
Further ReadingO. Bimber & R. Raskar. Spatial Augmented Reality: A Modern Approach to
Augmented Reality. B & T. 2005. see also: http://www.spatial-ar.com/courses.htm
http://www.augmented-reality.org/http://www.howstuffworks.com/augmented-reality.htm
Virtuelle Realität
2
Prof. B. Jung Virtuelle Realität, WS 2006/07
Mixed Reality
The Reality-Virtuality Continuum
P. Milgram, H.Takemura, A.Utsumi, F. Kishino:Augmented Reality: A class of Displays on the Reality-Virtuality ContinuumSPIE Vol. 2351, Telemanipulator and TelepresenceTechnologies, 1994.
Prof. B. Jung Virtuelle Realität, WS 2006/07
Augmented Reality (AR)
images projected over the real worldaircraft head-up displaysemi-transparent goggleshandhelds (PDA, smartphone)projecting onto a desktop…
types of informationunrelated – e.g. reading email with wearable
related – e.g. virtual objects interacting with world
issuesregistration – aligning virtual and realeye gaze direction Vampire Project
Visual Active Memory Processes and Interactive Retrieval (U Bielefeld)
Virtuelle Realität
3
Prof. B. Jung Virtuelle Realität, WS 2006/07
Applications of ARNavigation SystemsMaintenance
overlay instructionsdisplay schematic
MuseumsGaming…
howstuffworks.com
microvision.comhttp://www.research.ibm.com/journal/sj/384/spohrer.html
Prof. B. Jung Virtuelle Realität, WS 2006/07
Augmented Interaction
Goal: enhance the real world sensation with useful informationUsers see real and virtual objectsLocation-dependent additional information can be provided (display menu cards for restaurants)The real sensation can be partially disabled (replace all billboards with pictures from last holiday ...)Photo-realism not necessarily first goal but in the ultimate system, people cannot decide whether parts are virtual or real
http://www.csl.sony.co.jp/person/rekimoto/uist95/uist95.html
Virtuelle Realität
4
Prof. B. Jung Virtuelle Realität, WS 2006/07
Augmented Reality - What do we need for the combination of read and virtual worlds?
Locations and optical properties of the viewer (or camera) and the displayCalibration of all devicesCombination of all local coordinate systems centered on the devices and the objects in the scene in a global coordinate systemRegistration of models of all 3D object of interest with their counterparts in the sceneTracking of objects over time when the user moves and interacts with sceneRealistic merging requires:
Objects to behave in physically plausible manner when manipulatedOcclusionCollision detectionShadowsDetailed description of the physical scene Source: Cindy Robertson (Georgia Tech)
Prof. B. Jung Virtuelle Realität, WS 2006/07
AR Displays: Overview and Classification
Bimber & Raskar
Virtuelle Realität
5
Prof. B. Jung Virtuelle Realität, WS 2006/07
Retinal Displays
Bimber & Raskar
Prof. B. Jung Virtuelle Realität, WS 2006/07
Head Mounted Displays
Bimber & Raskar
Virtuelle Realität
6
Prof. B. Jung Virtuelle Realität, WS 2006/07
Handheld Displays Bimber & Raskar
Prof. B. Jung Virtuelle Realität, WS 2006/07
Screen-based Video See-Through Displays
Bimber & Raskar
Virtuelle Realität
7
Prof. B. Jung Virtuelle Realität, WS 2006/07
Spatial Optical See-Through DisplaysBimber & Raskar
www.laser-magic.comhttp://io2technology.com
Prof. B. Jung Virtuelle Realität, WS 2006/07
Projection-based Augmentation
Bimber & Raskar
Virtuelle Realität
8
Prof. B. Jung Virtuelle Realität, WS 2006/07
Example: DigitalDesk (Wellner, Xerox, 1992)
Extending the desktop metaphor to the real deskVirtual (displayed) and real documents share the same space
http://www.xrce.xerox.com/competencies/past-projects/ip/digitalDesk.html
Prof. B. Jung Virtuelle Realität, WS 2006/07
Example: Augmented Reality for New Gaming ExperiencesResearch Project: Virtual Reality and Hypermedia in Future Telecommunication Products and ServicesUniversity of Oulu, Finlandhttp://www.infotech.oulu.fi/Annual/2000/VIRGIN.html
Virtuelle Realität
9
Prof. B. Jung Virtuelle Realität, WS 2006/07
Example: Augmented Reality for New Gaming Experiences
Mozzies Game on Siemens SX1 mobile phone
The mosquitoes can be seen as they are placed on the live video feed from the camera. Aiming is done by moving the phone around so that the mosquitoes are at the cross hair. The Camera is used to detect the motion.
http://en.wikipedia.org/wiki/Siemens_SX1
Prof. B. Jung Virtuelle Realität, WS 2006/07
Example: AR Quakehttp://wearables.unisa.edu.au/projects/ARQuake/www/
Virtuelle Realität
10
Prof. B. Jung Virtuelle Realität, WS 2006/07
Example: Steve Mann – "Cyborg"
Steven Mann (MIT, now Toronto University)"Steve Mann is the world’s first real cyborg, a man who exists in harmony with technology." Canadian Film Institute, 2001 Started to develop ‚Cyborg‘ equipment in schoolSince the 1980s he is constantly wearing his ‚WearComp‘His main research is for privacy and social impacts He noticed two main trends:
The technology diminished (everything moved into sunglasses)His ‚Cyborg‘-feeling has been growing over the years
http://www.eyetap.org/
2007
http://www.imdb.com/title/tt0301145/
Prof. B. Jung Virtuelle Realität, WS 2006/07
Example: Reality Window Manager (EyeTap)
Window manager for XWindows that overlays xterms and other windows onto planar patched in the environmentAllows for real-time tracking, replacement and rendering
http://www.eyetap.org/, http://wearcam.org/
Virtuelle Realität
11
Prof. B. Jung Virtuelle Realität, WS 2006/07
Example: Third-person perspective in augmented reality (???)
Salamin, P., Thalmann, D., and Vexo, F. 2006.http://vrlab.epfl.ch/Publications/pdf/Salamin_Thalmann_Vexo_VRST_06.pdf
Prof. B. Jung Virtuelle Realität, WS 2006/07
ARToolKit – an open source software library for building AR applications
ARToolKit uses computer vision algorithms to solve the problem of tracking the users viewpoint calculates the camera position and orientation relative to physical markers in real timehttp://www.hitl.washington.edu/artoolkit/