augmented reality
TRANSCRIPT
Augmented RealityK.S. RAJU CSE-A
Agenda1) What is Augmented Reality?2) Augmented Reality vs Virtual Reality.3) AR System.4) Requirements.5) Types of Augmented Reality.6) Key issues of AR.7) Applications of AR.
What is Augmented Reality? Combination of two environments
i. the real environment viewed by the user.
ii. a virtual environment generated by the computer.
+ =
Term “Augmented Reality”
Real environment is augmented by means of virtual objects
Supplements reality, instead of completely replacing it
Image-enhanced by
inserting additional information.
removing the unnecessary region.
Why research this?
Enhances person’s perception.
Enhances person’s performance.
Provides a user with
work efficiency, convenience, interesting effects, and information in industry, education, entertainment, etc.
Virtual Reality
Augmented Reality in a nut shell:
Augumented Reality vs Virtual RealityVirtual Reality Augmented Reality
A user is fully immersed in Virtual Reality. Inserting virtual objects into real environment.
AR and VR statistics:
Realism-Modeling-Interaction
AR System Requirements of AR system
Blending real and virtual
Real-time interaction
Registration between 3D and 2D
Portability for wearable AR
Non-AR system:
Composition in film (ex. “Jurassic Park”)
Photorealistic virtual object
But not interactive media
2D virtual overlay (ex. “captions in TV”)
Interactive in real-time
But not combined with the real world in 3D
Requirements
Types of Augmented Reality
Device-based AR:
Uses hardware equipment.
Acquiring position data from position tracker, magnetic sensors, GPS, etc.
Including the camera(s).
Vision-Based AR:
Only uses a camera or multiple cameras
Estimating user’s position from input images
Device based AR: Architecture and Working of Device based AR:
Image Capture
Camera Frame
Grabber
Display-Out
Monitor or HMD
AR Processing
Synthesis
Virtual Object
Rendering
Positioncalculation
Data acquisition
Measuring instruments
Vision based AR: Architecture and Working of Vision based AR:
Display-Out AR Processing
Image Capture
Camera Frame
Grabber
Feature extraction& tracking
Monitor or HMD
SynthesisVirtual Object
Rendering
CameraCalibration
Buffer
Key technical issues in AR 3D Modeling
generates a virtual object to be inserted
Display device
displays mixed scenes with real and virtual environments
Calibration
estimates camera parameters
calculates transform between real and virtual world coordinates
Tracking
detects user’s position and orientation chases feature points for vision based tracking
Registration
merges a virtual object into real environment exactly
3D Modelling 3D model design tools
ex) Mayatm, SoftImagetm, …
3D reconstruction from images
Range Finder (Laser scanner)
Display Devices
Optical see-through Head Mounted Device(HMD)
Micro optic Head Mounted Device (HMD)
Calibration Calculate the camera’s parameters
intrinsic(focal length, principal points, axes’ scale/skew) and extrinsic(position, direction) parameters
Camera Calibration Toolbox for Matlab
http://www.vision.caltech.edu/bouguetj/calib_doc/
Tracking & Registration Tracking
Report the locations and orientations of the user and the surrounding objects in the environment.
continually matched with the user’s real-world andthe computer generated virtual-world.
Registration
Virtual and real worlds must be properly aligned.
If not
compromises illusion that the two coexist
prevents acceptance of many applications
Application of AR in Entertainment
Application of AR in Marketing
Application of AR by TOYOTA Automobiles
Application of AR in Games
Application of AR in Navigation
Application of AR in Automobile, Medical and Military
Application of AR in Technology and Fiction
Application of AR in Social Networking
Thank you.