3d holoscopic imaging: the next generation 3d tv technology
TRANSCRIPT
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Imaging: The next generation 3D TV technology
Presenter: Amar Aggoun3D Visual Information Engineering (3D VIE)
School of Engineering and DesignBrunel University, UK
Email: [email protected]
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Stereoscopy
Discovered by Wheatstone in the 18th century and used for entertainment. Eventually used for terrain relief by the military and lately in virtual reality systems for entertainment and 3D Cinema.
Simplest, based on “perception”
Two simultaneous video/image to two eyes
•Color-based filtering (anaglyphs)•Polarization-based filtering•Shutter-based filtering
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Autostereoscopic Viewing
No special eye-wearLenticular or barrier technologiesSweet-spot
Multi-view AutostereoscopyMany simultaneous horizontally spaced views
Usually 7-9 views; may go up to ~50Some horizontal parallax
Lenticular Technology
Parallax Barrier Technology
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Stereo Imaging
Stereoscopy is the simplest and oldest technique
• It does not create physical duplicates of 3D light• Quality of resultant 3D effect is inferior
– Focus and convergence mismatch
• “Motion sickness” type of a feeling (Eye fatigue)– Main reason for commercial failure of 3D techniques
Mutli-view video provides some horizontal parallax
• Jumping effect• Viewing discomfort similar to stereoscopy• Requires high-resolution display device• Leakage of neighboring images
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Holography
• Basic principle -1948, first holograms – 1960• Based on physics : duplication of light field: True 3D technique• Recording on
– Photographic films– High resolution Image sensors
• 3D reconstruction by proper illumination of the recording• Experimental holographic motion pictures – 1989• Still at basic research phase
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Video Technology 3D Holoscopic imaging (also referred to as Integral Imaging) methodology uses the
principle of “Fly’s eye” and hence allows natural viewing of objects (i.e. fatigue free viewing);
Replicates 3D physical light distribution: True 3D technique
Uses incoherent radiation and forms an image that is a sampled representation of the original object space, to scale and in full colour;
The 3D content is captured using a single aperture camera in real-time
A flat panel display for example one using LCD technology is used to reproduce the captured intensity modulated image and a microlens array re-integrates the captured rays to replay the original scene in full colour and with continuous parallax in all directions;
The 3D content can be viewed by more than one person and independently of the viewer’s position;
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Image Capture/Replay
The recording of a 3D Holoscopic image The replay of a 3D Holoscopic image
A 3D holoscopic image (Integral Image) is represented entirely by a planar intensity distribution.
A flat panel display for example one using LCD technology is used to reproduce the captured intensity modulated image and a microlens array re-integrates the captured rays to replay the original scene in full colour and with continuous parallax in all directions (both horizontal and vertical).
As can be seen the replayed image is pseudoscopic (inverted in depth)
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Imaging Camera
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Photographic Camera.
This camera was constructed through a EPSRC/DTI funded LAIRD project involving several UK companies such as NPL, Hadland Photonics and EPIGEM.
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Microlens Arrays
1D Array of Cylindrical lenses to record Unidirectional 3D Holoscopic Images
2D Array of microlenses to record Omnidirectional 3D Holoscopic Images
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic image (optical model) display
The work on 3D Holoscopic imagedisplay was initially funded byDERA in the mid-90s
A flat panel display for exampleone using LCD technology is usedto reproduce the capturedintensity modulated image and amicrolens array re-integrates thecaptured rays to replay the originalscene in full colour and withcontinuous parallax in alldirections.
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Parallax Information at Extreme Viewpointsof a 3D Holoscopic Image
3D Holoscopic Image captured using a 500µm pitch spherical microlens recording array
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
An electronically captured Omni directional 3D Holoscopic image
3D Holoscopic Image Magnified Section
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
An electronically captured unidirectional 3D Holoscopic image
3D Holoscopic Image Magnified Section
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Project Information
Web site: http://www.3dvivant.euContract No: IST-7-248420-STREP Programme: FP7-ICT-2009-4Start Date: 1st March 2010Duration: 36 monthsCoordinator: Brunel University
Contact
Project Coordinator & Technical Manager:
Dr. Amar AggounBrunel UniversitySchool of Engineering and Designe-mail: [email protected]
3D Live Immerse Video-Audio Interactive Multimedia(3D VIVANT)
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Live Immerse Video-Audio Interactive Multimedia (3D VIVANT)
List of Participant: 9 Partners from 7 EU Countries
Brunel University(UK)
Centre for Research& Technology Hellas/ Informatics & Telematics Institute(Greece)
Institut für Rundfunktechnik(Germany)
Holografika(Hungary)
RAI Research Centre(Italy)
Rundfunk Berlin – Brandenburg(Germany)
Instituto de Telecomunicações(Portugal)
European Broadcast Union(Switzerland)
Arnold & Richter Cine Technik(Germany)
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Live Immerse Video-Audio Interactive Multimedia(3D VIVANT)
AIM
To investigate the generation of a 3D video technology, based on mixed 3D Holoscopicvideo content capture and associated manipulation, distribution, and displaytechnologies. The outcomes of the proposal will have extremely high impact to users,producers, content creators, filmmakers that would render the EU the leader in this newgenre.
The 3D VIVANT project will investigate the possibility of using different technologies for capture and display of 3D content.
For the capture, 3D VIVANT will take full advantage of 3D Holoscopic imaging technology, where a single camera is required.
For the display, the project will take advantage of the hologram geometrical principles to provide immersive, ultra high resolution presentation of 3D content.
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Live Immerse Video-Audio Interactive Multimedia (3D VIVANT) - System Platform
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Type 1: 3D Holoscopic Camera
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Camera
a) microlens array W×H = 153×107mm, b) magnified image of microlenses, pitch =847µm
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Preliminary type 1 camera data takenwith 847µm pitch microlens array. Thismagnified section ~7.6mm×7.6mmshows a mannequin under a desk lampwith 50×50 pixels under each microlens
3D Holoscopic Image with Full Parallax
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Image with Horizontal Parallax
A unidirectional 3D Holoscopicimage captured using the Type 1
3D holoscopic camera
Two view point images extracted
from the 3D holoscopic image
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Full Parallax 3D Holoscopic Computer graphics.
(a) 3D model generated using OpenGL (b) equivalent 3D Holoscopic image
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Two Frames of a 3D Holoscopic Animation
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
3D Holoscopic Display Using and LCD panel with a Lenticular Sheet
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Display of 3D Holoscopic Image on the Holografika System
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Example of a real 3D holoscopic image and its depth map
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
nm
l
Research Themes
• Live Capture of 3D Content (Optics and Electronic)• Real-Time Computer Generation of 3D Holoscopic Content• 3D Games• 3D Video Coding• 3D Virtual Studio For Mixed 3D Content Generation• Large Scale 3D Video Projection• 3D Teleconferencing• 3D feature extraction and recognition• Medical Imaging
3D Medical Visualization• Surveillance and Security:
3D Face Recognition3D Infra Red Integral Imaging Security System
www.3dvivant.eu
www.brunel.ac.uk/about/acad/sed
Conclusions
• 3D Holoscopic imaging (Integral Imaging) technology is a candidate for consideration in terms of human factors, cost of conversion of studios , production of content, decoders and current cost of display technology;
• Compression algorithms with high ratios are possible;
• Computer generated content can be produced by other than ray tracing;
• Display technologies are advancing to a point where high contrast images of good depth can be displayed;
• Traditional Image processing tools applied directly or modified to accommodate the data structure and enhance the image quality and/or extract information about objects in the 3D world;