image synthesis 1 image synthesis image synthesis operations create images from other images or...

41
IMAGE SYNTHESIS 1

Upload: thomas-johns

Post on 13-Jan-2016

241 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

IMAGE SYNTHESIS

1

Page 2: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Image Synthesis• Image synthesis operations create images from other

images or non-image data• Used when a desired image is either physically impossible

or impractical to acquire• CT-image, CAD, abstract data, image composition, 3D

graphics

2

Page 3: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Tomography

• Creates cross-sectional images of solid 3D objects

• Based on X-ray imaging• The technique is implemented by moving an X-radiation source and an x-ray detector in parallel and opposing directions, pivoting about the plane of interest

3

Page 4: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Computed Tomography• Uses digital computation techniques• 2D synthetic cross-sectional image is made of 1D

projections • CT is vital for medicine

4

Page 5: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Computed Tomography

• Transmissive mode• Computed Tomography• Based on X-radiation

• Emissive mode• MRI (Magnetic Resonance Imaging)• PET( Positron Emission Tomography)

• Reflective mode• radar imaging, ultrasonic

5

Page 6: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Projections

8

Page 7: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

2D Images From Projections (object: a ball)

9

Page 8: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Details of CT scanning• http://www.impactscan.org/slides/impactcourse/basic_prin

ciples_of_ct/img0.html

10

Page 9: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

MRI = Magnetic Resonance Imaging

11

3D image from 2D´s

Page 10: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Videos on MRI

Physics of MRI • Patient training for MRI-imaging

12

Page 11: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

3D Scene Construction From Images• Stereo image pairing

13

Page 12: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Depth Perception

• Based on:• two eyes, stereo vision (or stereoscopy)• relative object sizes• object shading and shadowing• object obscuring• atmospheric haze

14

Page 13: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Stereoscopy15

Page 14: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Stereo Image Pair• Two images of the same scene with different view angles

16

Page 15: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Volume Rendering Slice-Image• Slice-image is two-dimensional and has no depth• Convert 2Ds (x,y) into 3D (x,y,z)

• z is a cross-sectional surface index • z is usually coarser than x,y. Intermediate slices are

created by interpolation methods

• Voxel can represent multiple features such as brightness, color and transparency

• See: http://en.wikipedia.org/wiki/Voxel

19

Page 16: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Example on a voxel image

20

Page 17: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Voxels in videos

• Brain MRI• 3D Aorta CT

• Kinect User Interface• Brain AVM 3D MRI

21

Page 18: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Visualization of Non-image Data• CAD rendering (computer aided design)• Elevation data rendering • 3D scanning• Visualization of abstract data

23

Page 19: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

CAD Rendering

24

Page 20: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

CAD Rendering Methods• Wireframe model

• Hidden-line removal

• Solid model • Tinted solid model

25

Page 21: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

3D Rendering

In 3D rendering following methods are used:

• A model is created from sample points

• A real object is a model • A brand new object is created

26

Page 22: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

3D Rendering

• 3D object model can be composed of surfaces, polygons or of a combination of above

• Surfaces are utilised to render simple objects (balls, sylinders)

• An arbitary plane can be rendered by using this kind of polygons

27

Page 23: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Methods

• In wireframe polygons can be seen as borderlines• In hidden-line removal lines behind the polygons are

not drawn

28

Page 24: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Methods

• Solid model rendering• Surface and color

29

Page 25: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Methods

• Shaded solid model • A surface can also illustrate different materials such as metal or plastic

30

Page 26: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Texture and lighting

• Images we create can look like real when we add different surfaces on them and illuminate them with multiple light sources

31

Page 27: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Photo-realistic Rendering

• Materials, light refraction and reflections

32

Page 28: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

33

Elevation data rendering

Page 29: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Elevation Model -Reflection planes

34

Page 30: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

The Calculation of A Reflectance

35

Page 31: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

36

Page 32: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

37

Page 33: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Example of Digital Terrain Model

38

Page 34: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

39

Page 35: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

3D-lightingModels

40

Page 36: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

The Use of 3D Models

• In scientific research 3D models are used to render objects which are too small, large, fast or slow to be viewed by other ways

• Examples:• atoms,• molecules,• Explosions• etc

41

Page 37: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

The Use of 3D Models

• In industry 3D rendering before building an expensive prototype

42

Page 38: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

The Use of 3D Models

• Commercial use and entertainment industry

• Games, movies and TV-programs

43

Page 39: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

3D Examples

• The features of the light can be rendered well, but this requires substantial computing power

44

Page 40: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

3D Examples

• The 3D- models have almost totally replaced the plastic models in the movie industry

45

Page 41: IMAGE SYNTHESIS 1 Image Synthesis Image synthesis operations create images from other images or non-image data Used when a desired image is either physically

Examples of 3D animation

•Birth

•3DDentalPlanning

•Fertilization

47