image and multidimensional signal processing -...

21
Image and Multidimensional Signal Processing Colorado School of Mines Colorado School of Mines Image and Multidimensional Signal Processing Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/

Upload: others

Post on 31-May-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Colorado School of Mines

Image and Multidimensional Signal Processing

Professor William HoffDept of Electrical Engineering &Computer Science

http://inside.mines.edu/~whoff/

Page 2: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Introduction to Image Processing

2

Page 3: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

What is an Image?

• An image is a 2D function f(x,y)– f is the amplitude or “gray level”– (x,y) are the spatial plane coordinates– Conceptually, (x,y) are continuous, although in practice we limit them to

discrete (integer) values

• In general, the function value can be vector-valued– Example: Color can be represented by (red, green, blue)

• The function domain can be N-dimensional– Example: Computed Tomography (CT) images are 3D– f(x,y,z) represents the x-ray absorption at point (x,y,z)

( )( , ) , , Tr

f x y g r g bb

= =

3

Page 4: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Demos

• Matlab– Display gray scale image

I = imread(‘moon.tif’);

imtool(I);

– Display color imageimtool(‘peppers.png’)

– Plot image as a surfacesurf(double(I(1:8:end,1:8:end)))

4

Page 5: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

What is Digital Image Processing?

• DIP refers to computer processing to– Extract information– Restore or correct

aberrations – Transform image to a more

useful form • Enhance for viewing• Compress for storage or

transmission

• Began in earnest in 1960’s

FIGURE 1.4 The first picture of the moon by a U.S. spacecraft. Ranger 7 took this image on July 31, 1964 at 9:09 A.M. EDT, about 17 minutes before impacting the lunar surface.(Courtesy of NASA.)

5

Page 6: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Example

• Digital images from remote spacecraft

• Also see an interactive panorama at – http://www.panoramas.dk/mars/greeley-haven.html

6

(August 2012) This image is the first high-resolution color mosaic from NASA's Curiosity rover, showing the geological environment around the rover's landing site in Gale Crater on Mars. From http://mars.jpl.nasa.gov/msl/multimedia/images/

Page 7: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Image Processing vs. Related Areas

• Image Processing (CSCI 510 / EENG 510)– Usually low level techniques (eg, compression, edge detection)– Quantitative measurements– 2D (image in, image out)

• Computer Vision (CSCI 512 / EENG 512)– Higher level techniques (eg, object recognition)– Artificial intelligence (emulate human intelligence)– Semantic (instead of quantitative) output– 3D– There is overlap

• Other related fields– Signal processing, communications– Photogrammetry– Pattern recognition

7

Page 8: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Example Applications

• Industrial inspection

8

Page 9: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Example Applications

• Remote sensing

9

Page 10: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Example Applications

• Target recognition

Vehicles in a synthetic aperture radar (SAR) image

10

Page 11: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Example Applications

• Medical diagnosis

Xray fluoroscopy image of patient with knee implant

IVUS11

Page 12: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Sources of Image Data

• Normally images are formed from EM radiation (light, x-rays, radio waves)

12

Page 13: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

(a) Inject patient with isotope

(b) Positron emission tomography

(c) Gas cloud in constellation Cygnus

(d) Radioactive valve

Gamma rays

13

Page 14: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

X-rays

14

Page 15: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

(a,b) Fluorescence microscope

Ultraviolet

15

Page 16: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Visible

16

Page 17: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Infra-red

www.infrared-cameras.org/.../scope.htm

17

Page 18: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Microwave

18

Page 19: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines 19

Radio

Magnetic resonance imaging (MRI)

Page 20: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Images formed from other sources

• Ultrasound• Seismic• Scanning

electron microscope

20

Page 21: Image and Multidimensional Signal Processing - …inside.mines.edu/~whoff/courses/EENG510/lectures/01...Colorado School of Mines Image and Multidimensional Signal Processing What is

Image and Multidimensional Signal ProcessingColorado School of Mines

Topics in Digital Image Processing

21