gp-based image segmentation (gpis) with applications to biomedical image segmentation

39
GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Upload: damien

Post on 17-Jan-2016

58 views

Category:

Documents


0 download

DESCRIPTION

GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation. Problem statement. How do we select an optimal sequence of low-level image operators (& parameters) to get the segmented image?. Segmentation example: cell nuclei. …. Model description. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

GP-based Image Segmentation (GPIS)

withApplications to Biomedical

Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 2: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Problem statement

(c) Louis Charbonneau and Nawwaf Kharma, 2009

• How do we select an optimal sequence of low-level image operators (& parameters) to get the segmented image?

Page 3: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Segmentation example: cell nuclei

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 4: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 5: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 6: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 7: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 8: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 9: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Model description• We use Cartesian GP:– Primitive operators are clearly defined, their right combination is the problem

– CGP allows for an easy interpretation of the resulting sequence

– Segmentation is a class of problems without one perfect solution; CGP can handle this

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 10: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

System objectives • Effectiveness: segmentation should be correct• Efficiency: The smallest number of operations• Transparency: operation sequences should be easy to understand

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 11: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

System objectives (cont.)• Segmentation should be doable without a priori information (except for training ground truths)• Generality: effective on wide classes of images• Ease of Use: Minimal human intervention

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 12: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 13: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 14: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 15: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 16: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Crossover

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 17: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Mutations (I)

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 18: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Mutations (II)

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 19: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 20: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Data

(c) Louis Charbonneau and Nawwaf Kharma, 2009

1026 images, 512 x 384 pixels

120 images, 340 x 780 pixels

Page 21: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

System settings, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 22: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Pixel segmentation accuracy, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 23: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Cell segmentation accuracy, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 24: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Statistical results, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 25: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Example of evolved program, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 26: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Example of evolved program, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 27: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

System settings, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 28: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Pixel segmentation accuracy, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 29: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Cell segmentation accuracy, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 30: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Statistical results, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 31: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Example of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 32: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 33: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 34: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 35: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Superimposed input + evolved program

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 36: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

GPIS on other types of images

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Lane detection tree detection

Page 37: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

GPIS on other types of images

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Intra-cellular content of Wright-stained white blood cell images

Page 38: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Conclusion• CGP was able to adapt to the complexity of input images:– A short program was evolved to solve the easy problem – a longer program was evolved to solve the harder problem

• Operator pool can be extended with specialized operators• Injection was a reliable means of maintaining population diversity

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 39: GP-based Image Segmentation (GPIS)  with Applications to Biomedical Image Segmentation

Conclusion• A training window approach is very effective for operator refinement

• A small but accurate set of ground truths is enough to evolve segmentation algorithms without a priori information on the images

(c) Louis Charbonneau and Nawwaf Kharma, 2009