knowledge systems lab jn 9/15/2015 heterogeneous collection of learning systems for confident...

19
JN 07/04/22 Knowledge Systems Lab Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory Jacksonville State University

Upload: debra-mcdonald

Post on 11-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Heterogeneous Collection of Learning Systems for Confident

Pattern Recognition

Joshua R. NewKnowledge Systems Laboratory

Jacksonville State University

Page 2: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Outline

• Motivation

• Simplified Fuzzy ARTMAP (SFAM)

• Interactive Learning Interface

• System Demonstration

• Conclusions and Future Work

Page 3: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Motivation

Page 4: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Motivation

• Doctors and radiologists spend several hours daily analyzing patient images (ie. MRI scans of the brain)

• The patterns being searched for in the image are standard and well-known to doctors

• Why not have the doctor teach the computer to find these patterns in the images?

Page 5: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Motivation

• Doctors and radiologists who use supervised AI systems for image segmentation:– Usually can not interactively refine the computer’s

segmentation performance– Must be able to precisely select regions/pixels of

the image to train the computer– Often do not use an interface that facilitates

accomplishment of their task– Can easily lose where they are looking in the

image when using magnification

Page 6: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Simplified Fuzzy ARTMAP (SFAM)

Page 7: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

• In order to “teach the computer” to find tumors in neuro-images, a supervised machine learning system must be used

• Simplified Fuzzy ARTMAP (SFAM) is a neural network that was created by Grossberg in 1987 and uses a mathematical model of the way the human brain learns and encodes information

• This AI system was utilized because it allows very fast learning for interactive training (ie. seconds instead of days to weeks)

Page 8: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

• SFAM is a computer-based system capable of online, incremental learning

• Two “vectors” are sent to this system for learning:– Input feature vector gives the data is

available from which to learn– Supervisory signal indicates whether that

vector is an example or counterexample

Page 9: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

• Data from which to learn– Feature vector from slice pixel values from shunted and single-

opponency images (Whole Brain Atlas)

Page 10: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

• Vector-based graphic visualization of learning

Array of Pixel Values

x

y

Category 1 - 2 members

Category 2 - 1 member

Category 4 - 3 members

0.35 0.90

Page 11: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

• Only one tunable parameter – vigilance– Vigilance can be set from 0 to 1 and corresponds to the

generality by which things are classified(ie. vig=0.3=>human, vig=0.6=>male, 0.9=>Joshua New)

0.675 0.75 0.825

Page 12: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

• SFAM is sensitive to the order of the inputs

x

y

Category 1 - 2 members

Category 2 - 1 member

Category 4 - 3 members

Vector 3

Vector 1

Vector 2

Page 13: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

• Voting scheme of 5 Heterogeneous SFAM networks to overcome vigilance and input order dependence– 3 networks: random input order, set vigilance

– 2 networks: 3rd network order, vigilance ± 10%

Page 14: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

Page 15: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

SFAM

Threshold results

Overlay results

Trans-slice results

Page 16: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Interactive Learning Interface

• Screenshot of Segmentation & Features

Page 17: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

System Demonstration

Page 18: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Conclusions

• Doctors and radiologists can teach the computer to recognize abnormal brain tissue

• They can refine the learning systems results interactively

• They can precisely select targets/non-targets• They can zoom for precision while

maintaining context of the entire image• The interface developed facilitates task

performance through display of segmentation results and interactive training

Page 19: Knowledge Systems Lab JN 9/15/2015 Heterogeneous Collection of Learning Systems for Confident Pattern Recognition Joshua R. New Knowledge Systems Laboratory

JN 04/21/23

Knowledge Systems Lab

Future Work

• Quantity of health-care can be increased by utilizing these trained “agents” to allow radiologists to only view the required images and directing their attention for the ones that are viewed

• Quality of health care can be increased by using the agents to classify an entire database of images to highlight possibly overlooked or misdiagnosed cases