image recognition christian cosgrove kelly lirebecca lin shree nadkarnisamanvit vijapur priscilla...

23
Image Recognition Christian Cosgrove Kelly Li Rebecca Lin Shree Nadkarni Samanvit Vijapur Priscilla Wong Yanjun Yang Kate Yuan Daniel Zheng Drew University New Jersey Governor’s School in the Sciences

Upload: maximilian-pearson

Post on 03-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Image Recognition

Christian Cosgrove

Kelly Li Rebecca Lin

Shree Nadkarni Samanvit Vijapur

Priscilla Wong

Yanjun Yang Kate Yuan Daniel Zheng

Drew UniversityNew Jersey Governor’s School in the

Sciences

Page 2: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University
Page 3: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Dog

Page 4: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University
Page 5: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

What is image recognition?

Page 6: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Machine Learning

• Testing and Training

Page 7: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Database

Feature Extraction

Classification

Page 8: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Digit Database

• 515 images per digit

Page 9: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

AT&T Face Database

• 40 subjects

• 10 images per subject

Page 10: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

NJGSS Face Database

• 40 subjects

• 10 images per subject

Page 11: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Feature Extraction

Vertical Edges

Intensity

Horizontal Edges

Within each patch:

Page 12: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Classification

Nearest Neighbor Centroid

Page 13: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Classification

Nearest Neighbor Centroid

Page 14: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Output: Confusion Matrix

Page 15: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Output: Confusion Matrix

Page 16: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Network Graph

Page 17: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Network Graph

Page 18: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Digit Classification Performance

WHAT IS “N PATCHES”?

Number of patches

2 2 2 2 2 2 2

Nearest Neighbor

Centroids

2 2 2

Number of patches

Per

cen

t Acc

urac

y

Page 19: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Facial Classification Performance

Nearest Neighbor

Centroids

Number of patches

2 2 2 2 2 2 2 2 2

Per

cen

t Acc

ura

cy

Page 20: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Colored Nearest Neighbor

Colored Centroids

Grayscale Nearest Neighbor

Grayscale Centroids

Number of Training Pictures

Per

cen

t Acc

ura

cy

Page 21: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Conclusions

Optimal Performance• Digits: 588 features, 14x14 patches

91%• AT&T Grayscale Faces: 480 features, 16x8/8x4

patches99% ± 0.67%

• NJGSS RGB Faces: 360 features, 16x8/8x4 patches96% ± 1.20%

Page 22: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

ConclusionsImprovements• Prioritization of feature• More training• Tolerance for rotation

and reflections of subjects• Tolerance for

background differences/lighting

Applications• Personal security• Social media• Robotics• Medical examination

Page 23: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University

Acknowledgements

Dr. Minjoon KouhMr. Michael Clancy

NJ Governor’s School in the Sciences

Dr. Adam Cassano Dr. Steve Surace

Yumi KouhBayer Health Care Dr. Robert Mayans

AT&T

Laura (NJGSS ’86) and John Overdeck

NJGSS Alumnae and Parents of Alumnae

Board of Overseers, New Jersey Governor’s

SchoolsState of New Jersey

Drew University

And all of NJGSS’s generous sponsors!