image recognition christian cosgrove kelly lirebecca lin shree nadkarnisamanvit vijapur priscilla...
TRANSCRIPT
![Page 1: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/1.jpg)
Image Recognition
Christian Cosgrove
Kelly Li Rebecca Lin
Shree Nadkarni Samanvit Vijapur
Priscilla Wong
Yanjun Yang Kate Yuan Daniel Zheng
Drew UniversityNew Jersey Governor’s School in the
Sciences
![Page 2: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/2.jpg)
![Page 3: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/3.jpg)
Dog
![Page 4: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/4.jpg)
![Page 5: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/5.jpg)
What is image recognition?
![Page 6: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/6.jpg)
Machine Learning
• Testing and Training
![Page 7: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/7.jpg)
Database
Feature Extraction
Classification
![Page 8: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/8.jpg)
Digit Database
• 515 images per digit
![Page 9: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/9.jpg)
AT&T Face Database
• 40 subjects
• 10 images per subject
![Page 10: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/10.jpg)
NJGSS Face Database
• 40 subjects
• 10 images per subject
![Page 11: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/11.jpg)
Feature Extraction
Vertical Edges
Intensity
Horizontal Edges
Within each patch:
![Page 12: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/12.jpg)
Classification
Nearest Neighbor Centroid
![Page 13: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/13.jpg)
Classification
Nearest Neighbor Centroid
![Page 14: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/14.jpg)
Output: Confusion Matrix
![Page 15: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/15.jpg)
Output: Confusion Matrix
![Page 16: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/16.jpg)
Network Graph
![Page 17: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/17.jpg)
Network Graph
![Page 18: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/18.jpg)
Digit Classification Performance
WHAT IS “N PATCHES”?
Number of patches
2 2 2 2 2 2 2
Nearest Neighbor
Centroids
2 2 2
Number of patches
Per
cen
t Acc
urac
y
![Page 19: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/19.jpg)
Facial Classification Performance
Nearest Neighbor
Centroids
Number of patches
2 2 2 2 2 2 2 2 2
Per
cen
t Acc
ura
cy
![Page 20: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/20.jpg)
Colored Nearest Neighbor
Colored Centroids
Grayscale Nearest Neighbor
Grayscale Centroids
Number of Training Pictures
Per
cen
t Acc
ura
cy
![Page 21: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/21.jpg)
Conclusions
Optimal Performance• Digits: 588 features, 14x14 patches
91%• AT&T Grayscale Faces: 480 features, 16x8/8x4
patches99% ± 0.67%
• NJGSS RGB Faces: 360 features, 16x8/8x4 patches96% ± 1.20%
![Page 22: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/22.jpg)
ConclusionsImprovements• Prioritization of feature• More training• Tolerance for rotation
and reflections of subjects• Tolerance for
background differences/lighting
Applications• Personal security• Social media• Robotics• Medical examination
![Page 23: Image Recognition Christian Cosgrove Kelly LiRebecca Lin Shree NadkarniSamanvit Vijapur Priscilla Wong Yanjun YangKate YuanDaniel Zheng Drew University](https://reader030.vdocuments.mx/reader030/viewer/2022032806/56649f035503460f94c17397/html5/thumbnails/23.jpg)
Acknowledgements
Dr. Minjoon KouhMr. Michael Clancy
NJ Governor’s School in the Sciences
Dr. Adam Cassano Dr. Steve Surace
Yumi KouhBayer Health Care Dr. Robert Mayans
AT&T
Laura (NJGSS ’86) and John Overdeck
NJGSS Alumnae and Parents of Alumnae
Board of Overseers, New Jersey Governor’s
SchoolsState of New Jersey
Drew University
And all of NJGSS’s generous sponsors!