vision extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/schulz.pdf · kyle...
TRANSCRIPT
![Page 1: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/1.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
VisionExten)on
![Page 2: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/2.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
Goals
1. Enhanceuser’sexperience• Extendvisionbeyondrestric@ons• Createseamlessintegra@on
2. Enhanceviewer’sexperience• Createillusionofreality• Mimicfinernuances
![Page 3: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/3.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
Process
1. Buildcapturemechanism2. Captureuser’seye3. Locateeyesinreal@me4. Determinegaze5. Projectontoexternalcameras6. Compositexternals
CurrentProgress
![Page 4: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/4.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
BuildingtheCaptureMechanism
CheapWebcam
IRFilter
CameraFilm
![Page 5: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/5.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
BuildingtheCaptureMechanism
Lens
USBPower
IRLEDs
![Page 6: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/6.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
CaptureUser’sEye
• OpenCV• C++• Grabsimagefromvideo
stream• Issomewhatclunkywith
mul@plecameras• IRallowsforsemi‐stable
imagecondi@ons
![Page 7: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/7.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• Converttograyscale• Dialateanderodetoremove
LEDglareandnoise• Erodeanddialatetoremove
damagedCCDpixelsanddust
• Playwithhistogramstoenhancecontrast
![Page 8: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/8.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• DynamicThresholding• Storesaminandmax
successfulthreshold• Checksmin,maxand
averagewhenlost• Returnsanareasimilartoan
elipse• LessaccurateinIRsitua@ons
![Page 9: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/9.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• Applygausianblur• Usecannyeedgedetector• Findthe“blobs”,compute
theirarea• Findboundingrectangle• Compareareawithbounding
rectangle’sellipsearea• Returnbestcandidate
![Page 10: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/10.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
LocateEyesinReal)me
• Useeitherorbothsolu@onstobestdeterminepupilloca@on
• Persistance,smoothing
![Page 11: Vision Extenon - cs-courses.mines.educs-courses.mines.edu/csci507/projects/2013/Schulz.pdf · Kyle Schulz • CSCI 512 • Spring 2013 Goals 1. Enhance user’s experience • Extend](https://reader035.vdocuments.mx/reader035/viewer/2022081614/5fce1ccb84af6968a04fac63/html5/thumbnails/11.jpg)
GazeDetec)onandTrackingKyleSchulz•CSCI512•Spring2013
DetermineGaze
PossibleSolu)ons
• Usewidthofirisandloca@onofcamera
• Calibratewithextentsofvision
• Detecteyeasawhole