(2012) whats missing in biometric testing
DESCRIPTION
Panel presentation on "What is missing in Biometric Testing". Other panel presentations are available on the NIST IBPC website.TRANSCRIPT
![Page 1: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/1.jpg)
BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation
STEPHEN ELLIOTTIPBC 2012 – 3/7/2012
BIOMETRIC TESTING – PANEL DISCUSSION
![Page 2: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/2.jpg)
BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation
WHAT IS MISSING IN BIOMETRIC TESTING
![Page 3: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/3.jpg)
BIOMETRIC TESTING
• Traditional biometric testing– Algorithm testing
• Well established metrics• Well understood testing methodologies
• Operational testing– Harder to do
• Access to environments• Test methodologies dependent in some cases on
the test
![Page 4: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/4.jpg)
TESTING AND EVALUATION
• Essentially trying to understand how a system performs– Maybe more fundamentally – who or what is
causing the errors
![Page 5: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/5.jpg)
BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation
PROBABLY NOT MISSING, BUT HARD TO DO
![Page 6: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/6.jpg)
GAPS IN BIOMETRIC TESTING
• There have been several papers on the contribution of individual error on performance– What causes these errors?
• There are some papers that examine meta-data and the contribution of variables (age) and examines the training of algorithms
![Page 7: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/7.jpg)
GAPS IN BIOMETRIC TESTING
• Training– How do users get accustomed to devices– Can they remember how to use them– How do we provide good training to the
users that has a consistent message
![Page 8: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/8.jpg)
GAPS IN BIOMETRIC TESTING
• Accessibility– How many people know people (!) who have
problems with interacting with a biometric systems
– How do we deal with accessibility and usability issues
• Hearing and sight issues
![Page 9: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/9.jpg)
GAPS IN BIOMETRIC TESTING
• Human Factors– Testing and evaluating biometric systems by
looking at how the users interact with the system
• Are performance results different in an operational environment than collect in a lab?
• Are these performance results due to the environment?
![Page 10: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/10.jpg)
GAPS IN BIOMETRIC TESTING
• It the error always subject centric?– The role of the device?– The role of the operator?
![Page 11: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/11.jpg)
BIOMETRICS LABBiometric Standards, Performance and Assurance LaboratoryDepartment of Technology, Leadership and Innovation
FILLING IN THOSE GAPS
![Page 12: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/12.jpg)
WORK IN PROGRESS
• Interaction methodologies such as HBSI have been addressing issues such as interaction errors from the subject perspective
• Developed a framework for the establishment of metrics
• Continual work on defining those metrics• Evaluation methodology
![Page 13: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/13.jpg)
INTERACTION
![Page 14: (2012) Whats missing in biometric testing](https://reader033.vdocuments.mx/reader033/viewer/2022052621/558b0593d8b42aa40f8b463b/html5/thumbnails/14.jpg)
AND MY TIME IS UP…
• An additional presentation on the Evolution of the HBSI model is tomorrow.