snout: one-handed use of capacitive touch devices
DESCRIPTION
SNOUT: One-Handed use of Capacitive Touch Devices. Adam Zarek, Daniel Wigdor, Karan Singh University of Toronto. Problem. Exploring the solution space . Survey: We presented 6 scenarios where conventional finger input was not possible, seeking input alternatives. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/1.jpg)
SNOUT: One-Handed use of Capacitive Touch Devices
Adam Zarek, Daniel Wigdor, Karan Singh
University of Toronto
![Page 2: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/2.jpg)
2
Problem
![Page 3: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/3.jpg)
3
Exploring the solution space
• Survey: • We presented 6 scenarios where conventional finger
input was not possible, seeking input alternatives. …wearing gloves, dirty or preoccupied hands.
• 15 participants (13 male, 12 owning a touch device).
• Results: • 86% of participants suggested the non-conventional
appendages: nose, toe, elbow, knuckle at least once.
• the nose provided the broadest coverage across participants, 60% suggesting it in at least one scenario.
![Page 4: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/4.jpg)
4
Touch-free Alternatives
![Page 5: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/5.jpg)
5
Nose Pilot Study
• How accurate is nose-based interaction?
• 8 participants (7 male, all familiar with touch devices)
• Results:
Mean miss distance from the target was 0.43 times the target sizeTarget size should be scaled by 1.5x the target width
4/5mm 8/11mm 12/15mm
![Page 6: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/6.jpg)
6
Design Principles from pilot study• Avoid sliding since will dirty the screen
• UI elements must be “large enough”
• Focusing on what the nose is currently touching induces eye-fatigue
• Avoid repeated up-down motions
![Page 7: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/7.jpg)
7
Design Goals
• Minimize nose taps
• Minimize nose sliding
• Avoid inducing eye-fatigue
• Preserve existing UI layouts
• Mitigate interaction errors
![Page 8: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/8.jpg)
8
SNOUT Design
• Selection
• Text Entry
• Continuous parameter specification
![Page 9: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/9.jpg)
9
SNOUT selection• Increase target size by 1.5x (pilot study)•Reduce reliance on focused visual feedback
• Solution: Two-stage color-based selection
• Pre-processing: • split UI into Voronoi regions• apply cyclic color patterns
• step 1: aim for the selection target flooding the periphery with the color of the currently selected
region
• step 2: slide nose on screen until the color of the desired selection is on the periphery, then
disengage
![Page 10: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/10.jpg)
10
SNOUT selection
![Page 11: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/11.jpg)
11
SNOUT text entry• Small keyboard• Single appendage• No visual focus on selection
=> repeated key selection cumbersome
• Augment color-based selection with speech recognition
• Tapping a text box launches speech recognition service
• Corrections are made using color-based selection
![Page 12: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/12.jpg)
12
SNOUT text entry
![Page 13: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/13.jpg)
13
SNOUT continuous parameters
• No visual focus• Minimize sliding
=> direct touch manipulation is difficult
• Control the parameter by tilting the device• Enter tilt mode via touch-and-tap gesture • Exit tilt mode via hardware volume buttons
• Touch-and-tap: hold the device to your nose and then tap on the back of the device
![Page 14: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/14.jpg)
14
SNOUT continuous parameters
![Page 15: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/15.jpg)
15
Usability Study• Method:
• 3 custom applications that use our interaction techniques• Asked to accomplish a set of tasks within each application• Before/after survey about willingness to use different body parts as input methods
• Participants:• 12 participants (9 male, 22-35, all with mobile experience)
![Page 16: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/16.jpg)
16
Applications
• Application Launcher: selection and scrolling• Launch 5 applications at different screen locations
including scrolling
• Notepad: speech to text and keypad selection• Text input of at least 10 characters and less than 3
characters. Text input of varying length using both text entry methods.
• Map Browser: scrolling and zooming• Map navigation exercise, viewing a round trip of
checkpoints in Cambridge MA, Mexico City, Tokyo.
![Page 17: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/17.jpg)
17
Qualitative Results
• Peripheral color based selection • Generally successful, works well in practice• Overhead of keeping target color in memory• Works better when focus is on color than tip of nose
• Text entry• Generally preference for text to speech• Direct selection useable for short messages• Additional support for word-level selection desired
• Continuous parameters• Touch+tap is an easily performed gesture• Works as well/poorly as tilt based parameter control• Some users attempted to use typical sliding motions
![Page 18: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/18.jpg)
18
Quantitative Results
![Page 19: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/19.jpg)
19
Message
• Peripheral feedback has general UI potential• Potential as accessability interface.
![Page 20: SNOUT: One-Handed use of Capacitive Touch Devices](https://reader036.vdocuments.mx/reader036/viewer/2022062316/56816812550346895ddda026/html5/thumbnails/20.jpg)
20
Thank you!