Hover Widgets: Using the Tracking State to Extend the Capabilities of
Pen-Operated Devices
Adaptive Systems and Interaction Research Group Microsoft Research www.research.microsoft.com
Tovi GrossmanKen Hinckley
Patrick BaudischManeesh AgrawalaRavin Balakrishnan
Dynamic Graphics Project Dept of Computer Science University of Toronto www.dgp.toronto.edu
Pen-Based Interfaces
• Great for notes, sketches• Lack of shortcuts problematic
Pen-Based Interfaces
• Great for notes, sketches• Lack of shortcuts problematic• Round trip problem
Localized User Interfaces
• Gesture Interaction• Tivoli (Moran, Chiu, Melle. UIST ’97)• SKETCH (Zeleznik, Herndon & Hughes. SIGGRAPH ’96)• DENIM (Newman, Lin, Hong & Landay. HCI ’03)
• Menu Interaction• Marking Menu (Kurtenbach & Buxton. CHI ’93)• Flow Menu (Guimbretière & Winograd. UIST ’03)
• Scroll ring (Smith & schraefel. Moscovich & Hughes. UIST ’04)
• Hybrid• Scriboli (Hinckley, Baudisch, Ramos, & Guimbretière. CHI ’05)
Localized User Interfaces
• Gesture Interaction• Ink confused with gesture• Explicitly switch with button
• Menu Interaction• Activated with button
Localized User Interfaces
Localized User Interfaces
Design Challenge
1. Localized user interface2. Clearly distinct from ink input3. No button required
Tracking menus
Fitzmaurice G., Khan A., Pieke R., Buxton B., Kurtenbach G. UIST 2003
Hover Widgets
• Gesture in tracking state• Widget fades in• Click on widget
Hover Widgets
Independent Variables
• Technique (Hover Widget, Icon)• GridN (4, 8, 12)• Distance (300, 600, 900, 1200)
Summary
• New distinct command layer• Button free • Localized UI
• Reduce time• Minimal shift of attention
Future Work
• Customize & adapt
Future Work
• Customize & adapt• Large displays
Acknowledgements
• Members of The Microsoft Research Adaptive Systems & Interaction group
• Members of the Microsoft Research Visualization and Interaction Group
• Members of the University of Toronto Dynamic Graphics Lab
• David Thiel• Study Participants
Questions?
Using the Tracking State
• Tool tips• Input panel gesture
Visualization
Learning
