Hover Widgets: Using the Tracking State to Extend the Capabilities of

Pen-Operated Devices

Adaptive Systems and Interaction Research Group Microsoft Research www.research.microsoft.com

Tovi GrossmanKen Hinckley

Patrick BaudischManeesh AgrawalaRavin Balakrishnan

Dynamic Graphics Project Dept of Computer Science University of Toronto www.dgp.toronto.edu

Pen-Based Interfaces

• Great for notes, sketches• Lack of shortcuts problematic

Pen-Based Interfaces

• Great for notes, sketches• Lack of shortcuts problematic• Round trip problem

Localized User Interfaces

• Gesture Interaction• Tivoli (Moran, Chiu, Melle. UIST ’97)• SKETCH (Zeleznik, Herndon & Hughes. SIGGRAPH ’96)• DENIM (Newman, Lin, Hong & Landay. HCI ’03)

• Menu Interaction• Marking Menu (Kurtenbach & Buxton. CHI ’93)• Flow Menu (Guimbretière & Winograd. UIST ’03)

• Scroll ring (Smith & schraefel. Moscovich & Hughes. UIST ’04)

• Hybrid• Scriboli (Hinckley, Baudisch, Ramos, & Guimbretière. CHI ’05)

Localized User Interfaces

• Gesture Interaction• Ink confused with gesture• Explicitly switch with button

• Menu Interaction• Activated with button

Localized User Interfaces

Localized User Interfaces

Localized User Interfaces

Design Challenge

1. Localized user interface2. Clearly distinct from ink input3. No button required

Tracking menus

Fitzmaurice G., Khan A., Pieke R., Buxton B., Kurtenbach G. UIST 2003

Hover Widgets

• Gesture in tracking state• Widget fades in• Click on widget

Hover Widgets

Design Considerations

• Shape

Design Considerations

• Shape• Recognition

Design Considerations

• Shape• Recognition• Visualization

DEMO

Experiment

Independent Variables

• Technique (Hover Widget, Icon)• GridN (4, 8, 12)• Distance (300, 600, 900, 1200)

Results

• Reduced Movement Time

Results

• Reduced Movement Time• Increased Accuracy

Summary

• New distinct command layer• Button free • Localized UI

• Reduce time• Minimal shift of attention

Future Work

• Customize & adapt

Future Work

• Customize & adapt• Large displays

Acknowledgements

• Members of The Microsoft Research Adaptive Systems & Interaction group

• Members of the Microsoft Research Visualization and Interaction Group

• Members of the University of Toronto Dynamic Graphics Lab

• David Thiel• Study Participants

Questions?

Using the Tracking State

• Tool tips

Using the Tracking State

• Tool tips• Input panel gesture

Pilot Study

False Activations

Visualization

Learning