Transcript
Page 1: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Hover Widgets: Using the Tracking State to Extend the Capabilities of

Pen-Operated Devices

Adaptive Systems and Interaction Research Group Microsoft Research www.research.microsoft.com

Tovi GrossmanKen Hinckley

Patrick BaudischManeesh AgrawalaRavin Balakrishnan

Dynamic Graphics Project Dept of Computer Science University of Toronto www.dgp.toronto.edu

Page 2: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Pen-Based Interfaces• Great for notes, sketches• Lack of shortcuts problematic

Page 3: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Pen-Based Interfaces• Great for notes, sketches• Lack of shortcuts problematic• Round trip problem

Page 4: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Localized User Interfaces• Gesture Interaction

• Tivoli (Moran, Chiu, Melle. UIST ’97)• SKETCH (Zeleznik, Herndon & Hughes. SIGGRAPH ’96)• DENIM (Newman, Lin, Hong & Landay. HCI ’03)

• Menu Interaction• Marking Menu (Kurtenbach & Buxton. CHI ’93)• Flow Menu (Guimbretière & Winograd. UIST ’03)• Scroll ring (Smith & schraefel. Moscovich & Hughes. UIST ’04)

• Hybrid• Scriboli (Hinckley, Baudisch, Ramos, & Guimbretière. CHI ’05)

Page 5: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Localized User Interfaces• Gesture Interaction

• Ink confused with gesture• Explicitly switch with button

• Menu Interaction• Activated with button

Page 6: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Localized User Interfaces

Page 7: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Localized User Interfaces

Page 8: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Localized User Interfaces

Page 9: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Design Challenge1. Localized user interface2. Clearly distinct from ink input3. No button required

Page 10: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Tracking menus

Fitzmaurice G., Khan A., Pieke R., Buxton B., Kurtenbach G. UIST 2003

Page 11: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Hover Widgets• Gesture in tracking state• Widget fades in• Click on widget

Page 12: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Hover Widgets

Page 13: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Design Considerations• Shape

Page 14: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Design Considerations• Shape• Recognition

Page 15: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Design Considerations• Shape• Recognition• Visualization

Page 18: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Independent Variables• Technique (Hover Widget, Icon)• GridN (4, 8, 12)• Distance (300, 600, 900, 1200)

Page 19: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Results• Reduced Movement Time

Page 20: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Results• Reduced Movement Time• Increased Accuracy

Page 21: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Summary• New distinct command layer• Button free • Localized UI

• Reduce time• Minimal shift of attention

Page 22: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Future Work• Customize & adapt

Page 23: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Future Work• Customize & adapt• Large displays

Page 24: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Acknowledgements• Members of The Microsoft Research

Adaptive Systems & Interaction group• Members of the Microsoft Research

Visualization and Interaction Group• Members of the University of Toronto

Dynamic Graphics Lab • David Thiel• Study Participants

Page 25: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Questions?

Page 26: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Using the Tracking State• Tool tips

Page 27: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Using the Tracking State• Tool tips• Input panel gesture

Page 28: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Pilot Study

Page 29: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

False Activations

Page 30: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Visualization

Page 31: Hover Widgets: Using the Tracking State to Extend the Capabilities of  Pen-Operated Devices

Learning


Top Related