stanford hci group / cs376

research topics in human-computer interaction http://cs376.stanford.edu

Tangible Interaction /Augmented Reality

Scott Klemmer12 October 2004

12 October 2004 2Tangible UIs / Augmented Reality

Baychi tonight: Don Norman

User Experience: Why Do So Many Organizations Believe They Own It?Kresge Auditorium, 7:45-9:45pm

12 October 2004 3Tangible UIs / Augmented Reality

Human Subjects

http://www.stanford.edu/dept/DoR/hs

Email me before class on Thursday that you have read and understand the guidelines

12 October 2004 4Tangible UIs / Augmented Reality

“The future is already here. It is just not uniformly distributed”

—William Gibson

mentioned inBill Buxton, Forward Into the Past, Time Magazine, 10/11/2004 http://www.time.com/time/covers/1101041011/nextessay.html

12 October 2004 5Tangible UIs / Augmented Reality

Graphical User Interfaces Potato, keyboard, small “desktop”

Seated, single-user Structured tasks (word processing,

spreadsheets, …)

12 October 2004 6Tangible UIs / Augmented Reality

Tangible User Interfaces

Augment the physical world, integrating digital information with everydayphysical objects

Generally, physical input controlsgraphical or audio output

12 October 2004 7Tangible UIs / Augmented Reality

Three main types

Everyday (no actuation) Mechatronic (actuated) Ambient (actuated)

12 October 2004 8Tangible UIs / Augmented Reality

12 October 2004 9Tangible UIs / Augmented Reality

Web Design Practice Interviews with 11 professional designers [Newman

DIS 2000] Post-It notes on large surfaces

affinity diagrams Brainstorming

collaborative solo

Advantages persistent immersive & haptic fluid, informal interface

Difficulties hard to edit …to share …to make digital

Contextual Design, by Hugh Beyer and Karen HoltzblattWall of a design room at a Silicon Valley web design firm

THE DESIGNERS’ OUTPOST

12 October 2004 10Tangible UIs / Augmented Reality

THE DESIGNERS’ OUTPOST

12 October 2004 11Tangible UIs / Augmented Reality

The Designers’ Outpost Combining...

affordances of paper andadvantages of electronic media to support design practice[Klemmer et al, UIST 01]

Electronic wall surface (180 cm diagonal SMART Board)

Regular Post-it notes Computer vision, stylus, & physical

tools UI

12 October 2004 12Tangible UIs / Augmented Reality

12 October 2004 13Tangible UIs / Augmented Reality

Vision SystemI N F R A S T R U C T U R E

Rear Camera Vision (640x480, 7fps)

THE DESIGNERS’ OUTPOST

12 October 2004 14Tangible UIs / Augmented Reality

I N F R A S T R U C T U R E

Vision SystemTHE DESIGNERS’ OUTPOST

12 October 2004 15Tangible UIs / Augmented Reality

Geo-referenced I/OTHE DESIGNERS’ OUTPOST

12 October 2004 16Tangible UIs / Augmented Reality

12 October 2004 17Tangible UIs / Augmented RealityCollaborage Collaborage [Moran et al, UIST99][Moran et al, UIST99]

Rasa Rasa [McGee et al, CHI02][McGee et al, CHI02]

Illuminating LightIlluminating Light [CHI98] [CHI98]

12 October 2004 18Tangible UIs / Augmented RealityPaper Flight StripsPaper Flight Strips [Mackay et al, [Mackay et al, CHI98]CHI98]

MediaBlocksMediaBlocks [Ullmer] [Ullmer]

Palette Palette [Nelson, CHI99][Nelson, CHI99]

12 October 2004 19Tangible UIs / Augmented RealityAudio Notebook Audio Notebook [Stifelman, [Stifelman, CHI01]CHI01]

Listen Reader Listen Reader [Back, CHI01][Back, CHI01]

Books with VoicesBooks with Voices [CHI03] [CHI03]

12 October 2004 20Tangible UIs / Augmented Reality

12 October 2004 21Tangible UIs / Augmented Reality

12 October 2004 22Tangible UIs / Augmented Reality