input / output devices, technologies and techniques...
TRANSCRIPT
SI3 – Master ISI : IHM02 2006/2007 1
Input / Output devices, Input / Output devices,
technologies and techniquestechnologies and techniques
Diane Lingrand
http://www.polytech.unice.fr/~lingrand
SI3 – Master ISI : IHM02 2006/2007 2
Today's topic
� Input / output devices
� mouse, keyboard, etc.
� Taxonomies
� Evaluation
� Next time:
� displays
� About 3D space and more
SI3 – Master ISI : IHM02 2006/2007 3
Inputs / outputs
� Input
� text (keyboard, handwritten)
� position (mouse, GPS, ...)
� audio (speech recognition)
� visual (image, video: tracking, recognition)
� Output
� audio (precomputed, speech synthesis)
� visual (precomputed, synthetic image)
� tactil (force feedback, vibration, ...)SI3 – Master ISI : IHM02 2006/2007 4
Text entry
� Handwritten
� totally free
� constrained
� Keyboards
� hardware / software
� mobility (wearable computer, mobile phone, PDAs, ...)
� handicap
SI3 – Master ISI : IHM02 2006/2007 5
Graffiti, Calligrapher 8.3, xscribble
uni-stroke alphabetSI3 – Master ISI : IHM02 2006/2007 6
Keyboard's layout
� AZERTY, QWERTY, ..., Dvorak (1936).
SI3 – Master ISI : IHM02 2006/2007 7
Ergonomic keyboards
SI3 – Master ISI : IHM02 2006/2007 8
Logical keyboard
Mackenzie and Zhang, CHI'99
Hunter, Zhai and Smith, CHI 2000
SI3 – Master ISI : IHM02 2006/2007 9
Games
SI3 – Master ISI : IHM02 2006/2007 10
Wearable computer
SI3 – Master ISI : IHM02 2006/2007 11
2005
SI3 – Master ISI : IHM02 2006/2007 12
Mobility
� Twiddler
� WristPC
�
http://www.redwoodhouse.com/wearable/index.php?module=pagemaster&P
AGE_user_op=view_page&PAGE_id=7&MMN_position=16:7
SI3 – Master ISI : IHM02 2006/2007 13
Chord Keyboard: Microwriter (1980)
SI3 – Master ISI : IHM02 2006/2007 14
Another Chord Keyboards
� BAT keyboard (Infogrip)
� CyKey (Bellaire Electronics)
SI3 – Master ISI : IHM02 2006/2007 15
Keyboards for PDA
SI3 – Master ISI : IHM02 2006/2007 16
Mobile phone
� Example: Glyph (F. Poirier, Univ. Bretagne Sud)
SI3 – Master ISI : IHM02 2006/2007 17
Glyph alphabet
SI3 – Master ISI : IHM02 2006/2007 18
Motor handicap
� limiting displacements
� logical keyboard
� Ex: KeyGlasses (M. Raynal, Univ. Toulouse)
SI3 – Master ISI : IHM02 2006/2007 19
Pointing devices
� absolute / relative
� graphic tablet, touchscreen, optical pen
� mouse, joystick, trackball
� direct / indirect
� Control to Display Ratio
� touchscreen, optical pen
� graphic tablet, mouse, joystick, trackball
SI3 – Master ISI : IHM02 2006/2007 20
Mouse
� invented in 1967 by Douglas Engelbart and co.
� « any device that is capable of producing cursor motion » ?
SI3 – Master ISI : IHM02 2006/2007 21� touchscreen, camera mouse, eye mouse ...
� touchpad
� pointing stick
Alternative pointing devices
� foot mouse
� trackball
SI3 – Master ISI : IHM02 2006/2007 22
� where :� MT is the average time taken to complete the movement.
� a and b are empirical constants, and can be determined by fitting a straight line to measured data.
� A is the distance from the starting point to the center of the target or amplitude of movement.
� W is the width of the target measured along the axis of motion. W can also be thought of as the allowed error tolerance in the final position, since the final point of the motion must fall within ± W/2 of the target's centre.
Evaluation of pointing task:Fitt's law (1954)
W
A
SI3 – Master ISI : IHM02 2006/2007 23
Accot and Zhai Steering law (1997)
� Extension to 2D space
� Special case of path = straight tunnel of constant width W
SI3 – Master ISI : IHM02 2006/2007 24
Joystick
� Axes (absolute value)
� Buttons (up/down)
� Hats (discrete value: up, right, ...)
� Trackballs (relative 2D value)
SI3 – Master ISI : IHM02 2006/2007 25
Other ....
� Mouth joystick � « as a » joystick
Jouse2 (Infogrip)
SI3 – Master ISI : IHM02 2006/2007 26
Gaming
� Joypad, ....
SI3 – Master ISI : IHM02 2006/2007 27
Eye - tracking
� Method:
� Image Processing
� Cornea reflexion
� Magnetic system
� Mobile (on user head) / fixed (computer)
� 2D / 3D (?)
SI3 – Master ISI : IHM02 2006/2007 28
Positionning
� GPS
� Wifi
� RFID
� Camera tracking: eye, head, hand, body, ...
� ...
SI3 – Master ISI : IHM02 2006/2007 29
Laval Virtuel, 2006
Use your imagination !
Gestaction 3D
SI3 – Master ISI : IHM02 2006/2007 30
Taxonomies
� An exhaustive list is unusable
� GKS: logical device
� Locator, Stroke, Valuator, Choice, Pick, String
� 1974-84 :Foley
� Select, Position, Orient, Ink, Text, Value
� 1983: Buxton
� 1991: Card, Mackinlay and Robertson
SI3 – Master ISI : IHM02 2006/2007 31
1984: Foley
SI3 – Master ISI : IHM02 2006/2007 32
1983: Buxton's Taxonomy
SI3 – Master ISI : IHM02 2006/2007 33
Card, MacKinlay
and Robertson
(1997)
SI3 – Master ISI : IHM02 2006/2007 34
Mackinlay's radio
VolumeKnob = <Rz, [0o, 270o], �, I, [0o, 270o], {}>
= Rz : [0o, 270o] � [0o, 270o]
Volume = < InputDomain: [0, 25] decibels>
� Connection composition:
Connect (VolumeKnob, Volume, f( � deg) = Cv * � decibels)
VolumeKnob � Volume
� Layout composition:
VolumeKnobT1(x)�SelectionKnobT2(x)�StationKnobT3(x)
� Merge composition:
GenericTabletxy
= Generic1DTabletx X Generic1DTablet
y
SI3 – Master ISI : IHM02 2006/2007 35
Limitations
1D sensor 1D sensor 1D sensor 1D sensor
2D event (x;y)
X Y
2D event (x;y)
equivalent ???SI3 – Master ISI : IHM02 2006/2007 36
Ouputs
� Audio
� Visual
� screen / monitor
� glasses
� retinal
� Touch / Force
SI3 – Master ISI : IHM02 2006/2007 37
BCI: Brain Computer Interfaces
� Non-invasive / Invasive
� Paralysed people
� control of a robotic arm, ...
� Blind people
� camera + electrodes in the visual cortex
SI3 – Master ISI : IHM02 2006/2007 38
Tools and libraries
� Using different input devices:
� drivers
� libraries: � VRPN : Virtual Reality Peripheral Network
� SDL (www.libsdl.org): Simple DirectMedia Layer
� Speech recognition
� Speech synthesis (TTS=text-to-speech)� http://en.wikipedia.org/wiki/Speech_synthesis
� Handwritten recognition
� Gestures recognition
SI3 – Master ISI : IHM02 2006/2007 39
CHI at the Movie Theater
1968
20022001
2003
SI3 – Master ISI : IHM02 2006/2007 40
Bibliography
� Ken Hinckley « The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications » , chapter 7, 2003, J.A. Jacko and A. Sears editors.
� J. Accot and Sh. Zhai « More than dotting the i's � Foundations for crossing-based interfaces » CHI 2002
� Bill Buxton: http://www.billbuxton.com