visual thinking colin_ware_lectures_2013_11_objects and object-based displays
TRANSCRIPT
Perceiving and Representing Structured Information
using Objects
Organization
Image based theories Structural 3D theories Object perception: Object displays
Image Based vs Structure Theories
Template theories based on 2D image processing
In structural theories we extract the structure of a scene in terms of 3D primitives
Template theories
A template with simple morphing operations
Objects as patterns of (2D) patterns
Scenes (gist in 100 msec)
Torralba and Oliva Patterns of patterns
Properties of Image Recognition
Remarkable image recognition memory Up to 5 images for second in object
identification Applications in image searching interfaces RSVP Rapid serial visual presentation
Perception of object structure
Geon Theory
Geon Theory
3D Primitives “Geons”Structural skeleton
Shape from shading is also primitive
How Does the Brain Find Geons?
a
Contourgenerator
Canonical Views
To make things clear both component parts and the critical joints must be clear
Processing stages for recognition
The Geon Diagram Pourang Irani
3D shape primitives for architecture - entities and relationships
Surface texture and color for attributes
Pattern finding& Recognition
13% errors: 4.3 secsub-structure
26% errors 7.1 secsub-structure
42% memoryerrors
22% memoryerrors
Semantics
On top of - relies on Underneath – support, foundation Inside – containment (private code) Attachment points (external interfaces; part_of
relationships) more than topology mid Upper Lower
Natural semanticsInstances Dependency
Strength of Relationship Multiplicity
The Object Display (Wickens)
Use complex objects to fuse variables Map entities to object parts Map structure to object structure Can be pictorial (simplified) – an engine +
fuel tank Map attributes to object attributes
- color, size, motion etc.
Object Display
100 L
45 L
Solids: 23%
45 deg 0.2/1.0
Vol : 45 LTemp: 45 degFlow: 20%Solids: 23%
Approx 1/3 errors with anesthiologists Dr George Blike
A medical ventilator
Such displays Must be custom
Chart Junk (ducks) Tufteor Effective Communication
1990 2000 2010 1990 2000 2010
A Duck? (Tufte)
The concrete/abstraction tradeoff Object displays may lead to lower errors Lend themselves to overly literal interpretation.
They are not general purpose. Object displays must be custom designed
More abstract representations leave more room for interpretation (better support the creative process)
2 ½ D design
Use 3D objects to represent entities Layout to make structure clear in 2D.
-Connections, basic shapes
Use canonical views
Holding attention-Object scene conflict
Used in advertising
Emotional and motivational effects
There is a great future in 3D object icons and object structures
It is happening anyway, but nice to know that it is not always “chart junk”.
Conclusion
Conclusions
Visual space is non-homogenous The plane orthogonal to the line of sight
and the forward direction are very different.
A 21/2D design attitude recognizes the cost of actions.
3D versus 2D
34% memoryerrors
20% memoryerrors
21% errors 5.1 secsub-structure
11.4% errors 3.7 secsub-structure