Rendering and AffectRendering and AffectA look into emotive invariants A look into emotive invariants

through NPRthrough NPR

J.J. GibsonJ.J. Gibson

““Ecological Psychology”Ecological Psychology”

Theory of AffordancesTheory of Affordances

Some affordances are biological, others Some affordances are biological, others are environmentalare environmental

Perception is not mediated by memoryPerception is not mediated by memory

(Medin 2001)

InvariantsInvariants

They can reflect the stable properties of They can reflect the stable properties of entities and properties of behaviors over entities and properties of behaviors over time.time.

They can apply across a range of They can apply across a range of abstraction levelsabstraction levels

They can be restricted in some way by the They can be restricted in some way by the context (culture, task or environment)context (culture, task or environment)

Latent KnowledgeLatent Knowledge

Knowledge we access unconsciouslyKnowledge we access unconsciously

Hardwired knowledgeHardwired knowledge

Affects automated judgmentsAffects automated judgments

Not available to introspectionNot available to introspection

Why use non photorealistic rendering to Why use non photorealistic rendering to explore these phenomena?explore these phenomena?

NPR gives psychologists more freedom represent NPR gives psychologists more freedom represent structural information allowing them to discover structural information allowing them to discover invariantsinvariants

NPR can be stylized in order to elicit affective responsesNPR can be stylized in order to elicit affective responses

“NPR can effectively render objects and images in non-realistic styles without influencing primary feature binding processes necessary for basic object identification” (Halper 2004)

Evidence of cross-modal invariantsEvidence of cross-modal invariants

Takete Uloomo

(Davis 1961)

Invariants in motionInvariants in motion

Brownian Motion

Heider-Simmel experiments

Interacting Cognitive SubsystemsInteracting Cognitive Subsystems

A cognitive model of human information A cognitive model of human information processingprocessing

Cognitition is an activity distributed Cognitition is an activity distributed between 9 subsystemsbetween 9 subsystems

Distinguishes between propositional and Distinguishes between propositional and implicational meaningimplicational meaning Propositional (Semantic network)Propositional (Semantic network) Implicational (Holistic, Affective, Ideational)Implicational (Holistic, Affective, Ideational)

Sensory Subsystems:

VIS visual

AC acoustic

BS proprioceptive

Structural Subsystems:

OBJ object (mental imagery)

MPL morphonolexical

Meaning Subsystems

PROP propositional

IMPLIC implicational

Effector Subsystems:

ART articulatory

LIM motion of limbs, eyes, etc.

Assessment of Safety and DangerAssessment of Safety and Danger

Sharp Objects represent danger

Smooth Objects represent safety

Assessment of Safety and DangerAssessment of Safety and Danger

Assessment of Strength and Assessment of Strength and WeaknessWeakness

Used silhouette Used silhouette thickness & line thickness & line stylization as the stylization as the independent variablesindependent variables

Hypothesized thicker Hypothesized thicker silhouette would be silhouette would be mapped to an mapped to an attribution of strengthattribution of strength

Goal Directed InteractionGoal Directed Interaction

Exploration

Goal Directed InteractionGoal Directed Interaction

Way finding

ApplicationsApplications

CAD/CAM mechanical drawings and CAD/CAM mechanical drawings and architecturearchitecture

Computer GamesComputer Games

User InterfacesUser Interfaces

Virtual EnvironmentsVirtual Environments

ReferencesReferences

Davis, R. The fitness of names to drawings. British Davis, R. The fitness of names to drawings. British Journal of Psychology. 52:259-268. 1961.Journal of Psychology. 52:259-268. 1961.

Duke D.J., Barnard P.J. et al. Rendering and Affect. Duke D.J., Barnard P.J. et al. Rendering and Affect. Computer Graphics Forum. 22(3): 359 – 368. 2003.Computer Graphics Forum. 22(3): 359 – 368. 2003.

Halper N., Mellin, D.J., et al. Implicational rendering: Halper N., Mellin, D.J., et al. Implicational rendering: Drawing on latent human knowledge. ACM Drawing on latent human knowledge. ACM Transactions on Applied Perception. 2004.Transactions on Applied Perception. 2004.

Medin D.L., Ross B. H., Markman A. B. Medin D.L., Ross B. H., Markman A. B. Cognitive Cognitive PsychologyPsychology. Harcourt Publishers 2001.. Harcourt Publishers 2001.