the architecture of understanding (world ia day chicago keynote)

WORLD IA DAY CHICAGO

THE ARCHITECTURE OF UNDERSTANDING

@stephenanderson | #WIADChi #WIADt

presented by

Stephen P. Anderson

Anderson

Product

DesignStrategy aND

Stephen P.

Stephen P. Anderson

Consulting

What is the purpose of a map?


NavigationHow do I get to...?

OrientationWhere am I? Where can I go from here-paths and core

-iPhone navigation example

DiscoveryWhat is nearby? What can I do from here?

DefinitionWhere are the edges? What are the boundaries?

What was the purpose of this map?

…or this map?

By studying the similarities and differences between human genes and those of other organisms, researchers can discover the functions of particular genes and identify which genes are critical for life.

…or this map?

abigail.smith » Skill Progress

…or this map?






UnderstandingWhat patterns do I see? How do things relate? What can I infer from this?







UnderstandingWhat patterns do I see? How do things relate? What can I infer from this?

DESIGN FOR UNDERSTANDING

Learning through playful, visual interactions.

How do we design for understanding?

When, Where and How does Understanding occur?

through interactions

directly with information

that help reveal patterns








Interactions through interactions


http://vimeo.com/36579366



“The approach to teaching without words that I’m proposing makes heavy use of interactivity and instant informative feedback.”

http://www.creativitypost.com/education/teaching_without_words

STMath



Interactions reveal previously unseen patterns.

from “Toward a Deeper Understanding of the Role of Interaction in Information Visualization”

from “Toward a Deeper Understanding of the Role of Interaction in Information Visualization”

Name User Intent

Select mark something as interesting

Explore show me something else

Reconfigure show me a different arrangement

Encode show me a different representation

Abstract/Elaborate show me more or less detail

Filter show me something conditionally

Connect show me related items

from “Interaction and the epistemic potential of digital libraries”


3 Basic Interactions:

Conversingconveying intended actions to a VR through language (i.e., the mouth and talking).

Manipulatingtouching, grasping, or handling visually perceptible aspectsofaVR(i.e.,thehandsandhandling)

Navigatingmoving from one location or piece of information in a VR to another (i.e., the feet and walking).


3 Basic Interactions:

Conversingconveying intended actions to a VR through language (i.e., the mouth and talking).

Manipulatingtouching, grasping, or handling visually perceptible aspectsofaVR(i.e.,thehandsandhandling)

Navigatingmoving from one location or piece of information in a VR to another (i.e., the feet and walking).

Animatinginitiating and, optionally, controlling motion in a VR.

Annotatingplacing informative marks, or meta-information, on or around a VR.

Chunkinggrouping independent, but related, visual elements into a unified visual structure.

Cloningcreating an identical copy of a VR, in whole or in part.

Collectinggathering visual elements for future use.

Probingacquiring more detailed information from a VR.

Rearrangingaltering the spatial position and/or the orientation of a VR, or the components within it.

Repicturingdisplaying a VR in a new or different way

Searchinglooking for, or ascertaining the position of, specific features, elements or structures in a VR.

13 Task-Based Interactions:

Composingcreating a new VR by putting together independent visual elements.

Cuttingremoving extraneous elements from a VR.

Filteringexposing, concealing, or transforming elements of a VR that possess certain characteristics or match certain criteria.

Fragmentingdismantling aVR into its component parts.




Interactions through interactions





Embodiedthrough interactions Interactions


Everything your brain knows, it knows because of your body (your senses)

Saying words like "lick, pick, and kick" activates the corresponding brain regions associated with the mouth, hand, and foot, respectively.

Thinking, then doing.


Thinking through doing.


Thinking through doing.

PRAGMATIC

VS

EPISTEMIC ACTIONS(Actions that use the world to improve cognition)

(Actions performed to bring one physically closer to a goal)








Embodied Interactions




Information Environments





“the structural design of information environments”

!“the structural design of information environments”

May 1955


TOOLS / OBJECTSOTHERPEOPLE

PHYSICAL ENVIRONMENTS




“The “polar bear book” as it came to be known helped a generation of information architects and user experience designers make sense of the Web through structure, organization, navigation, and search. Today, much of what we wrote remains relevant, and yet new questions arise as the world and the Web intertwingle…How do we rise to the new challenges of creating paths and places that bridge physical, digital, and cognitive spaces?”

– P E T E R M O RV I L L E

(from the foreward to Pervasive Information Architecture)

Line between Digital and Physical is blurring


The world is becoming our information environment



Interactions will be much richer (and complex)



Interactions will be much richer (and complex)

#EXCITING!!

http://vitaminsdesign.com/projects/lego-calendar/



http://www.kickstarter.com/projects/863853574/touch-board-interactivity-everywhere




10 distinct sensory modalities:

1. Visual (seeing)

2. Auditory (hearing)

3. Olfactory (smelling)

4. Gustatory (tasting)

5. Vestibular (sense of balance and body movement)

6. Tactile (touching)

7. Thermoreceptive (feeling temperature)

8. Proprioceptive (positioning and movement of the extremities)

9. Introceptive (body condition and organ activity)

10. Nocioceptive (feeling pain)

(from Michael Haverkamp)

Senseg

GameDesk

https://www.youtube.com/watch?feature=player_ embedded&v=CCp_9304j3Q

https://www.youtube.com/watch?feature=player_embedded&v=CCp_9304j3Q

https://www.youtube.com/watch?feature=player_embedded&v=CCp_9304j3Q

www.leapmotion.com

http://www.leapmotion.com

http://www.leapmotion.com

The really far out stuff…

http://vimeo.com/tangiblemedia



http://leejinha.com/ZeroN



Dan Rubin@Dan_Rubin_NY

Enchanted objects are incredibly purpose built - and you won't need nav or a ui #enchantobj #SXSW

http://twitter.com/Dan_Rubin_NY




https://twitter.com/#!/search?q=%23enchantobj

https://twitter.com/#!/search?q=%23enchantobj

https://twitter.com/#!/search?q=%23SXSW

https://twitter.com/#!/search?q=%23SXSW

Dan Rubin@Dan_Rubin_NY

Enchanted objects are incredibly purpose built - and you won't need nav or a ui #enchantobj #SXSW

“From Human-Computer Interaction to Human-Information Interaction”

http://pinterest.com/stephenpa/smart-objects/











Spatial-Visual

http://archive.org/details/AlanKeyD1987?start=1439.5











Spatial-Visual




that help reveal patterns Internal Representations






Spatial-Visual



PHYSICAL ENVIRONMENTS!


STIMULUS SENSORY ORGANS PERCEPTUAL ORGANICONIC MEMORY

SHORT-TERM MEMORY

LONG-TERM MEMORY

(THE WORLD OUT THERE) (THE WORLD YOU PERCEIVE)

SimulationReality

HEARING

TASTE

SMELL

TOUCH

VISION

BALANCE

PAIN

TIME

TEMPERATURE

ANDMORE!

ABILITY TO REGISTER

HUNGER AND THIRST

SPATIAL (MAGNETIC)

ORIENTATION

(THE WORLD OUT THERE)

(THE WORLD YOU PERCEIVE)

SimulationReality

PERCEPTION IS YOUR (NEURAL) MAP OF REALITY

Michael Haverkamp distinguishes 10 distinct sensory modalities:

1. Visual (seeing)2. Auditory (hearing)3. Olfactory (smelling)4. Gustatory (tasting)5. Vestibular (sense of balance and body movement)6. Tactile (touching)7. Thermoreceptive (feeling temperature)8. Proprioceptive (positioning and movement of the extremities)9. Introceptive (body condition and organ activity)10. Nocioceptive (feeling pain)

Your brain constructs (an experience) of reality.

Food is influenced through interaction with and between our senses.

- Bernard Lahoussehttps://vimeo.com/86171854

https://vimeo.com/86171854

https://vimeo.com/86171854

http://www.happyplace.com/10999/incredibly-ill-conceived-headline-photo-pairings




Perception is not a process of active absorption but of active construction based

on prior experiences and memories.

Why do we know these are all the letter A?

A A A AA A A

A AA AA

http://imjustcreative.com/unevolvedbrands/

“Message of Love from the Dolpins” (Message d’Amour des Dauphins)

If you look at the vase you’ll probably agree that it depicts a man holding and kissing a woman from behind. What if I told you that the image in fact depicts a number of dolphins?In fact it depicts both - it’s all a matter of how your brain interprets it. Kids, who are “inexperienced” tend to see the dolphins. Grownups tend to see the loving couple, Some grownups can’t even see the dolphins if they try really hard.It’s all about what the brain expects and knows. If you know how to see a certain pattern, you’re more likely to see that pattern.

Changing the label on wine bottles changes the taste

http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price

Changing the label on wine bottles changes the taste

brain scans confirmed that people don't just think the more expensive (but identical) wine tasted better—it actually really did taste better…

http://www.psychologytoday.com/blog/brainstorm/200803/is-5000-prostitute-worth-the-price

“How fast was the car going when it hit the other car?”

“How fast was the car going when it smashed into the other car?”



that help reveal patterns Internal Representations






Spatial-Visual


Change the way you do UX/IA work.

Change the way you think about doing UX/IA work.

Change the way you do UX/IA work.

A map of this talk…

REPRESENTATIONS

INFORMATION ENVIRONMENTS

The World “Outside”

…and that whole “pervasive IA” thing

Perception & Cognition

The World “Inside”

Digital Things

Connected Media / Devices

TOOLS / OBJECTSPEOPLE


INTERACTIONS

Wearables

MACHINES TALKING TO MACHINES

Digital Environments

We need new maps.

We need new maps.

Maps that help us, as practictioners, architect exciting new information systems.

We need new maps.


Maps that celebrate and amplify human ingenuity.

We need new maps.


Maps that celebrate and amplify human ingenuity.

Maps that help us to understandwhat is unknown.

Thank you!

Stephen P. Anderson@stephenanderson

www.poetpainter.com | www.slideshare.net/stephenpa

getmentalnotes.com

Design for Understanding