cognition - visual & aural

7/29/2019 Cognition - Visual & Aural

1/41

COGNITION


2/41

SOME INTERESTING OBSERVATIONS

P.R. is thought to exist independent of anobserver (objectivite & unaccessible)

V.R. creates the hypothetical image of

physical reality (adequate signal to modalities)

2/23/2013 2Student's Presentation

PHYSICAL REALITY vs VIRTUAL REALITY

So, what is more REAL?


3/41



EXPT ON COMMISSUROTOMIZED BRAIN


4/41



VENTRILOQUISM SHOWS


5/41

DEFINITION

Sensing


What is COGNITION?

Interpreting

Decision-making


6/41

VISUAL COGNITION

a) Light: EM Wave, Frequency Range, Reflection


HOW WE SEE?


7/41

VISUAL COGNITION

b) Eye: Simple Receptor for Light stimuli


HOW WE SEE?


8/41

VISUAL COGNITION



9/41

VISUAL COGNITION

c) Brain: Receiving, Interpreting, Directing sensory information


HOW WE SEE?


10/41

VISUAL COGNITION

Massive parallel distributed processing (PDP)of signals throughout the brain, iteratively andmulti-modally


Specific parts of visual cortex are responsible to

specific visual stimuli (spatial frequency analysis)

There are functional asymmetries between thetwo hemispheres of brain: Left more logical andanalytical; while Right is more for organizing andsynthesizing (art-related)

3 STRIKING OBSERVATIONS OF BRAIN:


11/41

VISUAL COGNITION


Referring back to the Commissurotomized Brain Experiment:


12/41

VISUAL COGNITION


Sequence of steps that we follow for Visual Cognition:


13/41

VISUAL COGNITION


Evolution of Human Eye and Brain:


14/41

VISUAL COGNITION


Saccadic Eye Movements (Scanpaths):


15/41

VISUAL COGNITION


Yarbus (1967): Will, Economic, Age, Activity, Clothing, Position, How long


16/41

VISUAL COGNITION

1. Contours vs Ganzfeld


PRINCIPLES GUIDING THE BASIC STIMULITO IDENTIFIABLE PATTERNS:


17/41

VISUAL COGNITION

2. Gratings




18/41

VISUAL COGNITION

3. Proximity (Gestalt Psychology)




19/41

VISUAL COGNITION

4. Similarity (Gestalt Psychology)




20/41

VISUAL COGNITION



21/41

VISUAL COGNITION

5. Continuation (Gestalt Psychology)




22/41

VISUAL COGNITION

6. Closure (Gestalt Psychology)




23/41

VISUAL COGNITION

7. Pragnanz (Gestalt Psychology)




24/41

VISUAL COGNITION

8. Context / Schemata (Top Down Approach)




25/41

VISUAL COGNITION

VISUAL DISSONANCE:



26/41

VISUAL COGNITION

DEPTH PERCEPTION:



27/41

VISUAL COGNITION



28/41

AURAL COGNITION

a) Sound: Mechanical Wave, Frequency Range, Diffraction


HOW WE HEAR?


29/41

AURAL COGNITION

b) Ear: Convert Mech. vibration to Elec. impulses


HOW WE HEAR?


30/41

AURAL COGNITION


Impedance Matching, Amplification, Equalization


31/41

AURAL COGNITION


Basilar Membrane and Tonotopic Frequency distribution


32/41

AURAL COGNITION


Auditory Masking


33/41

AURAL COGNITION

c) Brain: Receiving, Interpreting, Directing sensory information


HOW WE HEAR?


34/41

AURAL COGNITION


Tonotopic and Binaural Hearing (stripes of EE and EI)


35/41

AURAL COGNITION

Figure-Ground vs Use-of-Silence


AUDITORY ANALOGUE FOR GESTALT THEORY

Proximity-principle vs A regular intervalof Short-clicks (temporarily or spatially)


36/41

AURAL COGNITION

For weak signal, but strong in meaning (name,

soft signals for predators)


PATTERN-MATCHING IN AUDITORY PERCEPTION

Previously learnt experience (Amygdala)

Aggregate firing of the nerve cells togetherwith rate of firing match an earlier waveform

(volley theory and place theory)


37/41

AURAL COGNITION


QUALITY (SOUND, PRODUCT, TRANSMISSION)

EXAMPLE OF A PSQ LIFE CYCLE:


38/41

RELATED APPLICATION AREAS


Medical Therapy (Binaural beats reduce anxiety)

Improved acoustic environment and gadgets

Making Weapons (unfortunately)

Product Designing (like improvising PSQ)

HR initiatives (behaviour mapped to mind)


39/41

MULTIMODAL COGNITION

Colour: I realized that to make an R all I had to do was first write a P and

draw a line down from its loop. And I was so surprised that I could turn a

yellow letter into an orange letter just by adding a line


SYNESTHESIA

Multimodal PDP more accurately defines the

speed and correctness with which individuals

perceive external stimulus

Sound-Colour: My favorite music has lines that extend horizontally beyond

the 'screen' area

Bayesian Model and Max Likelihood Estimation


40/41

SOME ONGOING PROJECTS


BLUE BRAIN PROJECT

DEVELOPING THE SIXTH SENSE

EXPLORING ON AUGMENTED REALITY


41/41

COGNITION

/ / d '

THANK YOU

cognition - visual & aural

Documents