understanding perception and action using the kalman filter mathematical models of human behavior...
Post on 21-Dec-2015
220 views
TRANSCRIPT
![Page 1: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/1.jpg)
Understanding Perception and Action Using the Kalman filter
Mathematical Models of Human Behavior
Amy Kalia
April 24, 2007
![Page 2: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/2.jpg)
Learning in the Context of Action
• What do you need to know to accomplish an action?– Reaching for a glass– Walking in a straight line
• How about without vision?
– Finding your way to the nearest restroom?
![Page 3: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/3.jpg)
Possibilities
• Understanding of the motor system (arm, locomotor)
• accuracy of system
• means of correcting the system
• cognitive map, current location and orientation
![Page 4: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/4.jpg)
Overview
• Overview of an algorithm useful for modeling actions (Kalman filter)
• Application to reaching
• Application to the more complex problem of navigation
![Page 5: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/5.jpg)
Kalman Filter Basics
Occurs in discrete time steps.
![Page 6: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/6.jpg)
Kalman Filter Basics
X is the state at step k
A relates x at the previous time step to x at the current step.
B relates control input u to current state
Q is the process noise covariance
![Page 7: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/7.jpg)
Kalman Filter Basics
H relates the state to the measurement z at step k.
R is the measurement noise covariance.
![Page 8: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/8.jpg)
Estimating the State of a Walker
• Define the state?
![Page 9: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/9.jpg)
Estimating the State of a Walker
• Define the state:X = [position; velocity]
![Page 10: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/10.jpg)
Estimating the State of a Walker
• Define the system model:System dynamics
xt = Axt-1 (ignoring control input)
A = [1 Δt 0 1]
System noiseQ = [0 0
0 0.5]
![Page 11: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/11.jpg)
Estimating the State of a Walker
• Define the measurement model:Zk = H’xk + noiseSensory information from visual, proprioceptive and
vestibular cues.H = [1 0 0 0 position measurement 0 1 1 1] velocity measurement
Measurement noiseR = [1 0 0 0
0 0.1 0 0 0 0 0.5 0
0 0 0 1.5] vestibular cue is noisiest
![Page 12: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/12.jpg)
Estimating the State of a Walker
• Run model for 20 steps
Position Velocity
![Page 13: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/13.jpg)
Estimating the State of a Walker
• What happens when measurement noise increases?
Position Velocity
![Page 14: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/14.jpg)
Estimating the State of a Walker
• What happens when measurement noise is small?
Position Velocity
![Page 15: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/15.jpg)
Summary of Kalman Filter Basics
• Model of state dynamics
• Correction of predicted state using measurement
• Weighted by Kalman gain, K
• Weighting depends on the noisiness of the state model vs. measurement
![Page 16: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/16.jpg)
Application to Perception and Action
• Forward models- the motor system has a model of its dynamics
• Uses sensory feedback to correct errors
![Page 17: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/17.jpg)
Forward Model of Reaching
Wolpert, et. al. (1995)
![Page 18: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/18.jpg)
Wolpert, et. al. (1995)
Model Data
Human Data
![Page 19: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/19.jpg)
How do you walk a straight line while blindfolded?
• People can’t, but instead they veer.– No consistent directional bias
• Why?
![Page 20: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/20.jpg)
How do you walk a straight line while blindfolded?
• People can’t, but instead they veer.
• Why?– Proposed Explanations:
• Differences in leg length? (“Why Lost People Walk in Circles”, 1893)
• Biomechanical asymmetries (leg strength, dominance of one side over another)
![Page 21: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/21.jpg)
How do you walk a straight line while blindfolded?
• Ability to walk a straight line depends on…– The ability to execute the motor commands
necessary– Sensory information about walking direction
• Vision, proprioception, vestibular cues
– Sounds familiar?
![Page 22: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/22.jpg)
Accumulation of Motor Noise
Kallie, Schrater & Legge (2007)
![Page 23: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/23.jpg)
Results
Kallie, Schrater & Legge (2007)
![Page 24: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/24.jpg)
Accumulation of Motor Noise in Length Dimension
Also can explain the increase in variability in path length with distance when subjects are asked to look at a target and walk to it blindfolded.
![Page 25: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/25.jpg)
Navigation Using Dead Reckoning
• Dead reckoning (path integration) is one type of navigation that requires knowledge of your actions => direction and distance traveled.
Gallistel (1990)
![Page 26: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/26.jpg)
Dead Reckoning
Muller & Wehner (1988)
Behavior seen in ants, honeybees, golden hamsters, funnel-web spider, and several species of geese.
![Page 27: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/27.jpg)
Ant Odometry: Estimating Distances
The ant’s odometer does not record the uphill-downhill distance, but rather the horizontal projection of the path (ground distance).
![Page 28: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/28.jpg)
Dead Reckoning in Ants
Muller & Wehner (1988)
![Page 29: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/29.jpg)
Dead Reckoning in Humans
Angular error: 26 deg
Distance error: 175 cm
Angular error: 35 deg
Distance error: 250 cm
![Page 30: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/30.jpg)
Possible Solution: Landmarks
• Landmarks, once learned, can provide a “position fix,” thereby reducing positional uncertainty.
![Page 31: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/31.jpg)
What is a Landmark?
![Page 32: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/32.jpg)
What is a Landmark?
Stankiewicz & Kalia (in press)
![Page 33: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/33.jpg)
Error correction with Landmarks
![Page 34: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/34.jpg)
Error correction with Landmarks
Etienne, et. al. (2004)
![Page 35: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/35.jpg)
Error correction with Landmarks
![Page 36: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/36.jpg)
Error Correction with Landmarks in Humans
Philbeck & O’Leary (2005)
![Page 37: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/37.jpg)
Error Correction with Landmarks
Philbeck & O’Leary (2005)
![Page 38: Understanding Perception and Action Using the Kalman filter Mathematical Models of Human Behavior Amy Kalia April 24, 2007](https://reader030.vdocuments.mx/reader030/viewer/2022033104/56649d6b5503460f94a4a311/html5/thumbnails/38.jpg)
Conclusions
• Dynamic models (Kalman filter) provide a method for approaching problems in perception and action
• It is necessary to specify a model of the system dynamics, sensory information, and the noisiness of these processes.
• The Kalman filter helps explain several behaviors by describing the interaction of internal processes with external information.