need volunteers… from monday’s paper: a simple story about representations input signal: a...
TRANSCRIPT
![Page 1: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/1.jpg)
![Page 2: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/2.jpg)
![Page 3: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/3.jpg)
Need volunteers…
![Page 4: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/4.jpg)
From Monday’s paper: A simple story about
representations
Input signal: a moving edge.
Model it using an auto-regressive model,
Using two different representations for observations y:
Representation 1: image-based.
Representation 2: position-based.
Cxy Axx
![Page 5: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/5.jpg)
Input signal
Representation 1
![Page 6: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/6.jpg)
Bases, n=8
Representation 1
![Page 7: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/7.jpg)
Dynamics, n=8
Representation 1
![Page 8: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/8.jpg)
Bases, n=20
Representation 1
![Page 9: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/9.jpg)
Dynamics, n=20
Representation 1
![Page 10: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/10.jpg)
Bases, n=50
Representation 1
![Page 11: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/11.jpg)
N = 50 dynamics
Representation 1
![Page 12: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/12.jpg)
What happens next?
Representation 1
![Page 13: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/13.jpg)
Representing the edge position
Input signal: y = [1:100]
What dimension of an auto-regressive model do we need to describe that signal?
Representation 2
![Page 14: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/14.jpg)
N = 1
Can only show exponentially decaying position.
axx
Representation 2
![Page 15: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/15.jpg)
N = 2
A 2-d model can handle uniform translation exactly.
Axx
110
11
111 xx
Representation 2
![Page 16: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/16.jpg)
The simple story
For a simple, canonical signal like a moving edge,
modelling it with an AR model,
The pixel-based representation requires a high-dimensional state vector, and even then doesn’t work very well.
The position-based representation works perfectly with a 2-dimensional state vector.
![Page 17: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/17.jpg)
Separating style and content with bilinear
models
Bill Freeman, MIT AI Lab.
Josh Tenenbaum, MIT Dept. Brain and Cognitive Sciences
![Page 18: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/18.jpg)
Content Style
character font
rendered observation
A
Matura MTCharacter #1
not observe
d
observed
syn
thesis
an
aly
sis
Style and content example
![Page 19: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/19.jpg)
Domain Content Style
typography letter font
face recognition identity head orientation
shape from shading shape lighting
color perception object color illum. color
speech recognition words speaker
Many perception problems have this
two-factor structure
Factor 1 Factor 2
![Page 20: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/20.jpg)
Color constancy demo
![Page 21: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/21.jpg)
How much of what we may consider to be (high-level) visual style can we account for by a simple, low-level statistical model?
Given: observations that are the result of two strongly interacting factors,
can we separately analyze or manipulate those two factors?
![Page 22: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/22.jpg)
Perceptual tasks
![Page 23: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/23.jpg)
Common form of observations
A B C
D E F
G H I . . .
factor 1
facto
r 2
![Page 24: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/24.jpg)
General case
content-class (“b” values)
style (“a”
values)
f(a1,b1) f(a1,b2) f(a1,b3) ...
f(a2,b1) f(a2,b2) f(a2,b3) ... ... ... ...
Account for observationsby a rendering function, f(a,b)
![Page 25: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/25.jpg)
Asymmetric bilinear model
ysc = f(As , bc) = As bc
Observation vectorin style s and content c
Matrix for style s
Vector for content element c
![Page 26: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/26.jpg)
Asymmetric bilinear model, with
identity is the style factor.
![Page 27: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/27.jpg)
Symmetric bilinear model
ysck = f(as, bc) = as Wk bc
Kth element ofthe observation vectorin style s and content c
Matrix for element kof observationvector.
Vector for content element c
Vector for style s
![Page 28: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/28.jpg)
Symmetric bilinear model
![Page 29: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/29.jpg)
Fitting model to training observations
Iterate SVD’sMagnus and Neudecker, 1988
SVD
=...
...
Asymmetric model
Symmetric model
ysc = As bc
ysck = as Wk bc
![Page 30: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/30.jpg)
head pose
identity
y =
![Page 31: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/31.jpg)
Vector transpose
![Page 32: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/32.jpg)
Related Work, bilinear models
Koenderink and Van Doorn, 1991, 1996
Tomasi and Kanade, 1992
Faugeras, 1993
Magnus and Neudecker, 1988
Marimont and Wandell, 1992
Turk and Pentland, 1991
Ullman and Basri, 1991
Murase and Nayar, 1995
![Page 33: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/33.jpg)
Related Work, analyzing style
Hofstadter, 1995 and earlier papers.
Grebert et al, 1992
SIGGRAPH papers regarding controls for animation or line style. Typically hand-crafted, not learned.
Brand and Hertzmann, 2000
Hertzmann et al, 2001
Efros and Freeman, 2001
![Page 34: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/34.jpg)
Procedure
(1) Fit a bilinear model to the training data of content elements observed across different styles, using linear algebra techniques.
(2) Use new data to find the parameters for a new, unknown style, or to classify new observations, or to generalize both style and content.
![Page 35: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/35.jpg)
phoneme
speaker
“ah eh ou ... ”
“ah eh ou … ”
“ah eh ou ... ”
“ah eh ou ... ”
“ah eh ou ...”
“eh ee ”ou eeuah
training set
utterances from new speaker
Task: ClassificationDomain: vowel phonemes
![Page 36: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/36.jpg)
Benchmark dataset
CMU machine learning repository
Training: 8 speakers saying 11 different vowel phonemes.
Testing: 7 new speakers
Data representation: LPC coefficients.
![Page 37: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/37.jpg)
Classification using bilinear models
Use EM (expectation maximization) algorithm.
Build up model for new speaker’s style simultaneously with classification of the content.
yobserved = Anew speaker bphonemes
Vowel datafrom a speaker in a new style
Matrix describing the unknown style of the new speaker
Previously learned vowel (content) descriptors
![Page 38: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/38.jpg)
Example problem for Expectation Maximization
(EM) algorithm
“Find the probability that each point came from one of two random spatial processes”.
![Page 39: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/39.jpg)
Estimate the underlyingprobability distributions
Assign classmembership probabilities
EM algorithm
(E-step)(M-step)
![Page 40: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/40.jpg)
Classification results: performance comparison
Multi-layer perceptron: 51%1-nearest neighbor (nn): 56%Discrm. adapt. nn: 62%Bilinear model:
data not grouped 69%data grouped by speaker 76%
![Page 41: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/41.jpg)
Task: ClassificationDomain: faces and pose.
![Page 42: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/42.jpg)
Nearest neighbor matching: 53%
Bilinear model: Estimate As while classify bc with EM: 74%
Face pose classification results
Given observations of a new face, what % of the poses can we identify correctly?
![Page 43: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/43.jpg)
Chicago
Zaph
Times
Mistral
Times Bold
Monaco
(Rest of alphabet, used in training, not shown.)
Task: ExtrapolationDomain: typography
![Page 44: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/44.jpg)
Coulomb warp representation
Describe each shape by the warp that a square of ink particles would have to undergo to form the shape.
![Page 45: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/45.jpg)
Coulomb warping
reference shape
target shape
+ charges
- charges
![Page 46: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/46.jpg)
Coulomb warp representation
shapes averages
pix
el
Cou
lom
b
warp
![Page 47: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/47.jpg)
S1 S2 S1+ S2 S1+ S2
(pixel) (Coulomb)
![Page 48: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/48.jpg)
Basis functions for the asymmetric bilinear model
bletter “C”
Achicago
Azaph
Amistral
x x x x x x x
=
=
=
![Page 49: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/49.jpg)
Controlling complexity in calculating the style matrix for
the new font
asymmetric model, using symmetric model as a
prior
asymmetric model
(173,280 parameters to fit)
symmetric model
(5 parameters to fit)
Monaco
(true)
![Page 50: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/50.jpg)
synthetic
actual
Chicago
Zaph
Times
Mistral
Times Bold
Monaco
Results of extrapolation to a new style
![Page 51: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/51.jpg)
Leave-one-out results
Ch
ica
go
Za
ph
Ch
an
ce
ry
Tim
es
Mis
tra
l
Tim
es
Bo
ld
Mo
na
co
![Page 52: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/52.jpg)
![Page 53: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/53.jpg)
Task: TranslationDomain: shape and lighting
Factor 2: Identity (face shape)
Facto
r 1:
ligh
ti ng
(1) Fit symmetric bilinear model to training data (pixel representation).(2) Solve for parameters describing face and lighting of new image.
Training
Generalization
![Page 54: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/54.jpg)
Translation Results
Factor 2: Identity (face shape)
Facto
r 1: lig
htin
g
![Page 55: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/55.jpg)
Conclusion: bilinear models are useful for translation,
classification, and extrapolation perceptual tasks.
factor 1 factor 2 observation
letter#1 Matura MT
phoneme speaker “ahh”
pose 3 Hiro
illuminant surface color eye cone
A
responses
![Page 56: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/56.jpg)
![Page 57: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/57.jpg)
![Page 58: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/58.jpg)
End. Extra pages follow.
The following slides are extras….
![Page 59: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/59.jpg)
Style and content
Mention unsupervised version would be a good class project. Josh or I would be into working with someone on it.
![Page 60: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/60.jpg)
Increase dimensionality to represent non-linearities
Say f(x) = p x2 + q x + r.This parabola varies non-linearly with x,
but as a linear function of .
(Like “homogeneous coordinates” in graphics)
x2
x
1
![Page 61: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/61.jpg)
Fitting parabolas
1-d model
2-d model
3-d model
![Page 62: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/62.jpg)
Reconstruction from low-dimensional model
![Page 63: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/63.jpg)
Eigenfaces for each pose
![Page 64: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/64.jpg)
Factor 1:
head pose
Factor 2:
identity
Task: ClassificationDomain: faces
and pose.
We build a bilinear model of how head pose and identity modify face appearance.
![Page 65: Need volunteers… From Monday’s paper: A simple story about representations Input signal: a moving edge. Model it using an auto-regressive model, Using](https://reader035.vdocuments.mx/reader035/viewer/2022062717/56649e3f5503460f94b3001c/html5/thumbnails/65.jpg)
Basis images
Pose
Pose-dependent basis functions for face appearance.
One set of coefficients will reconstruct the same person in different poses.