online motion puppetry for non-human...
TRANSCRIPT
Online Motion Puppetry for Non-human Characters비인간형 캐릭터에 대한 실시간 조종
서울대학교 대학원컴퓨터 공학부
윤민지
Introduction to Online Motion Puppetry Problems
http://www.youtube.com/watch?v=A_iPnC5sgRQ
Introduction to Online Motion Puppetry Problems
4/ 12
Related Work
Seol et al. SCA 2013
Number of DOFs
Absolute position 3 (x, y, z)
Root-coordinate position 3 (x, y, z)
Distance from root joint 1
Displacement from parent joint 3 (x, y, z)
Ground height 1
Joint angle at parent marker 1
Displacement from end effectors 15 (3×5 end effectors)
Distance from end effectors 5 (for 5 end effectors)
Velocity 3 (x, y, z)
Acceleration 3 (x, y, z)
Square of above features 38
Exponential of above features 38
Dot product of two vector features 45
Multiplication of two scalar features 28
(x,y,z)
Related Work
6 / 12
Challenges on …
• Limitation of pose to pose mapping
• Characters' Original Motion Style
(ex) Biped VS Quadruped manner
7 / 12
Our Approach
Motion Motion Mapping Pose Mapping
: Predefined motions : Undefined motions
Motion Mapping
What kind of predefined motions?
From the current motion, what is the most natural
motion?
9 / 12
일정차트Motion Mapping
(a) (c)(b)
• Motion Classifier: classify input motion among predefined motions
• Background data for classifying undefined motion
What kind of predefined motions?
10 / 12
일정차트Motion Mapping
From the current motion, what is the most natural motion?
11 / 12
일정차트Motion Mapping
From the current motion, what is the most natural motion?Motion graph
12 / 12
일정차트Motion Mapping
From the current motion, what is the most natural motion?Motion graph + probability
prob1
prob2
prob3
prob4
prob5
prob6
prob7
prob8
prob9
prob10
prob11
prob12
13 / 12
일정차트Motion Mapping
From the current motion, what is the most natural motion?
prob1
prob2
prob3
prob4
prob5
prob6
prob7
prob8
prob9
prob10
Current Node
prob12
14 / 12
일정차트Motion Mapping
From the current motion, what is the most natural motion?
prob1
prob2
Current Node
prob4
prob5
prob6
prob7
prob8
prob9
prob10
prob12
prob11
Motion Mapping
What kind of predefined motions?
Walk!
From the current motion, what is the most natural
motion?Node3 from motion graph
Motion Mapping
What kind of predefined motions?
Walk!
From the current motion, what is the most natural
motion?Node3 from motion graph
17 / 12
Pose Mapping
Number of DOFs
Absolute position 3 (x, y, z)
Root-coordinate position 3 (x, y, z)
Distance from root joint 1
Displacement from parent joint 3 (x, y, z)
Ground height 1
Joint angle at parent marker 1
Displacement from end effectors 15 (3×5 end effectors)
Distance from end effectors 5 (for 5 end effectors)
Velocity 3 (x, y, z)
Acceleration 3 (x, y, z)
Square of above features 38
Exponential of above features 38
Dot product of two vector features 45
Multiplication of two scalar features 28
(x,y,z)
18/ 12
Online Process ..
Input motion
Motion Mapping
Motion classifier & Motion graph
Pose MappingPose mapping
Predefined Motion
Undefined Motion
Final Motion
19/ 12
Results
For predefined motions, original motion styles are well maintained.
20/ 12
Results
The motion classifier succeeds in distinguishing undefined motions and the pose mappings work well based on input motion.
21/ 12
Results
predefined Motion + undefined Motion → Final Motion
Question & Answers
23/ 12
Discussion & Future Works
• Expansion of motion feature vectors• Support Vector Regression learning for pose mappings