rising from various lying postures
DESCRIPTION
Rising from Various Lying Postures. Wen-Chieh Lin and Yi-Jheng Huang Department of Computer Science National Chiao Tung University, Taiwan. Motivation. Rising up is a very common and important motion Human / robot / avatar could fall and need stand up - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/1.jpg)
Rising from Various Lying Postures
Wen-Chieh Lin and Yi-Jheng HuangDepartment of Computer ScienceNational Chiao Tung University, Taiwan
![Page 2: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/2.jpg)
Lin & Huang, Rising from Various Lying Postures 2
Motivation
• Rising up is a very common and important motion– Human / robot / avatar could fall and need stand up
– reflects physical capability and style variation
• Rarely addressed in computer animation – focus on motion control of general types of motions
– Not address motion varieties
![Page 3: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/3.jpg)
Lin & Huang, Rising from Various Lying Postures 3
Why is rising up hard?
• Rich variations– various lying postures
– various environments
– different characters (style, physical capability)
• Complex motor skills– collision avoidance
– balance maintenance
– adaptation
![Page 4: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/4.jpg)
Lin & Huang, Rising from Various Lying Postures 4
Basic Idea
• Small database for typical rising motions
• Motion planning for large variations
• Dynamics filtering for small variations
![Page 5: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/5.jpg)
Lin & Huang, Rising from Various Lying Postures 5
Small database for typical rising motions
• Most varieties appear at lying-to-squatting
• 14 rising motions from prone, supine, and lateral positions on flat ground
rising motion database
![Page 6: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/6.jpg)
Lin & Huang, Rising from Various Lying Postures 6
Motion planning for large variations
• Connects an arbitrary lying pose to database– avoids collisions
– satisfies constraints
rising motion databasevarious lying postures
. . . . ..
![Page 7: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/7.jpg)
Lin & Huang, Rising from Various Lying Postures 7
Dynamics filtering for small variations
• Ensures physical plausibility
• Adapts to environments and characters
Dynamics Controller torques output
motionplanned motion
external forces
![Page 8: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/8.jpg)
Lin & Huang, Rising from Various Lying Postures 8
Related Work: Computer Animation
• Composable controllers– Faloutsos et al., SIGGRAPH 2001
• Contact-rich motion control– Liu et al., SIGGRAPH 2010
• Both focus on motion control of various types of motions
• Not address the motion varieties– crucial for rising up motions
![Page 9: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/9.jpg)
Lin & Huang, Rising from Various Lying Postures 9
Related Work: Robotics
• Hot topic in humanoid research– Morimoto and Doya, IROS’98
– Fujiewara et al. IROS’03
– Hirukawa et al., IJRR’05
– Kanehiro et al., ICRA’07
• Focus on robustness instead of varieties and flexibilities
Hirukawa et al.
![Page 10: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/10.jpg)
Lin & Huang, Rising from Various Lying Postures 10
Related Work: Biomechanics
• Address analysis rather than generation of rising motions– McCoy and VanSant, Physical Therapy, 1993
– Ford-Smith and VanSant, Physical Therapy, 1993
![Page 11: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/11.jpg)
Lin & Huang, Rising from Various Lying Postures 11
Motion Planning Problem
Goal
Initial
![Page 12: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/12.jpg)
Lin & Huang, Rising from Various Lying Postures 12
Rapidly-exploring random tree (RRT)
Steve LaValle http://msl.cs.uiuc.edu/rrt/gallery.html
![Page 13: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/13.jpg)
Lin & Huang, Rising from Various Lying Postures 13
RRT-connect [Kuffner et al. 2000]
initx
goalx
bT aT
nearx
![Page 14: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/14.jpg)
Lin & Huang, Rising from Various Lying Postures 14
RRT-connect [Kuffner et al. 2000]
initx
goalx
bT aT
1. Ta executes EXTEND function
![Page 15: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/15.jpg)
Lin & Huang, Rising from Various Lying Postures 15
RRT-connect [Kuffner et al. 2000]
initx
goalx
randx
bT aT
2. Generate a random node xrand as a reference node
![Page 16: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/16.jpg)
Lin & Huang, Rising from Various Lying Postures 16
RRT-connect [Kuffner et al. 2000]
initx
goalx
randx
bT aT
nearx
3. Find xnear on Ta (nearest to xrand)
![Page 17: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/17.jpg)
Lin & Huang, Rising from Various Lying Postures 17
RRT-connect [Kuffner et al. 2000]
initx
goalx
randx
bT aT
nearx
4. Grow xnew toward xrand (within distance ε)
newx
![Page 18: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/18.jpg)
Lin & Huang, Rising from Various Lying Postures 18
RRT-connect [Kuffner et al. 2000]
initx
goalx
randx
bT aT
nearxnewx
5. Tb executes EXTEND function
![Page 19: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/19.jpg)
Lin & Huang, Rising from Various Lying Postures 19
RRT-blossom [Kalisiak & van de Panne, 2006]
• Blossom– add multiple samples
– explore space more quickly
Sub-goal Sub-goal
RRT-BlossomRRT
![Page 20: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/20.jpg)
Lin & Huang, Rising from Various Lying Postures 20
RRT-blossom
• Regression– avoids searching spanning nodes
– merge nearby nodes
Regression!
Regression
![Page 21: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/21.jpg)
Lin & Huang, Rising from Various Lying Postures 21
Initial postureInitial posture
Full-body RRT-blossomFull-body RRT-blossom
Ground Ground collisioncollision
Cut illegal motionCut illegal motionAdjust constraintAdjust constraint
Obstacle & Obstacle & Self collisionSelf collision
Smoothing and Smoothing and dynamics filteringdynamics filtering
MotionMotion
Cut illegal motion Cut illegal motion Adjust constraintAdjust constraint
Partial-body RRT-blossomPartial-body RRT-blossom
YesYes
YesYes
NoNo
NoNo
Connecting Connecting posture selectionposture selection
EnvironmentEnvironment
Stage IStage I
Stage IIStage II
Stage IIIStage III
Key postureKey posture
![Page 22: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/22.jpg)
Lin & Huang, Rising from Various Lying Postures 22
Connecting Posture Selection
• Posture
• Posture difference
• Accelerating search by clustering the motion database
},,{ VqpP
),(),(),( 212121 VVdistVqqdistQwPPdist q
![Page 23: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/23.jpg)
Lin & Huang, Rising from Various Lying Postures 23
Motion Planning Strategies
• Loose-to-strict iterative refinement
• Spatiotemporally local refinement
Full-body RRT-blossomFull-body RRT-blossom
Ground Ground collisioncollision
Cut illegal motionCut illegal motionAdjust constraintAdjust constraint
Obstacle & Obstacle & Self collisionSelf collision
Cut illegal motion Cut illegal motion Adjust constraintAdjust constraint
Partial-body RRT-blossomPartial-body RRT-blossom
YesYes
YesYes
NoNo
NoNo
Stage IIStage II
EnvironmentEnvironment
![Page 24: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/24.jpg)
Lin & Huang, Rising from Various Lying Postures 24
RRT-blossom Modifications
• RRT-blossom is originally proposed for lower-dimensional configuration space
• To handle motion planning in high- dimensional posture space– plan global orientation and joint angle separately
• Impose joint limit constraint and avoid collision in the blossom operation
![Page 25: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/25.jpg)
Lin & Huang, Rising from Various Lying Postures 25
Dynamics Filtering
• Track a planned motion using velocity-driven control [Tsai et al., TVCG 2010]
• Balance by virtual actuator control [Pratt et al.]
Dynamics Controller torques output
motionplanned motion
external forces
![Page 26: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/26.jpg)
Lin & Huang, Rising from Various Lying Postures 26
Dynamics Filtering (cont.)
• In some cases, our controller may not be able to track from squatting to standing– connect to a nearest rising motion in the database
– fine since less variations from squatting to standing
![Page 27: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/27.jpg)
Lin & Huang, Rising from Various Lying Postures 27
Results
• Our database only has14 motions of rising up on flat ground (CMU MOCAP database)
• Rising up from random initial postures
• Rising up with an initial and a key posture
• Rising up in various environments
• Motion retargeting of rising up
![Page 28: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/28.jpg)
Lin & Huang, Rising from Various Lying Postures 28
Rising from random initial poses
20 prone positions 20 lateral positions 20 supine positions
![Page 29: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/29.jpg)
Lin & Huang, Rising from Various Lying Postures 29
Rising from a sitting pose
![Page 30: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/30.jpg)
Lin & Huang, Rising from Various Lying Postures 30
Rising with given initial and key poses
![Page 31: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/31.jpg)
Lin & Huang, Rising from Various Lying Postures 31
Rising from prone with a key pose
![Page 32: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/32.jpg)
Lin & Huang, Rising from Various Lying Postures 32
Rising from lateral with a key pose
![Page 33: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/33.jpg)
Lin & Huang, Rising from Various Lying Postures 33
Rising from sitting with a key pose
![Page 34: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/34.jpg)
Lin & Huang, Rising from Various Lying Postures 34
Rising from different environments
![Page 35: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/35.jpg)
Lin & Huang, Rising from Various Lying Postures 35
Arm motion adapts to environments
![Page 36: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/36.jpg)
Lin & Huang, Rising from Various Lying Postures 36
Rising up under a table
![Page 37: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/37.jpg)
Lin & Huang, Rising from Various Lying Postures 37
Rising up on different ground
![Page 38: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/38.jpg)
Lin & Huang, Rising from Various Lying Postures 38
Motion Retargeting
![Page 39: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/39.jpg)
Lin & Huang, Rising from Various Lying Postures 39
Quality evaluation by human subjects
• score range from 10 (best) to 1 (worst)
• 27 males and 13 females aged 19 to 60
![Page 40: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/40.jpg)
Lin & Huang, Rising from Various Lying Postures 40
Conclusion
• Simple and effective approach– Small database + motion planning + dynamics
filtering
• Generate rising up motions with varieties– various lying postures and environments
– physically plausible
• Efficient motion planning strategy– Loose-to-strict spatiotemporally local refinement
strategy
![Page 41: Rising from Various Lying Postures](https://reader035.vdocuments.mx/reader035/viewer/2022062814/5681684c550346895dde4a5f/html5/thumbnails/41.jpg)
Lin & Huang, Rising from Various Lying Postures 41