linear blend skinning (lbs) · cap 5726 - computer graphics - fall 18 – xifeng gao florida state...

27
CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Linear Blend Skinning (LBS) Acknowledgement: Daniele Panozzo, Alec Jacobson

Upload: others

Post on 15-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Linear Blend Skinning (LBS)

Acknowledgement: Daniele Panozzo, Alec Jacobson

Page 2: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

LBS generalizes to different handle types

skeletons regions points cages

Page 3: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Linear Blend Skinning rigging preferred for its real-time performance

place handles in shape

Page 4: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Linear Blend Skinning rigging preferred for its real-time performance

place handles in shape paint weights

Page 5: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Linear Blend Skinning rigging preferred for its real-time performance

place handles in shape paint weights deform handles

Page 6: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Linear Blend Skinning rigging preferred for its real-time performance

place handles in shape paint weights deform handles

Page 7: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Linear Blend Skinning rigging preferred for its real-time performance

place handles in shape paint weights deform handles

Page 8: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Challenges with LBS

• Weight functions wj• Can be manually painted or

automatically generated• Degrees of freedom Tj

• Exposed to the user (possibly with a kinematic chain)

• Richness of achievable deformations

• Want to avoid common pitfalls – candy wrapper, collapses

Page 9: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Properties of the Weights

Handle vertices

Interpolation of handlesPartition of unity

is linear along cage faces

Page 10: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Weights Should Be Positive

Unconstrained biharmonic[Botsch and Kobbelt 2004]

Bounded Biharmonic Weights[Jacobson et al. 2011]

Page 11: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Weights Should Be Smooth

Bounded Biharmonic Weights

Extension of Harmonic Coordinates[Joshi et al. 2005]

[Jacobson et al. 2011]

Page 12: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Weights Should Be Smooth

Bounded Biharmonic Weights Extension of Harmonic Coordinates[Joshi et al. 2005]

Page 13: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Different Types of Handles

Page 14: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Bounded biharmonic weights enforce properties as constraints to minimization

is linear along cage faces

Page 15: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Bounded biharmonic weights enforce properties as constraints to minimization

is linear along cage faces

Constant inequality constraints

Partition of unity

Page 16: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Bounded biharmonic weights enforce properties as constraints to minimization

is linear along cage faces

Constant inequality constraints

Solve independently and normalize

Page 17: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Bounded biharmonic weights enforce properties as constraints to minimization

Page 18: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Bounded biharmonic weights enforce properties as constraints to minimization

Page 19: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Bounded biharmonic weights enforce properties as constraints to minimization

Page 20: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Some examples of LBS in action

Page 21: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Some examples of LBS in action

Page 22: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Some examples of LBS in action

Page 23: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

3D Characters

Page 24: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Mixing different handle types

Page 25: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Skinning Decomposition for Rigid Bones

Page 26: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

Skinning Decomposition for Skeletons

Page 27: Linear Blend Skinning (LBS) · CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University Challenges with LBS • Weight functions wj • Can be manually painted

CAP 5726 - Computer Graphics - Fall 18 – Xifeng Gao Florida State University

ReferencesFundamentals of Computer Graphics, Fourth Edition 4th Edition by Steve Marschner, Peter ShirleyChapter 16

Skinning: Real-time Shape DeformationACM SIGGRAPH 2014 Coursehttp://skinning.org