eurographics 2012, cagliari, italy gpu based arap deformation using volumetric lattices m....
TRANSCRIPT
![Page 1: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/1.jpg)
Eurographics 2012, Cagliari, Italy
GPU based ARAP Deformation using Volumetric Lattices
M. Zollhöfer, E. Sert, G. Greiner and J. SüßmuthComputer Graphics Group, University Erlangen-Nuremberg, Germany
![Page 2: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/2.jpg)
Eurographics 2012, Cagliari, Italy
Motivation/Requirements
• Intuitive modeling– Handle-based– Direct manipulation
2
![Page 3: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/3.jpg)
Eurographics 2012, Cagliari, Italy
Motivation/Requirements
• Intuitive modeling– Handle-based– Direct manipulation
• Interactivity– Even for high quality models
3
![Page 4: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/4.jpg)
Eurographics 2012, Cagliari, Italy
Motivation/Requirements
• Intuitive modeling– Handle-based– Direct manipulation
• Interactivity– Even for high quality models
• Physical plausibility– Globally smooth
deformations– Detail preservation
4
![Page 5: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/5.jpg)
Eurographics 2012, Cagliari, Italy
Recent Work
• ARAP Surface Modeling
5
[SA07]
![Page 6: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/6.jpg)
Eurographics 2012, Cagliari, Italy
Recent Work
• ARAP Surface Modeling
• Deformation Graphs
6
[SA07]
[SSP07]
![Page 7: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/7.jpg)
Eurographics 2012, Cagliari, Italy
Recent Work
• ARAP Surface Modeling
• Deformation Graphs
• Coupled Prisms/Rigid Cells
7
[SA07]
[SSP07]
[BPGK06, BPWG07]
![Page 8: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/8.jpg)
Eurographics 2012, Cagliari, Italy
Recent Work
• ARAP Surface Modeling
• Deformation Graphs
• Coupled Prisms/Rigid Cells
• Hybrid Mesh Editing
8
[SA07]
[SSP07]
[BPGK06, BPWG07]
[BHZN10]
![Page 9: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/9.jpg)
Eurographics 2012, Cagliari, Italy
Facts/Contribution
• Method– Based on the non-linear ARAP energy [SA07]– Volumetric proxy geometry– Multi-res GPU deformation pipeline
9
![Page 10: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/10.jpg)
Eurographics 2012, Cagliari, Italy
Facts/Contribution
• Method– Based on the non-linear ARAP energy [SA07]– Volumetric proxy geometry– Multi-res GPU deformation pipeline
• Benefits– The optimization is decoupled from the
model’s geometric complexity– Volume-awareness– Fast even for high quality models– Easy to integrate into existing systems
10
![Page 11: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/11.jpg)
Eurographics 2012, Cagliari, Italy
Overview
• Preprocessing– Construct volumetric lattice
• Decouples the optimization from the model’s geometric complexity
• Transparent for the user
11
![Page 12: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/12.jpg)
Eurographics 2012, Cagliari, Italy
Overview
• Preprocessing– Construct volumetric lattice
• Decouples the optimization from the model’s geometric complexity
• Transparent for the user
• Runtime loop– Modify handle positions– Deform lattice using our multi-res
GPU ARAP solver– Use lattice to deform the input model
12
![Page 13: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/13.jpg)
Eurographics 2012, Cagliari, Italy
Proxy Geometry
• Starting point– Uniform voxel grid– Delete cubes which are
entirely outside Volumetric Lattice
13
![Page 14: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/14.jpg)
Eurographics 2012, Cagliari, Italy
Proxy Geometry
• Starting point– Uniform voxel grid– Delete cubes which are
entirely outside Volumetric Lattice
• Express vertices in local coordinates– Interactive modeling
• Tri-linear interpolation– Offline high quality poses
• B-Splines
14
𝒗 𝒋=∑𝒊
𝜶𝒊𝒋𝒄 𝒊❑
𝒗 𝒋
![Page 15: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/15.jpg)
Eurographics 2012, Cagliari, Italy
Optimization Problem
• Paradigm– ARAP [SA07] on a volumetric lattice
15
𝒄 𝒋𝒄 𝒊
![Page 16: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/16.jpg)
Eurographics 2012, Cagliari, Italy
Optimization Problem
• Paradigm– ARAP [SA07] on a volumetric lattice
• Objective function– Plausibility of deformation
• Rigidity of local transformations
16
𝑬 𝒓𝒊𝒈𝒊𝒅(𝑮 ,𝑮′)=∑
𝒊∑𝒋∈𝑵 𝒊
‖(𝒄𝒊′ −𝒄 𝒋
′ )−𝑹𝒊(𝒄 𝒊−𝒄 𝒋)‖𝟐
𝒄 𝒋𝒄 𝒊
![Page 17: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/17.jpg)
Eurographics 2012, Cagliari, Italy
Optimization Problem
• Paradigm– ARAP [SA07] on a volumetric lattice
• Objective function– Plausibility of deformation
• Rigidity of local transformations– Fulfillment of user constraints
• Distance of vertices to handles
17
𝑬 𝒄𝒐𝒏𝒔(𝑮 ,𝑮′)= ∑
𝒗 𝒋∈HV‖∑𝒊 𝜶𝒊𝒋𝒄𝒊
′ −𝒕 𝒋‖𝟐𝑬 𝒓𝒊𝒈𝒊𝒅(𝑮 ,𝑮
′)=∑𝒊
∑𝒋∈𝑵 𝒊
‖(𝒄𝒊′ −𝒄 𝒋
′ )−𝑹𝒊(𝒄 𝒊−𝒄 𝒋)‖𝟐
𝒄 𝒋𝒄 𝒊
![Page 18: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/18.jpg)
Eurographics 2012, Cagliari, Italy
Optimization Problem
• Paradigm– ARAP [SA07] on a volumetric lattice
• Objective function– Plausibility of deformation
• Rigidity of local transformations– Fulfillment of user constraints
• Distance of vertices to handles
Non-linear optimization
18
𝑬 𝒄𝒐𝒏𝒔(𝑮 ,𝑮′)= ∑
𝒗 𝒋∈HV‖∑𝒊 𝜶𝒊𝒋𝒄𝒊
′ −𝒕 𝒋‖𝟐𝑬 𝒓𝒊𝒈𝒊𝒅(𝑮 ,𝑮
′)=∑𝒊
∑𝒋∈𝑵 𝒊
‖(𝒄𝒊′ −𝒄 𝒋
′ )−𝑹𝒊(𝒄 𝒊−𝒄 𝒋)‖𝟐
𝐦𝐢𝐧𝑮 ′
𝑬 𝒍𝒂𝒓𝒂𝒑(𝑮 ,𝑮′)
𝒄 𝒋𝒄 𝒊
![Page 19: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/19.jpg)
Eurographics 2012, Cagliari, Italy
Minimizing the Objective Function
• Why do we use the ARAP paradigm?– Non-linear rotation-aware objective function– Minimization does not require a general-purpose
non-linear solver
19
![Page 20: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/20.jpg)
Eurographics 2012, Cagliari, Italy
Minimizing the Objective Function
• Why do we use the ARAP paradigm?– Non-linear rotation-aware objective function– Minimization does not require a general-purpose
non-linear solver
• Iterative flip-flop solver [SA07]– Compute optimal local rotations
SVDs are independent– Compute new control points
Iterative linear solver
20
![Page 21: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/21.jpg)
Eurographics 2012, Cagliari, Italy
Minimizing the Objective Function
• Why do we use the ARAP paradigm?– Non-linear rotation-aware objective function– Minimization does not require a general-purpose
non-linear solver
• Iterative flip-flop solver [SA07]– Compute optimal local rotations
SVDs are independent– Compute new control points
Iterative linear solver
Massively parallel GPU implementation
21
![Page 22: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/22.jpg)
Eurographics 2012, Cagliari, Italy
GPU Deformation Pipeline
• CUDA Implementation– SVD Kernel (per control point)
22
![Page 23: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/23.jpg)
Eurographics 2012, Cagliari, Italy
GPU Deformation Pipeline
• CUDA Implementation– SVD Kernel (per control point)– Solve Kernel (per control point)
• Parallel Gauss-Seidel solver or gradient descent
• Use new positions ASAP
23
![Page 24: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/24.jpg)
Eurographics 2012, Cagliari, Italy
GPU Deformation Pipeline
• CUDA Implementation– SVD Kernel (per control point)– Solve Kernel (per control point)
• Parallel Gauss-Seidel solver or gradient descent
• Use new positions ASAP- Transfer Kernel (per vertex)
24
![Page 25: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/25.jpg)
Eurographics 2012, Cagliari, Italy
GPU Deformation Pipeline
• CUDA Implementation– SVD Kernel (per control point)– Solve Kernel (per control point)
• Parallel Gauss-Seidel solver or gradient descent
• Use new positions ASAP- Transfer Kernel (per vertex) Synchronize between kernel calls
25
![Page 26: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/26.jpg)
Eurographics 2012, Cagliari, Italy
Multi-res GPU Deformation Pipeline
• New Proxy Geometry– Hierarchy of lattices
• Join 8 adjacent cubes• Encode lattices w.r.t. the next
coarser one
26
Level 0
Level 1
…
![Page 27: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/27.jpg)
Eurographics 2012, Cagliari, Italy
Multi-res GPU Deformation Pipeline
• New Proxy Geometry– Hierarchy of lattices
• Join 8 adjacent cubes• Encode lattices w.r.t. the next
coarser one
• Hierarchical Solver– Optimization Loop
• Solve for deformation on level • Transfer deformation to next
finer level
27
Level 0
Level 1
…
![Page 28: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/28.jpg)
Eurographics 2012, Cagliari, Italy
Results/Properties
• Volume-awareness
28
ARAP Ours
![Page 29: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/29.jpg)
Eurographics 2012, Cagliari, Italy
Results/Properties
• Volume-awareness
• Smoothness
29
ARAP Ours
Tri-linear B-Spline
![Page 30: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/30.jpg)
Eurographics 2012, Cagliari, Italy
Facts
• Evaluation– Core i7 860 CPU with an NVidia
GeForce 580 GPU– 71ms (14fps) to deform a 2M
polygon model (40k lattice)
30
Triangle Mesh
Polygon SoupMultiple Components
Triangle Mesh
Triangle Mesh
Polygon Soup
![Page 31: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/31.jpg)
Eurographics 2012, Cagliari, Italy
Facts
• Evaluation– Core i7 860 CPU with an NVidia
GeForce 580 GPU– 71ms (14fps) to deform a 2M
polygon model (40k lattice)– Multi-res solver gives a 3x
speedup compared to the single level version
Less iterations per hierarchy level required to converge
31
Triangle Mesh
Polygon SoupMultiple Components
Triangle Mesh
Triangle Mesh
Polygon Soup
![Page 32: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/32.jpg)
Eurographics 2012, Cagliari, Italy
Conclusion
• Summary– Intuitive mesh editing paradigm
using a simple volumetric lattice– Data-parallel multi-res GPU
deformation pipeline
32
![Page 33: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/33.jpg)
Eurographics 2012, Cagliari, Italy
Conclusion
• Summary– Intuitive mesh editing paradigm
using a simple volumetric lattice– Data-parallel multi-res GPU
deformation pipeline
• Future Work– Construct lattice hierarchy in a
topology preserving way– Monitor deformation error to solve
the optimization problem locally up to a given threshold
33
![Page 34: Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics](https://reader036.vdocuments.mx/reader036/viewer/2022062407/56649cd75503460f9499f625/html5/thumbnails/34.jpg)
Eurographics 2012, Cagliari, Italy
Questions?
34
Thanks for your attention!