mutigrid methods for solving differential equations ferien akademie 05 – veselin dikov
TRANSCRIPT
![Page 1: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/1.jpg)
Mutigrid Methods for Solving Differential Equations
Ferien Akademie ’05 – Veselin Dikov
![Page 2: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/2.jpg)
Multigrid Methods
Ferien Akademie ’05 Veselin Dikov
Agenda
● Model problem
● Relaxation. Smoothing property
● Elements of Multigrid
● Multigrid schemes
![Page 3: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/3.jpg)
Multigrid Methods Model Problem
Ferien Akademie ’05 Veselin Dikov
0)1()0(
0,10),()()("
uu
xxfxuxu
● Discretization in n points, step h = 1/n
● 1D boundary problem of steady state temperature a long a uniform rod
0
,11,2
0
2
11
n
jjjjj
vv
njfvh
vvv
![Page 4: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/4.jpg)
Multigrid Methods Model Problem
Ferien Akademie ’05 Veselin Dikov
● Stencil notation
● Av = f, where
2
2
2
2
21
1..
...
121
12
1
h
h
h
hA
)121(1 2
2 h
hA
Tnvvv 11 ,..., Tnfff 11 ,..., and
● A is Symmetric positive definite
![Page 5: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/5.jpg)
Multigrid Methods
Ferien Akademie ’05 Veselin Dikov
Agenda
● Model problem
● Relaxation. Smoothing property
● Elements of Multigrid
● Multigrid schemes
![Page 6: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/6.jpg)
Multigrid Methods Iterative Methods
Ferien Akademie ’05 Veselin Dikov
● Jacobi and Gauss-Seidel methods
● Iterative vs Direct methods
● Smoothing property
More about iterative methods
![Page 7: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/7.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Error along the domain
After 35 sweeps with weighted Jacobi
Error was smoothed
![Page 8: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/8.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
11,0,sin,
nknjn
jkv jk
● k – wave number
![Page 9: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/9.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
k = 1 k = 2
k = 7 k = 12
![Page 10: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/10.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
● smooth modes - 2
1n
k
● oscillatory modes - 12
nkn
![Page 11: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/11.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
● f = 0, σ = 0 Au = 0
2. Modified model problem
● exact solution: u = 0
● error: e = u – v = -v
we can trace the error!
![Page 12: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/12.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
2. Modified model problem
● wJacobi step
3. Weighted Jacobi relaxation
cvRv kk )()1(
● error )0()( eRe mm
21
1..
...
121
12
22
IAIR
![Page 13: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/13.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
2. Modified model problem
● we relax with wJacobi with ω = 2/3 on initial guesses respectively:
3. Weighted Jacobi relaxation
6)0(
3)0(
1)0( , vvandvvvv
4. Three experiments
e
# iterations
![Page 14: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/14.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
2. Modified model problem
● repeat the experiment with:
ω = 2/3 and initial guess
3. Weighted Jacobi relaxation
631)0(
2
1
2
1vvvv
4. Three experiments
e
# iterations
![Page 15: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/15.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
2. Modified model problem
3. Weighted Jacobi relaxation
4. Three experiments● Explanation
● Rω has the same eigenvectors as A and they are the same as the wave vectors
● Recall that for the error e(m) = Rme(0)
● Eigenvalues of Rω ?
![Page 16: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/16.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
2. Modified model problem
3. Weighted Jacobi relaxation
4. Three experiments● Explanation
wavenumber k
Eig
enva
lue
![Page 17: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/17.jpg)
Multigrid Methods Smoothing Property
Ferien Akademie ’05 Veselin Dikov
● Smoothing property explained in four steps
1. Fourier modes
2. Modified model problem
3. Weighted Jacobi relaxation
4. Three experiments● Explanation● Smoothing property
● Fast damping of oscillatory error modes
● Common for all iterative methods
● How to overcome the bad performance effect over smooth error modes?
![Page 18: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/18.jpg)
Multigrid Methods
Ferien Akademie ’05 Veselin Dikov
Agenda
● Model problem
● Relaxation. Smoothing property
● Elements of Multigrid
● Multigrid schemes
![Page 19: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/19.jpg)
Multigrid Methods Elements of Multigrid
Ferien Akademie ’05 Veselin Dikov
● Element I: A smooth wave looks more oscillatory on a coarser grid
● Aliasing: k looks like (n-k)
![Page 20: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/20.jpg)
Multigrid Methods Elements of Multigrid
Ferien Akademie ’05 Veselin Dikov
● Element II: Nested Iterations
coarsest grid
finest grid
Relax
Relax
Relax
transfer the coarse grid result to the finer grid for the initial guess
● Problems?
![Page 21: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/21.jpg)
Multigrid Methods Elements of Multigrid
Ferien Akademie ’05 Veselin Dikov
● Element III: Correction scheme
● Residual equation: Ae = r
● The scheme:
» Relax on Au = f on to obtain an approximation .» Compute .» Relax on Ae = r on to obtain an approximation to the error, .» Correct the approximation .
hhv
hAvfr h2
he2
hhh evv 2
![Page 22: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/22.jpg)
Multigrid Methods Elements of Multigrid
Ferien Akademie ’05 Veselin Dikov
● Element IV: Interpolation and restriction
● Interpolation :
● Restriction :
● Variational property:
hhI 2
.12
0,2
1
,
21
212
22
n
jvvv
vv
hj
hj
hj
hj
hj
hhI2
.22 h
jhj vv Injection:
.12
1,24
112212
2 n
jvvvv hj
hj
hj
hjFull weighting:
RcIcITh
hhh ,2
2
![Page 23: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/23.jpg)
Multigrid Methods
Ferien Akademie ’05 Veselin Dikov
Agenda
● Model problem
● Relaxation. Smoothing property
● Elements of Multigrid
● Multigrid schemes
![Page 24: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/24.jpg)
Multigrid Methods Two-Grid
Ferien Akademie ’05 Veselin Dikov
● Two-Grid = Corr.Scheme+Interpolation+Restriction
» Relax times on on with initial guess
» Compute and restrict .
» Solve on .
» Interpolate and correct .
» Relax times on on with initial guess
hhh fvMGv ,
1 hhh fuA hhv
hhhh vAfr hhh
h rIr 22 hhh reA 222 h2
hhh
h eIe 22 hhh evv
2 hhh fuA hhv
![Page 25: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/25.jpg)
Multigrid Methods Two-Grid -> V-Cycle
Ferien Akademie ’05 Veselin Dikov
● V-Cycle = Recursive Two-Grid Scheme
● Two-Grid Scheme
V-Cycle W-Cycle
![Page 26: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/26.jpg)
Multigrid Methods Full Multigrid(FMG)
Ferien Akademie ’05 Veselin Dikov
● FMG = V-Cycle + nested iterations
FMG
![Page 27: Mutigrid Methods for Solving Differential Equations Ferien Akademie 05 – Veselin Dikov](https://reader036.vdocuments.mx/reader036/viewer/2022062619/5516274a55034694308b5c40/html5/thumbnails/27.jpg)
Multigrid Methods Costs
Ferien Akademie ’05 Veselin Dikov
● V-Cycle costs
d
d
Lddd nn
21
2
2
1...
2
1
2
112
2
WUdLdd
21
2
2
1...
2
1
2
112
2Computational cost
Storage
● FMG computational costs
WUdLddd 2221
2
2
1...
2
1
2
11
21
2
● Speedup because working on smaller domains