improved gene expression programming to solve the inverse problem for ordinary differential...
TRANSCRIPT
![Page 1: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/1.jpg)
Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations
Kangshun Kangshun LiLi Professor, Ph.DProfessor, Ph.D
College of Information, College of Information,
South China Agricultural University, ChinaSouth China Agricultural University, China
Hong KongHong Kong
December 6, 2014December 6, 2014
![Page 2: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/2.jpg)
Outline of My Talk
Introduction
Inverse problems for ODEs
Improved GEP for the inverse problem of ODEs
Experiments
Conclusions and future research
![Page 3: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/3.jpg)
Outline of My Talk
Introduction
Inverse problems for ODEs
Improved GEP for the inverse problem of ODEs
Experiments
Conclusions
![Page 4: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/4.jpg)
1. Introduction
Dynamic systems Their dominant features are complicated or non-linear.
They often change over time.
How to predict them?
Stock MarketWeather Forecast Population Trends
![Page 5: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/5.jpg)
Features of such dynamic systems It’s difficult to find the functional relations among variables in the
complicated changing processes. It’s possible to find out the change rate or differential coefficient of
some variables.
1. Introduction
Ordinary Differential Equations (ODEs)
121213
232
11
1 xxxxxedtdx
exxdtdx
xdtdx
tx
t
![Page 6: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/6.jpg)
1. Introduction
Inverse problems How to establish the ODEs based on previous data.
tt
t
t
etex
tex
ex
2
12
3
22
1
t 1x 2x 3x
0.00 1.000000 1.000000 1.000000
0.01 1.010050 1.030403 1.040555
0.02 1.020201 1.061627 1.082236
0.03 1.030455 1.093692 1.125074
0.04 1.040811 1.126619 1.169095
Canonical problem
Inverse problem
121213
232
11
1
xxxxxedtdx
exxdtdx
xdtdx
tx
t
![Page 7: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/7.jpg)
1. Introduction
Example
121213
232
11
1 xxxxxedtdx
exxdtdx
xdtdx
tx
t
![Page 8: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/8.jpg)
1. Introduction
Challenges of solving inverse problems With a few observed data, it’s difficult to create ODEs. It’s difficult to determine the model structure. It’s difficult to adjust parameters.
![Page 9: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/9.jpg)
Outline of My Talk
Introduction
Inverse problems for ODEs
Improved GEP for the inverse problem of ODEs
Experiments
Conclusions
![Page 10: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/10.jpg)
A dynamic system can be expressed by: , and t denotes time.
A series of observed data collected at times . .
2. Inverse problems for ODEs
txtxtx n,,, 21
11211
11211
00201
,,,
,,,
,,,
mnmm
n
n
txtxtx
txtxtx
txtxtx
X
![Page 11: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/11.jpg)
Approaches to solving inverse problems of ODEs: Linear modeling Autoregressive model
Moving Average model
Autoregressive Moving Average model
Pre-selected based on experience
Faced with complex data, it’s hard to select the right differential equation model.
Evolutionary modeling Genetic Programming (GP)
Gene Expression Programming (GEP)
2. Inverse problems for ODEs
Non-linear dynamical systems
![Page 12: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/12.jpg)
Outline of My Talk
Introduction
Inverse problems for ODEs
Improved GEP for the inverse problem of ODEs
Experiments
Conclusions
![Page 13: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/13.jpg)
GEP Based on genome and phenomena.
Refer to the gene expression rule in the genetics.
Have advantages of both GP and GA.
GEP chromosome Q ×+×a×Q a a ba b b a a b a b a a b
× stands for the multiplication operation.
Q represents square root operation.
Segment without underline belongs to the Head.
Underlined segment is the Tail.
3. Improved GEP for the inverse problem of ODEs
![Page 14: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/14.jpg)
An example of GEP coding Each gene describes an ODE.
A chromosome describes an ODE group.
- + * x1 ^ 2 x3 x2 2 x1 x2 + + x3 x1 x2 2 4 x1 x2 x3 8 + + 3 x1 ^ t 3 6 x1 x2 x3
|————gene1———| ————gene2——— | ———gene3——— |
3. Improved GEP for the inverse problem of ODEs
-
+ *
x1 ^ 2 x3
x2 2
+
+ x3
x1 x2
+
+ 3
x1 ^
t 3
T1 T2 T3
3
2
31
3
3212
3221
1
txdtdx
xxxdtdx
xxxdtdx
![Page 15: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/15.jpg)
The flowchart of GEP algorithm for the ODEs inverse problem
3. Improved GEP for the inverse problem of ODEs
Share the same evolution framework with other evolutionary algorithms!
![Page 16: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/16.jpg)
Initialize population Set control parameters
termination symbol
Functional set head
head length: 8
tail lengths : 9
gene number: 3
Create initial population
genetic : *+-1q*+3201321023
chromosome: *+-1q*+3201321023*-*1+*+*202312032*+*1q*+3210301323
population size : 50
3. Improved GEP for the inverse problem of ODEs
![Page 17: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/17.jpg)
Fitness evaluation and chromosomes ranking
3. Improved GEP for the inverse problem of ODEs
![Page 18: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/18.jpg)
Calculate genes Traditional method
Convert the chromosome into the expression tree, and then solve it
via stacks.
Our approach
Gene Read & Compute Machine (GRCM) algorithm.
The procedure of converting the chromosome into the expression
tree can be avoided.
3. Improved GEP for the inverse problem of ODEs
![Page 19: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/19.jpg)
An example of GRCM algorithm
3. Improved GEP for the inverse problem of ODEs
+ - sin a b c d e f
+ - sin a b c
+ - sin a b c
P
+ - sin(c) a b
P
+ a-b sin(c)
P
(a-b)+sin(c)
P
![Page 20: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/20.jpg)
Generate training data and prediction data The Runge-Kutta is adopted in this phase, which is a iteration method for
simulating the ODE solutions. The RK4 formula is shown:
3. Improved GEP for the inverse problem of ODEs
njKKKKtxtx
tKtxKtxKtxfK
tKtxKtxKtxfK
tKtxKtxKtxfK
ttxtxtxfK
valuesoriginalaretxtxtx
tiiiijiji
tjtnjntjtjii
tjtnjntjtjii
tjtnjntjtjii
jjnjjii
n
,3,2,1,)22(6
1)()(
)2
1,
2
1)(,,
2
1)(,
2
1(
)2
1,
2
1)(,,
2
1)(,
2
1(
)2
1,
2
1)(,,
2
1)(,
2
1(
,,,
,,
4,3,2,1,1
3,3,223,114,
2,2,222,113,
1,1,221,112,
211,
00201
![Page 21: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/21.jpg)
Construction of fitness function It is constructed by the differences between X and X*, i.e. ∆=‖X-X* ‖
3. Improved GEP for the inverse problem of ODEs
![Page 22: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/22.jpg)
Genetic operators Selection
The Roulette selection is adopted, which means that he better the fitness, the greater probability an individual is reproduced to the next generation.
Mutation
The Head can be mutated into any function or terminal symbol, while the Tail can only be mutated into the terminal symbol
Transportation
Insertion Sequence Transposition
Root Insertion Sequence Transposition
Gene Transposition
3. Improved GEP for the inverse problem of ODEs
![Page 23: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/23.jpg)
Reconstruction
Single point restructuring
Double-point restructuring
Gene restructuring
Termination conditions
The maximum number of generations is reached.
The fitness of the best individual reaches a predefined value, or it is unchanged for a predefined number of generations.
3. Improved GEP for the inverse problem of ODEs
![Page 24: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/24.jpg)
Outline of My Talk
Introduction
Inverse problems for ODEs
Improved GEP for the inverse problem of ODEs
Experiments
Conclusions
![Page 25: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/25.jpg)
Four different datasets are used.
GP and the basic GEP are involved in the comparison.
Three different metrics are compared. Training standard deviation
Prediction
Running time
4. Experiments
![Page 26: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/26.jpg)
Four different datasets are used.
GP and the basic GEP are involved in the comparison.
Three different metrics are compared. Training standard deviation
Prediction
Running time
4. Experiments
![Page 27: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/27.jpg)
Datasets
4. Experiments
![Page 28: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/28.jpg)
Results
4. Experiments
![Page 29: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/29.jpg)
Running time
Almost performs similar with the standard GEP.
Significantly less than the GP algorithm.
Stability
Better than using the GP algorithm, particularly for complex problems.
Prediction accuracy
Better than standard GEP for each dataset
Also be superior to the standard deviation of GP algorithm
4. Experiments
![Page 30: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/30.jpg)
An improved GEP is proposed to solve the inverse problem of ODE
Overcome the shorting of evolution operations in the recessive segment.
Provide a better way to model dynamic systems.
5. Conclusions and future research
Stock MarketStock Market
Weather Forecast Population Trends
![Page 31: Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College](https://reader035.vdocuments.mx/reader035/viewer/2022062305/56649e8f5503460f94b93c06/html5/thumbnails/31.jpg)
Thank you!Thank you!Q&AQ&A