stability and chaos. additional material we will be using two additional sources posted on ecollege:...
TRANSCRIPT
Stability and Chaos
Additional material
• We will be using two additional sources posted on eCollege:
• 1) Berry, M. V., ‘Regular and Irregular Motion’ in Topics in Nonlinear Mechanics, ed. S. Jorna, Am. Inst. Ph. Conf. Proc No.46, pp. 16-120, 1978. (B-1)
• 2) Berry, M. V., ‘Semiclassical Mechanics of Regular and Irregular Motion’ in Les Houches Lecture Series Session XXXVI, eds. G. Iooss, R. H. G. Helleman and R. Stora, North Holland, Amsterdam, 1983. (B-2)
Sir Michael Victor Berry(born 1941)
http://www.phy.bris.ac.uk/people/berry_mv/
Regular and irregular classical motion
• Let us consider dynamics of a classical system with N degrees of freedom described by a Lagrangian (Hamiltonian) – i.e. system without dissipation
• It turns out that motion of such a system can be of two types: regular and irregular
• Regular motion (very small fraction of all systems in the universe): trajectories with neighboring initial conditions separate linearly
• Irregular motion (overwhelming majority of all systems in the universe): trajectories with neighboring initial conditions separate exponentially, resulting in a sensitivity to initial conditions
(B-2) 2.1
Integrable systems
• The simplest type of a system with a regular motion is an integrable system, for which there exist N smooth independent functions
that are constant along the trajectory of the system in the phase space
• Such quantities are called constants of motion
• For integrable systems, the number of constants of motion is equal to the number of degrees of freedom N
(B-2) 2.2(B-1) 2
NjpppqqqF NNj 1 );,...,,,,...,,( 2121
Integrable systems
• E.g., for Lagranigans (Hamiltonians) without explicit time dependencies, one of the constants of motion is the total energy (Hamiltonian)
• E.g., for systems with central potentials, three constants of motion are the components of the total angular momentum
• Along the trajectory:
• These equations can be solved for momenta:
(B-2) 2.2(B-1) 2
constCpppqqqF jNNj ),...,,,,...,,( 2121
),...,,,,...,,( 2121 NNjj CCCqqqpp
Integrable systems
• We can consider a canonical transformation to a new set of coordinates Qj and momenta Pj such that the Fj functions to be the new (conserved) momenta
• Since the new momenta are constant, the new Hamiltonian will be independent of the generalized coordinates:
• Therefore
(B-2) 2.2(B-1) 2
})){},({}),...,{},({,,...,,( 121 jjNjjNjj CqpCqpqqqFP
0~
j
j Q
HP ),...,,(
~~21 NPPPHH ),...,,(
~21 NCCCH
constC
H
P
HQ
jjj
~~ constt
C
HQ jj
jj
;~
Integrable systems
• The problem is solved if we can express the new generalized coordinates in terms of the old generalized coordinates
• We choose a generating function of the form
• For such generating function, the Legendre transformations yield
• So, the problem is solved since the 2N constants Cj and βj can be found
(B-2) 2.2(B-1) 2
N
j
q
q
jjjjjjjj
j
j
dqCqpCqSPqS1
0,
}){},({}){},({}){},({
}){},({ jjjjj
j CqQC
S
P
SQ
jj
j tC
HQ
~
Integrable systems
• The described canonical transformations will work if the conserved quantities Fj satisfy conditions necessary to consider them as independent generalized canonical momenta:
• 1) They should be independent (one cannot be derived from the other)
• 2) Poisson brackets of all the pairs of the Fj functions vanish
• The existence of N functions Fj implies that the system is limited to move on N-dimensional manifold in the 2N-dimensional phase-space
(B-2) 2.2(B-1) 2
0],[ ji FF
Integrable systems
• To describe the motion-restricting N-dimensional manifold we introduce N vector fields in the 2N-dimensional phase space
• On each manifold, these vector fields will be smooth and independent (because Fj are smooth and independent)
(B-2) 2.2(B-1) 2
NNNkq
Fv
Nkp
Fv
k
jkj
k
jkj
2,...,2,1 ;
,...,2,1 ;
,
,
jv
Integrable systems
• The normals to the N-dimensional manifold can be defined as:
• On each manifold, the vector fields will be tangential to the manifold (perpendicular to the normals):
(B-2) 2.2(B-1) 2
NNNkp
Fn
Nkq
Fn
k
iki
k
iki
2,...,2,1 ;
,...,2,1 ;
,
,
in
jv
ji vn
N
kkjki vn
2
1,,
N
Nkkjki
N
kkjki vnvn
2
1,,
1,,
N
Nk k
j
k
iN
k k
j
k
i
q
F
p
F
p
F
q
F 2
11
0],[ ji FF
Bounded integrable systems
• Let us concentrate of systems with bound motion, i.e. motion with a finite accessible phase space
• In this case, the motion-restricting manifold is compact
• Topology theorem (without proof): A compact manifold “parallelizable” with N smooth independent fields must be an N-torus:
(B-2) 2.2(B-1) 2
11.1
Bounded integrable systems
• Such tori are called invariant tori, because the orbit starting on such a torus, remains on the torus forever
• An N-dimensional torus has N independent irreducible circuits γj on it
• We coordinatize the phase space using Qj and Pj, with {Pj} defining the invariant torus and {Qj} defining the coordinates on the torus
• Standard set of such variables: actions and angles on tori
(B-2) 2.2(B-1) 2
11.1
i
N
kkki dqpJ
1 i
kki J
JqSw
}){},({
Example: 2D harmonic oscillator
• Let us consider a 2D harmonic oscillator:
• This Hamiltonian can be separated into two independent Hamiltonians,
for each of which
• Invariant tori:
(B-1) 211.1
2222
22
222
2
22
21
211
1
21 qm
m
pqm
m
pH
iii dqpJi
i J
Ww
constv
J
Hw i
ii iii tvw
iii
i EJ
H
2
22 ;
222
21iii
i
ii
qm
m
pHHHH
22
222iii
i
i qm
m
p
Example: 2D harmonic oscillator
• If one frequency is a multiple of another, e.g.
then the trajectory will close on itself and repeat the same pattern every period
• If the frequencies are commensurate (n – rational), then the orbit still will be closed, but will trace out more than one path around p1 and q1 before closing
• If the frequencies are incommensurate (n – irrational), then the orbit will never close, gradually covering the entire surface of the torus
(B-1) 211.1
n1
2
1
2
Example: 2D harmonic oscillator
• For the case of incommensurate frequencies, the orbit is called dense periodic
• Dense periodic orbit does not pass through exactly the same point twice, but will eventually pass arbitrarily close to every point
• So, the motion is confined to a toroidal surface – a 2D manifold in a 4D phase space
(B-1) 211.1
Nonintegrable systems
• Is integrability the rule or the exception?
• If all Hamiltonian systems were integrable, the constants of motion would always exist and our inability to determine them for all but the simplest problems would merely reflect our lack of analytical ingenuity
• As a matter of fact, there are rigorous analytical and numerical methods showing that most Hamiltonian systems are not integrable, while integrable systems form a very small set (possibly of zero measure)
• For nonintegrable systems, the trajectory in phase space fills a region of dimensionality greater than N
(B-2) 2.3(B-1) 3
11.2
Perturbations
• Many Hamiltonian systems can be modeled as a combination of a sum of an integrable system and a small nonintegrable perturbation
• Does a small nonintegrable perturbation destroy the tori?
• The answer is: it depends
• In most cases, the tori persist under small perturbation albeit distorted
• Some are destroyed and such tori form a finite set, which grows with the perturbation
(B-2) 2.3(B-1) 3
11.2
HHH 0
Time-dependent perturbation theory
• We start with an unperturbed integrable Hamiltonian
• This system has N conserved quantities
• We produce canonical transformations employing Hamilton’s principal function
• The new Hamiltonian (Kamiltonian) is required to be identically zero, so for the new constant momenta and coordinates we have:
(B-1) 311.212.2
NktpqH kk ,...,2,1 );},{},({0
Nkk
,...,2,1
}{
)},{},({ tqS kk
kkk
kk
SQ
P
0 ;0 00
kk
kk P
KQ
Q
KP
t
SHK
00 0
Time-dependent perturbation theory
• The perturbed Hamiltonian is
• We use the same functional dependence for S, only now the new canonical variables may not be constant, and the Kamiltonian does not vanish
• Now the equations of motion are
• These equations generally cannot be solved since the perturbation in nonintegrable
(B-1) 311.212.2
)},{},({)},{},({)},{},({ 0 tpqHtpqHtpqH kkkkkk
t
SHK
t
SHH
0 )},{},({ tpqH kk
kk
kk
HH
;
Time-dependent perturbation theory
• Now we take advantage of the smallness of ΔH
• In the first order approximation we can write
• The notation with zero indicates that after differentiation we substitute αk and βk with their unperturbed (constant) values
• These equations can be written in a symplectic form
(B-1) 311.212.2
0
,1
0
,1 ;k
kk
k
HH
0
1
),(
γ
γJγ
tH
NNk
Nk
kk
kk
2,...,1,
,...,1,
01
10J
Time-dependent perturbation theory
• These equations can be integrated to yield γ1(t) and by inverting the functional dependencies to obtain the time dependencies of qk and pk to the first order of perturbation
• The second order perturbation equations are obtained by using γ1(t) dependence in the right hand side:
• And for the higher orders:
(B-1) 311.212.2
0
1
),(
γ
γJγ
tH
1
2
),(
γ
γJγ
tH
1
),(
n
n
tH
γ
γJγ
Poisson brackets formalism
• Sometimes we need to know the time evolution of some functions of the new canonical set
• For the perturbed system, the evolution is described by
• We can invert the functional dependence and make K depend on ci
• Then:
12.2
}){},({ kkii cc
],[ Kcc ii ],[ Hci
],[ Hci γJ
γ
Hci
j
j
j
ic
c
Hc
γJ
γ
j
ji
j
cc
c
H
γJ
γ
j
jij
ccc
H],[ ic
Poisson brackets formalism
• If these equations cannot be solved exactly, we apply the perturbation theory approach, i.e. the right-hand-sides are evaluated for the unperturbed motion, etc.
• This is a generalization of the perturbation theory equations derived previously
12.2
j
jij
i ccc
Hc ],[
1
, ],[
n
jji
jni cc
c
Hc
1
),(
n
n
tH
γ
γJγ
Types of perturbed motion
• As determined by the perturbation treatment, the parameters of the orbit may vary with time in two ways
• There may be a small variation of the orbit around the unperturbed solution, which is not growing with time
• There may be a perturbation of the orbit, which is slowly diverging form the unperturbed solution – secular change
• The first type of perturbation does not change average parameters of the orbit; the secular perturbation slowly changes orbit parameters
12.2
Fake example 1: the harmonic oscillator potential as a perturbation
• Unperturbed Hamiltonian:
• The momentum is conserved
• The Hamilton-Jacobi equation:
12.2
m
pH
2
2
0
constx
Sp
02
12
t
S
x
S
m),(),(),,( 21 tSxStxS
0)),(),(()),(),((
2
1 21
2
21
t
tSxS
x
tSxS
m
t
tS
x
xS
m
),(),(
2
1 2
2
1 const constx
xS
),(1
Fake example 1: the harmonic oscillator potential as a perturbation
12.2
xxS ),(1
constx
xS
),(1
x
tSxS
)),(),(( 21
x
S
constx
Sp
t
tS
x
xS
m
),(),(
2
1 2
2
1 constm2
2
mt
tS
2
),( 22
m
ttS
2),(
2
2
m
txSSS
2
2
21
S
Qm
tx
m
tx
Fake example 1: the harmonic oscillator potential as a perturbation
• Let us assume that the small perturbation is
• We pretend that we don’t know that the perturbation is integrable
• The Kamiltonian is
• The perturbed equations of motion:
12.2
1 ;2
222
m
xmH
22
2),,(),,(
m
tmtHtK
H
H
m
tm 2
m
tt2
Fake example 1: the harmonic oscillator potential as a perturbation
• First order perturbation approximation:
• Assuming
• Then:
• Inverting for x and p:
12.2
0
021
m
tm
0
021
m
tt
0)0(0 x 00 0
m00
t02
1 m
t 20
2
1
2
20
2
01
t m
t
3
30
2
1
11
1
m
tx
m
t
m
t
6
30
20 2
20
2
011
tp
Fake example 1: the harmonic oscillator potential as a perturbation
• Second order perturbation approximation:
• Solutions:
• Inverting for x and p:
12.2
1
122
m
tm
1
122
m
tt
6
322
02
tt
m
t
m
t
m
tx
1206
50
430
20
2
242
40
420
2
022
ttp
242
40
420
2
02
tt m
t
m
t
303
50
430
2
2
6
422
20
2
tt
m
Fake example 1: the harmonic oscillator potential as a perturbation
• If we continue to higher orders, it can be shown that
• For
• Big surprise!
12.2
m
t
m
t
m
tx
1206
50
430
20
2
242
40
420
2
022
ttp
!5!3
55330
2
ttt
mx
!4!21
4422
02
ttp
n
i
ii
n i
t
mx
1
1210
)!12(
)()1(
n
i
ii
n i
tp
0
2
0 )!2(
)()1(
n
tm
x
sin0 tp cos0
Fake example 2: simple pendulum
• Full Hamiltonian:
• Expanding:
• To obtain a harmonic oscillator approximation, we retain terms with i = 0,1
• Let’s assume that the angles are small, but not small enough to use the harmonic oscillator approximation
• Therefore, we have to retain a term with i = 2 as a small perturbation for the harmonic oscillator
12.3
)cos1(2 2
2
mglml
pH
0
2
2
2
)!2()1(1
2 i
ii
imgl
ml
pH
Fake example 2: simple pendulum
• Full (reduced) Hamiltonian:
• We assume that we don’t know the solutions of the anharmonic oscillator and accept the anharmonicity as a perturbation
• The harmonic oscillator has been solved previously employing the action-angle formalism
12.3
24211
2
42
2
2 mglml
pH
2422
42
2
2 mglmgl
ml
p
24
4mglH
JH 0 )(2sin2
tml
J
)(2cos2
tmlJ
p
)(2sin24
422
2
tml
J
l
g
Fake example 2: simple pendulum
• The first order time-dependence:
• Averaging over a period
Therefore, β is not a constant anymore, but it is changing with time in the following manner:
• Averaging over a period
• J (which is the measure of the amplitude) does not change with time
12.3
H
JJ
H
)(2sin12
422
tml
J
2232 ml
J
0 t
)(2cos)(2sin3
32
ttml
JHJ
0J
Time-independent perturbation theory
• We will consider conservative periodic separable systems with many degrees of freedom and a perturbation parameter ε
• For the unperturbed system we introduce a set of action-angle variables {J0i}, {w0i} such that
• The original generalized coordinates, which are multiple-periodic in {w0i} (with period unity) can be expanded in the Fourier series of the unperturbed angles
(B-1) 310.712.4
iiii twJHH 000000 });({
1 2
0022011
1
)...(2001
)(... ),...,(,...,
j j j
wjwjwjiN
kjjk
N
NN
NeJJAq
Time-independent perturbation theory
• A compact form of the same Fourier expansion:
• The perturbed Hamiltonian can be expanded in the powers of ε:
• In the perturbed system, {J0i}, {w0i} remain a valid set of canonical variables, although they are no longer action-angle variables (since the full Hamiltonian depends on {w0i} now), and therefore {J0i} are not constants of motion
(B-1) 310.712.4
...),(),()(),,( 0022
0010000 JwJwJJw HHHH
j
j wjJ )2exp()( 00)( iAq k
k
1 2
0022011
1
)...(2001
)(... ),...,(,...,
j j j
wjwjwjiN
kjjk
N
NN
NeJJAq
j
j βνjJ )](2exp[)( 000)( tiA k
Time-independent perturbation theory
• If the invariant tori exist in the perturbed system, there must be a new set of action-angle variables {Ji}, {wi} such that
• The sets {Ji}, {wi} and {J0i}, {w0i} are related by a canonical transformation generated by a function:
• From the Legenndre transformation it follows that
• Thus the question of the continuing existence of tori reduces to the question of whether the latter equation can be solved (we have to find Y)
(B-1) 312.4
)(~
),( 00 JJw HH
),( 0 JwY
0
00
),(
w
JwJ
Y
)(~),(
,0
00 J
w
Jww H
YH
Time-independent perturbation theory
• We expand both the generating function and the new Hamiltonian in powers of ε:
• On the other hand
(B-1) 312.4
...)(~
)(~
)(~
),(~
...),(),(),,(
22
10
022
0100
JJJJ
JwJwJwJw
HHHH
YYY
)(~),(
,0
00 J
w
Jww H
YH
...),(),()( 0022
00100 JwJwJ HHH
0
00
),(
w
JwJ
Y
...),(),(
0
022
0
01
w
Jw
w
JwJ
YY
...),(),(),(
0
022
0
01
0
00
w
Jw
w
JwJ
w
JwJJ
YYY
Time-independent perturbation theory
• Using Taylor series expansion:
(B-1) 312.4
...)(2
1)()()()( 0
02
000
000
JJ
JJJJJJ
JJJ
HHHH
...),(),(
0
022
0
010
w
Jw
w
JwJJ
YY
......2
1...
...)(
0
22
0
102
0
22
0
1
0
22
0
100
wwJJww
wwJJ
YYHYY
YYHH
...2
1)(
0
102
0
1
0
2020
0
10
wJJwwJJw
JYHYYHHY
H
Time-independent perturbation theory
• Using Taylor series expansion:
(B-1) 312.4
...)(2
1)()(),(),( 0
12
001
01001
JJ
JJJJJJ
JJwJw
HHHH
...),(),(
0
022
0
010
w
Jw
w
JwJJ
YY
......2
1...
...),(
0
22
0
112
0
22
0
1
0
22
0
1101
wwJJww
wwJJw
YYHYY
YYHH
...2
1),(
0
112
0
1
0
2121
0
101
wJJwwJJw
JwYHYYHHY
H
Time-independent perturbation theory
• Therefore:
(B-1) 312.4
...),( 1
0
101 JwJw
HYH
...),(),()(),,( 0022
0010000 JwJwJJw HHHH
...2
1)(
0
102
0
1
0
2020
0
10
wJJwwJJw
JYHYYHHY
H
...),( 022 JwH
...),(2
102
1
0
1
0
102
0
1
0
202
JwJwwJJwwJ
HHYYHYYH
),()( 010
0
10 Jw
JwJ H
HYH
Time-independent perturbation theory
• Thus:
(B-1) 312.4
...),(2
1
),()(
021
0
1
0
102
0
1
0
202
010
0
10
JwJwwJJwwJ
JwJw
J
HHYYHYYH
HHY
HH
...)(~
)(~
)(~
),(~
22
10 JJJJ HHHH
),(2
1)(
~
);,()(~
);()(~
021
0
1
0
102
0
1
0
202
010
0
1100
JwJwwJJwwJ
J
JwJw
JJJ
HHYYHYYH
H
HHY
HHH
)()(
00 JwJ
J
Hdt
td ))()(( 00 JβJν )(0 Jν
Time-independent perturbation theory
• Therefore, for the first order of ε:
• If the system remains on the invariant tori, the coordinates and momenta should be periodic functions of {w0i}
• Since H1 is a function of q’s and p’s, it is a (given) periodic function of {w0i}
(B-1) 312.4
),()()(~
0100
11 JwJν
wJ H
YH
j
j wjJ )2exp()( 0)( iAq k
k j
j wjJ )2exp()( 0)( iDp k
k
j
j wjJJw )2exp()(),( 001 iCH
Time-independent perturbation theory
• Since Y is a function of q’s and p’s, it is a periodic function of {w0i}; so are all the expansion terms Yk:
• The expansion terms Yk are defined up to an arbitrary constant, since Y is a generating function
• Let’s choose Y1 in the following form:
(B-1) 312.4
j
j wjJwJ )2exp()(),( 0)(
0 iBY kk
0
0)1(
01 )2exp()(),(j
j wjJwJ iBY
0 0 0
)...(21
)1(...
1
1
2
2
0022011
1),...,(,...,
jj
jj
jj
wjwjwjiNjj
N
N
NN
NeJJB
Time-independent perturbation theory
• Let us consider constant (time-independent) terms:
• The remaining terms:
(B-1) 312.4
0
0)1(
01 )2exp()(),(j
j wjJwJ iBY
),()()(~
0100
11 JwJν
wJ H
YH
j
j wjJJw )2exp()(),( 001 iCH
constH )(~
1 J )(J0C
j
jj
j wjJwjJw
Jν )2exp()()2exp()()( 00
0)1(
00 iCiB
0)]()(2[0
2)1(0
0
j
wjjj JJνj ieCBi
0
)1(
2
)()(
νj
JJ j
j
i
CB
Time-independent perturbation theory
• In principle we can continue this algorithm for higher orders in ε
• But we have to proceed with caution
• What if the unperturbed orbit was closed?
• Then we have a case of commensurate frequencies
(B-1) 312.4
0
)1(
2
)()(
νj
JJ j
j
i
CB
0
)(
ωj
Jj
iC
min,00 ωnω ii min,00 ωnω
min,00 ωnjωj
Time-independent perturbation theory
• We can always find such set of ji that
• The resonance! (Zero divisors)
• The series diverges?!
• Actually, there are two concerns about convergence: of the series in powers of ε and the sum
(B-1) 312.4
0
)1(
2
)()(
νj
JJ j
j
i
CB
0
)(
ωj
Jj
iC
min,00 ωnjωj
N
iiinj
1
nj
1
1
N
iiiNN njnj
1
1
N
i N
iiN n
njj
00
0
0)1(
01 )2exp()(),(j
j wjJwJ iBY
Time-independent perturbation theory
• Moreover, even for an open orbit (non-commensurate frequencies), as we go higher and higher of the integer indices in the j-vector we can always find a combination of integers such that
• And we have problems with convergence again!
• Do all tori get destroyed?
• Not so!
(B-1) 312.4
10 ωj
)(
0
irrational
ω
KAM theorem
• So, what happens to the perturbed invariant tori?
• The answer to this question is given by the celebrated “KAM theorem” (Kolmogorov-Arnold-Moser theorem)
(B-1) 3(B-2) 2.4
11.2
Andrey Nikolaevich Kolmogorov
Андрей Николаевич Колмогоров(1903 - 1987)
Vladimir IgorevichArnold
Владимир ИгоревичАрнольд
(born 1937)
Jürgen Moser(1928 – 1999)
KAM theorem
• KAM theorem (we mentioned this result earlier): “If the bounded motion of an integrable Hamiltonian H0 with N degrees of freedom is disturbed by a small perturbation ΔH, that makes the total Hamiltonian, H = H0 + ΔH, nonintegrable and if two conditions are satisfied:
(a) the perturbation ΔH is small(b) the frequencies ωi of H0 are incommensurate,
then the motion in 2N-dimensional phase space remains confined to an toroidal manifold of dimension N, except for a negligible set of initial conditions that result in a trajectory on a manifold with a dimension greater than N”
(B-1) 3(B-2) 2.4
11.2
KAM theorem
• Perturbation theory in the form discussed previously was known and employed for several centuries
• However, it turned out that this theory was a very crude tool for studying the delicate problems arising from the small denominators
• The central feature of KAM is the replacement of the series expansions of the conventional perturbation theory by a series of successive approximations to the suspected new tori
• This approach has a vastly improved convergence leading to the proof of the theorem
(B-1) 3
KAM theorem
• Without going deep into technicalities of the proof, we will point out main features of this proof
• Essentially, each new torus generated by the previous approximation is itself made the basis of the next approximation, rather than expressing all approximations in terms of the unperturbed torus
• The central result is that the process of generating “perturbed” tori does converge for small but finite ε almost always
• Another result is that the unperturbed tori in the neighborhood of those on which the orbits are closed (or partially closed) are almost all destroyed
(B-1) 3
KAM theorem
• We will not discuss explicit forms of the KAM theorem expansion series because of the complex mathematics
• Instead, we will illustrate the idea of improved convergence on a simple example from conventional calculus: finding the zero of a function f(x)
• We start with a guess: x0
(an unperturbed value)
• Then we use a perturbation theory
(B-1) 3
0
0
0
0
!
)(
!
)()(
0n
n
nn xx
n
nn
n
xxf
dx
fd
n
xxxf
0)( xf
KAM theorem
• After standard series reversion:
• This is analog of the standard perturbation theory
• This is a very slowly converging method of finding a zero
(B-1) 3
0!
)(
0)(
0
0
n
n
n n
xxf
xf
2
0
10
1
0
!
)(
n
nn
n
xx
f
fxx
f
f
...62
22 1
3
2
1
23
1
220
f
f
f
f
f
fxx
KAM theorem
• In calculus to find a zero of a function, we usually use Newton’s method instead
(B-1) 3
)('
)(
0
0011 xf
xfxx
0
)()()( 010xxdx
dfxxxfxf
)('
)(
1
1122 xf
xfxx
)('
)(11
n
nnnn xf
xfxx
...
)](")('[
)("5.0)(')(
11
12
11
nnn
nnnnn
xfxf
xfxfxf
)(0 2n
)(0);...;(0);(0;124
32
21
n
n
...)(0)(0)(0 842
10
n
nxx
Example: calculating π
• Let's compare the speed of conversion of both methods on the example of the following function:
• The speed of convergence is best illustrating by the following table:
(B-1) 3
1tan)( xxf ...785398164.04
x
The anatomy of torus destruction
• The tori that are destroyed correspond to commensurable frequencies
• These destroyed tori give rise to zero denominators
• How about tori with non-zero but small denominators? Are they all destroyed too?
• No. KAM specifies the widths of the destroyed regions
• To illustrate this, we will consider a simple example for N = 2
(B-1) 3(B-1) 4
min,00 ωnω
0
)(
ωj
JjiC
1)(
0
ωjJjiC
Simple example: N = 2
• For the tori with closed orbits:
• For tori with closed orbits this ratio is rational
• For tori with open orbits the frequency ratio is not rational (cannot be written as a ratio of two integers)
• But it can be approximated arbitrarily closely by a rational number, e.g.
• However there is a better way to approximate irrational tori by the rational ones
(B-1) 4
0201 rωsω s
r
ω
ω
02
01
;...100
314;
10
31;
1
3...141592654.3
02
01 s
r
ω
ω ss
r
ω
ω 1
02
01
Simple example: N = 2
• Instead of a decimal ratio we represent the ratio as a continued fraction:
• For π
• Defining
• The convergence is then
(B-1) 4
...1
11
32
1
002
01
aa
aa
ω
ω
102
01 1
nnn
n
sss
r
ω
ω
,...1,0,1,...,0a
,...3,2,10 na
...2931
15
17
13
n
n
n
aa
aa
s
r
1...
11
2
1
0
Simple example: N = 2
• For π:
• KAM theorem proves convergence of such accelerated iteration-perturbation scheme for the torus generator Y for all initial tori whose frequency ratio is sufficiently irrational for the following relation to hold (for 2D case):
• The tori excluded:
are mostly destroyed
(B-1) 4
s
K
s
r
ω
ω )(
02
01
1415929.3113
355 ;14151.3
106
333
;1429.37
22 ;3
3
3
2
2
1
1
0
0
s
r
s
r
s
r
s
r
0)(lim0
K
s
K
s
r
ω
ω )(
02
01
2
Main result (revisited)
• In a perturbed system, most orbits lie on tori in phase space
• Those that do not, form a small but finite set pathologically disturbed in phase space near each unperturbed torus that supported closed or partially closed orbits
• The motion in the narrow (0(s-μ)) gaps will be pushed out of the gaps onto a nearby preserved torus by a further random perturbation
• The gaps resulting from low-order resonances are relatively wide and give rise to non-trivial observable and computable effects: deterministic chaos
(B-1) 4
Back to dimensional considerations
• Hamiltonian systems of N degrees of freedom with constant energy are restricted to move on a (2N-1)-dimensional manifold in the 2N-dimensional phase space: energy hypersurface
• For such systems that are non-integrable, there is an important class of motion – ergodic: orbits eventually pass through practically all points on the energy hypersurface
• Case N = 1 is pathological (2N – 1 = N) all orbits are both integrable and ergodic
• Therefore true ergodic (and chaotic) motion can exist only for systems with N > 1
(B-2) 2.3(B-1) 6
Back to dimensional considerations
• The first non-trivial dimension is N = 2
• The dimension of the energy hypersurface is 2N - 1 = 3
• This 3D energy hypersurface is not an ordinary 3D position space, because it is non-Euclidian, closed and may be multiple-connected (cf. 2D surfaces in 3D space may have a non-trivial topology)
(B-2) 2.3(B-1) 6
Jules HenriPoincaré
(1854 – 1912)
Poincaré maps
• One of the most efficient techniques to monitor the breakdown of integrabiltiy is Poincaré mapping
• We study a 2D slice (section) of the trajectory on 3D hypersurface and calculate the locations of points where the orbits pass through the section
• If the system is integrable (toroidal orbit) then the 2D Poincaré map is a smooth closed curve
(B-2) 2.6(B-1) 6
11.5
Example: Hénon-Heiles Hamiltonian
• In 1960’s, Michel Hénon and Carl Heiles considered the Kepler astronomical problem equivalent to a 2D harmonic oscillator with two cubic perturbations:
• In polar coordinates:
• The potential has a 3-fold symmetry
11.5
Carl Heiles(born 1939)
32
)(
2
32
2222y
yxyxk
m
ppH yx
3
3sin
222
32
2
22 rkr
mr
p
m
pH r
Michel Hénon (born 1931)
Example: Hénon-Heiles Hamiltonian
• Hénon and Heiles calculated the Poincaré maps in the plane for different values of E and λ = 1
11.5
),( yy
Chaos!
Example: Hénon-Heiles Hamiltonian
• Hénon and Heiles calculated the Poincaré maps in the plane for different values of E
11.5
),( yy
Example: Hénon-Heiles Hamiltonian
• How does KAM compare with the perturbation theory?
(B-1) 611.5
Open (non-conservative) systems
• So far we considered Hamiltonian (closed) systems
• Does deterministic chaos emerge in open (non-conservative) systems?
• Yes
• Before considering specific examples of such systems we will introduce several concepts helpful for quantitative description of deterministic chaos
• Those are, among others: stationary orbits and points of the phase space, Lyapunov exponents, fractals, bifurcations
Stationary points
• Let us recall a simple pendulum (closed system)
• Its phase portrait
• All orbits are stable
0sin2 grr
Stationary points
• Let us recall a simple pendulum (closed system)
• For large momenta, it will not oscillate anymore, but will start rotating instead
• The special case of a trajectory separating oscillations and rotations – separatrix
• Nodal points of the separatrix correspond to unstable equilibrium of a pendulum with its bob at the top
0sin2 grr
Stationary points
• For a damped pendulum (open system)
• Its phase portrait
• Phase portrait converges to a stationary point
0sin2 grkrr
Stationary points
• On the phase portrait, stationary points can be of several types: attractors, repellers, and saddle points
• Attractors: solutions converge on them
• Repellers: solutions escape from them
• Saddle points: solutions converge on them along one direction and escape from them along the other
Examples of stationary points
• For a damped oscillator, the phase diagram contains attractors and saddle points
Limit cycles
• Of the phase diagram, in addition to stationary points there could be limit cycles
• For instance, for the van der Pol oscillator:
• Zero point is a repeller
0')1(" 2 yyyy
11.3
Balthasarvan der Pol
(1889 -1959)
Lyapunov exponents
• Let us consider two orbits in phase space
• Initial separation between these orbits is s0
• How does a separation between these two orbits s changes with time?
• To measure this time change, we use Lyapunov exponents λ defined as:
Aleksandr MikhailovichLyapunov
Александр МихайловичЛяпунов
(1857 – 1918)
tests 0~)(
11.4
Hausdorff dimension
• For evaluating trajectories of dynamic systems and describing natural objects it is useful to introduce a generalized treatment of dimension – Hausdorff dimension
• For a line, a square, and a cube we reduce the scale of each object by a factor of r and add objects so that we fill the same space with N objects
Felix Hausdorff(1868 – 1942)
11.9
Hausdorff dimension
• Hausdorff dimension is defined as:
11.9
r
ND
ln
ln
rDN lnln
DrN lnln
DrN
Cantor set
• We begin with a straight line
• We remove the middle third of the line
• Iteratively removing the middle third the remaining segments, we generate a Cantor set
• What is the Hausdorff dimension of it?
Georg FerdinandLudwig Philipp
Cantor(1845 – 1918)
11.9
r
ND
ln
ln
1
1
0
N
r
n
2
3
1
N
r
n
22
33
2
N
r
n
222
333
3
N
r
n
Cantor set
• We begin with a straight line
• We remove the middle third of the line
• Iteratively removing the middle third the remaining segments, we generate a Cantor set
• What is the Hausdorff dimension of it?
• Fractal (non-integer) Housdorff dimension
Georg FerdinandLudwig Philipp
Cantor(1845 – 1918)
11.9
n
n
N
r
2
3
n
n
3ln
2ln
3ln
2ln 631.0
r
ND
ln
ln
3ln
2ln
n
n
Sierpinski carpet
• We reproduce iterations similar to Cantor set in 2D to generate a Sierpinski carpet
• What is the Hausdorff dimension of it?
Wacław FranciszekSierpiński
(1882 – 1969)
11.9
r
ND
ln
ln
1
1
0
N
r
n
8
3
1
N
r
n
88
33
2
N
r
n
888
333
3
N
r
n
n
n
N
r
8
3
n
n
3ln
8ln
3ln
8ln 893.1
Menger sponge
• We reproduce iterations similar to Cantor set in 3D to generate a Menger sponge
Karl Menger(1902 - 1985)
r
ND
ln
ln
3ln
20ln 724.2
Other related examples
• Cantor dust
Other related examples
• Sierpinski triangle
1.5852ln
3lnD
Other related examples
• Sierpinski pyramids
Self-similarity
• Important feature of all these fractal objects – they are self-similar
Self-similarity
• In nature, there are plenty of examples of self-similar structures with essentially fractal dimensions
Self-similarity
• Self-similarity has been with the humankind for centuries
Fractals and chaos
• There is a direct relationship between the fractal geometry and deterministic chaos
• To demonstrate this connection we will first consider a discrete form of evolution equations
• One of the simplest discrete evolution equations generating chaos is the logistic equation:
• The variable is restricted to the following domain:
• a - is called a control parameter
11.8
)1(1 nnn xaxx
10 x
Logistic equation
• Successive iterations of the logistic equation are expected to bring x closer and closer to a limiting value x∞, so that further iterations produce no additional change in x
• Stationary points of this equation lie at the intersection of a straight line (l.h.s.) and a parabola (r.h.s.)
11.8
)1(1 nnn xaxx
)1( xaxx )1(2 axax
a
ax
1
Logistic equation
• As the value of the control parameter grows, the maximum of the parabola rises and the value of x∞ grows
11.8
)1(1 nnn xaxx
a
ax
1 a
11
Logistic equation
• As the value of the control parameter grows, the maximum of the parabola rises and the value of x∞ grows
11.8
)1(1 nnn xaxx
a
ax
1 a
11
Logistic equation
• How stable is the stationary point x∞?
• For convergence we need:
• What happens if a > 3?
11.8
)1(1 nnn xaxx
a
axn
1
a
a
a
aaxn
11
11
a
aa1
1
211 aaa
)2(1
aa
a
12 a 31 a
Logistic equation
• The stationary point loses its stability and a stable solution is a cycle with two alternating stable points
• Transition from one stable points to two stable points is called a bifurcation
11.8
3a
Logistic equation11.8
3a
Logistic equation
• With the increase of the control parameter the cycle becomes unstable and generates a double cycle (two more bifurcations)
11.8
Logistic equation
• With the increase of the control parameter the cycle becomes unstable and generates a double cycle (two more bifurcations)
11.8
Logistic equation
• With further growth of the control parameter, the process of multiplication of bifurcations continues until we reach a chaotic type of evolution
11.8
Logistic equation
• With further growth of the control parameter, the process of multiplication of bifurcations continues until we reach a chaotic type of evolution
11.8
Logistic equation
• Such type of transition to chaos is called the Feigenbaum scenario
11.8
Mitchell JayFeigenbaum(born 1944)
Logistic equation
• Despite its chaotic nature, the Feigenbaum set has a rich structure, which is fractal
11.8
Logistic equation11.8
Logistic equation
• For the Feigenbaum set we introduce a discrete equivalent of the Lyapunov exponent
11.8
region chaoticfor ,'
region normalfor ,
nnn
nn
exx
exx
Feigenbaum scenario for continuous systems
• We now consider a non-conservastive system of a driven and damped simple pendulum
• It is equivalent to a system of three first-order equations (recall: chaos exists in systems with N > 1)
11.7
)cos(sin1
tgq D
sincos
qg
D
Feigenbaum scenario for continuous systems
• Remarkably, with growing g this system exhibits a transition to chaos extremely similar to that for the logistic equation
11.7
Feigenbaum scenario for continuous systems
• Remarkably, with growing g this system exhibits a transition to chaos extremely similar to that for the logistic equation
11.7
Feigenbaum scenario for continuous systems
• Remarkably, with growing g this system exhibits a transition to chaos extremely similar to that for the logistic equation
11.7
Feigenbaum scenario for continuous systems
• Remarkably, with growing g this system exhibits a transition to chaos extremely similar to that for the logistic equation
11.7
Feigenbaum scenario for continuous systems
• Remarkably, with growing g this system exhibits a transition to chaos extremely similar to that for the logistic equation
11.7
Questions?