![Page 1: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/1.jpg)
Modeling Genetic Network: Boolean Network
Yongyeol Ahn2004.08.18. KAIST
![Page 2: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/2.jpg)
Genetic Network
• Genes interact with each other via proteins, RNAs and themselves.
![Page 3: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/3.jpg)
Main Objectives
• To infer genetic network from biological data
• To explain and predict the behaviors of genetic regulatory network
![Page 4: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/4.jpg)
Modeling Genetic Networks
• Statistics rules!Bayesian network
Hmm.. We need some dynamics.
• Let’s be realistic! Differential equation approach
• Simple is the best!Boolean network
![Page 5: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/5.jpg)
Bayesian Network : Information Theory
• Shannon entropy:
• Joint probability: Pr(x,y)• Conditional probability:
Pr(y|x) = Pr(x,y)/Pr(x)• Mutual information:
![Page 6: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/6.jpg)
Bayesian Network
• Find a directed acyclic graph which shows the relationships of nodes well.
Xi : Expression level
![Page 7: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/7.jpg)
Differential Equation Approach
Gene A Gene R
AA
1 AA
1
50 0.01
A50
R 5
C
+
2
100.5
500 50
50 100
10.2
1‘The Clock’
![Page 8: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/8.jpg)
Differential Equation Approach
30 40 50 60
0.2
0.4
0.6
0.8
Expressedgenes
30 40 50 60
20
40
60
80
mRNAsR
A
30 40 50 60
500
1000
1500
2000
A
C
R
250 500 750 1000 1250 1500 1750
500
1000
1500
2000
R
C
![Page 9: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/9.jpg)
Why Boolean network?
• It tells about the dynamics (vs. bayesian network)
• ‘Gene switch’ : There are attempts to make a ‘genetic computer’ using genetic ‘logic gates’. Binary state approximation is fine.
• In many cases, the exact timing may not be important.
• Simple, general, easy to implement, …
![Page 10: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/10.jpg)
The Boolean Network
• Nodes, Directed links• Synchronous dynamics• Binary states: ‘on’ or ‘off’
• A node’s state is determined by states of other nodes which have a link to the node(by assigned boolean functions).
![Page 11: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/11.jpg)
Example
0
1
2
1 20 0 10 1 01 0 11 1 1
Node 0 Node 2
1 0 11 0
0 1 2
0 0 01 0 10 0 10 0 1
t
![Page 12: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/12.jpg)
Boolean Network Variations
• Multi-Valued model• Different updating scheme
(asynchronous, …)• Probabilistic model
![Page 13: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/13.jpg)
Classification of boolean networks
(Gershenson2004)
![Page 14: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/14.jpg)
Tools
• DDLab – http://www.ddlab.com
• RBNLab– http://rbn.sourceforge.net
• BN/PBN toolbox: – http://www2.mdanderson.org/app/ilya/PBN/PBN.htm
![Page 15: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/15.jpg)
(Classical) Random Boolean Network
• Parameter: N, K, p– N: number of nodes– K: average in-degree– p: probability of ‘1’ in each boolean function
• Large ensemble ,state space(2^N) So big! Very high standard deviations
![Page 16: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/16.jpg)
Phase Transition
• Stable (K<=2)• Critical• Chaotic (K>=3)
• Visualization method– Active nodes: ‘green’– Frozen nodes: ‘red’
![Page 17: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/17.jpg)
Phase Transition
• Islands– Chaotic: green sea percolate & red islands– Stable: frozen red sea & green islands
• Robustness– Chaotic: damage spreads– Stable: robust
• Convergence and divergence of traj. (Lyapunov exponent)– Chaotic: similar states tend to diverge– Stable: tend to converge
![Page 18: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/18.jpg)
Loops Trees
• For active dynamics, network needs Loops.
• Loops activate other parts (trees).• Active wave propagates from loops
to trees.
![Page 19: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/19.jpg)
G – Density
• G-density : Garden of Eden states density
• Ordered: very high G-density, high in-degree frequency
• Critical: power-law in-degree distribution
• Chaotic: lower G-density,
![Page 20: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/20.jpg)
Analytical Result of Phase Transition
• Derrida’s annealed approx. : Assuming connections and boolean functions are randomly reshuffled at each time step.
• Define overlap = 1 – Normalized Hamming distance between two states
• What will happen at tinf ?
![Page 21: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/21.jpg)
Analytical Result of Phase Transition
))(1(2
1))(1(
2
1)()1( txtxtxtx kkk
For a network with in-degree k,
Transforming with Hamming distance and consider bias
]))(1(1)[1(2)1( ktdpptd
![Page 22: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/22.jpg)
Derrida Curves
)1( td
)(td
K=2
K=5
1)]1(2[ ppkCritical connectivity
![Page 23: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/23.jpg)
Phase diagram
(In practice, the size of the network can play a role in the phase transitions)
![Page 24: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/24.jpg)
Topology of boolean network
• In reality, genetic networks have very inhomogeneous degree distribution
• Using Derrida’s annealed approximation, the phase diagram for scale-free network can be obtained.
![Page 25: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/25.jpg)
Derrida’s Annealed Approx. For Power-law Degree Distribution
• By the assumption, x(t) obeys the equation
Where,
![Page 26: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/26.jpg)
Contd.
1
1
1
1
))()(1)(1(21)1(
))())(1(1)(1(2)1(
,arbitraryforgeneralize
))())(1(1(2
1)1(
))(1(2
1)1(
kI
k
kI
k
kI
k
kI
k
kPtxpptx
kPtdpptd
p
kPtdtd
kPxtx
![Page 27: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/27.jpg)
Contd.
1)(
)1()1(2
,)(
1)(Let
1)1(2 :conditionn transitiophase The
c
c
I
I
pp
kkP
kpp
![Page 28: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/28.jpg)
Topology of boolean network: Scale-free boolean network
![Page 29: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/29.jpg)
Attractors
![Page 30: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/30.jpg)
The Number of Attractors
• The number of attractors grows faster than any power law with system size. (Samuelsson2003)
![Page 31: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/31.jpg)
The Length of Attractor
• For K=1, root(N/2)• At critical phase, it is long believed
that the length proportional to root N ( Kauffman argued that this is related to the number of cell types )
• But it is linear
![Page 32: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/32.jpg)
Applications
• Reverse Engineering• Morphogenesis model• Segment polarity development• Yeast transcriptional network
![Page 33: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/33.jpg)
Reverse engineering: REVEAL
• REVerse Engineering Algorithm• It finds a minimal solution for a
boolean network given any set of time-series.
• Use entropy, mutual information
![Page 34: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/34.jpg)
Neutral Mutation and Punctuated Equilibrium (Bornholdt1998)
• The model evolves under robustness principle (look for silent mutations)
• Threshold networks (restricted set of the boolean networks)
Weight = ± 1, 0
![Page 35: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/35.jpg)
Evolutionary Rule
• Create a daughter network by ‘adding’, ‘removing’, ‘adding and removing a weight in the coupling matrix’ at random. (each p = 1/3)
• With a random initial state, if mother & daughter reach the same attractor, replace the mother with the daughter. In other case, keep the mother network.
![Page 36: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/36.jpg)
Punctuated Equilibrium
• The evolution shows punctuated network connectivity (lifetime ~ 1/t^2)
• Evolved networks have much shorter attractors, large frozen components
![Page 37: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/37.jpg)
Model for Morphogenesis(Sole2003)
• Modeling an organism with one dimensional cell array.
• Each cells have the same set of genes and hormones.
• Genes interact within the cell.• Hormones communicate with
neighboring cells.• Threshold model.
![Page 38: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/38.jpg)
Morphogenesis Model
![Page 39: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/39.jpg)
Development
![Page 40: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/40.jpg)
Adaptive Walks
• ‘Toward more complex organism’• Complexity measure: the number
of cell types• Rule
– Evolve many organism in parallel– Addition, Removal, randomization of
link, link’s weight (each p=1/3)– Check the complexity
![Page 41: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/41.jpg)
Logarithmic Increase of the Number of Patterns
• Consistent with Kauffman’s ‘rugged landscape’ explanation of Cambrian Explosion
![Page 42: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/42.jpg)
Segment Polarity Network in Fly (Albert2003)
• The genetic network of Fly development
• This network is simulated with ODE(Dassow, 2002) and has shown a good result.
![Page 43: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/43.jpg)
Boolean Network Construction Rules
• The effect of transcriptional activators and inhibitors is never additive, but rather, inhibitors are dominant.
• Transcription and translation are ON/OFF functions of the state
• If transcription/translation is ON, mRNAs/proteins are synthesized in one time step
• mRNAs decay in one time step if not transcribed• Transcription factors and proteins undergoing
post-translational modification decay in one time step if their mRNA is not present.
![Page 44: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/44.jpg)
Constructed Boolean Network
![Page 45: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/45.jpg)
Results
• Stable state is same as the real fly.• Essential gene deletion results also
agree with real data.• There are six distinct steady states
in the model. Three of these are well-known experimentally
![Page 46: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/46.jpg)
Yeast transcriptional network(Kauffman2003)
• For a given network structure, they generate boolean network ensembles with nested canalyzing functions.
• The ensemble of networks are very stable.
![Page 47: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/47.jpg)
Canalyzing Function
• Canalyzing boolean function has at least one input which the output value is fixed.
• In most cases, genetic networks consist of canalyzing functions.
![Page 48: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/48.jpg)
Yeast Transcriptional Network
• Find topological transition point (to determine the confidence p value)
• Remove genes that have no output to other genes
![Page 49: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/49.jpg)
Yeast Transcriptional Network
• For a given network structure..– Functions with null
hypothesis– Functions based
on literature (canalyzing)
![Page 50: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/50.jpg)
Nested Canalyzing Function
• Inputs im, outputs Om, in degree k
• Assume i1 is canalyzing input, then we can define a new rule without i1 (with indegree k-1)
• In most cases, this new rule is also canalyzing.
![Page 51: Modeling Genetic Network: Boolean Network Yongyeol Ahn 2004.08.18. KAIST](https://reader035.vdocuments.mx/reader035/viewer/2022062722/56649f305503460f94c4aa22/html5/thumbnails/51.jpg)
Conclusion
• Boolean network model is simple, abstract, general.
• But, it’s powerful.