swarm intteligence by thiemo krink

Upload: luki-bangun-subekti

Post on 04-Jun-2018

227 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    1/49

    Swarm Intelligence Introduction

    Swarm Intelligence -

    Introduction

    ALifeGroup, Dept. of Computer Science, University of AarhusEV

    Thiemo Krink

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    2/49

    Swarm Intelligence Introduction

    Why do we need new computing techniques?

    The computer revolution changed human societies:

    communication

    transportation

    industrial production

    administration, writing, and bookkeeping

    technological advances / science

    entertainment

    However, some problems cannot be tackled with

    traditional hardware and software!

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    3/49

    Swarm Intelligence Introduction

    Drawback of traditional techniques

    well-defined

    fairly predictable

    computable in reasonable time with serial computers

    Computing tasks have to be

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    4/49

    Swarm Intelligence Introduction

    Hard problems

    Well-defined, but computational hard problems

    NP hard problems (Travelling Salesman Problem)

    Action-response planning (Chess playing)

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    5/49

    Swarm Intelligence Introduction

    Hard problems

    intelligent human-machine interaction

    natural language understanding

    Fuzzy problems

    E-vo-lu-tio-na-ry Com-pu-ta-tion E-vo-lu-tio-na-ry Com-pu-ta-tion

    Example: Fuzziness in sound processing

    t t

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    6/49

    Swarm Intelligence Introduction

    Hard problems

    real-world autonomous robots

    management and business planning

    Hardly predictable and dynamic problems

    Japanese piano robot Trade at the stock exchange

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    7/49

    Swarm Intelligence Introduction

    What are the alternatives?

    DNA based computing (chemical computation)

    Quantum computing (quantum-physical computation)

    Bio-computing (simulation of biological mechanisms)

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    8/49

    Swarm Intelligence Introduction

    cell body

    dendrites

    axon

    The basic unit - the neurone Vertical cut through

    the neocortex of a cat

    Functional units of

    the human brain

    holistic

    parallel

    associative

    learning

    redundancy

    self-organisation

    Brains and Artificial Neural Networks

    Properties of the brain

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    9/49

    Swarm Intelligence Introduction

    Problem

    problem parameters: x1, x2, x3, x4

    quality measure: f(x1

    , x2

    , x3

    , x4

    )

    fitness:

    artificial genes: 1 1 1 1 10 0 0 0 0 0 0

    representation of one solution

    f (genes)

    Individual

    Evolution and Evolutionary Algorithms

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    10/49

    Swarm Intelligence Introduction

    Selection

    ReproductionMutation

    Evaluation

    1

    2

    3 4

    5

    6

    Population

    of solutions

    Fitness

    Evolution and Evolutionary Algorithms

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    11/49

    Swarm Intelligence Introduction

    The task: Design a bent tube with a maximum flow

    expected

    optimum

    Evolutionary

    Computingx1

    x2

    x3

    x4

    x5

    x6x7

    x8 x9

    Goal: water flow f(x1,x2,,x9) = fmax

    f

    EAs - Optimization without knowledge

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    12/49

    Swarm Intelligence Introduction

    Natural sciences

    Complexity theory

    Adaptive algorithms

    Artificial Life

    Swarm Intelligence

    Inspiration Identification Application Verification

    Foundations of Bio-Computing

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    13/49

    Swarm Intelligence Introduction

    Robotics / Artificial Intelligence

    Process optimisation / Staff scheduling

    Telecommunication companies

    Entertainment

    Fields of application

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    14/49

    Swarm Intelligence Introduction

    biology makes compromises between different goals

    biology sometimes fails

    some natural mechanisms are not well understood

    well-defined problems can be solved by better means

    What are the limitations

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    15/49

    Swarm Intelligence Introduction

    What is Swarm Intelligence (SI)?

    The emergent collective intelligence of groups of simple agents.

    (Bonabeau et al, 1999)

    Examples

    group foraging of social insects

    cooperative transportation

    division of labournest-building of social insects

    collective sorting and clustering

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    16/49

    Swarm Intelligence Introduction

    Why is Swarm Intelligence interesting for IT?

    Analogies in IT and social insects

    distributed system of interacting autonomus agents

    goals: performance optimization and robustness

    self-organized control and cooperation (decentralized)

    division of labour and distributed task allocation

    indirect interactions

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    17/49

    Swarm Intelligence Introduction

    How can we design SI systems?

    identification of analogies: in swarm biology and IT systems

    understanding: computer modelling of realistic swarm biology

    engineering: model simplification and tuning for IT applications

    The 3 step process

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    18/49

    Swarm Intelligence Introduction

    Some observations...

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    19/49

    Swarm Intelligence Introduction

    Nest-building in social wasps

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    20/49

    Swarm Intelligence Introduction

    Group defence in honey bees

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    21/49

    Swarm Intelligence Introduction

    cooperation and division of labour

    adaptive task allocation

    work stimulation by cultivation

    pheromones

    Ants

    ants solve complex tasks by simple local means

    ant productivity is better than the sum of their single activities

    ants are grand masters in search and exploitation

    Why are ants interesting?

    Which mechanisms are important?

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    22/49

    Swarm Intelligence Introduction

    What are there principal mechanisms ofnatural organization?

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    23/49

    Swarm Intelligence Introduction

    Self-organization

    Self-organization is a set of dynamical mechanisms

    whereby structures appear at the global level of a

    system from interactions of its lower-level components.

    (Bonabeau et al, in Swarm Intelligence, 1999)

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    24/49

    Swarm Intelligence Introduction

    The four bases of self-organization

    positive feedback (amplification)

    negative feedback (for counter-balance and stabilization)

    amplification of fluctuations (randomness, errors, random walks)

    multiple interactions

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    25/49

    unload from

    source B

    Recruiting

    follow other dancers

    Unloading

    dance for

    source B

    forage at

    source B

    forage at

    source A

    dance for

    source A

    Foraging

    unload from

    source A

    Hive

    Environment

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    26/49

    Swarm Intelligence Introduction

    Ant foraging

    Nest Food

    Cooperative search by pheromone trails

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    27/49

    Swarm Intelligence Introduction

    Nest Food

    Cooperative search by pheromone trails

    Ant foraging

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    28/49

    Swarm Intelligence Introduction

    Nest Food

    Cooperative search by pheromone trails

    Ant foraging

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    29/49

    Swarm Intelligence Introduction

    Nest Food

    Cooperative search by pheromone trails

    Ant foraging

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    30/49

    Swarm Intelligence Introduction

    Nest Food

    Cooperative search by pheromone trails

    Ant foraging

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    31/49

    Swarm Intelligence Introduction

    Nest Food

    Cooperative search by pheromone trails

    Ant foraging

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    32/49

    Swarm Intelligence Introduction

    Characteristics of self-organized systems

    structure emerging from a homogeneous startup state

    multistability - coexistence of many stable states

    state transitions with a dramatical change of the system behaviour

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    33/49

    Swarm Intelligence Introduction

    random walk

    bumped into

    a wood chip

    carrying

    a wood chip drop chipPick-up chip

    yes

    no

    yesno

    initialization

    Self-organization in a termite simulation

    (Mitchel Resnick, 1994)

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    34/49

    Swarm Intelligence Introduction

    (Mitchel Resnick, 1994)

    Self-organization in a termite simulation

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    35/49

    Swarm Intelligence Introduction

    Self-organization in honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    36/49

    Swarm Intelligence Introduction

    the queen moves randomly over the combs

    eggs are more likely to be layed in the neighbourhood of brood

    honey and pollen are deposited randomly in empty cells

    four times more honey is brought to the hive than pollen

    removal ratios for honey: 0.95; pollen: 0.6

    removal of honey and pollen is proportional to the number of

    surrounding cells containing brood

    Self-organization in honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    37/49

    Swarm Intelligence Introduction

    Simulation of honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    38/49

    Swarm Intelligence Introduction

    Simulation of honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    39/49

    Swarm Intelligence Introduction

    Simulation of honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    40/49

    Swarm Intelligence Introduction

    Simulation of honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    41/49

    Swarm Intelligence Introduction

    Simulation of honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    42/49

    Swarm Intelligence Introduction

    Simulation of honey bee nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    43/49

    Swarm Intelligence Introduction

    Stigmergy

    Stigmergy:stigma(sting) + ergon(work)

    = stimulation by work

    indirect agent interaction modification of the environment

    environmental modification serves as external memory

    work can be continued by any individual

    the same, simple, behavioural rules can create different designs

    according to the environmental state

    Characteristics of stigmergy

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    44/49

    Swarm Intelligence Introduction

    Stigmergy in termite nest building

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    45/49

    Swarm Intelligence Introduction

    Stigmergy in spider webs

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    46/49

    Swarm Intelligence Introduction

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    47/49

    Swarm Intelligence Introduction

    Stigmergy in spider webs

    Spiral analysis - Real spider vs simulation

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    48/49

    Swarm Intelligence Introduction

    Summary

    there are analogies in distributed computing and social insects

    biology has found solution to hard computational problems

    biologically inspired computing requires:

    identification of analogies

    computer modelling of biological mechanisms

    adaptation of biological mechanisms for IT applications

    Motivation and methods in biologically inspired IT

  • 8/13/2019 Swarm Intteligence by Thiemo Krink

    49/49

    Swarm Intelligence Introduction

    Two principles in swarm intelligence

    Summary

    self-organization is based on:

    activity amplification by positive feedback

    activity balancing by negative feedbackamplification of random fluctuations

    multiple interactions

    stigmergy - stimulation by work - is based on:

    work as behavioural response to the environmental state

    an environment that serves as a work state memory

    work that does not depend on specific agents