spatially structured metaheuristics: principles and practical applications

33
Spatially Structured Metaheuristics: Principles and Practical Applications Juan Luis Jiménez Laredo University of Luxembourg

Upload: juan-luis-jimenez-laredo

Post on 28-Aug-2014

429 views

Category:

Science


4 download

DESCRIPTION

A relevant number of metaheuristics are based on population. Although conventions may establish different names, individuals in evolutionary algorithms, ants in ant colony optimization or particles in particle swarm optimization belong to the same side of a coin: they are all atomic elements of the population (a.k.a. building-blocks). In this context, spatially structured metaheuristics investigate how to improve the performance of metaheuristics by confining these elements in neighborhoods. This talk aims at presenting the working principles of spatially structured metaheuristics and practical applications to enhance diversity, scalability and robustness.

TRANSCRIPT

Page 1: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Juan Luis Jiménez LaredoUniversity of Luxembourg

Page 2: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Wikipedia A metaheuristic is a higher-level procedure or heuristic designed to find, generate, or select a lower-level procedure or heuristic that may provide a sufficiently good solution to an optimization problem, especially with incomplete or imperfect information or limited computation capacity [Bianchi et al.].

Page 3: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Wikipedia A metaheuristic is a higher-level procedure or heuristic designed to find, generate, or select a lower-level procedure or heuristic that may provide a sufficiently good solution to an optimization problem, especially with incomplete or imperfect information or limited computation capacity [Bianchi et al.].

By Sam Derbyshire

Page 4: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

by Johann "nojhan" Dréo, Caner Candan

Page 5: Spatially structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

Spatially Structured Metaheuristics: Principles and Practical Applications

by Johann "nojhan" Dréo, Caner Candan

Page 6: Spatially structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

Spatially Structured Metaheuristics: Principles and Practical Applications

by Johann "nojhan" Dréo, Caner Candan

Page 7: Spatially structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

Spatially Structured Metaheuristics: Principles and Practical Applications

Metaheuristics

Population

Evolutionaryalgorithms

Page 8: Spatially structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

Spatially Structured Metaheuristics: Principles and Practical Applications

Evolutionaryalgorithms

Page 9: Spatially structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

Spatially Structured Metaheuristics: Principles and Practical Applications

Evolutionaryalgorithms

Graph of acquaintances having a not-null probability of mating

Page 10: Spatially structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

Spatially Structured Metaheuristics: Principles and Practical Applications

Evolutionaryalgorithms

Graph of acquaintances having a not-null probability of mating

What kind of a graph definesa canonical EA??

Page 11: Spatially structured Metaheuristics: Principles and Practical Applications

By Sam Derbyshire

Spatially Structured Metaheuristics: Principles and Practical Applications

What kind of a graph definesa canonical EA??

The answer is: a complete graph

A population like that

is called panmictic

Page 12: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Then what happen if we

remove some edges??

Page 13: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

We are defining a Spatially Structured

MetaheuristicAn individual can only mate

within a neighborhood.

Then what happen if we

remove some edges??

Page 14: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

In panmictic populations the environmental selection

pressure is very high

Page 15: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

But remember:The graph can be any!!

Page 16: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

… and we can really relaxthe selection pressure and

favoring niching

Page 17: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Can we really do something with ALL this?

By Sam Derbyshire

Page 18: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

The answer is YES, and we are gonna talk about 2 things:

• Diversity• Scalability By Sam Derbyshire

Page 19: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

About diversity…

Page 20: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

About diversity…

Page 21: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

About diversity…

?

Page 22: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

This is P2P…

Page 23: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

This is P2P…

Page 24: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

This is P2P…

Page 25: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Can P2P really scale !?

Page 26: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Simulator

J.L.J. Laredo, A.E. Eiben, M. van Steen, J. J. Merelo. EvAg: a scalable peer-to-peer evolutionary algorithm.

Genetic Programming and Evolvable Machines , 11(2):227-246. 2010. Simulator conducted experimentation!!!

Page 27: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Simulator

Page 28: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Simulator

Page 29: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

Simulator

Page 30: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

https://forja.rediris.es/svn/geneura/drmWrapper

http://www.hlrs.de/systems/platforms/nec-nehalem-cluster

Page 31: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

https://forja.rediris.es/svn/geneura/drmWrapper

http://www.hlrs.de/systems/platforms/nec-nehalem-cluster

Page 32: Spatially structured Metaheuristics: Principles and Practical Applications

Spatially Structured Metaheuristics: Principles and Practical Applications

1st large parallel P2P EA experiment188 computers x 8 cores x 2 threads = 3008 agents

Seamless scalability

1000par

seq

TT

upSpeed

Page 33: Spatially structured Metaheuristics: Principles and Practical Applications

Thanks for your attention