# nonlinear optimization of constrained functions using tabu search

Post on 06-Mar-2017

215 views

Embed Size (px)

TRANSCRIPT

This article was downloaded by: [University North Carolina - Chapel Hill]On: 29 October 2014, At: 08:21Publisher: Taylor & FrancisInforma Ltd Registered in England and Wales Registered Number: 1072954Registered office: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK

International Journal ofMathematical Education in Scienceand TechnologyPublication details, including instructions for authors andsubscription information:http://www.tandfonline.com/loi/tmes20

Nonlinear optimization ofconstrained functions using tabusearchJ.A. Bland aa Department of Mathematics, Statistics and OperationalResearch , The Nottingham Trent University, Burton Street ,Nottingham NG1 4BU, EnglandPublished online: 09 Jul 2006.

To cite this article: J.A. Bland (1993) Nonlinear optimization of constrained functions usingtabu search, International Journal of Mathematical Education in Science and Technology, 24:5,741-747, DOI: 10.1080/0020739930240515

To link to this article: http://dx.doi.org/10.1080/0020739930240515

PLEASE SCROLL DOWN FOR ARTICLE

Taylor & Francis makes every effort to ensure the accuracy of all the information(the Content) contained in the publications on our platform. However, Taylor& Francis, our agents, and our licensors make no representations or warrantieswhatsoever as to the accuracy, completeness, or suitability for any purpose of theContent. Any opinions and views expressed in this publication are the opinions andviews of the authors, and are not the views of or endorsed by Taylor & Francis. Theaccuracy of the Content should not be relied upon and should be independentlyverified with primary sources of information. Taylor and Francis shall not be liablefor any losses, actions, claims, proceedings, demands, costs, expenses, damages,and other liabilities whatsoever or howsoever caused arising directly or indirectly inconnection with, in relation to or arising out of the use of the Content.

This article may be used for research, teaching, and private study purposes. Anysubstantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,systematic supply, or distribution in any form to anyone is expressly forbidden.

http://www.tandfonline.com/loi/tmes20http://www.tandfonline.com/action/showCitFormats?doi=10.1080/0020739930240515http://dx.doi.org/10.1080/0020739930240515

Terms & Conditions of access and use can be found at http://www.tandfonline.com/page/terms-and-conditions

Dow

nloa

ded

by [

Uni

vers

ity N

orth

Car

olin

a -

Cha

pel H

ill]

at 0

8:21

29

Oct

ober

201

4

http://www.tandfonline.com/page/terms-and-conditionshttp://www.tandfonline.com/page/terms-and-conditions

INT. J. MATH. EDUC. SCI. TECHNOL., 1993, VOL. 24, NO. 5, 741-747

Nonlinear optimization of constrained functionsusing tabu search

by J. A. BLANDDepartment of Mathematics, Statistics and Operational Research,

The Nottingham Trent University, Burton Street,Nottingham NG1 4BU, England

(Received 20 July 1992)

A direct search algorithm is presented which is based on the tabu searchmethodology. It is shown how the algorithm may be used to solve constrainednonlinear optimization problems. The major merit of the presented approach isthe ability of the algorithm to escape local optima in the search for a globaloptimim.

1. IntroductionThis article is concerned with the optimization of functions with constraints. An

algorithm is presented that is quite general in the sense that it is applicable to bothlinear and nonlinear functions of an arbitrary number of independent variableswhich may be continuous or discrete. Furthermore, it is flexible enough to cope withboth linear and nonlinear constraints.

Over the past few decades many optimization methods have been proposed, forreviews see references [1] and [2]. These methods, together with the ever increasingspeed and capacity of electronic computers, have enabled large and complexoptimization problems to be solved. In general, proposed optimization procedureshave fallen into two broad classes; search algorithms, which utilize functionevaluations only [3,4], and gradient-based techniques which require both functionand derivative information [5,6].

In this article a direct search algorithm is presented which adapts the tabu searchmethodology [7,8] to optimize constrained nonlinear functions.

2. Tabu searchOver the past few years the tabu search optimization procedure has grown

in popularity although, in general, it has been applied to combinatorial problems[9-11]. In this article it is applied to functions with independent variables that maybe continuous, or, if they are discrete, need not take integer values.

The tabu search methodology has been fully described (in a combinatorialcontext) in [10] and [12]; here a brief outline of the algorithm is given in terms ofunconstrained minimization.

The basic operation of the tabu search procedure is similar to a simple descentalgorithm in the sense that solutions with ever decreasing objective function valuesare continually accepted as the current minimum solution, until no furtherimprovements (i.e. reductions) are obtained. However, tabu search incorporates ashort-term memory of forbidden (or tabu) solutions that enables the procedure to

0020-739X/93 $10-00 1993 Taylor & Francis Ltd.

Dow

nloa

ded

by [

Uni

vers

ity N

orth

Car

olin

a -

Cha

pel H

ill]

at 0

8:21

29

Oct

ober

201

4

742 J. A. Bland

escape from local minima, which usually cause simple descent algorithms toterminate.

The short-term memory facility is a characteristic of tabu search and consists of alist (called the tabu list) of arbitrary length whose elements are previously acceptedsolutions. In the present context an accepted solution is one whose objective functionvalue is the smallest of those associated with a defined neighbourhood of solutions,and it is not currently in the tabu list.

The tabu list operates as a first in-first out queue of accepted solutions whichenables the algorithm to continue searching while retaining knowledge of the currentminimum solution. In this manner, tabu search with a tabu list of length L, avoidsboth entrapment by local minima and cycling (cycles of order L, at least) throughpreviously accepted solutions.

3. Constrained minimizationA basic algorithm which adapts the tabu search methodology to the minimization

of functions whose independent variables are continuous (or non-integer discrete) isnow presented.

Consider a function/of n independent variables, x, where x={xt}, i = l, 2 , . . .n.Ifxo = {xOi}, i = l , 2 , . . . , is an initial solution in n-dimensional space then/ 0 is thefunction value, where/0=/(a;0). In the framework of the tabu search technique x0becomes the first element of an initially empty tabu list. Furthermore, the currentminimum solution and function value, arbest and/best, respectively, are such that xbest= x0 and / b e s t =/ 0 . Next a neighbourhood of x0 is constructed by considering thesolutions that are generated when each coordinate of x0 is, in turn, slightly displaced(positively and negatively) by a specified amount; xoihh i = 1,2,. . . n, where ht areconstants. At each neighbourhood solution the function is evaluated and a move ismade from the initial solution to the neighbourhood solution with the smallestfunction value (ties are broken arbitrarily). If xt denotes the neighbourhoodsolution with the smallest function value, flt -where f1f(x1), then the searchprogresses from x0 to xt and xt enters the tabu list. If / t < / 0 then the currentminimum solution and function value are updated; *best = ;x;i ar>d/best = / i > respec-tively. Note that if / t > / 0 no updating takes place but the search, nonetheless,progresses to x1 even though, with strict inequality, x0 is a local minimum.Furthermore, at the next move, the search cannot return to x0 because it is in the tabulist of forbidden solutions.

In general terms, a move from solution xt to xt + j is based on/j + j being the lowestfunction value in the neighbourhood of x( and that xi+1 is not in the tabu list. As thesearch progresses the tabu list becomes full, after which its length is maintained byreleasing the least recent solution when the current solution is entered. In thismanner the tabu list provides the search with the capability to escape local minimaand avoid cycling through solution cycles of order less than or equal to the list length.Because of its ability to avoid termination at a local minimum tabu search willprogress continually through n-dimensional space in the search for a globalminimum; hence a stopping condition, such as a specified maximum number ofmoves, is required.

The preceeding explanation gives an outline of a basic (unconstrained) tabusearch algorithm which may be enhanced in the following ways. First, the searchmay incorporate a second sweep, where a sweep consists of a specified number ofmoves. If the tabu list length is greater than the number of moves in a sweep and the

Dow

nloa

ded

by [

Uni

vers

ity N

orth

Car

olin

a -

Cha

pel H

ill]

at 0

8:21

29

Oct

ober

201

4

Nonlinear optimization using tabu search 743

search in the second sweep starts at xbest, then the search is forced to investigate newsolutions. A second enhancement is the incorporation of sweeps within a zoomfacility, whereby, after the sweep phase, the search starts at xbest, but some (or all)

Recommended