SlideShare a Scribd company logo
1 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Elementary Landscape Decomposition of
the Hamiltonian Path Optimization Problem
Darrell Whitley and Francisco Chicano
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
2 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• A landscape is a triple (X,N, f) where
Ø X is the solution space
Ø N is the neighbourhood operator
Ø f is the objective function
Landscape Definition
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
The pair (X,N) is called
configuration space
s0
s4
s7
s6
s2
s1
s8
s9
s5
s32
0
3
5
1
2
4
0
7
6
• The neighborhood operator is a function
N: X →P(X)
• Solution y is neighbor of x if y ∈ N(x)
• Regular and symmetric neighborhoods
• d=|N(x)| ∀ x ∈ X
• y ∈ N(x) ⇔ x ∈ N(y)
• Objective function
f: X →R (or N, Z, Q)
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
3 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• An elementary function is an eigenvector of the graph Laplacian (plus constant)
• Graph Laplacian:
• Elementary function: eigenvector of Δ (plus constant)
Elementary Landscapes: Formal Definition
s0
s4
s7
s6
s2
s1
s8
s9
s5
s3
Adjacency matrix Degree matrix
Depends on the
configuration space
Eigenvalue
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
4 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Elementary Landscapes: Characterizations
Linear relationship
• An elementary landscape is a landscape for which
where
• Grover’s wave equation
Eigenvalue
ba
Depend on the
problem/instance
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
def
a b
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
5 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Elementary Landscapes: Examples
Problem Neighbourhood d λ
Symmetric TSP
2-opt n(n-3)/2 n-1
swap two cities n(n-1)/2 2(n-1)
Antisymmetric TSP
inversions n(n-1)/2 n(n+1)/2
swap two cities n(n-1)/2 2n
Graph α-Coloring recolor 1 vertex (α-1)n 2α
Graph Matching swap two elements n(n-1)/2 2(n-1)
Graph Bipartitioning Johnson graph n2/4 2(n-1)
NEAS bit-flip n 4
Max Cut bit-flip n 4
Weight Partition bit-flip n 4
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
6 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• What if the landscape is not elementary?
• Any landscape can be written as the sum of elementary landscapes
• There exists a set of eigenfunctions of Δ that form a basis of the
function space (Fourier basis)
Landscape Decomposition
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
X X X
e1
e2
Elementary functions
(from the Fourier basis)
Non-elementary function
f Elementary
components of f
f < e1,f > < e2,f >
< e2,f >
< e1,f >
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
7 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Landscape Decomposition: Examples
Problem Neighbourhood d Components
General TSP
inversions n(n-1)/2 2
swap two cities n(n-1)/2 2
Subset Sum Problem bit-flip n 2
MAX-kSAT bit-flip n k
NK-landscapes bit-flip n K+1
Radio Network Design bit-flip n
max. nb. of
reachable
antennae
Frequency Assignment change 1 frequency (α-1)n 2
QAP swap two elements n(n-1)/2 3
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
8 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• Selection operators usually take into account the fitness value of the individuals
• We could use the average fitness value in the neighborhood of a solution instead
Selecting by Average Fitness Value
X
Neighborhoods
avg
avg
Minimizing
Fitness-based selection
Average-based
selection
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
9 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• In elementary landscapes the traditional and the new operator are the same!
Recall that...
• However, they are not the same in non-elementary landscapes. If we have n
elementary components, then:
• This selection strategy could be useful for plateaus
Elementary components
X
Minimizing
avg avg
Fitness-based selection
Average-based
selection
?
Selecting by Average Fitness Value
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
10 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• Let {x0, x1, ...} a simple random walk on the configuration space where xi+1∈N(xi)
• The random walk induces a time series {f(x0), f(x1), ...} on a landscape.
• The autocorrelation function is defined as:
• The autocorrelation length and coefficient:
• Autocorrelation length “conjecture”:
Autocorrelation
s0
s4
s7
s6
s2
s1
s8
s9
s5
s3
2
0
3
5
1
2
4
0
7
6
The number of local optima in a search space is roughly Solutions
reached from x0
after l moves
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Landscape Definition Elementary Landscapes Landscape decomposition Apps.
11 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Hamiltonian Path Optimization (HPO)
Definition Neighborhoods
• In TSP we search for a Hamiltonian circuit with minimal cost
• In HPO we search for a Hamiltonian path with minimal cost
• Applications:
•  DNA fragment assembly (usually not solved as such)
•  DNA linkage marker sequencing (solved as HPO)
6
1
2
3
5
4
(1,2,3,4,5)
6
1
2
3
5
4
(1,2,3,4,5)
d
¯f =
↵ +
X
c2C
w(c)
f(⇡) =
n 1X
i=1
w⇡(i),⇡(i+1) + w⇡(n),⇡(1)
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
12 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Neighborhoods
• We investigate two different neighborhoods: (reduced) reversals and swaps
2 4 3 5 1 6
2 1 5 3 4 6
(a) Reversal
2 4 3 5 1 6
2 1 3 5 4 6
(b) Swap
Fig. 1. Examples of reversal and swap for a permutation of size 6.
Component Model
ey and Sutton developed a “component” based model that makes it easy to
Reversal
f a more general problem: the Quadratic Assignment Problem
ven two matrices r and w the fitness function of QAP is:
fQAP (⇡) =
nX
i,j=1
ri,jw⇡(i),⇡(j). (3)
serve that (3) generalizes (2) if w is the weight matrix for HPO
ri,j = j
i+1, where is the Kronecker delta. HPO has applica-
ormatics, in particular in DNA fragment assembling [10] and the
f radiation hybrid maps [1].
ape for Reversals
utation ⇡ and two positions i and j with 1  i < j  n, we can
mutation ⇡0
by reversing the elements between i and j (inclusive).
new permutation is defined as:
⇡0
(k) =
⇢
⇡(k) if k < i or k > j,
⇡(j + i k) if i  k  j.
(4)
) illustrates the concept of reversal. The reversal neighborhood
rmutation ⇡ contains all the permutations that can be formed by
sals to ⇡. Each reversal can be identified by a pair [i, j], which are
d ending positions of the reversal. We use square brackets in the
tinguish them from swaps. Then, we have |NR(⇡)| = n(n 1)/2.
Swap
that is incident on vertex i is sampled once. Since this is true fo
follows that every edge not in the current solution is sampled twi
for each of the vertices in which it is incident. Therefore, summ
neighbors: d · Avg(f(y))y2N(x) = d · f(x) (n 2)f(x) + 2
P
c2
Computing the average over the neighborhood and taking i
result of Lemma 2:
Avg(f(y))
y2N(x)
= f(x)
n 2
n(n 1)/2 1
f(x) +
2
n(n 1)/2 1
X
c2
= f(x) +
n
n(n 1)/2 1
( ¯f f(x)).
5 Landscape Structure for Swaps
Given a permutation ⇡, we can build a new permutation ⇡0
b
positions i and j in the permutation. The new permutation is d
⇡0
(k) =
8
<
:
⇡(k) if k 6= i and k 6= j,
⇡(i) if k = j,
⇡(j) if k = i.
Figure 1(b) illustrates the concept of swap. The swap neighbo
a permutation ⇡ contains all the permutations that can be form
swaps to ⇡. Each swap can be identified by the pair (i, j) of positio
cardinality of the swap neighborhood is |NS(⇡)| = n(n 1)/2. U
stated, we will refer always to the swap neighborhood in this se
2 4 3 5 1 6
2 1 5 3 4 6
(a) Reversal
2 4 3 5 1 6
2 1 3 5 4 6
(b) Swap
Fig. 1. Examples of reversal and swap for a permutation of size 6.
4.1 Component Model
Whitley and Sutton developed a “component” based model that makes
• We call it “reduced” reversals because we omit the reversal of the whole permutation
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Definition Neighborhoods
13 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Component Model (Whitley, Sutton, Howe)
Component Model Elementariness
• Let C be a set of components, each component having a weight w(c)
• A solution x is a subset of C:
• The fitness value of x is the sum of the weights of the components in x:
• Let us consider a neighbor y of x, we can classify the components in x and y as:
•  Components that are in both solutions
•  Components that are in x and not in y (removed from x when we move to y)
•  Components that are in y and not in x (included from C-x when we move to y)
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
4.1 Component Model
Whitley and Sutton developed a “component” based
identify elementary landscapes [17]. Let C be a set of
Each component c 2 C has a weight (or cost) denote
is a subset of components and the evaluation functio
to the sum of the weights of the components in x: f(
C x denote the subset of components that do not
of solution x. Note that the sum of the weights of
computed by
P
c2C w(c) f(x). In the context of the
wave equation can be expressed as:
Avg(f(y))
y2N(x)
= f(x) p1f(x) + p2
X
c2C
where p1 = ↵/d is the (sampling) rate at which com
f(x) are removed from solution x to create a neig
and p2 = /d is the rate at which components in th
create a neighboring solution y 2 N(x). By simple a
X
wap for a permutation of size 6.
nent” based model that makes it easy to
be a set of “components” of a problem.
ost) denoted by w(c). A solution x ✓ C
ion function f(x) maps each solution x
nts in x: f(x) =
P
c2x w(c). Finally, let
hat do not contribute to the evaluation
weights of the components in C x is
ntext of the component model, Grover’s
+ p2
X
c2C
w(c) f(x)
!
,
t which components that contribute to
eate a neighboring solution y 2 N(x),
onents in the set C x are sampled to
By simple algebra,
ed a “component” based model that makes it easy to
es [17]. Let C be a set of “components” of a problem.
weight (or cost) denoted by w(c). A solution x ✓ C
d the evaluation function f(x) maps each solution x
the components in x: f(x) =
P
c2x w(c). Finally, let
omponents that do not contribute to the evaluation
sum of the weights of the components in C x is
x). In the context of the component model, Grover’s
ssed as:
(x) p1f(x) + p2
X
c2C
w(c) f(x)
!
,
pling) rate at which components that contribute to
2 4 3 5 1 6
2 1 5 3 4 6
(a) Reversal
2 4 3 5 1 6
2 1 3 5 4 6
(b) Swap
6
1
2
3
5
4
(1,2,3,4,5)
1 2
3
4
5
6 6
1
2
3
5
4
(1,2,3,4,5)
1 2
3
4
5
6
x
y
14 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Component Theorem (Whitley, Sutton, Howe)
• Let us assume that generating a symmetric neighborhood it happens that:
•  All the components IN x are removed the same number of times, α
•  All the components in C-x (OUT of x) are included the same number of times, β
• Then, the landscape is elementary
• And the wave equation is:
• where
6
1
2
3
5
4
(1,2,3,4,5)
1 2
3
4
5
6
Component Model
y and Sutton developed a “component” based model that makes it easy to
y elementary landscapes [17]. Let C be a set of “components” of a problem.
omponent c 2 C has a weight (or cost) denoted by w(c). A solution x ✓ C
bset of components and the evaluation function f(x) maps each solution x
sum of the weights of the components in x: f(x) =
P
c2x w(c). Finally, let
denote the subset of components that do not contribute to the evaluation
tion x. Note that the sum of the weights of the components in C x is
ted by
P
c2C w(c) f(x). In the context of the component model, Grover’s
quation can be expressed as:
Avg(f(y))
y2N(x)
= f(x) p1f(x) + p2
X
c2C
w(c) f(x)
!
,
p1 = ↵/d is the (sampling) rate at which components that contribute to
re removed from solution x to create a neighboring solution y 2 N(x),
= /d is the rate at which components in the set C x are sampled to
a neighboring solution y 2 N(x). By simple algebra,
(f(y)) = f(x) p1f(x) + p2
X
w(c) f(x)
!
= f(x) +
d
( ¯f f(x)),
nents in x: f(x) =
P
c2x w(c). Finally, let
s that do not contribute to the evaluation
he weights of the components in C x is
context of the component model, Grover’s
x) + p2
X
c2C
w(c) f(x)
!
,
at which components that contribute to
create a neighboring solution y 2 N(x),
mponents in the set C x are sampled to
). By simple algebra,
X
2C
w(c) f(x)
!
= f(x) +
d
( ¯f f(x)),
P
c2C w(c) [16].
omputed by c2C w(c) f(x). In the context of the compon
wave equation can be expressed as:
Avg(f(y))
y2N(x)
= f(x) p1f(x) + p2
X
c2C
w(c) f
where p1 = ↵/d is the (sampling) rate at which components
(x) are removed from solution x to create a neighboring
nd p2 = /d is the rate at which components in the set C
reate a neighboring solution y 2 N(x). By simple algebra,
Avg(f(y))
y2N(x)
= f(x) p1f(x) + p2
X
w2C
w(c) f(x)
!
= f(x
where = ↵ + , and ¯f = /(↵ + )
P
c2C w(c) [16].
↵
d
d
↵
d
d
↵
d
d
¯f =
↵ +
X
c2C
w(c)
Does not change with
the neighborhood
IN
OUT
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Component Model Elementariness
15 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Elementariness of HPO with reversals: IN
• How many times is a component IN the solution removed in the neighborhood?
α = n-2
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Component Model Elementariness
16 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Elementariness of HPO with reversals: IN
• How many times is a component OUT of the solution included in the neighborhood?
• HPO with reversals is elementary and the wave equation is:
β = 2
and all feasible locations j < i. When all possible values of j are considered,
this causes all of the vertices in the permutation left of vertex vi to come into a
position adjacent to vi except for vi 1 which is already adjacent. Next consider a
cut at location i+1 (i is still fixed) and all feasible locations m > i+1. When all
of the possible of value of m are considered all of the vertices in the permutation
to the right of vertex vi are moved into a position adjacent to vi except vi+1.
Thus, in these cases vi does not move, but every edge not in the solution x
that is incident on vertex i is sampled once. Since this is true for all vertices, it
follows that every edge not in the current solution is sampled twice ( = 2): once
for each of the vertices in which it is incident. Therefore, summing over all the
neighbors: d · Avg(f(y))y2N(x) = d · f(x) (n 2)f(x) + 2
P
c2C w(c) f(x) .
Computing the average over the neighborhood and taking into account the
result of Lemma 2:
Avg(f(y))
y2N(x)
= f(x)
n 2
n(n 1)/2 1
f(x) +
2
n(n 1)/2 1
X
c2C
w(c) f(x)
!
= f(x) +
n
n(n 1)/2 1
( ¯f f(x)).
ut
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Component Model Elementariness
17 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Quadratic Assignment Problem: Definition
Previously on QAP Decomposition of HPO
rij
• A QAP instance is composed of n facilities and n locations
• A distance rij is specified between each pair of locations
• A flow wpq is specified between each pair of facilities
• The problem consists in assigning the facilities to the locations minimizing cost
wpq
Facilities Locations
generalization
Kronecker’s delta
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
18 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
QAP Decomposition (Chicano, Whitley, Alba)
• Auxiliary ϕ functions
• Three elementary components for the swap neighborhood
p … q
i jπ
q … p
Eigenvalues
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Previously on QAP Decomposition of HPO
19 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• The three components of QAP
Kronecker’s delta
QAP Decomposition (Chicano, Whitley, Alba)
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Previously on QAP Decomposition of HPO
20 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• If any of the matrices w or r is symmetric, then f2n is a constant
• If any of the matrices w or r is antisymmetric, then f2(n-1) is a constant
Properties of the decomposition
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Previously on QAP Decomposition of HPO
21 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• TSP is a particular case of QAP with two elementary components: f2n and f2(n-1)
• HPO is another subproblem of QAP
Subproblems of QAP: TSP and HPO
d
d
¯f =
↵ +
X
c2C
w(c)
f(⇡) =
n 1X
i=1
w⇡(i),⇡(i+1) + w⇡(n),⇡(1)
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Previously on QAP Decomposition of HPO
22 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• If distance matrix in HPO is symmetric then f2n is a constant and the landscape has
two elementary components:
Subproblems of QAP: TSP and HPO
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
Previously on QAP Decomposition of HPO
23 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
• HPO with the reduced reversals neighborhood is an elementary landscape
• HPO with the swap neighborhood is the sum of two elementary landscapes
• The analysis of the problem can be used to compute statistics that could help in the
search
• Spectral theory of quasi-Abelian Cayley graph cannot be easily applied to the reversals
Conclusions
Future Work
• Analysis of partial neighborhoods
• Search for additional applications of the elementary landscape decomposition
• How do the elementary components of HPO relate to the equivalent TSP problem?
Conclusions & Future Work
Introduction to
Landscapes
Hamiltonian Path
Optimization
Result for
Reversals
Result for
Swaps
Conclusions
& Future Work
24 / 24Granada, Spain, April 2014EvoCOP 2014
UNIVERSITY*OF*GRANADA*
23225*APRIL*2014
Thanks for your attention !!!
Elementary Landscape Decomposition of
the Hamiltonian Path Optimization Problem

More Related Content

PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
PDF
QMC Opening Workshop, High Accuracy Algorithms for Interpolating and Integrat...
PDF
A study of the worst case ratio of a simple algorithm for simple assembly lin...
PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
PDF
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
PDF
DETECTION OF MOVING OBJECT
PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
QMC Opening Workshop, High Accuracy Algorithms for Interpolating and Integrat...
A study of the worst case ratio of a simple algorithm for simple assembly lin...
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
DETECTION OF MOVING OBJECT
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...

What's hot (20)

PDF
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
PDF
RSS discussion of Girolami and Calderhead, October 13, 2010
PDF
Convex optimization methods
PDF
Ben Gal
PDF
Pres_Zurich14
PDF
Coordinate sampler: A non-reversible Gibbs-like sampler
PDF
Maximum likelihood estimation of regularisation parameters in inverse problem...
PDF
Richard Everitt's slides
PDF
Nonlinear Manifolds in Computer Vision
PDF
Jyokyo-kai-20120605
PDF
ABC with Wasserstein distances
PDF
no U-turn sampler, a discussion of Hoffman & Gelman NUTS algorithm
PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
PDF
Macrocanonical models for texture synthesis
PDF
Continuous and Discrete-Time Analysis of SGD
PDF
10.1.1.630.8055
PDF
My PhD defence
PDF
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
PDF
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
RSS discussion of Girolami and Calderhead, October 13, 2010
Convex optimization methods
Ben Gal
Pres_Zurich14
Coordinate sampler: A non-reversible Gibbs-like sampler
Maximum likelihood estimation of regularisation parameters in inverse problem...
Richard Everitt's slides
Nonlinear Manifolds in Computer Vision
Jyokyo-kai-20120605
ABC with Wasserstein distances
no U-turn sampler, a discussion of Hoffman & Gelman NUTS algorithm
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
Macrocanonical models for texture synthesis
Continuous and Discrete-Time Analysis of SGD
10.1.1.630.8055
My PhD defence
Program on Quasi-Monte Carlo and High-Dimensional Sampling Methods for Applie...
QMC Program: Trends and Advances in Monte Carlo Sampling Algorithms Workshop,...
Ad

Viewers also liked (17)

PPT
Hamilton
PDF
PDF
Steven Duplij - Generalized duality, Hamiltonian formalism and new brackets
PDF
Hamilton application
PPT
Distruct week 15 graphs theory (updated)
PDF
N. Bilic - "Hamiltonian Method in the Braneworld" 1/3
PDF
S. Duplij, Constraintless approach to singular theories, new brackets and mul...
PPT
Basic Ray Theory
PPT
The Variational Method
PPTX
Dirac's Positron
PPT
Time Dependent Perturbation Theory
PPT
Against Space
PPTX
Edith Hamilton’s Mythology Part 1: The Gods
PPT
Time Independent Perturbation Theory, 1st order correction, 2nd order correction
PPT
Lagrange's Theorem
PPTX
Lecture7
PDF
3 Things Every Sales Team Needs to Be Thinking About in 2017
Hamilton
Steven Duplij - Generalized duality, Hamiltonian formalism and new brackets
Hamilton application
Distruct week 15 graphs theory (updated)
N. Bilic - "Hamiltonian Method in the Braneworld" 1/3
S. Duplij, Constraintless approach to singular theories, new brackets and mul...
Basic Ray Theory
The Variational Method
Dirac's Positron
Time Dependent Perturbation Theory
Against Space
Edith Hamilton’s Mythology Part 1: The Gods
Time Independent Perturbation Theory, 1st order correction, 2nd order correction
Lagrange's Theorem
Lecture7
3 Things Every Sales Team Needs to Be Thinking About in 2017
Ad

Similar to Elementary Landscape Decomposition of the Hamiltonian Path Optimization Problem (13)

PDF
Problem Understanding through Landscape Theory
PDF
Elementary Landscape Decomposition of Combinatorial Optimization Problems
PDF
Elementary Landscape Decomposition of Combinatorial Optimization Problems
PDF
Elementary Landscape Decomposition of the Quadratic Assignment Problem
PDF
hillclimbing in Artificial intelligence.pdf
DOCX
Optimization
PDF
Exploring the Solution Space of Sorting by Reversals: A New Approach
PDF
02LocalSearch.pdf
PDF
Memetic Firefly algorithm for combinatorial optimization
PDF
Elementary Landscape Decomposition of the Test Suite Minimization Problem
PPTX
CS4700-LS_v6.pptx
PPT
local-search and optimization slides.ppt
PPTX
cs-171-05-LocalSearch.pptx
Problem Understanding through Landscape Theory
Elementary Landscape Decomposition of Combinatorial Optimization Problems
Elementary Landscape Decomposition of Combinatorial Optimization Problems
Elementary Landscape Decomposition of the Quadratic Assignment Problem
hillclimbing in Artificial intelligence.pdf
Optimization
Exploring the Solution Space of Sorting by Reversals: A New Approach
02LocalSearch.pdf
Memetic Firefly algorithm for combinatorial optimization
Elementary Landscape Decomposition of the Test Suite Minimization Problem
CS4700-LS_v6.pptx
local-search and optimization slides.ppt
cs-171-05-LocalSearch.pptx

More from jfrchicanog (20)

PDF
Seminario-taller: Introducción a la Ingeniería del Software Guiada or Búsqueda
PDF
Combinando algoritmos exactos y heurísticos para problemas en ISGB
PDF
Quasi-Optimal Recombination Operator
PDF
Uso de CMSA para resolver el problema de selección de requisitos
PDF
Enhancing Partition Crossover with Articulation Points Analysis
PDF
Search-Based Software Project Scheduling
PDF
Dos estrategias de búsqueda anytime basadas en programación lineal entera par...
PDF
Efficient Hill Climber for Constrained Pseudo-Boolean Optimization Problems
PDF
Efficient Hill Climber for Multi-Objective Pseudo-Boolean Optimization
PDF
Mixed Integer Linear Programming Formulation for the Taxi Sharing Problem
PDF
Descomposición en Landscapes Elementales del Problema de Diseño de Redes de R...
PDF
Optimización Multi-objetivo Basada en Preferencias para la Planificación de P...
PDF
Resolviendo in problema multi-objetivo de selección de requisitos mediante re...
PDF
On the application of SAT solvers for Search Based Software Testing
PDF
Efficient Identification of Improving Moves in a Ball for Pseudo-Boolean Prob...
PDF
Recent Research in Search Based Software Testing
PDF
Searching for Liveness Property Violations in Concurrent Systems with ACO
PDF
Finding Safety Errors with ACO
PDF
Exact Computation of the Expectation Curves of the Bit-Flip Mutation using La...
PDF
Comparing Metaheuristic Algorithms for Error Detection in Java Programs
Seminario-taller: Introducción a la Ingeniería del Software Guiada or Búsqueda
Combinando algoritmos exactos y heurísticos para problemas en ISGB
Quasi-Optimal Recombination Operator
Uso de CMSA para resolver el problema de selección de requisitos
Enhancing Partition Crossover with Articulation Points Analysis
Search-Based Software Project Scheduling
Dos estrategias de búsqueda anytime basadas en programación lineal entera par...
Efficient Hill Climber for Constrained Pseudo-Boolean Optimization Problems
Efficient Hill Climber for Multi-Objective Pseudo-Boolean Optimization
Mixed Integer Linear Programming Formulation for the Taxi Sharing Problem
Descomposición en Landscapes Elementales del Problema de Diseño de Redes de R...
Optimización Multi-objetivo Basada en Preferencias para la Planificación de P...
Resolviendo in problema multi-objetivo de selección de requisitos mediante re...
On the application of SAT solvers for Search Based Software Testing
Efficient Identification of Improving Moves in a Ball for Pseudo-Boolean Prob...
Recent Research in Search Based Software Testing
Searching for Liveness Property Violations in Concurrent Systems with ACO
Finding Safety Errors with ACO
Exact Computation of the Expectation Curves of the Bit-Flip Mutation using La...
Comparing Metaheuristic Algorithms for Error Detection in Java Programs

Recently uploaded (20)

PPTX
Comparative Structure of Integument in Vertebrates.pptx
PPTX
Cell Membrane: Structure, Composition & Functions
PDF
The scientific heritage No 166 (166) (2025)
PDF
Sciences of Europe No 170 (2025)
PDF
AlphaEarth Foundations and the Satellite Embedding dataset
PPTX
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
PPTX
INTRODUCTION TO EVS | Concept of sustainability
PDF
Phytochemical Investigation of Miliusa longipes.pdf
PPTX
neck nodes and dissection types and lymph nodes levels
DOCX
Q1_LE_Mathematics 8_Lesson 5_Week 5.docx
PPTX
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
PDF
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PDF
VARICELLA VACCINATION: A POTENTIAL STRATEGY FOR PREVENTING MULTIPLE SCLEROSIS
PDF
Biophysics 2.pdffffffffffffffffffffffffff
PDF
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
PDF
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
PDF
An interstellar mission to test astrophysical black holes
PDF
HPLC-PPT.docx high performance liquid chromatography
PPT
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
Comparative Structure of Integument in Vertebrates.pptx
Cell Membrane: Structure, Composition & Functions
The scientific heritage No 166 (166) (2025)
Sciences of Europe No 170 (2025)
AlphaEarth Foundations and the Satellite Embedding dataset
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
INTRODUCTION TO EVS | Concept of sustainability
Phytochemical Investigation of Miliusa longipes.pdf
neck nodes and dissection types and lymph nodes levels
Q1_LE_Mathematics 8_Lesson 5_Week 5.docx
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
The KM-GBF monitoring framework – status & key messages.pptx
VARICELLA VACCINATION: A POTENTIAL STRATEGY FOR PREVENTING MULTIPLE SCLEROSIS
Biophysics 2.pdffffffffffffffffffffffffff
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
An interstellar mission to test astrophysical black holes
HPLC-PPT.docx high performance liquid chromatography
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice

Elementary Landscape Decomposition of the Hamiltonian Path Optimization Problem

  • 1. 1 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Elementary Landscape Decomposition of the Hamiltonian Path Optimization Problem Darrell Whitley and Francisco Chicano Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 2. 2 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • A landscape is a triple (X,N, f) where Ø X is the solution space Ø N is the neighbourhood operator Ø f is the objective function Landscape Definition Landscape Definition Elementary Landscapes Landscape decomposition Apps. The pair (X,N) is called configuration space s0 s4 s7 s6 s2 s1 s8 s9 s5 s32 0 3 5 1 2 4 0 7 6 • The neighborhood operator is a function N: X →P(X) • Solution y is neighbor of x if y ∈ N(x) • Regular and symmetric neighborhoods • d=|N(x)| ∀ x ∈ X • y ∈ N(x) ⇔ x ∈ N(y) • Objective function f: X →R (or N, Z, Q) Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 3. 3 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • An elementary function is an eigenvector of the graph Laplacian (plus constant) • Graph Laplacian: • Elementary function: eigenvector of Δ (plus constant) Elementary Landscapes: Formal Definition s0 s4 s7 s6 s2 s1 s8 s9 s5 s3 Adjacency matrix Degree matrix Depends on the configuration space Eigenvalue Landscape Definition Elementary Landscapes Landscape decomposition Apps. Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 4. 4 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Elementary Landscapes: Characterizations Linear relationship • An elementary landscape is a landscape for which where • Grover’s wave equation Eigenvalue ba Depend on the problem/instance Landscape Definition Elementary Landscapes Landscape decomposition Apps. def a b Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 5. 5 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Elementary Landscapes: Examples Problem Neighbourhood d λ Symmetric TSP 2-opt n(n-3)/2 n-1 swap two cities n(n-1)/2 2(n-1) Antisymmetric TSP inversions n(n-1)/2 n(n+1)/2 swap two cities n(n-1)/2 2n Graph α-Coloring recolor 1 vertex (α-1)n 2α Graph Matching swap two elements n(n-1)/2 2(n-1) Graph Bipartitioning Johnson graph n2/4 2(n-1) NEAS bit-flip n 4 Max Cut bit-flip n 4 Weight Partition bit-flip n 4 Landscape Definition Elementary Landscapes Landscape decomposition Apps. Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 6. 6 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • What if the landscape is not elementary? • Any landscape can be written as the sum of elementary landscapes • There exists a set of eigenfunctions of Δ that form a basis of the function space (Fourier basis) Landscape Decomposition Landscape Definition Elementary Landscapes Landscape decomposition Apps. X X X e1 e2 Elementary functions (from the Fourier basis) Non-elementary function f Elementary components of f f < e1,f > < e2,f > < e2,f > < e1,f > Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 7. 7 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Landscape Decomposition: Examples Problem Neighbourhood d Components General TSP inversions n(n-1)/2 2 swap two cities n(n-1)/2 2 Subset Sum Problem bit-flip n 2 MAX-kSAT bit-flip n k NK-landscapes bit-flip n K+1 Radio Network Design bit-flip n max. nb. of reachable antennae Frequency Assignment change 1 frequency (α-1)n 2 QAP swap two elements n(n-1)/2 3 Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Landscape Definition Elementary Landscapes Landscape decomposition Apps.
  • 8. 8 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • Selection operators usually take into account the fitness value of the individuals • We could use the average fitness value in the neighborhood of a solution instead Selecting by Average Fitness Value X Neighborhoods avg avg Minimizing Fitness-based selection Average-based selection Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Landscape Definition Elementary Landscapes Landscape decomposition Apps.
  • 9. 9 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • In elementary landscapes the traditional and the new operator are the same! Recall that... • However, they are not the same in non-elementary landscapes. If we have n elementary components, then: • This selection strategy could be useful for plateaus Elementary components X Minimizing avg avg Fitness-based selection Average-based selection ? Selecting by Average Fitness Value Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Landscape Definition Elementary Landscapes Landscape decomposition Apps.
  • 10. 10 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • Let {x0, x1, ...} a simple random walk on the configuration space where xi+1∈N(xi) • The random walk induces a time series {f(x0), f(x1), ...} on a landscape. • The autocorrelation function is defined as: • The autocorrelation length and coefficient: • Autocorrelation length “conjecture”: Autocorrelation s0 s4 s7 s6 s2 s1 s8 s9 s5 s3 2 0 3 5 1 2 4 0 7 6 The number of local optima in a search space is roughly Solutions reached from x0 after l moves Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Landscape Definition Elementary Landscapes Landscape decomposition Apps.
  • 11. 11 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Hamiltonian Path Optimization (HPO) Definition Neighborhoods • In TSP we search for a Hamiltonian circuit with minimal cost • In HPO we search for a Hamiltonian path with minimal cost • Applications: •  DNA fragment assembly (usually not solved as such) •  DNA linkage marker sequencing (solved as HPO) 6 1 2 3 5 4 (1,2,3,4,5) 6 1 2 3 5 4 (1,2,3,4,5) d ¯f = ↵ + X c2C w(c) f(⇡) = n 1X i=1 w⇡(i),⇡(i+1) + w⇡(n),⇡(1) Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 12. 12 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Neighborhoods • We investigate two different neighborhoods: (reduced) reversals and swaps 2 4 3 5 1 6 2 1 5 3 4 6 (a) Reversal 2 4 3 5 1 6 2 1 3 5 4 6 (b) Swap Fig. 1. Examples of reversal and swap for a permutation of size 6. Component Model ey and Sutton developed a “component” based model that makes it easy to Reversal f a more general problem: the Quadratic Assignment Problem ven two matrices r and w the fitness function of QAP is: fQAP (⇡) = nX i,j=1 ri,jw⇡(i),⇡(j). (3) serve that (3) generalizes (2) if w is the weight matrix for HPO ri,j = j i+1, where is the Kronecker delta. HPO has applica- ormatics, in particular in DNA fragment assembling [10] and the f radiation hybrid maps [1]. ape for Reversals utation ⇡ and two positions i and j with 1  i < j  n, we can mutation ⇡0 by reversing the elements between i and j (inclusive). new permutation is defined as: ⇡0 (k) = ⇢ ⇡(k) if k < i or k > j, ⇡(j + i k) if i  k  j. (4) ) illustrates the concept of reversal. The reversal neighborhood rmutation ⇡ contains all the permutations that can be formed by sals to ⇡. Each reversal can be identified by a pair [i, j], which are d ending positions of the reversal. We use square brackets in the tinguish them from swaps. Then, we have |NR(⇡)| = n(n 1)/2. Swap that is incident on vertex i is sampled once. Since this is true fo follows that every edge not in the current solution is sampled twi for each of the vertices in which it is incident. Therefore, summ neighbors: d · Avg(f(y))y2N(x) = d · f(x) (n 2)f(x) + 2 P c2 Computing the average over the neighborhood and taking i result of Lemma 2: Avg(f(y)) y2N(x) = f(x) n 2 n(n 1)/2 1 f(x) + 2 n(n 1)/2 1 X c2 = f(x) + n n(n 1)/2 1 ( ¯f f(x)). 5 Landscape Structure for Swaps Given a permutation ⇡, we can build a new permutation ⇡0 b positions i and j in the permutation. The new permutation is d ⇡0 (k) = 8 < : ⇡(k) if k 6= i and k 6= j, ⇡(i) if k = j, ⇡(j) if k = i. Figure 1(b) illustrates the concept of swap. The swap neighbo a permutation ⇡ contains all the permutations that can be form swaps to ⇡. Each swap can be identified by the pair (i, j) of positio cardinality of the swap neighborhood is |NS(⇡)| = n(n 1)/2. U stated, we will refer always to the swap neighborhood in this se 2 4 3 5 1 6 2 1 5 3 4 6 (a) Reversal 2 4 3 5 1 6 2 1 3 5 4 6 (b) Swap Fig. 1. Examples of reversal and swap for a permutation of size 6. 4.1 Component Model Whitley and Sutton developed a “component” based model that makes • We call it “reduced” reversals because we omit the reversal of the whole permutation Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Definition Neighborhoods
  • 13. 13 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Component Model (Whitley, Sutton, Howe) Component Model Elementariness • Let C be a set of components, each component having a weight w(c) • A solution x is a subset of C: • The fitness value of x is the sum of the weights of the components in x: • Let us consider a neighbor y of x, we can classify the components in x and y as: •  Components that are in both solutions •  Components that are in x and not in y (removed from x when we move to y) •  Components that are in y and not in x (included from C-x when we move to y) Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work 4.1 Component Model Whitley and Sutton developed a “component” based identify elementary landscapes [17]. Let C be a set of Each component c 2 C has a weight (or cost) denote is a subset of components and the evaluation functio to the sum of the weights of the components in x: f( C x denote the subset of components that do not of solution x. Note that the sum of the weights of computed by P c2C w(c) f(x). In the context of the wave equation can be expressed as: Avg(f(y)) y2N(x) = f(x) p1f(x) + p2 X c2C where p1 = ↵/d is the (sampling) rate at which com f(x) are removed from solution x to create a neig and p2 = /d is the rate at which components in th create a neighboring solution y 2 N(x). By simple a X wap for a permutation of size 6. nent” based model that makes it easy to be a set of “components” of a problem. ost) denoted by w(c). A solution x ✓ C ion function f(x) maps each solution x nts in x: f(x) = P c2x w(c). Finally, let hat do not contribute to the evaluation weights of the components in C x is ntext of the component model, Grover’s + p2 X c2C w(c) f(x) ! , t which components that contribute to eate a neighboring solution y 2 N(x), onents in the set C x are sampled to By simple algebra, ed a “component” based model that makes it easy to es [17]. Let C be a set of “components” of a problem. weight (or cost) denoted by w(c). A solution x ✓ C d the evaluation function f(x) maps each solution x the components in x: f(x) = P c2x w(c). Finally, let omponents that do not contribute to the evaluation sum of the weights of the components in C x is x). In the context of the component model, Grover’s ssed as: (x) p1f(x) + p2 X c2C w(c) f(x) ! , pling) rate at which components that contribute to 2 4 3 5 1 6 2 1 5 3 4 6 (a) Reversal 2 4 3 5 1 6 2 1 3 5 4 6 (b) Swap 6 1 2 3 5 4 (1,2,3,4,5) 1 2 3 4 5 6 6 1 2 3 5 4 (1,2,3,4,5) 1 2 3 4 5 6 x y
  • 14. 14 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Component Theorem (Whitley, Sutton, Howe) • Let us assume that generating a symmetric neighborhood it happens that: •  All the components IN x are removed the same number of times, α •  All the components in C-x (OUT of x) are included the same number of times, β • Then, the landscape is elementary • And the wave equation is: • where 6 1 2 3 5 4 (1,2,3,4,5) 1 2 3 4 5 6 Component Model y and Sutton developed a “component” based model that makes it easy to y elementary landscapes [17]. Let C be a set of “components” of a problem. omponent c 2 C has a weight (or cost) denoted by w(c). A solution x ✓ C bset of components and the evaluation function f(x) maps each solution x sum of the weights of the components in x: f(x) = P c2x w(c). Finally, let denote the subset of components that do not contribute to the evaluation tion x. Note that the sum of the weights of the components in C x is ted by P c2C w(c) f(x). In the context of the component model, Grover’s quation can be expressed as: Avg(f(y)) y2N(x) = f(x) p1f(x) + p2 X c2C w(c) f(x) ! , p1 = ↵/d is the (sampling) rate at which components that contribute to re removed from solution x to create a neighboring solution y 2 N(x), = /d is the rate at which components in the set C x are sampled to a neighboring solution y 2 N(x). By simple algebra, (f(y)) = f(x) p1f(x) + p2 X w(c) f(x) ! = f(x) + d ( ¯f f(x)), nents in x: f(x) = P c2x w(c). Finally, let s that do not contribute to the evaluation he weights of the components in C x is context of the component model, Grover’s x) + p2 X c2C w(c) f(x) ! , at which components that contribute to create a neighboring solution y 2 N(x), mponents in the set C x are sampled to ). By simple algebra, X 2C w(c) f(x) ! = f(x) + d ( ¯f f(x)), P c2C w(c) [16]. omputed by c2C w(c) f(x). In the context of the compon wave equation can be expressed as: Avg(f(y)) y2N(x) = f(x) p1f(x) + p2 X c2C w(c) f where p1 = ↵/d is the (sampling) rate at which components (x) are removed from solution x to create a neighboring nd p2 = /d is the rate at which components in the set C reate a neighboring solution y 2 N(x). By simple algebra, Avg(f(y)) y2N(x) = f(x) p1f(x) + p2 X w2C w(c) f(x) ! = f(x where = ↵ + , and ¯f = /(↵ + ) P c2C w(c) [16]. ↵ d d ↵ d d ↵ d d ¯f = ↵ + X c2C w(c) Does not change with the neighborhood IN OUT Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Component Model Elementariness
  • 15. 15 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Elementariness of HPO with reversals: IN • How many times is a component IN the solution removed in the neighborhood? α = n-2 Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Component Model Elementariness
  • 16. 16 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Elementariness of HPO with reversals: IN • How many times is a component OUT of the solution included in the neighborhood? • HPO with reversals is elementary and the wave equation is: β = 2 and all feasible locations j < i. When all possible values of j are considered, this causes all of the vertices in the permutation left of vertex vi to come into a position adjacent to vi except for vi 1 which is already adjacent. Next consider a cut at location i+1 (i is still fixed) and all feasible locations m > i+1. When all of the possible of value of m are considered all of the vertices in the permutation to the right of vertex vi are moved into a position adjacent to vi except vi+1. Thus, in these cases vi does not move, but every edge not in the solution x that is incident on vertex i is sampled once. Since this is true for all vertices, it follows that every edge not in the current solution is sampled twice ( = 2): once for each of the vertices in which it is incident. Therefore, summing over all the neighbors: d · Avg(f(y))y2N(x) = d · f(x) (n 2)f(x) + 2 P c2C w(c) f(x) . Computing the average over the neighborhood and taking into account the result of Lemma 2: Avg(f(y)) y2N(x) = f(x) n 2 n(n 1)/2 1 f(x) + 2 n(n 1)/2 1 X c2C w(c) f(x) ! = f(x) + n n(n 1)/2 1 ( ¯f f(x)). ut Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Component Model Elementariness
  • 17. 17 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Quadratic Assignment Problem: Definition Previously on QAP Decomposition of HPO rij • A QAP instance is composed of n facilities and n locations • A distance rij is specified between each pair of locations • A flow wpq is specified between each pair of facilities • The problem consists in assigning the facilities to the locations minimizing cost wpq Facilities Locations generalization Kronecker’s delta Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 18. 18 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 QAP Decomposition (Chicano, Whitley, Alba) • Auxiliary ϕ functions • Three elementary components for the swap neighborhood p … q i jπ q … p Eigenvalues Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Previously on QAP Decomposition of HPO
  • 19. 19 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • The three components of QAP Kronecker’s delta QAP Decomposition (Chicano, Whitley, Alba) Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Previously on QAP Decomposition of HPO
  • 20. 20 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • If any of the matrices w or r is symmetric, then f2n is a constant • If any of the matrices w or r is antisymmetric, then f2(n-1) is a constant Properties of the decomposition Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Previously on QAP Decomposition of HPO
  • 21. 21 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • TSP is a particular case of QAP with two elementary components: f2n and f2(n-1) • HPO is another subproblem of QAP Subproblems of QAP: TSP and HPO d d ¯f = ↵ + X c2C w(c) f(⇡) = n 1X i=1 w⇡(i),⇡(i+1) + w⇡(n),⇡(1) Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Previously on QAP Decomposition of HPO
  • 22. 22 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • If distance matrix in HPO is symmetric then f2n is a constant and the landscape has two elementary components: Subproblems of QAP: TSP and HPO Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work Previously on QAP Decomposition of HPO
  • 23. 23 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 • HPO with the reduced reversals neighborhood is an elementary landscape • HPO with the swap neighborhood is the sum of two elementary landscapes • The analysis of the problem can be used to compute statistics that could help in the search • Spectral theory of quasi-Abelian Cayley graph cannot be easily applied to the reversals Conclusions Future Work • Analysis of partial neighborhoods • Search for additional applications of the elementary landscape decomposition • How do the elementary components of HPO relate to the equivalent TSP problem? Conclusions & Future Work Introduction to Landscapes Hamiltonian Path Optimization Result for Reversals Result for Swaps Conclusions & Future Work
  • 24. 24 / 24Granada, Spain, April 2014EvoCOP 2014 UNIVERSITY*OF*GRANADA* 23225*APRIL*2014 Thanks for your attention !!! Elementary Landscape Decomposition of the Hamiltonian Path Optimization Problem