# The (1+1) Elitist Black-Box Complexity of LeadingOnes

@article{Doerr2016TheE, title={The (1+1) Elitist Black-Box Complexity of LeadingOnes}, author={Carola Doerr and Johannes Lengler}, journal={Proceedings of the Genetic and Evolutionary Computation Conference 2016}, year={2016} }

One important goal of black-box complexity theory is the development of complexity models allowing to derive meaningful lower bounds for whole classes of randomized search heuristics. Complementing classical runtime analysis, black-box models help us understand how algorithmic choices such as the population size, the variation operators, or the selection rules influence the optimization time. One example for such a result is the Ω(n log n) lower bound for unary unbiased algorithms on functions… Expand

#### Tables and Topics from this paper

#### 11 Citations

The $$(1+1)$$(1+1) Elitist Black-Box Complexity of LeadingOnes

- Mathematics, Computer Science
- Algorithmica
- 2017

The permutation- and bit-invariant version of LeadingOnes is regarded and it is proved that its(1+1) elitist black-box complexity is VarOmega (n^2)Ω(n2), a bound that is matched by(1-1)-type evolutionary algorithms, a bound which shows that for LeadingOns the memory-restriction, together with the selection requirement, has a substantial impact on the best possible performance. Expand

Choosing the Right Algorithm With Hints From Complexity Theory

- Computer Science
- IJCAI
- 2021

This work argues that the purely academic question of what could be the best possible algorithm in a certain broad class of black-box optimizers can give fruitful indications in which direction to search for good established optimization heuristics and shows a remarkably good performance of the Metropolis algorithm. Expand

Parallel Black-Box Complexity With Tail Bounds

- Computer Science
- IEEE Transactions on Evolutionary Computation
- 2020

The main result is a general performance limit: it is proved that on every function, the typical optimization time on unimodal and multimodal problems, for the time to find any local optimum, and for the times to even get close to any optimum are reduced. Expand

Complexity Theory for Discrete Black-Box Optimization Heuristics

- Computer Science
- ArXiv
- 2018

Running-time analysis is aimed at understanding the performance of a given heuristic on a given problem by bounding the number of function evaluations that are needed by the heuristic to identify a solution of a desired quality. Expand

Simple on-the-fly parameter selection mechanisms for two classical discrete black-box optimization benchmark problems

- Computer Science
- GECCO
- 2018

This work experiments with a multiplicative, comparison-based update rule to adjust the mutation rate of a (1+1) Evolutionary Algorithm and shows that this simple self-adjusting rule outperforms the best static unary unbiased black-box algorithm on LeadingOnes, achieving an almost optimal speedup of about 18%. Expand

On the Effectiveness of Simple Success-Based Parameter Selection Mechanisms for Two Classical Discrete Black-Box Optimization Benchmark Problems

- Computer Science
- ArXiv
- 2018

This work experiments with a multiplicative, comparison-based update rule to adjust the mutation probability of a (1+1)~Evolutionary Algorithm and shows that this simple self-adjusting rule outperforms the best static unary unbiased black-box algorithm on LeadingOnes, achieving an almost optimal speedup. Expand

Simple Hyper-heuristics Optimise LeadingOnes in the Best Runtime Achievable Using Randomised Local Search Low-Level Heuristics

- Computer Science
- 2018

It is proved that the Generalised Random Gradient hyper-heuristic has the best possible performance achievable with the low-level heuristics (Randomised Local Search with different neighbourhood sizes), up to lower order terms. Expand

Theory of Evolutionary Computation: Recent Developments in Discrete Optimization

- 2020

This chapter collects several probabilistic tools that have proven to be useful in the analysis of randomized search heuristics. This includes classic material such as the Markov, Chebyshev, and… Expand

Theory of Iterative Optimization Heuristics: From Black-Box Complexity over Algorithm Design to Parameter Control

- Computer Science
- 2020

Improved bounds for the black-box complexity of the two best known benchmark problems in the theory of IOHs, OneMax and LeadingOnes are derived, and it is demonstrated how insights obtained from such black- box complexity studies can inspire the design of efficient optimization techniques. Expand

Simple Hyper-Heuristics Control the Neighbourhood Size of Randomised Local Search Optimally for LeadingOnes*

- Medicine, Computer Science
- Evolutionary Computation
- 2018

This article considers the most simple HHs from the literature and rigorously analyse their performance for the LeadingOnes benchmark function, and proves that the Generalised Random Gradient HH has the best possible performance achievable with the low-level heuristics, up to lower-order terms. Expand

#### References

SHOWING 1-10 OF 28 REFERENCES

The $$(1+1)$$(1+1) Elitist Black-Box Complexity of LeadingOnes

- Mathematics, Computer Science
- Algorithmica
- 2017

The permutation- and bit-invariant version of LeadingOnes is regarded and it is proved that its(1+1) elitist black-box complexity is VarOmega (n^2)Ω(n2), a bound that is matched by(1-1)-type evolutionary algorithms, a bound which shows that for LeadingOns the memory-restriction, together with the selection requirement, has a substantial impact on the best possible performance. Expand

OneMax in Black-Box Models with Several Restrictions

- Mathematics, Computer Science
- Algorithmica
- 2016

This work shows that the (1+1) memory-restricted ranking-based black-box complexity of OneMax is linear, and provides improved lower bounds for the complexity of the OneMax in the regarded models. Expand

Black-Box Complexity: Breaking the O(n logn) Barrier of LeadingOnes

- Mathematics, Computer Science
- Artificial Evolution
- 2011

We show that the unrestricted black-box complexity of the n-dimensional XOR- and permutation-invariant LeadingOnes function class is O(n log(n) / loglogn). This shows that the recent natural looking… Expand

Black-Box Search by Unbiased Variation

- Computer Science, Mathematics
- GECCO '10
- 2010

This paper introduces a more restricted black-box model for optimisation of pseudo-Boolean functions which it is claimed captures the working principles of many randomised search heuristics including simulated annealing, evolutionary algorithms, randomised local search, and others. Expand

Ranking-Based Black-Box Complexity

- Mathematics, Computer Science
- Algorithmica
- 2012

A ranking-based black-box algorithm is presented that has a runtime of Θ(n/logn), which shows that the OneMax problem does not become harder with the additional ranking- basedness restriction. Expand

Elitist Black-Box Models: Analyzing the Impact of Elitist Selection on the Performance of Evolutionary Algorithms

- Computer Science, Mathematics
- GECCO
- 2015

This work proposes a new elitist black-box model, in which algorithms are required to base all decisions solely on (a fixed number of) the best search points sampled so far, and introduces the concept of $p-Monte Carlo black- box complexity, which measures the time it takes to optimize a problem with failure probability at most p. Expand

Faster black-box algorithms through higher arity operators

- Computer Science, Mathematics
- FOGA '11
- 2011

The work of Lehre and Witt (GECCO 2010) on the unbiased black- box model is extended by considering higher arity variation operators by showing that already for binary operators the black-box complexity of LeadingOnes drops from Θ(<i>n</i><sup>2</sup>) for unary operators to <i>O</i>(<i-i> log <i*n> log<i+i>) in the binary case. Expand

Upper and Lower Bounds for Randomized Search Heuristics in Black-Box Optimization

- Computer Science, Mathematics
- Theory of Computing Systems
- 2004

Lower bounds on the black-box complexity of problems are derived without complexity theoretical assumptions and are compared with upper bounds in this scenario. Expand

Probabilistic computations: Toward a unified measure of complexity

- Computer Science
- 18th Annual Symposium on Foundations of Computer Science (sfcs 1977)
- 1977

Two approaches to the study of expected running time of algoritruns lead naturally to two different definitions of intrinsic complexity of a problem, which are the distributional complexity and the randomized complexity, respectively. Expand

A New Method for Lower Bounds on the Running Time of Evolutionary Algorithms

- Computer Science, Mathematics
- IEEE Transactions on Evolutionary Computation
- 2013

A new method based on fitness-level partitions and an additional condition on transition probabilities between fitness levels allows us to determine the optimal mutation-based algorithm for LO and OneMax, i.e., the algorithm that minimizes the expected number of fitness evaluations. Expand