2015•Unpublished venueRequires access

Evolution strategies with Ledoit-Wolf covariance matrix estimation

Oliver Krämer

Open publisher page 4 citations

Abstract

Evolution strategies are successful blackbox optimization algorithms for continuous solution spaces. The covariance matrix adaptation evolution strategy (CMA-ES) and variants have shown great success on various problems in the past. In this paper, we present an evolution strategy (ES) based on a (1+1)-ES with Rechenberg's 1/5th step size control and Ledoit-Wolf covariance estimation. We compare this algorithm with a variant based on empirical maximum likelihood estimation. In the experimental part, the methods are compared to each other on a short benchmark function set. The ES with Ledoit-Wolf estimation turns out to outperform empirical covariance estimation. The analysis of the covariance estimation population size and the influence of the problem dimensionality allows insights into the choice of parameters.

About this research paper

What this paper is about

Evolution strategies are successful blackbox optimization algorithms for continuous solution spaces. The covariance matrix adaptation evolution strategy (CMA-ES) and variants have shown great success on various problems in the past. In this paper, we present an evolution strategy (ES) based on a (1+1)-ES with Rechenberg's 1/5th step size control and Ledoit-Wolf covariance estimation. We compare this algorithm with a variant based on empirical maximum likelihood estimation. In the experimental part, the methods are compared to each other on a short benchmark function set. The ES with Ledoit-Wolf estimation turns out to outperform empirical covariance estimation. The analysis of the covariance estimation population size and the influence of the problem dimensionality allows insights into the choice of parameters.

Why it matters

OpenAlex reports 4 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Evolution strategies are successful blackbox optimization algorithms for continuous solution spaces. The covariance matrix adaptation evolution strategy (CMA-ES) and variants have shown great success on various problems in the past. In this paper, we present an evolution strategy (ES) based on a (1+1)-ES with Rechenberg's 1/5th step size control and Ledoit-Wolf covariance estimation. We compare this algorithm with a variant based on empirical maximum likelihood estimation. In the experimental part, the methods are compared to each other on a short benchmark function set. The ES with Ledoit-Wolf estimation turns out to outperform empirical covariance estimation. The analysis of the covariance estimation population size and the influence of the problem dimensionality allows insights into the choice of parameters.

Key concepts: CMA-ES, Covariance, Covariance matrix, Curse of dimensionality, Benchmark (surveying), Evolution strategy, Estimation of covariance matrices, Computer science

Related papers

Back to paper searchBrowse research topicsOriginal source
Evolution strategies with Ledoit-Wolf covariance matrix estimation — Research Paper | ScholarLens