A benchmark study on intelligent sampling techniques in Monte Carlo simulation

In recent years, new, intelligent and efficient sampling techniques for Monte Carlo simulation have been developed. However, when such new techniques are introduced, they are compared to one or two existing techniques, and their performance is evaluated over two or three problems. A literature survey shows that benchmark studies, comparing the performance of several techniques over several problems, are rarely found. This article presents a benchmark study, comparing Simple or Crude Monte Carlo with four modern sampling techniques: Importance Sampling Monte Carlo, Asymptotic Sampling, Enhanced Sampling and Subset Simulation; which are studied over six problems. Moreover, these techniques are combined with three schemes for generating the underlying samples: Simple Sampling, Latin Hypercube Sampling and Antithetic Variates Sampling. Hence, a total of fifteen sampling strategy combinations are explored herein. Due to space constrains, results are presented for only three of the six problems studied; conclusions, however, cover all problems studied. Results show that Importance Sampling using design points is extremely efficient for evaluating small failure probabilities; however, finding the design point can be an issue for some problems. Subset Simulation presented very good performance for all problems studied herein. Although similar, Enhanced Sampling performed better than Asymptotic Sampling for the problems considered: this is explained by the fact that in Enhanced Sampling the same set of samples is used for all support points; hence a larger number of support points can be employed without increasing the computational cost. Finally, the performance of all the above techniques was improved when combined with Latin Hypercube Sampling, in comparison to Simple or Antithetic Variates sampling.