« Previous post - - Next post »

Sporadic model building for efficiency enhancement of hBOA

11 July 2006

Pelikan, M., Sastry, K., Goldberg, D. E. (2006). Proceedings of the 2006 Genetic and Evolutionary Computation Conference, 405—412. [Full paper - PDF] [Full paper - PS][Presentation slides].


Abstract:
This paper describes and analyzes sporadic model building, which can be used to enhance the efficiency of the hierarchical Bayesian optimization algorithm (hBOA) and other estimation of distribution algorithms (EDAs). With sporadic model building, the structure of the probabilistic model is updated once every few iterations (generations), whereas in the remaining iterations only model parameters (conditional and marginal probabilities) are updated. Since the time complexity of updating model parameters is much lower than the time complexity of learning the model structure, sporadic model building decreases the overall time complexity of model building. The paper shows that for boundedly difficult nearly decomposable and hierarchical optimization problems, sporadic model building leads to a significant model-building speedup that decreases the asymptotic time complexity of model building in hBOA by a factor of ?(n0.26) to ?(n0.65), where n is the problem size. On the other hand, sporadic model building also increases the number of evaluations until convergence; nonetheless, for decomposable problems, the evaluation slowdown is insignificant compared to the gains in the asymptotic complexity of model building.


Posted in Conference Proceedings, Estimation of Distribution Algorithms, Principled Efficiency Enhancement Techniques, Publications | Trackback | Top Of Page

Related Posts:

No comments yet

Leave a Reply