Research Article Open Access

Nelder-Mead Method with Local Selection Using Neighborhood and Memory for Stochastic Optimization

Noocharin Tippayawannakorn1 and Juta Pichitlamken1
  • 1 Kasetsart University, Thailand
Journal of Computer Science
Volume 9 No. 4, 2013, 463-476

DOI: https://doi.org/10.3844/jcssp.2013.463.476

Submitted On: 18 January 2013
Published On: 10 May 2013

How to Cite: Tippayawannakorn, N. & Pichitlamken, J. (2013). Nelder-Mead Method with Local Selection Using Neighborhood and Memory for Stochastic Optimization. Journal of Computer Science, 9(4), 463-476. https://doi.org/10.3844/jcssp.2013.463.476

Abstract

We consider the Nelder-Mead (NM) simplex algorithm for optimization of discrete-event stochastic simulation models. We propose new modifications of NM to reduce computational time and to improve quality of the estimated optimal solutions. Our means include utilizing past information of already seen solutions, expanding search space to their neighborhood and using adaptive sample sizes. We compare performance of these extensions on six test functions with 3 levels of random variations. We find that using past information leads to reduction of computational efforts by up to 20%. The adaptive modifications need more resources than the non-adaptive counterparts for up to 70% but give better-quality solutions. We recommend the adaptive algorithms with using memory with or without neighborhood structure.

Download

Keywords

  • Nelder-Mead Simplex
  • Adaptive Nelder-Mead Simplex
  • Continuous Stochastic Optimization
  • Neighborhood Search
  • Local Selection