mloss.org BayesOpt, a Bayesian Optimization toolboxhttp://mloss.orgUpdates and additions to BayesOpt, a Bayesian Optimization toolboxenWed, 09 Dec 2015 04:53:31 -0000 BayesOpt, a Bayesian Optimization toolbox 0.8.2http://mloss.org/software/view/453/<html><p>BayesOpt is an efficient, C++ implementation of the Bayesian optimization methodology for nonlinear-optimization, experimental design and stochastic bandits. In the literature it is also called Sequential Kriging Optimization (SKO), Sequential Model Based Optimization (SMBO) or Efficient Global Optimization (EGO). </p> <p>There are also interfaces for C, Matlab/Octave and Python. The online HTML version of the documentation is in: http://rmcantin.bitbucket.org/html/ </p> <p>Bayesian optimization uses a distribution over functions to build a metamodel of the unknown function for we are looking the extrema, and then apply some active learning strategy to select the query points that provides most potential interest for the seek. For that reason, it has been traditionally intended for optimization of expensive function. However, the efficiency of the library make it also interesting for many types of functions. It is intended to be both fast and clear for development and research. At the same time, it does everything the "right way". For example: </p> <ul> <li> there are different methods that can be used for the preliminary design step, </li> <li> extensive use of Cholesky decomposition and related techniques to improve numeral stability and reduce computational cost, </li> <li> kernels, criteria and parametric functions can be combined to produce more advanced functions, etc. </li> </ul> <p>Originally, it was developed for as part of a robotics research project, where a Gaussian process with hyperpriors on the mean and signal covariance parameters. Then, the metamodel was constructed using the Maximum a Posteriory (MAP) of the parameters. However, the library now has grown to support many more surrogate models, with different distributions (Gaussian processes, Student's-t processes, etc.), with many kernels and mean functions. It also provides different criteria (even some combined criteria) so the library can be used to any problem involving some bounded optimization, stochastic bandits, active learning for regression, etc. </p> <p>You can also find more details in the project webpage: http://rmcantin.bitbucket.org/html/ </p></html>Ruben Martinez CantinWed, 09 Dec 2015 04:53:31 -0000http://mloss.org/software/rss/comments/453http://mloss.org/software/view/453/active learningoptimizationexperimental designgaussian processbanditsbayesian optimization