Self-tuning portfolio-based Bayesian optimization

• Published in: Expert systems with applications 2022-02, Vol.188, p.115847, Article 115847
• Main Authors: Vasconcelos, Thiago de P., de Souza, Daniel Augusto R.M.A., Virgolino, Gustavo C. de M., Mattos, César L.C., Gomes, João P.P.
• Format: Article
• Language: English
• Subjects: Acquisition functions; Bayesian analysis; Bayesian optimization; Fault detection; Gaussian process; Iterative methods; Machine learning; Optimization; Portfolio allocation; Self tuning; Thompson sampling
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2021.115847

Portfolio strategies for Bayesian optimization (BO) aim to mitigate the issue of choosing an acquisition function when performing black-box optimization with Gaussian processes (GP) surrogate models. In that sense, the GP-Hedge is a straightforward portfolio framework commonly used in practice. Our work proposes to overcome existing limitations on the GP-Hedge and related methods, such as reducing the influence of far past evaluations and promoting better exploration. Moreover, we aim to achieve such improvements without sacrificing the practicality of simpler portfolio strategies. More specifically, we propose a new BO method equipped with the aforementioned enhancements enabled by additional self-tuned hyperparameters, which are sampled during the optimization via Thompson sampling. We are able to update the posteriors analytically at each iteration by carefully choosing meaningful conjugate priors. The new approach, named Self-Tuning Portfolio-based BO (SETUP-BO), improves standard portfolio strategies without the need for manually tuning hyperparameters, which preserves easiness of use. We evaluate our method and its competitors in the task of hyperparameter optimization (HPO), a critical step towards automated machine learning (AutoML), following a thorough meta-surrogate benchmarking approach. We also consider a real-world scenario related to the task of fault detection in energy plants. Our methodology achieves promising results, which indicates the viability of the proposed SETUP-BO. •The work proposes a new portfolio based Bayesian Optimization method (SETUP-BO).•SETUP-BO improves the performance of GP-Hedge while keeping its easiness to use.•SETUP-BO uses a Thompson Sampling to autonomous tune all hyperparameters.•The experiments showed that SETUP-BO is a valid alternative for various black box optimization tasks.