Abstract
Bayesian Optimization (BO) frameworks typically assume the function to be optimized is stationary (homogeneous) over the domain. However, in many real-world applications, we often deal with functions that present a rate of variation across the input space. In this paper, we optimize functions where a finite set of homogeneous functions defined over partitions of the input space can represent the heterogeneity. The disconnected partitions that can be characterized by the same function are said to be in the same class, and evaluating the function at input returns the minimum distance to a boundary of the contiguous class (partition). The ClassGP modeling framework, previously developed to model for such heterogenous functions along with a novel ClassUCB acquisition function and partition sampling strategy, is used to introduce a novel tree-based optimization framework dubbed as ClassBO (Class Bayesian Optimization). We demonstrate the superior performance of ClassBO against other methods via empirical evaluations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Archetti, F., Candelieri, A.: Bayesian Optimization and Data Science, vol. 849. Springer, Cham (2019)
Eriksson, D., Pearce, M., Gardner, J., Turner, R.D., Poloczek, M.: Scalable global optimization via local Bayesian optimization. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
Frazier, P.I.: A tutorial on Bayesian optimization. arXiv preprint arXiv:1807.02811 (2018)
Gibbs, M.N.: Bayesian Gaussian processes for regression and classification. Ph.D. thesis. Citeseer (1998)
Gramacy, R.B., Lee, H.K.H.: Bayesian treed gaussian process models with an application to computer modeling. J. Am. Stat. Assoc. 103(483), 1119–1130 (2008)
Malu, M., Pedrielli, G., Dasarathy, G., Spanias, A.: Class GP: Gaussian process modeling for heterogeneous functions. In: International Conference on Learning and Intelligent Optimization, pp. 408–423. Springer (2023)
Marmin, S., Ginsbourger, D., Baccou, J., Liandrat, J.: Warped gaussian processes and derivative-based sequential designs for functions with heterogeneous variations. SIAM/ASA J. Uncertainty Quantification 6(3), 991–1018 (2018)
Paciorek, C.J., Schervish, M.J.: Spatial modelling using a new class of nonstationary covariance functions. Environmetrics: Official J. Int. Environmetrics Soc. 17(5), 483–506 (2006)
Schmidt, A.M., O’Hagan, A.: Bayesian inference for non-stationary spatial covariance structure via spatial deformations. J. R. Stat. Soc.: Series B (Stat. Methodol.) 65(3), 743–758 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Malu, M., Pedrielli, G., Dasarathy, G., Spanias, A. (2025). ClassBO: Bayesian Optimization for Heterogeneous Functions. In: Festa, P., Ferone, D., Pastore, T., Pisacane, O. (eds) Learning and Intelligent Optimization. LION 2024. Lecture Notes in Computer Science, vol 14990. Springer, Cham. https://doi.org/10.1007/978-3-031-75623-8_19
Download citation
DOI: https://doi.org/10.1007/978-3-031-75623-8_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-75622-1
Online ISBN: 978-3-031-75623-8
eBook Packages: Computer ScienceComputer Science (R0)