Bayesian additive regression trees for probabilistic programming

Bayesian additive regression trees (BART) is a non-parametric method to approximate functions. It is a black-box method based on the sum of many trees where priors are used to regularize inference, mainly by restricting trees’ learning capacity so that no individual tree is able to explain the data,...

Descripción completa

Detalles Bibliográficos
Autores: Quiroga Andiñach, Miriana Esther, Garay, Pablo Germán, Alonso, Juan Manuel, Loyola, Juan Martin, Martín, Osvaldo Antonio
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2022
País:Argentina
Institución:Consejo Nacional de Investigaciones Científicas y Técnicas
Repositorio:CONICET Digital (CONICET)
Idioma:inglés
OAI Identifier:oai:ri.conicet.gov.ar:11336/211656
Acceso en línea:http://hdl.handle.net/11336/211656
Access Level:acceso abierto
Palabra clave:BAYESIAN INFERENCE
NON-PARAMETRICS
PYMC
PYTHON
BINARY TREES
ENSEMBLE METHOD
https://purl.org/becyt/ford/1.1
https://purl.org/becyt/ford/1
https://purl.org/becyt/ford/1.2
Descripción
Sumario:Bayesian additive regression trees (BART) is a non-parametric method to approximate functions. It is a black-box method based on the sum of many trees where priors are used to regularize inference, mainly by restricting trees’ learning capacity so that no individual tree is able to explain the data, but rather the sum of trees. We discuss BART in the context of probabilistic programming languages (PPLs), specifically we introduce a BART implementation extending PyMC, a Python library for probabilistic programming. We present a few examples of models that can be built using this probabilistic programming-oriented version of BART, discuss recommendations for sample diagnostics and selection of model hyperparameters, and finally we close with limitations of the current approach and future extensions.