Machine learning of ensembles aims at reducing the predictive error by integrating multiple models into a single one. One of the key components of algorithms for ensemble learning is combining predictions of the base models. In the thesis, we take a closer look at two functions for combining predictions. The first is majority voting, where all the base models contribute equally to the ensemble prediction. The other is performance weighting, where the contribution of a base model to the ensemble prediction is proportional to the model performance. Combination functions are also implemented in R and tested on a selected data set.
|
