We’ve always been told that decision trees are the best base learners for Gradient Boosting Machine Learning. I’ve always wanted to see for myself. A few days ago, I noticed that my Cython implementation of LSBoost in Python package mlsauce was already quite generic (never noticed before), and I decided to adapt it to any machine learning model with fit and predict methods.
We’ve always been told that decision trees are the best base learners for Gradient Boosting Machine Learning. I’ve always wanted to see for myself. A few days ago, I noticed that my Cython implementation of LSBoost in Python package mlsauce was already quite generic (never noticed before), and I decided to adapt it to any machine learning model with fit and predict methods.