ensemble-methods-notebooks-master

Jupyter notebooks for "Ensemble Methods for Machine Learning"

This repository contains companion material: data, Python code and Jupyter notebooks for Ensemble Methods for Machine Learning (Manning Publications). The code and notebooks are released under the MIT license.

These notebooks primarily use Python 3.7, scikit-learn 0.21 and matplotlib 3.2.1, though other packages such as pandas, seaborn and Keras make guest appearances as well.

This book is a work in progress and expected to be released some time in early 2021.

List of notebooks

• Chapter 1. Ensemble Methods: Hype or Halleujah?

  • 1.3. Fit vs. Complexity in Machine-Learning Models
  • 1.4. A Simple Model Averaging Ensemble

• Chapter 2. Homogeneous Parallel Ensembles: Bagging and Random Forests

  • 2.2, 2.3. Bagging and Random Forest
  • 2.5. Case Study: Breast Cancer Diagnosis

• Chapter 3: Heterogeneous Parallel Ensembles: Combining Strong Learners

  • 3.1 Base Estimators for Heterogeneous Ensembles
  • 3.2 Combining Predictions by Weighting
  • 3.3 Combining Predictions by Meta-Learning
  • 3.4 Case Study: Sentiment Analysis

• Chapter 4: Sequential Ensembles: Boosting

  • 4.1, 4.2 AdaBoost: Adaptive Boosting
  • 4.3 AdaBoost in Practice
  • 4.4 Case Study: Handwritten Digit Classification
  • 4.5 LogitBoost: Boosting with the Logistic Loss

• Chapter 5: Sequential Ensembles: Gradient Boosting

  • 5.1 Gradient Descent for Minimization
  • 5.2 Gradient Boosting = Gradient Descent + Boosting
  • 5.3, 5.4 Practical Boosting with LightGBM
  • 5.5 Case Study: Document Retrieval

• Chapter 6: Sequential Ensembles: Newton Boosting