Ensembles

1. An ensemble of learning algorithms. Main idea

2. Stacking. Bagging

3. Boosting. AdaBoost. Learning with weighted examples

4. Random Forest

5. Ensembles and bias-variance dilemma