What is relation between Bagging-Boosting and Bias-Variance?

Data Science Interview QuestionsCategory: Data ScienceWhat is relation between Bagging-Boosting and Bias-Variance?
MockInterview Staff asked 4 years ago
2 Answers
MockInterview Staff answered 4 years ago

Step 1: Define Bias and Variance and talk about the “trade-off”

  • The bias is an error from erroneous assumptions in the learning algorithm. High bias can cause an algorithm to miss the relevant relations between features and target outputs (underfitting).
  • The variance is an error from sensitivity to small fluctuations in the training set. High variance can cause an algorithm to model the random noise in the training data, rather than the intended outputs (overfitting).

Step 2: Talk about Bagging and Boosting

Step 3: Link them together like below:
Boosting leads to over-fitting and so by boosting the model, you are increasing variance. So if you inverse it, by bagging the model you are minimizing variance.

Art answered 2 years ago

here is a good article explaining bagging and boosting

Your Answer

13 + 13 =