In machine learning, there is always a trade off between complex hypotheses that fit the training data well simpler hypotheses that may generate better. As the amount of training data increases, the generalization error decreases