Avoiding Overfitting (cont..)

Other approaches include:

Holdout/Cross-validation/Leave-one-out
- Validate generalization on data withheld during training

Structural Risk Minimization
- Penalize hypotheses subclasses based on their VC dimension