Maximum Likelihood Estimation (Cont.)
Consistent
- Estimate converges to best possible value as the number of examples grow
-
Asymptotic efficiency
- Estimate is as close to the true value as possible given a particular training set
-
Representation invariant
- A transformation in the parameter representation does not change the estimated probability distribution