Learning Parameters: Summary
Estimation relies on sufficient statistics
- For multinomial these are of the form N (xi,pai)
- Parameter estimation
Bayesian methods also require choice of priors
Both MLE and Bayesian are asymptotically equivalent and consistent
Both can be implemented in an on-line manner by accumulating sufficient statistics