Conjugate Families
The property that the posterior distribution follows the same parametric form as the prior distribution is called conjugacy
- Dirichlet prior is a conjugate family for the multinomial likelihood
Conjugate families are useful since:
- For many distributions we can represent them with hyperparameters
- They allow for sequential update within the same representation
- In many cases we have closed-form solution for prediction