Notes

Statistics

• Random variables, common distributions; Moments and sufficient statistics
• Maximum Likelihood Estimation, KL Divergence, and their connection
• Variational inference
• Exponential families
• Score function, Fisher information matrix, and the Cramér-Rao lower bound
• James-Stein estimator
• Conformal prediction
• Monte Carlo methods and Variance reduction techniques (control variates, …)