an introduction to bayesian inference michael betancourt april 8, 2009 8.882
Post on 19-Dec-2015
217 views
TRANSCRIPT
![Page 1: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/1.jpg)
An Introduction to Bayesian Inference
Michael BetancourtApril 8, 2009
8.882
![Page 2: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/2.jpg)
Text
Introduction to Bayesian Inference
An Example
![Page 3: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/3.jpg)
Text
Introduction to Bayesian Inference
The General Problem
![Page 4: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/4.jpg)
Text
Introduction to Bayesian Inference
Estimators
![Page 5: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/5.jpg)
Text
Introduction to Bayesian Inference
Estimators: An Example
![Page 6: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/6.jpg)
Text
Introduction to Bayesian Inference
Estimators: The Danger
![Page 7: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/7.jpg)
Text
Introduction to Bayesian Inference
Estimators: The Limitation
![Page 8: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/8.jpg)
Text
Introduction to Bayesian Inference
Maximum Likelihood
![Page 9: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/9.jpg)
Text
Introduction to Bayesian Inference
Maximum Log Likelihood
![Page 10: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/10.jpg)
Text
Introduction to Bayesian Inference
Minimization
![Page 11: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/11.jpg)
Text
Introduction to Bayesian Inference
Maximum Likelihood: An Example
![Page 12: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/12.jpg)
Text
Introduction to Bayesian Inference
Maximum Likelihood Biases
![Page 13: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/13.jpg)
Text
Introduction to Bayesian Inference
Maximum Likelihood Subtleties
![Page 14: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/14.jpg)
Text
Introduction to Bayesian Inference
Bimodal Distributions
![Page 15: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/15.jpg)
Text
Introduction to Bayesian Inference
Back to the Drawing Board
![Page 16: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/16.jpg)
Text
Introduction to Bayesian Inference
Bayes Theorem
![Page 17: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/17.jpg)
Text
Introduction to Bayesian Inference
A New Approach?
The are not random variables!
![Page 18: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/18.jpg)
Text
Introduction to Bayesian Inference
Frequentist Statistics
![Page 19: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/19.jpg)
Text
Introduction to Bayesian Inference
Uncertainty of Belief
![Page 20: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/20.jpg)
Text
Introduction to Bayesian Inference
‣ Axiom One
‣ Axiom Two
The Cox Axioms
![Page 21: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/21.jpg)
Text
Introduction to Bayesian Inference
A New Approach!
![Page 22: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/22.jpg)
Text
Introduction to Bayesian Inference
Selecting Priors
![Page 23: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/23.jpg)
Text
Introduction to Bayesian Inference
Selecting Priors
![Page 24: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/24.jpg)
Text
Introduction to Bayesian Inference
An Example
![Page 25: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/25.jpg)
Text
Introduction to Bayesian Inference
An Example
![Page 26: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/26.jpg)
Text
Introduction to Bayesian Inference
An Example Revisted
![Page 27: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/27.jpg)
Text
Introduction to Bayesian Inference
Marginalization
![Page 28: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/28.jpg)
Text
Introduction to Bayesian Inference
Marginalization: An Example
![Page 29: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/29.jpg)
Text
Introduction to Bayesian Inference
Marginalization: An Example
![Page 30: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/30.jpg)
Text
Introduction to Bayesian Inference
Frequentist vs. Bayesian
![Page 31: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/31.jpg)
Text
Introduction to Bayesian Inference
Bayesian Inference in Practice
Frequentist ➲ Bayesian
Optimization ➲ Expectation
(Differentiation) ➲ (Integration)
![Page 32: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/32.jpg)
Text
Introduction to Bayesian Inference
The Opposition
‣“Priors are Subjective, Science Isn’t”
![Page 33: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/33.jpg)
Text
Introduction to Bayesian Inference
Application: Model Selection
![Page 34: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/34.jpg)
Text
Introduction to Bayesian Inference
Application: Model Selection
![Page 35: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/35.jpg)
Text
Introduction to Bayesian Inference
Application: Model Selection
![Page 36: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/36.jpg)
Text
Introduction to Bayesian Inference
The Bayesian Razor
![Page 37: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/37.jpg)
Text
Introduction to Bayesian Inference
Application: Systematics
Energy Scale 5%
Background Subtraction 1%
Trigger Bias 2%
Luminosity 4%
... n%
Total 7%
![Page 38: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/38.jpg)
Text
Introduction to Bayesian Inference
Application: Systematics
![Page 39: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/39.jpg)
Text
Introduction to Bayesian Inference
Application: Nonparametric Estimation
![Page 40: An Introduction to Bayesian Inference Michael Betancourt April 8, 2009 8.882](https://reader038.vdocuments.mx/reader038/viewer/2022103005/56649d365503460f94a0e0fc/html5/thumbnails/40.jpg)
Text
Introduction to Bayesian Inference
Further Reading
‣ Information Theory, Inference, and Learning Algorithms,
‣MacKay, http://www.inference.phy.cam.ac.uk/mackay/itila/
‣Data Analysis,
‣ Sivia with Skilling, Oxford 2006
‣ Lectures on Probability, Entropy, and Statistical Physics,
‣ Caticha, http://arxiv.org/abs/0808.0012v1