Bayesian Statistics, Philosophy and Practice - 2019 entry
MODULE TITLE | Bayesian Statistics, Philosophy and Practice | CREDIT VALUE | 15 |
---|---|---|---|
MODULE CODE | ECMM446 | MODULE CONVENER | Unknown |
DURATION: TERM | 1 | 2 | 3 |
---|---|---|---|
DURATION: WEEKS | 11 |
Number of Students Taking Module (anticipated) | 14 |
---|
Since the 1980s, computational advances and novel algorithms have seen Bayesian methods explode in popularity; today underpinning modern techniques in data analytics, pattern recognition and machine learning, as well as numerous inferential procedures used across science, social science and the humanities. This module will introduce Bayesian statistical inference, describing the differences between it and classical approaches to statistics. It will develop the ideas of subjective probability theory for decision-making and explore the place that subjectivity has in scientific reasoning. It will develop Bayesian methods for data analysis and introduce modern Bayesian simulation-based techniques for inference. As well as underpinning a philosophical understanding of Bayesian reasoning with theory, we will use software currently used for Bayesian inference in the lab allowing you to apply techniques discussed in the course to real data.
Pre-requisite skills/knowledge: An undergraduate course in probability theory covering key ideas such as marginalisation and conditioning, and core probability distributions (Normal, Binomial, Gamma, Exponential, Beta (Exeter MTH1004 and its predecessor are sufficient). Likelihood inference (estimation, confidence intervals) at undergraduate level, including exposure to the linear model - for example Exeter ECM2709, preferably the linear model seen in ECM2710 (though this is not a pre-requisite) .
The module runs parallel with the Level 3 course of the same name (ECM3741), with additional M-level material on advanced Bayesian sampling techniques, and their implementation within Bayes, studied independently and assessed as part of an extended Level 3 coursework assignment.
This module will cover the Bayesian approach to modelling, data analysis and statistical inference. The module describes the underpinning philosophies behind the Bayesian approach, looking at subjective probability theory, subjectivity in science, as well as the notion and handling of prior knowledge and the theory of decision-making under uncertainty. We then move to Bayesian modelling and inference looking at parameter estimation in simple models and then hierarchical models. Finally, we explore simulation-based inference in Bayesian analyses and develop important algorithms for Bayesian simulation by Markov Chain Monte Carlo (MCMC), such the Gibbs sampler and the Metropolis-Hastings algorithm.
On successful completion of this module you should be able to:
Module Specific Skills and Knowledge
2. Demonstrate an awareness of Bayesian approaches to statistical modelling and inference and an ability to apply them in practice.
Discipline Specific Skills and Knowledge
Personal and Key Transferable / Employment Skills and Knowledge
8. Apply relevant computer software competently.
Introduction: Bayesian vs. Classical statistics, Nature of probability and uncertainty, Subjectivism.
Decision Theory: Bayes’ rule, Bayes’ risk, Decision trees, Sequential decision-making, Utility.
Bayesian inference: Conjugate models, Prior and Posterior predictive distributions, Posterior summaries and simulation, Objective and subjective priors, Bayesian regression, Hierarchical models.
Bayesian Computation: Monte Carlo, Inverse CDF, Rejection Sampling, Markov Chain Monte Carlo (MCMC), The Gibbs sampler, Metropolis Hastings, Diagnostics.
M level only, advanced MCMC techniques (for example, from Sliced Sampler; Adaptive Metropolis)
Scheduled Learning & Teaching Activities | 33 | Guided Independent Study | 117 | Placement / Study Abroad | 0 |
---|
Category | Hours of study time | Description |
Scheduled learning and teaching activities | 33 | Lectures/practical classes |
Guided independent study | 33 | Post lecture study and reading |
Guided independent study | 40 | Formative and summative coursework preparation and attempting un-assessed problems |
Guided independent study | 44 | Exam revision/preparation |
Form of Assessment | Size of Assessment (e.g. duration/length) | ILOs Assessed | Feedback Method |
---|---|---|---|
Un-assessed practical and theoretical exercises | 11 hours (1 hour each week) | All | Verbal, in class and written on script |
Coursework | 30 | Written Exams | 70 | Practical Exams |
---|
Form of Assessment | % of Credit | Size of Assessment (e.g. duration/length) | ILOs Assessed | Feedback Method |
---|---|---|---|---|
Written exam – closed book | 70 | 2 hours - Summer Exam Period | 1-8, 9, 10 | Verbal on specific request |
Coursework 1 – practical and theoretical exercises | 15 | 12.5 hours | All | Written feedback on script and oral feedback in office hour |
Coursework 2 – Advanced practical and theoretical exercises | 15 | 12.5 hours | All | Written feedback on script and oral feedback in office hour |
Original Form of Assessment | Form of Re-assessment | ILOs Re-assessed | Time Scale for Re-assessment |
---|---|---|---|
All Summative Assessment | Written Exam (100%) | 1-7, 9, 10 | August Referral/Deferral Period |
information that you are expected to consult. Further guidance will be provided by the Module Convener
Basic reading:
ELE: http://vle.exeter.ac.uk/
Web based and Electronic Resources:
Other Resources:
Lindley, D. V. “Making Decisions”
De Groot, M. H. “Optimal Statistical Decisions”.
Sivia, D. S. “Data Analysis, A Bayesian Tutorial”.
Reading list for this module:
CREDIT VALUE | 15 | ECTS VALUE | 7.5 |
---|---|---|---|
PRE-REQUISITE MODULES | None |
---|---|
CO-REQUISITE MODULES | None |
NQF LEVEL (FHEQ) | 7 | AVAILABLE AS DISTANCE LEARNING | No |
---|---|---|---|
ORIGIN DATE | Tuesday 10th July 2018 | LAST REVISION DATE | Tuesday 10th July 2018 |
KEY WORDS SEARCH | Bayesian; Bayes; Statistics; Data; Big Data; Analysis; Decision theory; Inference; Mathematics; Probability |
---|
Please note that all modules are subject to change, please get in touch if you have any questions about this module.