Undergraduate Teaching 2024-25

Engineering Tripos Part IIB, 4F13: Probabilistic Machine Learning, 2022-23

Engineering Tripos Part IIB, 4F13: Probabilistic Machine Learning, 2022-23

Not logged in. More information may be available... Login via Raven / direct.

PDF versionPDF version

Module Leader

Prof C Rasmussen

Lecturers

Prof C Rasmussen, Dr D Krueger

Timing and Structure

Michaelmas term. 14 lectures + 2 examples classes. Assessment: 100% coursework

Prerequisites

3F3 useful

Aims

The aims of the course are to:

  • introduce students to basic concepts in machine learning, focusing on statistical methods for supervised and unsupervised learning.

Objectives

As specific objectives, by the end of the course students should be able to:

  • demonstrate a good understanding of basic concepts in statistical machine learning.
  • apply basic ML methods to practical problems.

Content

Machine learning (ML) is an interdisciplinary field focusing on both the mathematical foundations and practical applications of systems that learn, reason and act. The goal of machine learning is to automatically extract knowledge from observed data for the purposes of making predictions, decisions and understanding the world.

The aim of this module is to introduce students to basic concepts in machine learning, focusing on statistical methods for supervised and unsupervised learning. The module will be structured around three recent illustrative successful applications: Gaussian processes for regression and classification, Latent Dirichlet Allocation models for unsupervised text modelling and the TrueSkill probabilistic ranking model.

  • Linear models, maximum likelihood and Bayesian inference
  • Gaussian distribution and Gaussian process
  • Model selection
  • The Expectation Propagation (EP) algorithm
  • Latent variable models
  • The Expectation Maximization (EM) algorithm
  • Dirichlet Distribution and Dirichlet Process
  • Variational inference
  • Generative models, graphical models: Factor graphs

Lectures will be supported by Octave/MATLAB demonstrations.

A detailed syllabus and information about the coursework is available on the moodle website: https://www.vle.cam.ac.uk/course/view.php?id=69021

Coursework

Coursework Format

Due date

& marks

[Coursework activity #1 Gaussian Processes]

Coursework 1 brief description

Learning objective:

  • To gain experience in Bayesian Gaussian Process (GP) regression. 
  • To familiarise yourself with the GPML toolbox. 
  • To understand properties of covariance functions. 
  • To perform hyperparameter learning. 
  • To understand how model selection can be done using the marginal likelihood. 

Individual/group

Report / Presentation

anonymously marked for MPHIL/MLSALT & Undergraduates

Nonanonymously marked for PhDs

day during term, ex:

Fri week 5

[20/60]

[Coursework activity #2 Probabilistic Ranking]

Coursework 2 brief description

Learning objective:

  • To understand inference in continuous probabilistic models represented as factor graphs. 
  • To understand the Gibbs sampling algorithm and gain experience with using Markov chain Monte Carlo (MCMC) for inference. 
  • To understand message passing on (loopy) factor graphs. 
  • To learn how to construct approximate messages using Expectation Propagation (EP). 

Individual Report

Anonymously marked for MPHIL/MLSALT & Undergraduates

Nonanonymously marked for PhDs

  Fri week 7

[20/60]
[Coursework activity #3 Latent Dirichlet Allocation models for documents]

Coursework 3 brief description

Learning objective:

  • To understand unsupervised learnign in discrete graphical models for documents. 
  • To develop an understanding of graphical models with more complex latent structure. 
  • To understnad and apply the Expectation Maximization (EM) and Gibbs sampling algorithms. 
  • To perform unsupervised learning using Latent Dirichlet Allocation model on a collection of documents. 

Individual Report

Anonymously marked for MPHIL/MLSALT & Undergraduates

Nonanonymously marked for PhDs

 Fri week 9

[20/60]

 

Booklists

Please refer to the Booklist for Part IIB Courses for references to this module, this can be found on the associated Moodle course.

Examination Guidelines

Please refer to Form & conduct of the examinations.

UK-SPEC

This syllabus contributes to the following areas of the UK-SPEC standard:

Toggle display of UK-SPEC areas.

 
Last modified: 24/05/2022 13:12

Back to Top