Ph.D. course announcement: Optimisation algorithms in Statistics II (3.5 HEC)


Based on the topics discussed in first part of the course, we continue with deepening the theoretical basis for stochastic optimisation algorithms. Specifically, we discuss theory around Stochastic Gradient Ascent (including momentum and adaptive step sizes), Simulated Annealing, and Particle Swarm Optimisation. Theoretical results on convergence and speed will be discussed.

We will use again implementation with R. Examples from machine learning and optimal design will illustrate the methods.

Most welcome to the course!
Frank Miller, Department of Statistics, Stockholm University


The course is intended for Ph.D. students from Statistics or a related field (e.g. Mathematical Statistics, Engineering Science, Quantitative Finance, Computer Science). Previous knowledge in the following is expected:

  • familiarity with the content of the first part of the course,
  • familiarity with R (or another programming language with similar possibilities),
  • basic knowledge in multivariate calculus (e.g. from a Multivariate Statistics course),
  • statistical inference (e.g. from a Master's level course).

Examination and grading

The course is graded Pass or Fail. Examination is through three individual home assignments.

Course literature

We will not use a central course book. Several articles, book chapters and other learning resources will be recommended.

Course structure

The topics will be discussed during three online meetings with Zoom. Course participants will spend most of their study time by solving the problem sets for each topic on their own computers without supervision. The course will be held in March and April 2021.

Course schedule
  • Lecture 1: March 23; Time 10-12, 13-15 (online, Zoom)
  • Lecture 2: April 13; Time 10-12, 13-15 (online, Zoom)
  • Lecture 3: April 27; Time 10-12, 13-15 (online, Zoom)


To register for the course, please send an email to me (frank.miller at until March 9, 2021. You are also welcome for any questions related to the course.