statistical methods for machine learning
6 CFU, MSc in Computer Science
machine learning and statistical learning
6 CFU, MSc in Data Science for Economics
202223 edition

statistical methods for machine learning
6 CFU, MSc in Computer Science
machine learning and statistical learning
6 CFU, MSc in Data Science for Economics
202223 edition

News
Results of the September 4 written test are available here.
For students of the MSc in Data Science for Economics
Bibliographic references:
Lecture notes provided by the instructor
The course makes heavy use of probability and statistics. A good textbook on these topics is:
Some good machine learning textbooks:Dimitri P. Bertsekas and John N. Tsitsiklis, Introduction to Probability (2nd edition). Athena Scientific, 2008.
Shai ShalevShwartz e Shai BenDavid, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014.Mehryar Mohri, Afshin Rostamizadeh e Ameet Talwalkar, Foundations of Machine Learning, MIT Press, 2012.
L. Devroye, L. Gyorfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition, Springer, 1996.
Goals
Machine learning is concerned with the design of algorithms that can predict the evolution of a phenomenon based of a set of observations. A standard tool in the development of intelligent systems, machine learning has been successfully applied to a wide range of domains, including vision, speech and language, humancomputer interaction, personalized recommendations, health and medicine, autonomous navigation, and many more. The course will describe and analyze, in a rigorous statistical framework, some of the most important machine learning techniques. This will provide the student with a rich set of methodological tools for understanding the general phenomenon of learning in machines.
Note: This is a course about the theoretical foundations of machine learning and the analysis of machine learning algorithms. The focus is on understanding the mathematical principles at the basis of machine learning.
Syllabus
Notebooks shown in class will be added here.
Experimental projects for students who attended the course in the academic year 202223 or earlier:
Exams
The exam consists of two parts:
After the experimental project is turned in and graded, in order for the mark to be validated the student must answer a few questions about the project (date and time to be agreed with the TAs).
The evaluation of the theory project also includes an oral exam on the report's contents and the related topics covered in class.
The written test can be only taken at the regular exam sessions. The project can be turned in at any time between June 2023 and the end of May 2024. The final grade is the arithmetic average of the mark obtained in the written test and the mark obtained in the project. The exam is passed if: the average is 18 or higher and both marks are 17 or higher
The experimental project is typically based on implementing two or more learning algorithms (or variants of the same algorithm) from scratch. The algorithms are compared on realworld datasets. The programming language is immaterial. However, the implementation should be reasonable in terms of running time and memory footprint. If the experimental project is based on neural networks, then the student is allowed to use a toolbox (e.g., Keras). The report, preferably written using LaTeX, will be evaluated according to the following criteria:
Steps to complete the experimental project:
The theory project is typically (but not exclusively) focused on a topic taught in class. The report will be based on one scientific paper (provided by the instructor), and must contain the complete proof of at least a technical result, including all necessary definitions and auxiliary lemmas. The goal of the theory project is to provide an indepth presentation of the paper's results, including its connections with the related literature. The report may be structured as follows
Steps to complete the theory project:
Course calendar:
Browse the calendar pages and click on a day to find out what was covered on that day.