Seminar on Theoretical Aspects of Machine Learning Algorithms

General information

Format

This seminar simulates a machine learning conference, where the students take on the role of authors and reviewers. It consists of multiple phases.

1. Proposal phase

Attend the mandatory first meeting on 24.03, 14:00 (https://gotomeet.me/maximilianthiessen).

Option 1: our suggestions

You select two projects/papers (i.e. two bullet points) from one of the topics below. You will work with the material mentioned in the overview and the project-specific resources.

Option 2: your own projects

You choose two different own project ideas to work on. This can be some existing machine learning paper/work or an own creative idea in the context of machine learning. Importantly, it has to be specific and worked out well.

Independent of the option you chose, understand the fundamentals of your projects and try to answer the following questions:

Select projects and write a short description of them together with the answers to the questions (~3 sentences shoud be sufficient) in TUWEL.

We can only accept your own proposals if you can answer the mentioned questions and have a well worked out project idea.

2. Bidding and assignment phase

You will also act as reviewers and bid on the projects of your peers you want to review. Based on the biddings, we (in the role as chairs of the conference) will select one of each student’s proposals as the actual project you will work on for the rest of this semester. You do not need to work on the other project, anymore. Additionally, we will also assign two different projects from other students to you, which you will have to review later in the semester.

3. Working phase

Now the actual work starts. Gather deep understanding of your project, write a first draft of your report and give a 5-minute presentation. Feel free to go beyond the given material.

4. Reviewing phase

You will again act as a reviewer for the conference by writing two reviews, one for each draft report assigned to you.

5. Writing phase

Based on the reviews from your peers (and our feedback) you will further work on your project.

6. Submission phase

Give a final presentation and submit your report.

General resources (freely available books)

Topics (Tentative)

You should have access to the literature and papers through Google scholar, DBLP, the provided links, or the TU library.

Submodularity in machine learning

Overview:

Papers and projects:

Clustering and dimensionality reduction

Overview:

Papers and projects:

Equivariant neural networks

Overview:

Papers and projects:

Graph kernels

Overview:

Papers and topics:

Scalable kernel methods

Overview:

Papers and projects:

Causal inference

Overview:

Papers and projects:

Semi-supervised learning

Overview:

Papers and projects:

Active learning

Overview:

Papers and projects:

Online learning

Overview:

Papers and projects: