Schedule

Jump to: [Week 2: Transfer] - [Week 3: Self-Supervised] - [Week 4: Semi-Supervised] - [Week 5: Critical Evaluation] - [Week 6: Few Shot] - [Week 7: Parameter-Efficient Transfer ]

Schedule might change slightly as the semester goes on. Please check here regularly and refresh the page.

Week 1: Introduction

Date Assigned Do Before Class Class Content Optional
Tue 09/03 in-class: Prereq Quiz
Readings:
- Syllabus
- How to Read a Paper: Keshav ACM SigComm Review '07

Course Overview

Slides:
- day01 Logistics
- day01 How to Read Research Papers
Math/Concept Exercises:
- Prereq Quiz
- Small Data Challenges in Big Data Era
Thu 09/05  
Readings:
- Sec. 11.3 of SML Textbook

Supervised Learning for Small Data

Slides:
- day02 Learning with Small Data
Lab Notebook:
- Notebook: Intro to PyTorch [colab]
- Lippe '22 Introduction to PyTorch Notebook
- Sec. 13.5 of Murphy's Intro PML
- Ch 19 of Murphy's Intro PML


Week 2: Transfer Learning

Date Assigned Do Before Class Class Content Optional
Tue 09/10  
Readings:
- Razavian et al. 2014: CNN Features off-the-Shelf: An Astounding Baseline
- Li et al. ICML '18: Explicit Inductive Bias for Transfer Learning with CNNs

Transfer Learning Day 1

Slides:
- day03 Transfer 1
- Transfusion
Thu 09/12  
Readings:
- Fang et al. '23: Does Progress on ImageNet Transfer to Real-World?
--- Read in-depth
- Kumar et al. ICLR '22: Fine-Tuning Can Distort
--- Understand LP-FT in-depth (Sec. 3.4), Skim theory for main ideas

Transfer Learning Day 2

Slides:
- day04 Transfer 2
- Yu et al. 2024: ACM Comp. Survey on Visual Tuning


Week 3: Self-Supervised

Date Assigned Do Before Class Class Content Optional
Tue 09/17  
Readings:
- Gidaris et al. ICLR '18: Predicting Image Rotations

Self-supervised Day 1

Slides:
- day05 Self-Supervised 1
- Sec 32.3.3 of Murpny's Advanced PML Textbook
Thu 09/19  
Readings:
- Balestriero et al. '23: SSL Cookbook
- --- Read Sec. 1 and Sec. 2
- --- Focus on methods in 2.2, 2.3, and 2.4

Self-supervised Day 2

Slides:
- day06 Self-Supervised 2
- Azizi et al. 2023


Week 4: Semi-Supervised

Date Assigned Do Before Class Class Content Optional
Tue 09/24  
Readings:
- Ouali et al. 2020 Overview of Deep SSL

Semi-supervised Basics

Slides:
- day07 Semi-Supervised 1
  
Thu 09/26  
Readings:
- Huang et al. 2024

Semi-supervised SOTA

Slides:
- day08 Semi-Supervised 2
  


Week 5: Critical Evaluation

Date Assigned Do Before Class Class Content Optional
Tue 10/01  
Readings:
- Kapoor & Narayanan 2023

Reproducibility

Slides:
- day09 Critical Evaluation 1
- Pineau et al. JMLR 2021
- Barz & Denzler 2020: Do We Train on Test Data?
Thu 10/03  
Readings:
- Schaeffer et al. 2023: Are Emergent Abilities of Large Language Models a Mirage?

Critics of Foundation Models

Slides:
- day10 Critical Evaluation 2
- On the Dangers of Stochastic Parrots
- Hicks et al. '24: ChatGPT Is BS


Week 6: Few-Shot Learning

Date Assigned Do Before Class Class Content Optional
Tue 10/08 out: HW2
Readings:
- Snell et al. NeurIPS '17: Prototypical Networks for Few-Shot Learning

Few Shot 1/2

Slides:
- day11 Few Shot 1
  
Thu 10/10  
Readings:
- Perez et al. '21: True Few-Shot Learning with Language Models

Few Shot 2/2

Slides:
- day12 Few Shot 2
  


Week 7: Parameter-Efficient Transfer

Date Assigned Do Before Class Class Content Optional
Tue 10/15  
Readings:
- Hu et al. ICLR '22: LoRA

Parameter-Efficient Transfer 1/2

Slides:
- day13 PETL 1
- Evci et al. ICML '22: Head2Toe
Thu 10/17 due: HW2
Readings:
- Sung et al. NeurIPS '22: Ladder Side-Tuning
 Parameter-Efficient Transfer 2/2
- Liu et al. NeurIPS '22: Few-Shot PETL Is Better and Cheaper than In-Context


Projects and Student-Led Classes

Date Assigned Do Before Class Class Content Optional
Tue 10/22  
Readings:
- n/a
 Project Pitches 1/2  
Thu 10/24  
Readings:
- n/a
 Project Pitches 2/2  
Tue 10/29  
Readings:
- Harvey et al. TMLR 2024

Contributed 1

Slides:
- Discussion of Harvey et al. by S. Avaliani / J. Boerma
- Tufts HPC overview by Panos
  
Thu 10/31  
Readings:
- Zbontar et al. ICML '21: Barlow Twins
- Fawaz et al. BigData '18

Contributed 2

Slides:
- Barlow Twins by L. Jain / A. Reddy
- Time Series by B. Kor / Y. Hu
  
Tue 11/05     NO CLASS (Election Day)  
Thu 11/07 due: Chkpt 1
Readings:
- Liu et al. ICCV '21: Swin Transformer
- Liu et al. 2024: Grounding DINO

Contributed 3

Slides:
- Swin Transformer by Crane-Morris / Cheng
- GroundingDINO by Cook / Pretell / Williams
  
Tue 11/12     NO CLASS (Veteran's Day)  
Thu 11/14  
Readings:
- Lilhore et al. 2023: Smart Waste Classifier
- Ilse et al. ICML '18: Attention-based Deep MIL

Contributed 4

Slides:
- Smart Waste Classifier by Banerjee / Charkoudian / He
- Attention-based MIL by Harvey / Louvlie / Moukheiber
  
Thu 11/19  
Readings:
- Gururani & Lerch 2021: SSL for Audio
- Akbari et al NeurIPS '21: Multimodal SSL

Contributed 5

Slides:
- SSL for Audio by Falicov / Shen / Rekhi
- Multimodal SSL by Huan / Huang / Liu
  
Thu 11/21 due: Chkpt 2
Readings:
- Gao et al. NeurIPS '24: UNITS
- Wu & Zhang 2019

Contributed 6

Slides:
- Multi-task Time Series by Chen / Hu
- Deep Transfer for Low-Res Images by Hadidjojo/Muratbayev/Pham
  
Tue 11/26  
Readings:
- Xu et al. 2023: TranSDet
- Arruda et al. 2022: Cross-domain Object Detection

Contributed 7

Slides:
- TranSDet by Deguidice / Malik / Teh
- Cross-domain Detection by Eielson / Ezzo
  
Thu 11/28     NO CLASS (Thanksgiving)  
Tue 12/03  
Readings:
- Lee et al. ICLR 2023: Surgical Fine-tuning

Contributed 9

Slides:
- Surgical Fine-tuning by Lao / Oiknine / Vohra
  
Tue 12/05  
Readings:
- Umair et al. EMNLP 2024

Contributed 10

Slides:
- TRP Dataset by Umair
  
Tue 12/10 due: Slides for Presentation   Final Presentations 1  
Tue 12/17 due: Final Report   Final Presentations 2