18-847F: Schedule

Tentative Course Calendar

Date Day Seminar Topic Speaker Slides
August

27

Mon.

Intro and Logistics

PDF

29

Wed.

Overview of the Topics

PDF

September

3

Mon.

Labor Day; No Classes

5

Wed.

Lecture: Review of Probability Theory

PDF

10

Mon.

Grid Computing Survey

Lecture: Intro to Queueing Theory

Mansi Sood



PDF

12

Wed.

Tail at Scale

Lecture: Scheduling for Parallel Computing

Varun Joshi



PDF

17

Mon.

MapReduce

Lecture: Straggler Replication

Ganesh Palanikumar




PDF

19

Wed.

Sparrow

Lecture: Task Replication in Queueing Systems

Nishal Pereira



PDF

24

Mon.

RDDs for Spark

Lecture: Intro to Coding Theory

Abhiram Gogate




PDF

26

Wed.

When Queueing Meets Coding

Guest talk: Coded DNNs

Yasamin Hashemi

Sanghamitra Dutta

October

1

Mon.

Lecture: Coding for Distributed Storage

XORing Elephants



Vineet Kanetkar

PDF

3

Wed.

Speeding up ML using codes

Lecture: Rateless Codes for Coded Computing

Ganesh Palanikumar



PDF

8

Mon.

Polynomial Codes

Guest Talk: Coded PageRank



Yaoqing Yang

10

Wed.

Gradient Coding

Guest talk: Coded Fourier Transform

Krithika Vijayan

Haewon Jeong

15

Mon.

Survey of SGD methods

Lecture: SGD Convergence Analysis

Martial Sawasawa

17

Wed.

Distributed Deep Learning

ImageNet Classification

Abhishek Sawarkar

Anupma Sharan

22

Mon.

Stale-Sync-Parallel

Lecture: Slow and Stale Gradients

Sushant Mehta



PDF

24

Wed.

HogWild


Guest talk: PipeDream

Radhika Parik

Aaron Harlap

29

Mon.

Federated Learning

Lecture: Elastic Averaging SGD

Mayank Sharma



PDF

31

Wed.

Gradient Compression

Model Compression

Hongting Wang

Rahul Sharma

November

5

Mon.

Guest Lecture on Large-scale Machine Learning

Prof. Virginia Smith

7

Wed.

Decentralized SGD

Lecture: Multi-armed Bandits

Varun Joshi

12

Mon.

HyperBand

Lecture: Bayesian Optimization

Zhouyi Yang

14

Wed.

Spearmint

Parallel Bayesian Optimization

Akshay Bhaskar

Akarsh Prabhakara

19

Mon

Generative Adversarial Networks

Guest Talk: PacGANs

Ashwin Jadhav

Zinan Lin

21

Wed.

Thanksgiving break; No Class

26

Mon.

Lecture: Reinforcement Learning; Draft of project report due


28

Wed.

No Class; Project Office Hours

December

3

Mon.

Project Presentations

Abhiram, Akshay, Yasamin

Abhishek, Anupma, Mayank, Nishal

Ashwin, Krithika, Vineet

Ganesh

5

Wed.

Project Presentations

Radhika, Sushant, Varun

Akarsh

Rahul

Mansi

Hongting, Martial, Zhouyi

7

Fri

Project Reports Due