Schedule_2021
Date | Location | Topic | Notes | Reading | |
Week 1 | |||||
2021-10-27 10:00-12:00 |
zoom | Introduction | [slides] [printable] [video] | Deep Learning Book (Ch. 1, 2, 3) | |
2021-10-28 13:00-15:00 |
zoom | Machine learning with Spark | [slides] [printable] [video] | Spark Book (Ch. 24, 25) | |
Week 2 | |||||
2020-11-03 10:00-12:00 |
zoom | Machine Learning - Regression | [slides] [printable] [video] | Deep Learning Book (Ch. 4, 5)
Handson Book (Ch. 2, 4) Spark Book (Ch. 27) |
|
2020-11-04 14:00-16:00 |
zoom | Machine Learning - Classification | [slides] [printable] [video] | Deep Learning Book (Ch. 4, 5)
Handson Book (Ch. 3) Spark Book (Ch. 26) |
|
2020-11-06 13:00-15:00 |
zoom | Lab1 | [notebook] [video-spark] [video-docker] | ||
Week 3 | |||||
2021-11-17 10:00-12:00 |
More on Supervised Learning | [slides] [printable] | Handson Book (Ch. 6, 7)
Spark Book (Ch. 27) |
||
2021-11-18 08:00-10:00 |
Deep Feedforward Networks | [printable] [notebook] | Deep Learning Book (Ch. 6)
Handson Book (Ch. 10) |
||
2021-11-19 08:00-10:00 |
Lab2 | [slides] [colab] | |||
Week 4 | |||||
2021-11-24 10:00-12:00 |
Training Feedforward Networks | [printable] [notebook] | Deep Learning Book (Ch. 7, 8)
Handson Book (Ch. 11) |
||
2021-11-25 08:00-10:00 |
Convolutional Neural Networks | [slides] [printable] [notebook] | Deep Learning Book (Ch. 9)
Handson Book (Ch. 14) 10 CNN Architectures [link] |
||
2021-11-26 08:00-10:00 |
zoom | Lab3 | [notebook] [video] | ||
Week 5 | |||||
2021-12-01 10:00-12:00 |
zoom | Recurrent Neural Networks | [printable] [notebook] | Deep Learning Book (Ch. 10)
Handson Book (Ch. 15, 16) Understanding LSTM Networks [link] |
|
2021-12-02 08:00-10:00 |
Attention and Transformer Lecturer: Francisco J. Pena |
[slides] [colab] | Attention Is All You Need [paper]
Mechanics of Seq2seq Models With Attention [link] The Illustrated Transformer [link] |
||
Week 6 | |||||
2021-12-08 10:00-12:00 |
Distributed Learning - Part 1 | [printable] | Communication-Efficient Distributed Deep Learning: A Comprehensive Survey [paper] The TensorFlow Partitioning and Scheduling Problem [paper] Device Placement Optimization with Reinforcement Learning [paper] A Hierarchical Model for Device Placement [paper] |
||
2021-12-09 10:00-12:00 |
Distributed Learning - Part 2 Lecturer: Jim Dowling |
[slides] | |||
Week 7 | |||||
2021-12-15 10:00-12:00 |
Distributed Learning - Part 3 | [printable] | Machine Learning with Adversaries: Byzantine Tolerant Gradient Descent [paper] The Hidden Vulnerability of Distributed Learning in Byzantium [paper] SGD: Decentralized Byzantine Resilience [paper] Fast Machine Learning with Byzantine Workers and Servers [paper] |
||