Schedule and Syllabus


This is the syllabus for the Fall 2023 iteration of the course.

Event TypeDescriptionCourse MaterialsVideos
Chapter 1 Layers, Blocks and Modules
Fully Connected layers and blocks
Convolution Layers-Blocks-Modules
Recurrent Layers – Modules
Attention Layers – Modules
Pooling layers
Normalization Layers
Introduction
Chapter 1
Chapter 2 Complexity Indices:
Separation index and methods (Classification Problems)
Smoothness index and methods (Regression Problems)
Linear Density Index and methods (Unsupervised Problems)
Data analysis:
Dataset evaluation (ranking, cleaning, dividing, augmentation)
Supervised Data Subset Selection
Data Clustering
Unsupervised Data Subset Selection
Data Labeling in semi supervised datasets
Chapter 2
Homework #1 Due Deadline : November 12 Homework #1

Topics : (Data Evaluation, Subset Selection)
Hands-On #1 Pytorch Code
Dataset
Lecture
Chapter 3 Architectures
CNNs
Region Based CNNs
Transformers
Chapter 3 - Part 1
Chapter 3 - Part 2
Chapter 3 - Part 3
Topics : (Layer-wise Evaluation, Model Ranking)
Homework #2 Due Deadline : November 30 Homework #2

Homework-Extra #1 Due Deadline : December 10 Homework-Extra #1

Hands-On #2 Architectures
Chapter 4 Layer Wise Analysis Algorithms
Layer-wise Model evaluation
Pre-train Model ranking
Model Confidence and Guarantee
Other Layer-wise Analysis Algorithms
Homework #3 Due Deadline : N/A Topic: Model Compressing
Hands-On #3 Layer Wise Analysis Algorithms
Chapter 5 Layer Wise Design Algorithms
Model Compressing
Layer-wise forward learning (supervised, self supervised, unsupervised)
Layer-wise branching/Fusion
Layer-wise encoding and Feature Representation
Other Layer-wise Design Algorithms
Homework #4 Due Deadline : N/A Topic: Layer wise Learning
Hands-On #4 Layer Wise Design Algorithm
Chapter 6 Deep Metric Learning
An introduction to Metric Learning
An introduction to Similarity Learning
Contrastive Loss (Siamese Networks)
Triplet loss
Circle Loss
Softmax loss
SphereFace(Angular-Softmax)
CosineFace Loss
ArcFace loss
Homework #5 Due Deadline : N/A Topic: Metric Learning
Hands-On #5 Deep Metric Learning
Final Exam January 28, 2024
Final Exam