DS677-001: Deep Learning

Fall 2023

Instructor: Dr. Grace Guiling Wang

Textbook: No textbook.

Topics

Date Topic Programming Assignment Competition Winner
9/6 Machine Learning Review
9/13 Deep Learning Fundamentals Framewise Phoneme Classification (Kaggle) Ethan Oh
9/20 CNN Image Classification (Kaggle) Joseph Strizhak
9/27 Self-Attention Speaker Classification (Kaggle) Joseph Strizhak
10/4 Transformer Machine Translation (Canvas) Pratyush Sethi
10/11 GAN Anime Face Generation (Canvas) Michael Luo
10/18 Self-Supervised Learning and BERT User Localization based on CSI (Kaggle)
10/25 Auto-Encoder
11/1 Adversarial Attack 1
Midterm (1 hour)
11/8 Adversarial Attack 2
Explainable AI
Adversarial Attack (Canvas) Ethan Oh, Venkata Seetharam Pendekanti, Sara Zumerrah Binte Anwar, Sajid Hussain
11/15 Reinforcement Learning RL for Lunar Lander (Canvas) Joseph Strizhak
11/21 Few-shot classification Omniglot classification (Kaggle) Pratyush Sethi
12/15 Advanced Reinforcement Learning

* Our programming assignments will take the form of a competition. The best one (i.e., highest accuracy, lowest MSE, highest BLEU, highest AFD rate, etc, depending on the assignments) each week will receive a perfect score of 100 points and a $30 gift card as a reward. All other submissions will be graded on a scale relative to the performance of the winning entry.

Group Presentation Topics

  1. Large Language Model Represent Space and Time (paper) (Pranav Kowadkar)
  2. GPT-4 Turbo (Venkata Seetharam Pendekanti, Pruthvik Shashank Reddy Poreddy)
  3. Data Distillation (Niharika Singh, Sara Zumerrah Binte Anwar)
  4. Meta Quest 3 vs. Vision Pro (David Salazar, Sandeep Paluru)
  5. Meta AI (Michael Luo)
  6. PaLM2 (Sajid Hussain)
  7. DeepSpeed4Science (Amitha Unithirumala)
  8. Altman's Advice: AI Startups Should Not Simply Package OpenAI (talk)
  9. OpenAI's DALL-E and CLIP (Joseph Strizhak, Pratyush Sethi)
  10. Differential Privacy for Chatbots (Shashwat Singh)
  11. DeepMind's AlphaFold (Ethan Oh)

More Winners:

  1. Best research project: Michael Luo
  2. Biggest improvement: Venkata Seetharam Pendekanti
  3. Female Modeler: Sara Zumerrah Binte Anwar