CSCI 8945: Advanced Representation Learning (Fall 2021)

Instructor Sheng Li
E-mail: sheng.li@uga.edu
Time and Location of Lecture Online. The Zoom link is avaialble on eLC website.
Office Hours By email appointment.

Course Description

This course presents a rigorous overview of advanced representation learning algorithms in machine learning, from the traditional subspace learning models to the recent deep representation learning models. Applications in the fields of computer vision, data mining, and natural language processing will be covered.

Please refer to the course syllabus for more details.

Required Prerequisite

CSCI 6380 (Data Mining), CSCI 6550 (Artificial Intelligence) or Permission of Department

Grading

Section Portion Description
Paper Review 30% Write comprehensive paper reviews for assigned papers
Paper Presentation 20% Present assigned papers and lead discussion
Team Project 50% Project proposal (10%); Progress review (10%); Final presentation and report (30%)

Academic Honesty

We will strictly follow UGA’s Academic Honesty Policy. Dishonest behavior will not be tolerated and may result into failing the course. Please contact the instructor if you have any concerns regarding this issue.

Paper Review and Presentation

Note: Please sign up for paper presentations (Deadline: 11:59PM, August 24, 2021)

Paper Review: Students will be required to review 6 papers (ONE paper from each topic) over the semester and submit the reviews to eLC by 11:59PM of the due date shown on class schedule below. The reviewed paper should be chosen from the papers that will be presented in the following classes (Check class schedule for more details). The reviewed papers should not contain the papers you’re going to present in the class. The review should summarize the main idea and contributions of the paper, describe the major experimental results, and discuss the strengths and weaknesses of the paper. The students are also encouraged to check the follow-up work on the topic of the assigned paper (e.g., search the latest papers that cite the assigned paper), summarize the state-of-the-art methods and results, and discuss possible future research directions.

Paper Presentation: Each student will be required to present two research papers over the semester. Each presenter should prepare slides for a 30 minutes talk on the paper. Recordings of the talk must be submitted to eLC by midnight (12:00AM) before the class. The talk should clearly address the following points: (1) motivation and problem statement; (2) related work; (3) methodology; (4) experiments; (4) conclusions; and (5) at least 3 questions for discussion. The presenter will also need to lead discussions on eLC.

Class Schedule (Tentative)

Week Date Topic Lecture/Papers Presenters Notes
1 08/18 (W) Course Overview Lecture Instructor
08/19 (R) A Brief Overview of Machine Learning (I) Lecture Instructor
2 08/24 (T) A Brief Overview of Machine Learning (II) Lecture Instructor
08/25 (W) Neural Networks and Deep Learning (I) Lecture Instructor
08/26 (R) Neural Networks and Deep Learning (II) Lecture Instructor
3 08/31 (T) Deep Auto-Encoders (1) Extracting and composing robust features with denoising autoencoders, ICML 2008
(2) k-Sparse Autoencoders, ICLR 2014
Students Review-1 Due for ONE paper on deep auto-encoders.
09/01 (W) Deep Auto-Encoders (1) Contractive Auto-Encoders: Explicit Invariance During Feature Extraction, ICML 2011
(2) Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions, EMNLP 2011
Students
09/02 (R) Deep Auto-Encoders (1) Auto-Encoding Variational Bayes, ICLR 2014
(2)Adversarial Auto-Encoders, 2016
Students
4 09/07 (T) Deep Auto-Encoders (1) Semantic Autoencoder for Zero-Shot Learning, CVPR 2017
(2) Variational Autoencoders for Collaborative Filtering, WWW 2018
(3) TearingNet: Point Cloud Autoencoder to Learn Topology-Friendly Representations, CVPR 2021
Students Paper discussions on Zoom, for papers presented in Week 3.
09/08 (W) Convolutional Networks (1) ImageNet Classification with Deep Convolutional Neural Networks, NIPS 2012
(2) Very deep convolutional networks for large-scale image recognition, ICLR 2015
Students Review-2 Due for ONE paper on convolutional networks.
09/09 (R) Convolutional Networks (1) Going Deeper with Convolutions, CVPR 2015
(2) Deep Residual Learning for Image Recognition, CVPR 2016
Students
5 09/14 (T) Convolutional Networks (1) Densely Connected Convolutional Networks, CVPR 2017
(2) Res2Net: A New Multi-scale Backbone Architecture, IEEE TPAMI, 2019
(3) Deep Convolutional Neural Networks for Human Action Recognition Using Depth Maps and Postures
Students Paper discussions on Zoom, for papers presented in Week 4.
09/15 (W) Convolutional Networks (1) Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks, NIPS 2015
(2) Mask R-CNN, ICCV 2017
(3) You Only Look Once: Unified, Real-Time Object Detection, CVPR 2016
Students
09/16 (R) Convolutional Networks (1) Learning Spatiotemporal Features with 3D Convolutional Networks, ICCV 2015
(2) Xnor-net: Imagenet classification using binary convolutional neural networks, ECCV 2016
(3) Two Routes to Scalable Credit Assignment without Weight Symmetry
Students
6 09/21 (T) Recurrent Networks An Overview of Recurrent Neural Networks (Lecture) Instructor Paper discussions on Zoom, for papers presented in Week 5.
09/22 (W) Recurrent Networks (1) Bidirectional recurrent neural networks, IEEE Trans. Signal Processing, 1997
(2) Wavenet: a generative model for raw audio
(3) How to Construct Deep Recurrent Neural Networks
Students Review-3 Due for ONE paper on recurrent networks.
09/23 (R) Recurrent Networks (1) Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation, EMNLP 2014
(2) Hierarchical Attention Networks for Document Classification, ACL 2016
Students
7 09/28 (T) Recurrent Networks (1) Relational recurrent neural networks, NeurIPS 2018
(2) End-To-End Memory Networks, NIPS 2015
(3) Disconnected Recurrent Neural Networks for Text Categorization, ACL 2018
Students Paper discussions on Zoom, for papers presented in Week 6.
09/29 (W) Recurrent Networks (1) Long-Term Recurrent Convolutional Networks for Visual Recognition and Description, IEEE Trans. PAMI, 2016
(2) Attention Is All You Need, NIPS 2017
(3) Disentangled Item Representation for Recommender Systems
Students
09/30 (R) Recurrent Networks
(1) Understanding and Controlling Memory in Recurrent Neural Networks, ICML 2019
(2) Unsupervised Learning of Video Representations using LSTMs, 2015
(3) Training Recurrent Neural Networks via Forward Propagation Through Time, ICML 2021.
Students
8 10/05 (T) Project Proposal Presentation (I) N/A Students
10/06 (W) Project Proposal Presentation (II) N/A Students
10/07 (R) Project Proposal Presentation (III) N/A Students
9 10/12 (T) Adversarial Learning An Overview of Adversarial Machine Learning (Lecture) Instructor Paper discussions on Zoom, for papers presented in Week 7.
10/13 (W) Adversarial Learning (1) Generative Adversarial Nets, NIPS 2014
(2) Image-to-Image Translation with Conditional Adversarial Networks, CVPR 2017
(3) InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets, NIPS 2016
Students Review-4 Due for ONE paper on adversarial learning.
10/14 (R) Adversarial Learning (1) Unsupervised representation learning with deep convolutional generative adversarial networks, ICLR 2016
(2) Wasserstein Generative Adversarial Networks, ICML 2017
(3) Adversarially Adaptive Normalization for Single Domain Generalization, CVPR 2021
Students
10 10/19 (T) Adversarial Learning (1) Distributional Smoothing with Virtual Adversarial Training, ICLR 2016
(2) Adversarial Training Methods for Semi-Supervised Text Classification, ICLR 2017
Students Paper discussions on Zoom, for papers presented in Week 9.
10/20 (W) Adversarial Learning (1) Defense-gan: Protecting classifiers against adversarial attacks using generative models, ICLR 2018
(2) Towards Diverse and Natural Image Descriptions via a Conditional GAN, ICCV 2017
(3) Accurate 2D soft segmentation of medical image via SoftGAN network
Students
10/21 (R) Adversarial Learning (1) Coupled Generative Adversarial Networks, NIPS 2016
(2) Spectral Normalization for Generative Adversarial Networks, ICLR 2018
(3) Adversarial Discriminative Domain Adaptation, CVPR 2017.
Students
11 10/26 (T) Graph Neural Networks An Overview of Graph Neural Networks (Lecture) Instructor Paper discussions on Zoom, for papers presented in Week 10.
10/27 (W) Graph Neural Networks (1) Convolutional neural networks on graphs with fast localized spectral filtering, NIPS 2016
(2) Semi-Supervised Classification with Graph Convolutional Networks, ICLR 2017
Students Review-5 Due for ONE paper on graph neural networks.
10/28 (R) Graph Neural Networks (1) Dual Graph Convolutional Networks for Graph-Based Semi-Supervised Classification, WWW 2018
(2) Inductive Representation Learning on Large Graphs, NIPS 2017
(3) Skeleton-Based Action Recognition with Directed Graph Neural Networks
Students
12 11/02 (T) Project Update and Discussion (I) Students
11/03 (W) Project Update and Discussion (II) Students
11/04 (R) Project Update and Discussion (III) Students
13 11/09 (T) Graph Neural Networks (1) Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks, KDD 2019
(2) Hierarchical Graph Representation Learning with Differentiable Pooling, NeurIPS 2018
(3) Binary Graph Neural Networks, CVPR 2021
Students Paper discussions on Zoom, for papers presented in Week 11.
11/10 (W) Graph Neural Networks (1) GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models, ICML 2018
(2) Simplifying Graph Convolutional Networks, ICML 2019
Students
11/11 (R) Graph Neural Networks (1) Explainability Methods for Graph Convolutional Neural Networks, CVPR 2019
(2) Efficient Relative Attribute Learning Using Graph Neural Networks, ECCV 2018
Students
14 11/16 (T) Self-supervised Learning An Overview of Self-Supervised Learning (Lecture) Instructor Paper discussions on Zoom, for papers presented in Week 13.
11/17 (W) Self-supervised Learning (1) BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
(2) XLNet: Generalized Autoregressive Pretraining for Language Understanding
(3) RoBERTa: A Robustly Optimized BERT Pretraining Approach
Students Review-6 Due for ONE paper on self-supervised learning.
11/18 (R) Self-supervised Learning (1) Momentum Contrast for Unsupervised Visual Representation Learning, CVPR 2020
(2) A Simple Framework for Contrastive Learning of Visual Representations, ICML 2020
Students
15 11/23 (T) Self-supervised Learning (1) ViViT: A Video Vision Transformer
(2) VOLO: Vision Outlooker for Visual Recognition
Students Paper discussions on Zoom, for papers presented in Week 14.
16 11/30 (T) Course Project--Final Presentation (I) Students
12/01 (W) Course Project--Final Presentation (II) Students
12/02 (R) Course Project--Final Presentation (III) Students
17 12/07 (R) Project Report Due