Skip to content

Commit b1b1bcc

Browse files
committedMay 5, 2021
Update assignment3.md
1 parent c3943d1 commit b1b1bcc

File tree

1 file changed

+11
-39
lines changed

1 file changed

+11
-39
lines changed
 

‎assignments/2021/assignment3.md

+11-39
Original file line numberDiff line numberDiff line change
@@ -5,28 +5,7 @@ mathjax: true
55
permalink: /assignments2021/assignment3/
66
---
77

8-
This assignment is due on **Tuesday, May 25 2021** at 11:59pm PDT.
9-
10-
<details>
11-
<summary>Handy Download Links</summary>
12-
13-
<ul>
14-
<li><a href="{{ site.hw_3_colab }}">Option A: Colab starter code</a></li>
15-
<li><a href="{{ site.hw_3_jupyter }}">Option B: Jupyter starter code</a></li>
16-
</ul>
17-
</details>
18-
- [Setup](#setup)
19-
- [Goals](#goals)
20-
- [Google Colaboratory](#option-a-google-colaboratory-recommended)
21-
- [Q1: Image Captioning with Vanilla RNNs (29 points)](#q1-image-captioning-with-vanilla-rnns-29-points)
22-
- [Q2: Image Captioning with Transformers (18 points)](#q2-image-captioning-with-transformers-18-points)
23-
- [Q3: Network Visualization: Saliency maps, Class Visualization, and Fooling Images (15 points)](#q3-network-visualization-saliency-maps-class-visualization-and-fooling-images-15-points)
24-
- [Q4: Generative Adversarial Networks (15 points)](#q4-generative-adversarial-networks-15-points)
25-
- [Q5: Self-Supervised Learning for Image Classification (15 points)](#q5-self-supervised-learning-15-points)
26-
- [Optional (Extra Credit): Image Captioning with LSTMs (5 points)](#optional-image-captioning-with-lstms-5-points)
27-
- [Optional (Extra Credit): Style Transfer (5 points)](#optional-style-transfer-5-points)
28-
- [Submitting your work](#submitting-your-work)
29-
8+
<span style="color:red">This assignment is due on **Tuesday, May 25 2021** at 11:59pm PST.</span>
309

3110
### Setup
3211

@@ -46,13 +25,10 @@ In this assignment, you will implement language networks and apply them to image
4625

4726
The goals of this assignment are as follows:
4827

49-
- Understand the architecture of recurrent neural networks (RNNs) and how they operate on sequences by sharing weights over time.
50-
- Understand and implement Vanilla RNNs, Long-Short Term Memory (LSTM), and Transformer networks for Image captioning.
51-
- Understand how to combine convolutional neural nets and recurrent nets to implement an image captioning system.
28+
- Understand and implement RNN and Transformer networks. Combine them with CNN networks for image captioning.
5229
- Explore various applications of image gradients, including saliency maps, fooling images, class visualizations.
5330
- Understand how to train and implement a Generative Adversarial Network (GAN) to produce images that resemble samples from a dataset.
5431
- Understand how to leverage self-supervised learning techniques to help with image classification tasks.
55-
- *(optional) Understand and implement techniques for image style transfer.
5632

5733
**You will use PyTorch for the majority of this homework.**
5834

@@ -62,28 +38,24 @@ The notebook `RNN_Captioning.ipynb` will walk you through the implementation of
6238

6339
### Q2: Image Captioning with Transformers (20 points)
6440

65-
The notebook `Transformer_Captioning.ipynb` will walk you through the implementation of a Transformer model and apply it to image captioning on COCO. **When first opening the notebook, go to `Runtime > Change runtime type` and set `Hardware accelerator` to `GPU`.**
41+
The notebook `Transformer_Captioning.ipynb` will walk you through the implementation of a Transformer model and apply it to image captioning on COCO.
6642

67-
### Q3: Network Visualization: Saliency maps, Class Visualization, and Fooling Images (15 points)
43+
### Q3: Network Visualization: Saliency Maps, Class Visualization, and Fooling Images (15 points)
6844

6945
The notebook `Network_Visualization.ipynb` will introduce the pretrained SqueezeNet model, compute gradients with respect to images, and use them to produce saliency maps and fooling images.
7046

7147
### Q4: Generative Adversarial Networks (15 points)
7248

7349
In the notebook `Generative_Adversarial_Networks.ipynb` you will learn how to generate images that match a training dataset and use these models to improve classifier performance when training on a large amount of unlabeled data and a small amount of labeled data. **When first opening the notebook, go to `Runtime > Change runtime type` and set `Hardware accelerator` to `GPU`.**
7450

75-
### Q5: Self-Supervised Learning (20 points)
51+
### Q5: Self-Supervised Learning for Image Classification (20 points)
7652

77-
In the notebook `Self_Supervised_Learning.ipynb`, you will learn how to leverage self-supervised pretraining to obtain better performance on image classification task **When first opening the notebook, go to `Runtime > Change runtime type` and set `Hardware accelerator` to `GPU`.**
53+
In the notebook `Self_Supervised_Learning.ipynb`, you will learn how to leverage self-supervised pretraining to obtain better performance on image classification tasks. **When first opening the notebook, go to `Runtime > Change runtime type` and set `Hardware accelerator` to `GPU`.**
7854

79-
### Optional (Extra Credit): Image Captioning with LSTMs (5 points)
55+
### Extra Credit: Image Captioning with LSTMs (5 points)
8056

8157
The notebook `LSTM_Captioning.ipynb` will walk you through the implementation of Long-Short Term Memory (LSTM) RNNs and apply them to image captioning on COCO.
8258

83-
### Optional (Extra Credit): Style Transfer (5 points)
84-
85-
In the notebook `Style_Transfer.ipynb`, you will learn how to create images with the content of one image but the style of another.
86-
8759
### Submitting your work
8860

8961
**Important**. Please make sure that the submitted notebooks have been run and the cell outputs are visible.
@@ -94,13 +66,13 @@ Once you have completed all notebooks and filled out the necessary code, you nee
9466

9567
This notebook/script will:
9668

97-
* Generate a zip file of your code (`.py` and `.ipynb`) called `a3.zip`.
98-
* Convert all notebooks into a single PDF file.
69+
* Generate a zip file of your code (`.py` and `.ipynb`) called `a3_code_submission.zip`.
70+
* Convert all notebooks into a single PDF file called `a3_inline_submission.pdf`.
9971

10072
If your submission for this step was successful, you should see the following display message:
10173

102-
`### Done! Please submit a3.zip and the pdfs to Gradescope. ###`
74+
`### Done! Please submit a3_code_submission.zip and a3_inline_submission.pdf to Gradescope. ###`
10375

10476
**2.** Submit the PDF and the zip file to [Gradescope](https://www.gradescope.com/courses/257661).
10577

106-
Remember to download `a3.zip` and `assignment.pdf` locally before submitting to Gradescope.
78+
Remember to download `a3_code_submission.zip` and `a3_inline_submission.pdf` locally before submitting to Gradescope.

0 commit comments

Comments
 (0)
Please sign in to comment.