Updating environment files

README.md

@@ -4,26 +4,30 @@ UvA Deep Learning Tutorials
 *Note: To look at the notebooks in a nicer format, visit our RTD website: https://uvadlc-notebooks.readthedocs.io/en/latest/*
 
 *Course website*: https://uvadlc.github.io/<br>
-*Course edition*: Fall 2020 (Oct. 26 - Dec. 14) - Being kept up to date</br>
+*Course edition*: Fall 2021 (Nov. 01 - Dec. 24) - Being kept up to date</br>
 *Recordings*: [YouTube Playlist](<https://www.youtube.com/playlist?list=PLdlPlO1QhMiAkedeu0aJixfkknLRxk1nA>)</br>
 *Author*: Phillip Lippe
 
 For this year's course edition, we created a series of Jupyter notebooks that are designed to help you understanding the "theory" from the lectures by seeing corresponding implementations. 
-We will visit various topics such as optimization techniques, graph neural networks, adversarial attacks and normalizing flows (for a full list, see below).
+We will visit various topics such as optimization techniques, transformers, graph neural networks, and more (for a full list, see below).
 The notebooks are there to help you understand the material and teach you details of the PyTorch framework, including PyTorch Lightning. 
 
-The notebooks are presented in the second hour of each lecture slot.
+The notebooks are presented in the first hour of every Thursday's tutorial session.
 During the tutorial sessions, we will present the content and explain the implementation of the notebooks.
-You can decide yourself rather you just want to look at the filled notebook, want to try it yourself, or code along during the practical session.
-We do not have any mandatory assignments on which you would be graded or similarly. 
+You can decide yourself whether you just want to look at the filled notebook, want to try it yourself, or code along during the practical session.
+The notebooks are not directly part of any mandatory assignments on which you would be graded or similarly. 
 However, we encourage you to get familiar with the notebooks and experiment or extend them yourself.
+Further, the content presented will be relevant for the graded assignment and exam.
+
+The tutorials have been integrated as official tutorials of PyTorch Lightning.
+Thus, you can also view them in [their documentation](https://pytorch-lightning.readthedocs.io/en/latest/).
 
 How to run the notebooks
 ------------------------
 
 On this website, you will find the notebooks exported into a HTML format so that you can read them from whatever device you prefer. However, we suggest that you also give them a try and run them yourself. There are three main ways of running the notebooks we recommend:
 
-- **Locally on CPU**: All notebooks are stored on the github repository that also builds this website. You can find them here: https://github.com/phlippe/uvadlc_notebooks/tree/master/docs/tutorial_notebooks. The notebooks are designed that you can execute them on common laptops without the necessity of a GPU. We provide pretrained models that are automatically downloaded when running the notebooks, or can manually be downloaoded from this [Google Drive](https://drive.google.com/drive/folders/1SevzqrkhHPAifKEHo-gi7J-dVxifvs4c?usp=sharing). The required disk space for the pretrained models and datasets is less than 1GB. To ensure that you have all the right python packages installed, we provide a conda environment in the [same repository](https://github.com/phlippe/uvadlc_notebooks/blob/master/dl2020_environment.yml). 
+- **Locally on CPU**: All notebooks are stored on the github repository that also builds this website. You can find them here: https://github.com/phlippe/uvadlc_notebooks/tree/master/docs/tutorial_notebooks. The notebooks are designed that you can execute them on common laptops without the necessity of a GPU. We provide pretrained models that are automatically downloaded when running the notebooks, or can manually be downloaoded from this [Google Drive](https://drive.google.com/drive/folders/1SevzqrkhHPAifKEHo-gi7J-dVxifvs4c?usp=sharing). The required disk space for the pretrained models and datasets is less than 1GB. To ensure that you have all the right python packages installed, we provide a conda environment in the [same repository](https://github.com/phlippe/uvadlc_notebooks/blob/master/) (choose the CPU or GPU version depending on your system). 
 
 - **Google Colab**: If you prefer to run the notebooks on a different platform than your own computer, or want to experiment with GPU support, we recommend using [Google Colab](https://colab.research.google.com/notebooks/intro.ipynb#recent=true). Each notebook on this documentation website has a badge with a link to open it on Google Colab. Remember to enable GPU support before running the notebook (`Runtime -> Change runtime type`). Each notebook can be executed independently, and doesn't require you to connect your Google Drive or similar. However, when closing the session, changes might be lost if you don't save it to your local computer or have copied the notebook to your Google Drive beforehand.
 
@@ -34,61 +38,22 @@ On this website, you will find the notebooks exported into a HTML format so that
 Tutorial-Lecture alignment
 --------------------------
 
-We will discuss 12 tutorials in the course, each focusing on a different aspect of Deep Learning. The tutorials are spread across lectures, and we tried to cover something from every area. You can align the tutorials with the lectures as follows:
-
-- Lecture 1: Introduction to Deep Learning
-
-   - Guide 1: Working with the Lisa cluster
-   - Tutorial 2: Introduction to PyTorch
-
-- Lecture 2: Modular Learning
-
-   - Tutorial 3: Activation functions
-
-- Lecture 3: Deep Learning Optimizations 
-
-   - Tutorial 4: Optimization and Initialization
-
-- Lecture 4: Convolutional Neural Networks
-- Lecture 5: Modern ConvNets
-
-   - Tutorial 5: Inception, ResNet and DenseNet
-
-- Lecture 6: Recurrent Neural Networks
-
-   - Tutorial 6: Transformers and Multi-Head Attention
-
-- Lecture 7: Graph Neural Networks
-
-   - Tutorial 7: Graph Neural Networks
-
-- Lecture 8: Deep Generative Models
-
-   - Tutorial 8: Deep Energy Models
-
-- Lecture 9: Deep Variational Inference
-
-   - Tutorial 9: Deep Autoencoders
-
-- Lecture 10: Generative Adversarial Networks
-
-   - Tutorial 10: Adversarial Attacks
-
-- Lecture 11: Advanced Generative Models
-
-   - Tutorial 11: Normalizing Flows
-   - Tutorial 12: Autoregressive Image Modeling
-
-- Lecture 12: Deep Stochastic Models
-
-- Lecture 13: Bayesian Deep Learning
-
-- Lecture 14: Deep Dynamics
-
-*Additional notebooks*:
-
+We will discuss 7 of the tutorials in the course, spread across lectures to cover something from every area. You can align the tutorials with the lectures based on their topics. The list of tutorials is:
+
+- Guide 1: Working with the Lisa cluster
+- Tutorial 2: Introduction to PyTorch
+- Tutorial 3: Activation functions
+- Tutorial 4: Optimization and Initialization
+- Tutorial 5: Inception, ResNet and DenseNet
+- Tutorial 6: Transformers and Multi-Head Attention
+- Tutorial 7: Graph Neural Networks
+- Tutorial 8: Deep Energy Models
+- Tutorial 9: Autoencoders
+- Tutorial 10: Adversarial attacks 
+- Tutorial 11: Normalizing Flows on image modeling
+- Tutorial 12: Autoregressive Image Modeling
 - Tutorial 15: Vision Transformers
-- Tutorial 16: Meta-Learning - Learning to Learn
+- Tutorial 16: Meta Learning - Learning to Learn
 - Tutorial 17: Self-Supervised Contrastive Learning with SimCLR
 
 

dl2021_cpu.yml

@@ -0,0 +1,18 @@
+name: dl2021
+channels:
+  - pytorch
+  - conda-forge
+  - defaults
+dependencies:
+  - python=3.9.7
+  - pip=21.2.4
+  - cpuonly=2.0
+  - pytorch=1.10.0
+  - torchvision=0.11.1
+  - torchaudio=0.10.0
+  - pip:
+    - pytorch-lightning==1.4.9
+    - tensorboard==2.7.0
+    - tabulate==0.8.9
+    - tqdm==4.62.3
+    - pillow==8.0.1

dl2021_gpu.yml

@@ -0,0 +1,18 @@
+name: dl2021
+channels:
+  - pytorch
+  - conda-forge
+  - defaults
+dependencies:
+  - python=3.9.7
+  - pip=21.2.4
+  - cudatoolkit=11.3.1
+  - pytorch=1.10.0
+  - torchvision=0.11.1
+  - torchaudio=0.10.0
+  - pip:
+    - pytorch-lightning==1.4.9
+    - tensorboard==2.7.0
+    - tabulate==0.8.9
+    - tqdm==4.62.3
+    - pillow==8.0.1