Deep Learning, pt.1, Mathematics
Deep Learning course, part 1. This part of the course concentrates on the mathematical phenomena that occur in Neural Networks, both during training and inference. The main objective of this part is to demonstrate, how the training happens, and which mathematical concepts play an important role in it.
About
Content
- 1. Derivatives and Finite Differences
- 2. Derivatives Table
- 3. Deriving Derivatives lvl 1
- 4. Deriving Derivatives lvl 2
- 5. Deriving Derivatives lvl 3
- 6. Deriving Derivatives lvl 4
- 7. Derivatives Practice
- 11. Gradient Descent Practice
- 8. Gradient Descent
- 10. Rosenbrock Gradient Descent
- 9. Himmelblau Gradient Descent
- 1. Matrices Manual Exercise
- 2. Matrix Product Quiz
- 3. Matrix Product Optimal Order
- 4. Matrix Product
- 5. Some Interesting Linear Transforms
- 1. Linearity of Expectation
- 2. Variance of Sum
- 3. Random Variables and Covariance
- 4. Discrete Probability Practice
- 5. Maximal Likelihood of Normal Distribution
- 6. Maximal Likelihood of Multivariate Normal Distribution
- 1. PyTorch Getting Started
- 2. Gradient Descent Practice
- 3. MSE Gradient for Linear Regression
- 4. Pseudo-inverse Matrix Derivation
- 5. Spectral Geometry of Linear Regression
- 6. Careful Analysis of Linear Regression
- 7. Understanding Backpropagation
- 8. Coding Backpropagation
- 9. Training a Simple Network
Contains certificate
Add it to your resume or LinkedIn profile so recruiters can easily see your achievement.
Learn with the tools developers use every day
What do you need to start?
Install the free JetBrains Toolbox App
The JetBrains Toolbox App 2.7+ makes setting up your course effortless. Already have a compatible IDE? It will launch it. If not, the app will install the right IDE for your course.
Learn more about our licenses here.

Confirm the course launch
Click Take course and then Allow to open the Toolbox App.
Select Always Allow to skip this confirmation in the future.
To return to the course later, find it in your IDE's recent projects.
Need more help? Check out our guide.


The JetBrains Toolbox App 2.7+ makes setting up your course effortless. Already have a compatible IDE? It will launch it. If not, the app will install the right IDE for your course.
Learn more about our licenses here.

Click Take course and then Allow to open the Toolbox App.
Select Always Allow to skip this confirmation in the future.
To return to the course later, find it in your IDE's recent projects.
Need more help? Check out our guide.

FAQ and troubleshooting
Yes, you will need the JetBrains Toolbox App and a JetBrains IDE.
Just click this link to install the JetBrains Toolbox App. We've taken care of all the necessary settings, and the app will handle the rest of the setup for you.
The JetBrains Toolbox App checks which IDE is compatible with your course and whether it is installed on your computer. If you have the necessary IDE installed, the app will open it. If not, JetBrains Toolbox will initiate the installation, prioritizing free community editions.
Yes, the JetBrains Toolbox App is essential, even if you already have a JetBrains IDE. It automatically prepares your IDE for studying by installing the required plugins and updating the IDE if necessary.
Please make sure you have the latest version of the JetBrains Toolbox App. To update, open the app and click Update Toolbox App, or download the latest version here.
If you’re using a Chrome-based browser, please also allow Find devices on local networks in the popup that appears on the course page. When this permission is granted, the page will detect when the Toolbox App opens on your system and you’ll be able to open the course properly.
Yes! It's 100% free and works with both the free and paid versions of JetBrains IDEs.
If you're a student, apply for the Student Pack to get full access to JetBrains IDEs for the duration of your studies. If not, check if you qualify for a free non-commercial license.



