Mathematics in Deep Learning
Learn the mathematics behind deep learning, and see it work in code. This course holds the mathematical foundations of deep learning that are important to know. Every idea comes with exercises, so you do not only read the math, you use it. Tasks are quizzes, derivations and Python exercises with NumPy and PyTorch. You should know basic Python and the calculus from a first university year. Author: Mikhail Romanov, JetBrains. Found a bug or a typo, or have an idea for the course? Write to romanov.michael.v@gmail.com.
About
Content
- 1. Derivatives and Finite Differences
- 2. Derivatives Table
- 3. Deriving Derivatives lvl 1
- 4. Deriving Derivatives lvl 2
- 5. Deriving Derivatives lvl 3
- 6. Deriving Derivatives lvl 4
- 7. Derivatives Practice
- 8. Gradient Descent Practice
- 1. Matrices Manual Exercise
- 2. Matrix Product Quiz
- 3. Matrix Product Optimal Order
- 4. Matrix Product
- 5. Some Interesting Linear Transforms
- 1. Linearity of Expectation
- 2. Variance of Sum
- 3. Random Variables and Covariance
- 4. Discrete Probability Practice
- 5. Maximal Likelihood of Normal Distribution
- 6. Maximal Likelihood of Multivariate Normal Distribution
- 1. PyTorch Getting Started
- 2. Gradient Descent Practice
- 3. MSE Gradient for Linear Regression
- 4. Pseudo-inverse Matrix Derivation
- 5. Spectral Geometry of Linear Regression
- 6. Careful Analysis of Linear Regression
- 7. Understanding Backpropagation
- 8. Coding Backpropagation
- 9. Training a Simple Network
Contains certificate
Add it to your resume or LinkedIn profile so recruiters can easily see your achievement.
Learn with the tools developers use every day
What do you need to start?
Install the free JetBrains Toolbox App
The JetBrains Toolbox App 2.7+ makes setting up your course effortless. Already have a compatible IDE? It will launch it. If not, the app will install the right IDE for your course.
Learn more about our licenses here.

Confirm the course launch
Click Take course and then Allow to open the Toolbox App.
Select Always Allow to skip this confirmation in the future.
To return to the course later, find it in your IDE's recent projects.
Need more help? Check out our guide.


The JetBrains Toolbox App 2.7+ makes setting up your course effortless. Already have a compatible IDE? It will launch it. If not, the app will install the right IDE for your course.
Learn more about our licenses here.

Click Take course and then Allow to open the Toolbox App.
Select Always Allow to skip this confirmation in the future.
To return to the course later, find it in your IDE's recent projects.
Need more help? Check out our guide.

FAQ and troubleshooting
Yes, you will need the JetBrains Toolbox App and a JetBrains IDE.
Just click this link to install the JetBrains Toolbox App. We've taken care of all the necessary settings, and the app will handle the rest of the setup for you.
The JetBrains Toolbox App checks which IDE is compatible with your course and whether it is installed on your computer. If you have the necessary IDE installed, the app will open it. If not, JetBrains Toolbox will initiate the installation, prioritizing free community editions.
Yes, the JetBrains Toolbox App is essential, even if you already have a JetBrains IDE. It automatically prepares your IDE for studying by installing the required plugins and updating the IDE if necessary.
Please make sure you have the latest version of the JetBrains Toolbox App. To update, open the app and click Update Toolbox App, or download the latest version here.
If you’re using a Chrome-based browser, please also allow Find devices on local networks in the popup that appears on the course page. When this permission is granted, the page will detect when the Toolbox App opens on your system and you’ll be able to open the course properly.
Yes! It's 100% free and works with both the free and paid versions of JetBrains IDEs.
If you're a student, apply for the Student Pack to get full access to JetBrains IDEs for the duration of your studies. If not, check if you qualify for a free non-commercial license.



