About this course
AlphaZero, developed by DeepMind, is a pioneering AI system that has mastered games like Chess, Shogi, and Go through self-play and deep reinforcement learning.
In this course, you’ll learn how to apply the core principles behind AlphaZero to simpler board games, gaining insights that extend to a broad range of AI challenges.
You'll get hands-on experience building real AI models from scratch, utilizing powerful GPUs and cloud development environments.
Remote development without the setup hassle
This course runs in a dedicated cloud environment, automatically set up with everything you need, including the latest IDE, course materials, and essential tools.
Content
1. Tic Tac Toe
Implement the Tic Tac Toe game logic to enable agents to learn how to play.
2. Monte Carlo Tree Search Algorithm
Implement the MCTS algorithm to estimate the best moves for game players.
3. ResNet Estimator
Build a neural network to predict the next player move and evaluate the current position.
4. Alpha Monte Carlo Tree Search
Combine the results of MCTS with the neural network training outcomes.
5. AlphaZero
Set up the game players to train by playing against each other.
6. Connect Four
Implement the Connect Four game interface and teach your game players how to play.
7. Dots And Boxes
Implement the Dots and Boxes game interface and teach your game players how to play. Experiment with the web interface to play against the models you have trained.
Prerequisite knowledge:
- Basic understanding of machine learning and deep learning concepts
- Familiarity with Python, NumPy and PyTorch
- Some experience with neural networks is recommended but not required
Learn directly inside your JetBrains IDEs
Zoom
Zoom
Zoom
Zoom
Build a web interface
Design a simple web application to showcase your AI playing Dots and Boxes.
Master deep reinforcement learning
Discover the key concepts that empower AlphaZero to surpass human intelligence.
Develop AI games
Build AI players for Tic Tac Toe, Connect Four, and Dots and Boxes, step by step.
Learn from industry experts
JetBrains Academy taps into the more than 20 years of experience behind JetBrains’ top developer tools, which are trusted by 90 Fortune Global Top 100 companies. Benefit from our expertise as the creators of the tools you’ll be using.
90+
courses
Learn from experts who have refined this course with university students.
15M+
developers use JetBrains products
Get the chance to learn in the tools that professionals use every day.
1M+
IT enthusiasts for you
Join the community of learners, share knowledge, and grow together.
Join a community of over a million learners and educators!
Joviane Bellegarde
Java student
As someone transitioning into tech, I’ve learned more about Java and OOP concepts with JetBrains Academy and this has greatly helped me succeed in my classes! I wish I had known about it earlier – this is such a lifesaver.
Wojtek Ślusarczyk
Python student
When preparing for the technical interview, I decided to focus solely on JetBrains Academy. It had everything I needed to learn Python. I leveraged this knowledge to pass the job interview for a Software Tester position at Nokia.
Alexander Kulikov
Founder of the Computer Science Center
What I like about JetBrains Academy is that it allows students to get used to a professional programming environment (which they will definitely be using when they get a job) from the very beginning.
FAQ and troubleshooting
The only thing you need is to install a JetBrains Toolbox App.
Once you press the button to start the course, allow the Toolbox App to open, and it will handle the rest of the setup for you. We've already taken care of all the necessary settings, remote development environment installations, and IDE licenses.
As this course is built on accessing cloud development environments and utilizing remote development tools effectively, you will need:
- A strong and stable internet connection: at least 20 Mbps bandwidth and no more than 200 ms latency.
- The latest JetBrains Toolbox application: check its system requirements here.
- The latest versions of Windows, macOS, or Linux. We recommend 8 GB of total system RAM and at least 5 GB of free disk space for remote development to operate smoothly with the JetBrains Client.
Make sure you have installed the latest available Toolbox version. To update the existing app, go to Toolbox App menu (gear icon) | Check for updates | Install or download and install the latest version from scratch here.
If you’ve done the above but the issue persists, please let us know by submitting this form or creating a report in our issue tracker.
There’s no need to worry when you see this window! Since the course requires access to IDE features, we’ve assigned an IDE license to your account. This window is part of the setup process.
If you already have other licenses attached to your JetBrains account, you’ll be prompted to select the one you’d like to use for the course. Make sure to choose the license we provided specifically for this course.
Once you click Launch, follow these steps:
- Select Activate Paid License on the first screen.
- Choose Activate with JetBrains Account.
- Select the Evaluation purpose only license option issued to your personal account for this course.