JetBrains Academy logo
In-IDE learningJetBrains s.r.o.

Master AI: Build Game Players Using AlphaZero

Create AI models from scratch

Skill levelAdvanced
Time to complete 60 hours

The latest version of the JetBrains Toolbox App is required.
If you don't have it, download it here.

Skill levelAdvanced
Time to complete 60 hours

About this course

AlphaZero, developed by DeepMind, is a pioneering AI system that has mastered games like Chess, Shogi, and Go through self-play and deep reinforcement learning.

In this course, you’ll learn how to apply the core principles behind AlphaZero to simpler board games, gaining insights that extend to a broad range of AI challenges.

You'll get hands-on experience building real AI models from scratch, utilizing powerful GPUs and cloud development environments.

Code editor icon

Remote development without the setup hassle

This course runs in a dedicated cloud environment, automatically set up with everything you need, including the latest IDE, course materials, and essential tools.

Content

1. Tic Tac Toe

Implement the Tic Tac Toe game logic to enable agents to learn how to play.

2. Monte Carlo Tree Search Algorithm

Implement the MCTS algorithm to estimate the best moves for game players.

3. ResNet Estimator

Build a neural network to predict the next player move and evaluate the current position.

4. Alpha Monte Carlo Tree Search

Combine the results of MCTS with the neural network training outcomes.

5. AlphaZero

Set up the game players to train by playing against each other.

6. Connect Four

Implement the Connect Four game interface and teach your game players how to play.

7. Dots And Boxes

Implement the Dots and Boxes game interface and teach your game players how to play. Experiment with the web interface to play against the models you have trained.

Prerequisite knowledge:

  1. Basic understanding of machine learning and deep learning concepts
  2. Familiarity with Python, NumPy and PyTorch
  3. Some experience with neural networks is recommended but not required

Learn directly inside your JetBrains IDEs

Real-world development environmentZoom
Real-world development environmentZoom
Real-world development environmentZoom
Real-world development environmentZoom
  • Real-world development environment

    Gain practical experience with the tools and workflows you'll use in your career, minimizing the learning curve when transitioning to real-world projects.

  • Project-based learning journey

    Our plugin is built to help you finish real-world coding projects, which you can display in your code portfolio after completion.

  • Collaboration via Git

    Effortlessly track changes and collaborate on projects using Git, an essential tool for programmers in every field.

  • Focused learning

    Enjoy fewer distractions with assignments, code, debugging, and version control all in one window.

Screen

Build a web interface

Design a simple web application to showcase your AI playing Dots and Boxes.

University

Master deep reinforcement learning

Discover the key concepts that empower AlphaZero to surpass human intelligence.

Game dev

Develop AI games

Build AI players for Tic Tac Toe, Connect Four, and Dots and Boxes, step by step.

Start your learning
journey

Full course access

Enjoy complete access to the course content for six months.

$ 50.00

The tax rate depends on your country tax rules, entered tax identification number (e.g. VAT ID), and selected purchase method.

Trial version

Get a feel for the course with access to the first three tasks.

Free

Learn from industry experts

JetBrains Academy taps into the more than 20 years of experience behind JetBrains’ top developer tools, which are trusted by 90 Fortune Global Top 100 companies. Benefit from our expertise as the creators of the tools you’ll be using.

90+

courses

Learn from experts who have refined this course with university students.

15M+

developers use JetBrains products

Get the chance to learn in the tools that professionals use every day.

1M+

IT enthusiasts for you

Join the community of learners, share knowledge, and grow together.

Join a community of over a million learners and educators!

Joviane Bellegarde

Joviane Bellegarde

Java student

As someone transitioning into tech, I’ve learned more about Java and OOP concepts with JetBrains Academy and this has greatly helped me succeed in my classes! I wish I had known about it earlier – this is such a lifesaver.

Wojtek Ślusarczyk

Wojtek Ślusarczyk

Python student

When preparing for the technical interview, I decided to focus solely on JetBrains Academy. It had everything I needed to learn Python. I leveraged this knowledge to pass the job interview for a Software Tester position at Nokia.

Alexander Kulikov

Alexander Kulikov

Founder of the Computer Science Center

What I like about JetBrains Academy is that it allows students to get used to a professional programming environment (which they will definitely be using when they get a job) from the very beginning.

FAQ and troubleshooting

As this course takes you through building real AI models from scratch, it requires significant computational power. That’s what we take care of for you – you’ll get access to our GPUs thanks to remote development technology. We also provide access to IDE features and handle the installation of the necessary libraries. All you need to do is ensure a stable internet connection and dive into working with AI.

The only thing you need is to install a JetBrains Toolbox App.

Once you press the button to start the course, allow the Toolbox App to open, and it will handle the rest of the setup for you. We've already taken care of all the necessary settings, remote development environment installations, and IDE licenses.

As this course is built on accessing cloud development environments and utilizing remote development tools effectively, you will need:

  1. A strong and stable internet connection: at least 20 Mbps bandwidth and no more than 200 ms latency.
  2. The latest JetBrains Toolbox application: check its system requirements here.
  3. The latest versions of Windows, macOS, or Linux. We recommend 8 GB of total system RAM and at least 5 GB of free disk space for remote development to operate smoothly with the JetBrains Client.
During the free trial, you’ll get access to three course tasks for six months. You can work through them at your own pace.
You have access for six months. After that, your solutions will be available locally, but you won't be able to use our GPUs for calculations.
Yes, you will be able to see them in the corresponding task.

Make sure you have installed the latest available Toolbox version. To update the existing app, go to Toolbox App menu (gear icon) | Check for updates | Install or download and install the latest version from scratch here.

If you’ve done the above but the issue persists, please let us know by submitting this form or creating a report in our issue tracker.

No, this course is not included in any other subscriptions. This course can only be purchased separately.

There’s no need to worry when you see this window! Since the course requires access to IDE features, we’ve assigned an IDE license to your account. This window is part of the setup process.

If you already have other licenses attached to your JetBrains account, you’ll be prompted to select the one you’d like to use for the course. Make sure to choose the license we provided specifically for this course.

Once you click Launch, follow these steps:

  1. Select Activate Paid License on the first screen.
  2. Choose Activate with JetBrains Account.
  3. Select the Evaluation purpose only license option issued to your personal account for this course.
Please email us your questions by submitting this form. To report bugs, you can use our issue tracker.