JetBrains Academy logo
In-IDE learningJetBrains s.r.o.

Master AI: Build Game Players Using AlphaZero

This course is no longer available for new enrollments. Existing users can continue learning without any restrictions.

Skill levelAdvanced
Time to complete 60 hours

The latest version of the JetBrains Toolbox App is required.
If you don't have it, download it here.

Skill levelAdvanced
Time to complete 60 hours

About this course

AlphaZero, developed by DeepMind, is a pioneering AI system that has mastered games like Chess, Shogi, and Go through self-play and deep reinforcement learning.

In this course, you’ll learn how to apply the core principles behind AlphaZero to simpler board games, gaining insights that extend to a broad range of AI challenges.

You'll get hands-on experience building real AI models from scratch, utilizing powerful GPUs and cloud development environments.

Code editor icon

Remote development without the setup hassle

This course runs in a dedicated cloud environment, automatically set up with everything you need, including the latest IDE, course materials, and essential tools.

Content

1. Tic Tac Toe

Implement the Tic Tac Toe game logic to enable agents to learn how to play.

2. Monte Carlo Tree Search Algorithm

Implement the MCTS algorithm to estimate the best moves for game players.

3. ResNet Estimator

Build a neural network to predict the next player move and evaluate the current position.

4. Alpha Monte Carlo Tree Search

Combine the results of MCTS with the neural network training outcomes.

5. AlphaZero

Set up the game players to train by playing against each other.

6. Connect Four

Implement the Connect Four game interface and teach your game players how to play.

7. Dots And Boxes

Implement the Dots and Boxes game interface and teach your game players how to play. Experiment with the web interface to play against the models you have trained.

Prerequisite knowledge:

  1. Basic understanding of machine learning and deep learning concepts
  2. Familiarity with Python, NumPy and PyTorch
  3. Some experience with neural networks is recommended but not required

Learn directly inside your JetBrains IDEs

Real-world development environmentZoom
Real-world development environmentZoom
Real-world development environmentZoom
Real-world development environmentZoom
  • Real-world development environment

    Gain practical experience with the tools and workflows you'll use in your career, minimizing the learning curve when transitioning to real-world projects.

  • Project-based learning journey

    Our plugin is built to help you finish real-world coding projects, which you can display in your code portfolio after completion.

  • Collaboration via Git

    Effortlessly track changes and collaborate on projects using Git, an essential tool for programmers in every field.

  • Focused learning

    Enjoy fewer distractions with assignments, code, debugging, and version control all in one window.

Screen

Build a web interface

Design a simple web application to showcase your AI playing Dots and Boxes.

University

Master deep reinforcement learning

Discover the key concepts that empower AlphaZero to surpass human intelligence.

Game dev

Develop AI games

Build AI players for Tic Tac Toe, Connect Four, and Dots and Boxes, step by step.

Learn from industry experts

JetBrains Academy taps into the more than 20 years of experience behind JetBrains’ top developer tools, which are trusted by 90 Fortune Global Top 100 companies. Benefit from our expertise as the creators of the tools you’ll be using.

90+

courses

Learn from experts who have refined this course with university students.

15M+

developers use JetBrains products

Get the chance to learn in the tools that professionals use every day.

1M+

IT enthusiasts for you

Join the community of learners, share knowledge, and grow together.

Join a community of over a million learners and educators!

Joviane Bellegarde

Joviane Bellegarde

Java student

As someone transitioning into tech, I’ve learned more about Java and OOP concepts with JetBrains Academy and this has greatly helped me succeed in my classes! I wish I had known about it earlier – this is such a lifesaver.

Wojtek Ślusarczyk

Wojtek Ślusarczyk

Python student

When preparing for the technical interview, I decided to focus solely on JetBrains Academy. It had everything I needed to learn Python. I leveraged this knowledge to pass the job interview for a Software Tester position at Nokia.

Alexander Kulikov

Alexander Kulikov

Founder of the Computer Science Center

What I like about JetBrains Academy is that it allows students to get used to a professional programming environment (which they will definitely be using when they get a job) from the very beginning.

FAQ and troubleshooting

No, this course is no longer available for new enrollments. However, if you have already started or purchased the course, you can continue learning without any restrictions for six months from your start date.​
If you have already started or purchased the course, you have six months from the start date to complete it.
Yes, your progress is saved, and you can resume the course at any time from where you left off.
Please send us your questions using this form. To report bugs, use our issue tracker.