Welcome to the 🤗 Deep Reinforcement Learning Course

Welcome to the most fascinating topic in Artificial Intelligence: Deep Reinforcement Learning.

This course will teach you about Deep Reinforcement Learning from beginner to expert. It’s completely free and open-source!

In this introduction unit you’ll:

Learn more about the course content.
Define the path you’re going to take (either self-audit or certification process).
Learn more about the AI vs. AI challenges you’re going to participate in.
Learn more about us.
Create your Model Database account (it’s free).
Sign-up to our Discord server, the place where you can chat with your classmates and us (the Model Database team).

Let’s get started!

What to expect?

In this course, you will:

📖 Study Deep Reinforcement Learning in theory and practice.
🧑‍💻 Learn to use famous Deep RL libraries such as Stable Baselines3, RL Baselines3 Zoo, Sample Factory and CleanRL.
🤖 Train agents in unique environments such as SnowballFight, Huggy the Doggo 🐶, VizDoom (Doom) and classical ones such as Space Invaders, PyBullet and more.
💾 Share your trained agents with one line of code to the Hub and also download powerful agents from the community.
🏆 Participate in challenges where you will evaluate your agents against other teams. You’ll also get to play against the agents you’ll train.
🎓 Earn a certificate of completion by completing 80% of the assignments.

And more!

At the end of this course, you’ll get a solid foundation from the basics to the SOTA (state-of-the-art) of methods.

Don’t forget to sign up to the course (we are collecting your email to be able to send you the links when each Unit is published and give you information about the challenges and updates).

What does the course look like?

The course is composed of:

A theory part: where you learn a concept in theory.
A hands-on: where you’ll learn to use famous Deep RL libraries to train your agents in unique environments. These hands-on will be Google Colab notebooks with companion tutorial videos if you prefer learning with video format!
Challenges: you’ll get to put your agent to compete against other agents in different challenges. There will also be a leaderboard for you to compare the agents’ performance.

What's the syllabus?

This is the course’s syllabus:

Two paths: choose your own adventure

You can choose to follow this course either:

To get a certificate of completion: you need to complete 80% of the assignments.
To get a certificate of honors: you need to complete 100% of the assignments.
As a simple audit: you can participate in all challenges and do assignments if you want.

There’s no deadlines, the course is self-paced. Both paths are completely free. Whatever path you choose, we advise you to follow the recommended pace to enjoy the course and challenges with your fellow classmates.

You don’t need to tell us which path you choose. If you get more than 80% of the assignments done, you’ll get a certificate.

The Certification Process

The certification process is completely free:

To get a certificate of completion: you need to complete 80% of the assignments.
To get a certificate of honors: you need to complete 100% of the assignments.

Again, there’s no deadline since the course is self paced. But our advice is to follow the recommended pace section.

How to get most of the course?

To get most of the course, we have some advice:

Join study groups in Discord : studying in groups is always easier. To do that, you need to join our discord server. If you're new to Discord, no worries! We have some tools that will help you learn about it.
Do the quizzes and assignments: the best way to learn is to do and test yourself.
Define a schedule to stay in sync: you can use our recommended pace schedule below or create yours.

What tools do I need?

You need only 3 things:

A computer with an internet connection.
Google Colab (free version): most of our hands-on will use Google Colab, the free version is enough.
A Model Database Account: to push and load models. If you don’t have an account yet, you can create one here (it’s free).

What is the recommended pace?

Each chapter in this course is designed to be completed in 1 week, with approximately 3-4 hours of work per week. However, you can take as much time as necessary to complete the course. If you want to dive into a topic more in-depth, we’ll provide additional resources to help you achieve that.

Who are we

About the author:

Thomas Simonini is a Developer Advocate at Model Database 🤗 specializing in Deep Reinforcement Learning. He founded the Deep Reinforcement Learning Course in 2018, which became one of the most used courses in Deep RL.

About the team:

Omar Sanseviero is a Machine Learning Engineer at Model Database where he works in the intersection of ML, Community and Open Source. Previously, Omar worked as a Software Engineer at Google in the teams of Assistant and TensorFlow Graphics. He is from Peru and likes llamas 🦙.
Sayak Paul is a Developer Advocate Engineer at Model Database. He's interested in the area of representation learning (self-supervision, semi-supervision, model robustness). And he loves watching crime and action thrillers 🔪.

What are the challenges in this course?

In this new version of the course, you have two types of challenges:

A leaderboard to compare your agent’s performance to other classmates’.
AI vs. AI challenges where you can train your agent and compete against other classmates’ agents.

I found a bug, or I want to improve the course

Contributions are welcomed 🤗

If you found a bug 🐛 in a notebook, please open an issue and describe the problem.
If you want to improve the course, you can open a Pull Request.

I still have questions

Please ask your question in our discord server #rl-discussions.

Deep RL Course