A detailed introduction — Deep reinforcement learning has got to be one of the coolest tools I have used as an engineer. …

The first step in learning how to make your AI teach itself — Tabulated reinforcement learning is the first algorithm in which you should learn if you want to master the art of getting your AI to teach itself in a developing, and constantly changing environment. In general, the main idea behind reinforcement learning is that you have an Agent, Environment, State, Actions…

The AI is unbeatable if it goes first — In this article, we will create two agents who play each other in tick tac toe until one has reached tic tac toe mastery. Writing a program that learns to play tic tac toe is a first step in learning how reinforcement learning works. For this project, I assume you…

Without the help of any machine learning libraries — If you have read the previous articles in this series (links at bottom of page), you should have built a DNN class completely from base principles. Let’s see if we can use this class to create a neural network that’s able to read handwritten digits. This is a classic example…

A fundamental example of the implementation of gradient descent — We have derived an algorithm on how to implement gradient descent here, but there are a lot of nuances when implementing this algorithm in code. If you try to tackle this algorithm with a huge project right out the gate, you will find that it is very difficult to keep…

Deep dive into the mathematics of the gradient descent algorithm. — This post derives the algorithm for implementing gradient descent. It is messy, ugly, and tedious! It is a fun exercise deriving it yourself, but in the end, it’s just identifying patterns. Don’t let this page make your head explode and make you give up on AI! Just knowing how to…

The intuition behind finding the weights of a neural network, with an example. — In this article, I will continue our discussion on artificial neural networks, and give an example of a very simple neural network written in python. The purpose of this series of articles I am writing is to give a full explanation of ANN’s from the ground up, with no hiding…

An intuitive introduction to artificial neural networks. — Neural networks have received a lot of hype in recent years, and for good reason. With a basic understanding of this deep learning theory, we can create technology that solves complex problems with human, and sometimes superhuman, capabilities. Whether it be advanced signal processing, object detection, intelligent decision making, or…