When you peek under the hood of a deep learning library, things will look pretty complex. That’s because they use a lot of abstractions to handle a wide variety of cases. But the core code of a Deep Learning library is actually not that complex at all. In fact, you’d...
[Read More]

## Learning by Gradient Descent

### Understanding gradient descent, momentum and learning

Gradient descent is perhaps the simplest learning optimization algorithm that
exists. In Deep Learning, it’s the foundational learning algorithm upon
which modern learning algorithms are developed.
[Read More]