Gradient Descent Introduction

Gradient descent is an optimization algorithm for finding the maximum/minimum of some function. It is an iterative approach where you are calculating the slope of a derivative function to move step wise to the maximum/minimum value. The slope on this example is at 2. By decreasing/increasing x step wise and comparing the result with the […]