Descent method — Steepest descent and conjugate gradient in Python

Python implementation

Descent method — Steepest descent and conjugate gradient (math explained)

Let’s start with this equation and we want to solve for x:

The solution x the minimize the function below when A is symmetric positive definite (otherwise, x could be the maximum). It is because…