Gradient of quadratic form




     

See wiki: Definite matrix (Extension for non‐Hermitian square ma‐
trices)

For symmetric M, the gradient of xTAx becomes 2Ax.

Almost exactly the same as the derivative of xˆ2.