User:Foxnhound33/Books/General Optimization for Machine Learning

Inclusive Across Fields

 * Constraint Optimization
 * Linear programming
 * Quadratic programming
 * Interior point method


 * Smooth Optimization with a Cost Function
 * Gradient
 * Gradient descent
 * Lagrange multiplier
 * Regularization (mathematics)


 * Advanced Smooth Methods for Reducing Speed of Convergence
 * Stochastic gradient descent
 * Online machine learning