Lecture 4. Introduction to Neueral Networks

data input , x

SVM loss

data loss + recgularization

Gradient descent

• Numerical graident
• Analytic gradient