0-1 Loss

A discrete loss function that is not convex or continuous

$$\{\begin{array}{ll}0,& ya>0\\ 1,& ya<0\end{array}$$

• Loss for a particular vector $x$
• If $y$ and $a$, the activation function are of the same sign