It is interesting to see how our understanding on Loss functions has changed in the last 40 years. We started with the least squared error under the Ridge regression:

\[\]