Machine Learning

Many strategies used in machine learning are explicitly designed to reduce the test error, possibly at the expense of increased training error. These strategies are collectively known as regularization. —Goodfellow, Bengio, and Courville (2016) In previous lessons, we discussed two…

Last week, we discussed Multi-class SVM loss; specifically, the hinge loss and squared hinge loss functions. A loss function, in the context of Machine Learning and Deep Learning, allows us to quantify how “good” or “bad” a given classification function…

A couple weeks ago,we discussed the concepts of both linear classification and parameterized learning. This type of learning allows us to take a set of input data and class labels, and actually learn a function that maps the input to…

In last week’s post, I introduced the k-NN machine learning algorithm which we then applied to the task of image classification. Using the k-NN algorithm, we obtained 57.58% classification accuracy on the Kaggle Dogs vs. Cats dataset challenge: The question…

Normally, I only publish blog posts on Monday, but I’m so excited about this one that it couldn’t wait and I decided to hit the publish button early. You see, just a few days ago, François Chollet pushed three Keras…

Now that we’ve had a taste of Deep Learning and Convolutional Neural Networks in last week’s blog post on LeNet, we’re going to take a step back and start to study machine learning in the context of image classification in…

Well. I’ll just come right out and say it. Today is my 27th birthday. As a kid I was always super excited about my birthday. It was another year closer to being able to drive a car. Go to R…

So in last week’s blog post we discovered how to construct an image pyramid. And in today’s article, we are going to extend that example and introduce the concept of a sliding window. Sliding windows play an integral role in…

It’s too damn cold up in Connecticut — so cold that I had to throw in the towel and escape for a bit. Last week I took a weekend trip down to Orlando, FL just to escape. And while the…