Description
This is going to be a very ‘intellectual’ exercise to get you thinking about the lower-level mechanics of machine learning. Specifically, the excerpt from the Bishop book (attached PDF Download attached PDF) discusses issues around model selection and the “curse of dimensionality”.I will admit that it is a very academic piece, and you will have to slowly go through it, looking up terms along the way. However, I have done you a bit of a favor in highlighting the important parts, adding some simpler terms in parentheses, a few text changes, as well as adding an image at the end that helps you visualize what a ‘manifold’ is (and yes, the one in a car engine actually is named after this mathematical concept :)).All you have to do for this assignment is to write (type) in the text area at least four sentences, which, in your own words describe the concepts you learned from the book excerpt. Try to relate it to what you already know about how machine learning works. There’s not necessarily any right or wrong answers, but I’ll be able to tell if you put in more than 15 minutes by your response.Finally, I hope this will actually be the most (and perhaps last) highly academic exercise. It’s fundamental stuff, though, so we have to push through it.
