The Basic Ideas in Neural Networks

Consider it Throwback Thursday but with all the interest in Machine Learning, its easy to forget that many of the core ideas, such as neural networks, have been around for a long time. We were lacking the computing power and large data sets that Moore’s Law and The Cloud™ has brought us.

Here is a very readable paper [PDF] from 1994 on neural networks from Rumelhart & Widrow at Stanford.

I have to admit that when I was first introduced to neural networks in 1990 as part of my Computer Science degree I found them only mildly interesting. I considered a lot of AI researchers to be eternal optimists. What I didn’t foresee of course (and I don’t think I was alone here) was the impact of the rise of the Internet and the resultant massive data sets that would be generated as a result.

Everything I need to know in life I learned from watching television.

Leave a comment

Please be polite. We appreciate that. Your email address will not be published and required fields are marked