Consider it Throwback Thursday but with all the interest in Machine Learning, its easy to forget that many of the core ideas, such as neural networks, have been around for a long time. We were lacking the computing power and large data sets that Moore’s Law and The Cloud™ has brought us.
Here is a very readable paper [PDF] from 1994 on neural networks from Rumelhart & Widrow at Stanford.
I have to admit that when I was first introduced to neural networks in 1990 as part of my Computer Science degree I found them only mildly interesting. I considered a lot of AI researchers to be eternal optimists. What I didn’t foresee of course (and I don’t think I was alone here) was the impact of the rise of the Internet and the resultant massive data sets that would be generated as a result.