Neural Nets #1

By | 24th April 2017

Down the rabbit hole today: Looking at Comparisons between Hebbian and Oja models for Neural nets. I poked around in the world of conversion of categoric data (words) into numeric data, it seems that Markov chains lend themselves better to text analysis than neural networks. ┬áIt also strikes me that there is a lot of work still to be done around the neural weighting. It seems to me that there is a huge body of work still to be done around node responses and modelling. I also start feeling that TPM and GPU capabilities may need to be moved onto Hadoop and that JVMs should be supporting CUDA to allow for really large scale ‘nets.