Is there anyway to create self organising maps in dl4j ?

# Self organising maps

There is no out of the box support for self organizing maps in DL4J.

Even though they are often considered to be a type of neural network, the way that they actually work and are trained is very different from how a classical neural network is trained.

If you want to implement them yourself, you might still be interested in using ND4J for it.

This is a very useful book for such things:

https://archive.org/details/SelfOrganizationAndAssociativeMemory/mode/2up

It is also one of the few places I’ve seen any discussion of the error correction effects of the weighted sum when used as a recall device. The variance equation for linear combinations of random variables also tells you that and the central limit theorem. Overparameterization then can lead to error correction instead of overfitting as an example consequence.

Basically mild hashing before the weighted sum, together with some training algorithm allows it to act as a general associative memory.

And so what?

Well it seems to me that would make a nice sort of memory for a Neural Turing Machine, that is a neural network with an external memory bank.