I made a TrainingListener with a JavaFX UI. Like UIServer, it shows score, gradients, activations, weights, and log mean ratios of updates to parameters, per layer.
It has an associated LearningSchedule which you can control from the UI. You can adjust the LearningRate, as well as the decay factor of the learning rate. It’s nice to see the ratios change when you do that.
If I knew an easy way to adjust L2 or WeightDecay, I’d control them from the UI too.
I use StatsStorage to get the ratios of updates to parameters. Is there an cheaper way to get them? Can I get them directly from the Model?
The score chart uses JavaFX LineChart, so it has built-in functionality and prettiness.
I’ll push a branch if you want.