@kgoderis if you want to do anything custom you’d usually want to do that with the samediff api and implement it as a SameDiffLayer if you want to use the older dl4j api. If there’s “new network k + 1” including activation functions usually building blocks should be available for that.