Attention Layer

Team,

Is there any example available in DL4J for Attention Layer (SelfAttentionLayer class)?

Regards

1 Like

I would also be very much interested in such an example.

1 Like

At the moment there are no examples that use it.

Would als be interested in seeing Attention NNs working with DL4J, especially given their recent popularity.