# Attention Layer

**URL:** <https://community.konduit.ai/t/attention-layer/469>\
**Category:** DL4J\
**Created:** [April 29, 2020, 8:27pm UTC](https://community.konduit.ai/t/attention-layer/469 "2020-04-29T20:27:47Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![tsharma82](https://avatars.discourse-cdn.com/v4/letter/t/a9adbd/32.png) [@tsharma82](https://community.konduit.ai/u/tsharma82)\
**Post date:** [April 29, 2020, 8:27pm UTC](https://community.konduit.ai/t/attention-layer/469/1 "2020-04-29T20:27:47Z")

</div>

Team,

Is there any example available in DL4J for Attention Layer (SelfAttentionLayer class)?

Regards

---

<div class="post-metadata">

**Author:** ![Foodyborris](https://avatars.discourse-cdn.com/v4/letter/f/9fc29f/32.png) [@Foodyborris](https://community.konduit.ai/u/Foodyborris)\
**Post date:** [April 30, 2020, 4:47pm UTC](https://community.konduit.ai/t/attention-layer/469/2 "2020-04-30T16:47:57Z")

</div>

I would also be very much interested in such an example.

---

<div class="post-metadata">

**Author:** ![treo](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/treo/32/47_2.png) [@treo](https://community.konduit.ai/u/treo)\
**Post date:** [April 30, 2020, 6:58pm UTC](https://community.konduit.ai/t/attention-layer/469/3 "2020-04-30T18:58:21Z")

</div>

At the moment there are no examples that use it.

---

<div class="post-metadata">

**Author:** ![sascha08-15](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/sascha08-15/32/230_2.png) [@sascha08-15](https://community.konduit.ai/u/sascha08-15)\
**Post date:** [June 26, 2020, 2:28pm UTC](https://community.konduit.ai/t/attention-layer/469/4 "2020-06-26T14:28:59Z")

</div>

Would als be interested in seeing Attention NNs working with DL4J, especially given their recent popularity.

---

<div class="post-metadata">

**Author:** ![kurt-o-sys](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/kurt-o-sys/32/413_2.png) [@kurt-o-sys](https://community.konduit.ai/u/kurt-o-sys)\
**Post date:** [December 27, 2020, 10:07am UTC](https://community.konduit.ai/t/attention-layer/469/5 "2020-12-27T10:07:57Z")

</div>

Yea, I’d like to see an example also, especially how to make the example of the paper ‘Attention is All You Need’. imo, it would be very to see how to implement this model: [https://ricardokleinklein.github.io/images/transformer/transformer.png](https://ricardokleinklein.github.io/images/transformer/transformer.png) .