# TinyYolo training goes into NaN with CPU Backend

**URL:** <https://community.konduit.ai/t/tinyyolo-training-goes-into-nan-with-cpu-backend/372>\
**Category:** DL4J\
**Created:** [April 3, 2020, 6:58pm UTC](https://community.konduit.ai/t/tinyyolo-training-goes-into-nan-with-cpu-backend/372 "2020-04-03T18:58:00Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![treo](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/treo/32/47_2.png) [@treo](https://community.konduit.ai/u/treo)\
**Post date:** [April 5, 2020, 10:16am UTC](https://community.konduit.ai/t/tinyyolo-training-goes-into-nan-with-cpu-backend/372/2 "2020-04-05T10:16:28Z")

</div>

> [@TinyYOLO training goes into NaN with cuDNN](https://community.konduit.ai/t/tinyyolo-training-goes-into-nan-with-cudnn/185/18):
>
> I have checkout the snapshot version of dl4j, but now my IDE wants to checkout 1G all day, can I fix the SNAPSHOT to a specific day

You can remove the snapshot repository from your pom.xml again, and then it will use what is cached in your local maven repository.

> [@thhart](#):
>
> It is only a feeling but I think it is not related to cuDNN in general but more deeply in the computational layers of Yolo, it rather looks to CPU computation bugs to me but this is a wild guess.

At the moment we’ve only been able to reproduce this with cuDNN, so we have to assume that it is because of that. Numerical overflow/underflow issues do happen given specific hardware implementations. For, example on hardware ARM systems we sometimes run into those issues as well, while with a virtualized ARM system we don’t get those problems.

Our yolo implementation appears to work fine in our test cases, so we have to assume that it is working as intended on CPU. Hunting a bug that is hard to pinpoint requires a lot of resources, and we are still limited on that.

If you want to help with that, we will answer any questions that come up, but unless we have a better way to pin point the issue, we will have to prioritize the bugs that we have already confirmed to be fixable from our side.

---

_[View the full topic](https://community.konduit.ai/t/tinyyolo-training-goes-into-nan-with-cpu-backend/372)._
