# Arbiter: Cannot perform evaluation with NaNs present in predictions

**URL:** https://community.konduit.ai/t/arbiter-cannot-perform-evaluation-with-nans-present-in-predictions/993
**Category:** DL4J
**Created:** [November 17, 2020, 6:27am UTC](https://community.konduit.ai/t/arbiter-cannot-perform-evaluation-with-nans-present-in-predictions/993 "2020-11-17T06:27:09Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![SidneyLann](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/sidneylann/32/367_2.png) [@SidneyLann](https://community.konduit.ai/u/SidneyLann)
#### Post date: [November 17, 2020, 6:27am UTC](https://community.konduit.ai/t/arbiter-cannot-perform-evaluation-with-nans-present-in-predictions/993/1 "2020-11-17T06:27:09Z")

</div>

arbiter trainning throw below exception in some epochs, but arbiter trainning can be done successfully. this exception is normal?

java.lang.IllegalStateException: Cannot perform evaluation with NaNs present in predictions: 24576 NaNs present in predictions INDArray  
at org.nd4j.common.base.Preconditions.throwStateEx(Preconditions.java:641)  
at org.nd4j.common.base.Preconditions.checkState(Preconditions.java:286)  
at org.nd4j.evaluation.classification.Evaluation.eval(Evaluation.java:403)  
at org.deeplearning4j.nn.graph.ComputationGraph.doEvaluationHelper(ComputationGraph.java:4192)  
at org.deeplearning4j.nn.graph.ComputationGraph.doEvaluationHelper(ComputationGraph.java:4131)  
at org.deeplearning4j.nn.graph.ComputationGraph.doEvaluation(ComputationGraph.java:4089)  
at org.deeplearning4j.nn.graph.ComputationGraph.evaluate(ComputationGraph.java:3938)  
at org.deeplearning4j.nn.graph.ComputationGraph.evaluate(ComputationGraph.java:3900)  
at org.deeplearning4j.nn.graph.ComputationGraph.evaluate(ComputationGraph.java:3878)  
at org.deeplearning4j.arbiter.scoring.impl.EvaluationScoreFunction.score(EvaluationScoreFunction.java:78)  
at org.deeplearning4j.arbiter.scoring.impl.BaseNetScoreFunction.score(BaseNetScoreFunction.java:79)  
at org.deeplearning4j.arbiter.scoring.impl.BaseNetScoreFunction.score(BaseNetScoreFunction.java:59)  
at org.deeplearning4j.arbiter.task.ComputationGraphTaskCreator$GraphLearningTask.callHelper(ComputationGraphTaskCreator.java:239)  
at org.deeplearning4j.arbiter.task.ComputationGraphTaskCreator$GraphLearningTask.call(ComputationGraphTaskCreator.java:133)  
at org.deeplearning4j.arbiter.task.ComputationGraphTaskCreator$GraphLearningTask.call(ComputationGraphTaskCreator.java:88)  
at org.nd4j.shade.guava.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)  
at org.nd4j.shade.guava.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:69)  
at org.nd4j.shade.guava.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)  
at java.lang.Thread.run(Thread.java:748)

---

<div class="post-metadata">

### Author: ![SidneyLann](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/sidneylann/32/367_2.png) [@SidneyLann](https://community.konduit.ai/u/SidneyLann)
#### Post date: [November 19, 2020, 6:47am UTC](https://community.konduit.ai/t/arbiter-cannot-perform-evaluation-with-nans-present-in-predictions/993/3 "2020-11-19T06:47:16Z")

</div>

Only tanh can be used for LSTM, Other activation function should cause above exception.

---

<div class="post-metadata">

### Author: ![agibsonccc](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/agibsonccc/32/697_2.png) [@agibsonccc](https://community.konduit.ai/u/agibsonccc)
#### Post date: [November 22, 2020, 4:25am UTC](https://community.konduit.ai/t/arbiter-cannot-perform-evaluation-with-nans-present-in-predictions/993/4 "2020-11-22T04:25:43Z")

</div>

@SidneyLann I’m not quite convinced it’s a simple “yes/no this is an absolute rule” you can use a a few different activation functions with LSTMs.

If you see NANs that’s generally just from an unstable network though. This has the same trade offs as training any neural network.

---

<div class="post-metadata">

### Author: ![SidneyLann](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/sidneylann/32/367_2.png) [@SidneyLann](https://community.konduit.ai/u/SidneyLann)
#### Post date: [November 22, 2020, 8:58am UTC](https://community.konduit.ai/t/arbiter-cannot-perform-evaluation-with-nans-present-in-predictions/993/5 "2020-11-22T08:58:50Z")

</div>

It has no error in trainning stage, just in validating stage has error.
