# Exception in thread "ADSI prefetch thread" Exception in thread "main" java.lang.RuntimeException: java.lang.IllegalArgumentException: Invalid indices: cannot get \[1,5\] from a \[20, 5\] NDArray **URL:** \ **Category:** DL4J\ **Created:** [September 21, 2020, 3:47pm UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874 "2020-09-21T15:47:45Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![SaviorD7](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@SaviorD7](https://community.konduit.ai/u/SaviorD7)\ **Post date:** [September 21, 2020, 3:47pm UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/1 "2020-09-21T15:47:46Z")
I have dataset with 7 columns of features and 1 label. Label is multy class: 1, 2 ,3 , 4 or 5 value. I uloaded dataset and set NN paramaters next: ```auto int seed = 123; double learningRate = 0.01; int batchSize = 20; int nEpochs = 7; int numInputs = 7; int numOutputs = 5; int numHiddenNodes = 20; //dataLocalPath = '' //Load the training data: RecordReader rr = new CSVRecordReader(); rr.initialize(new FileSplit(new File( "scs_TRAIN.csv"))); DataSetIterator trainIter = new RecordReaderDataSetIterator(rr, batchSize, 7,5); //Load the test/evaluation data: RecordReader rrTest = new CSVRecordReader(); rrTest.initialize(new FileSplit(new File("scs_TEST.csv"))); DataSetIterator testIter = new RecordReaderDataSetIterator(rrTest, batchSize, 7,5); MultiLayerConfiguration conf = new NeuralNetConfiguration.Builder() .seed(seed) .weightInit(WeightInit.XAVIER) .updater(new Nesterovs(learningRate, 0.9)) .list() .layer(new DenseLayer.Builder().nIn(numInputs).nOut(numHiddenNodes) .activation(Activation.RELU) .build()) .layer(new OutputLayer.Builder(LossFunction.NEGATIVELOGLIKELIHOOD) .activation(Activation.SOFTMAX) .nIn(numHiddenNodes).nOut(numOutputs).build()) .build(); ``` And after: ```auto o.d.o.l.ScoreIterationListener - Score at iteration 9200 is 0.00621582604944706 o.d.o.l.ScoreIterationListener - Score at iteration 9300 is 0.001661047525703907 ``` iterations I have this Error: ```auto Exception in thread "ADSI prefetch thread" Exception in thread "main" java.lang.RuntimeException: java.lang.IllegalArgumentException: Invalid indices: cannot get [1,5] from a [20, 5] NDArray at org.nd4j.linalg.dataset.AsyncDataSetIterator$AsyncPrefetchThread.run(AsyncDataSetIterator.java:437) Caused by: java.lang.IllegalArgumentException: Invalid indices: cannot get [1,5] from a [20, 5] NDArray at org.nd4j.linalg.api.shape.Shape.getOffsetUnsafe(Shape.java:1093) at org.nd4j.linalg.api.ndarray.BaseNDArray.putScalar(BaseNDArray.java:1421) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.convertWritablesBatched(RecordReaderMultiDataSetIterator.java:421) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.convertFeaturesOrLabels(RecordReaderMultiDataSetIterator.java:360) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.nextMultiDataSet(RecordReaderMultiDataSetIterator.java:333) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.next(RecordReaderMultiDataSetIterator.java:213) at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:378) at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:453) at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:85) at org.nd4j.linalg.dataset.AsyncDataSetIterator$AsyncPrefetchThread.run(AsyncDataSetIterator.java:411) java.lang.IllegalArgumentException: Invalid indices: cannot get [1,5] from a [20, 5] NDArray at org.nd4j.linalg.api.shape.Shape.getOffsetUnsafe(Shape.java:1093) at org.nd4j.linalg.api.ndarray.BaseNDArray.putScalar(BaseNDArray.java:1421) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.convertWritablesBatched(RecordReaderMultiDataSetIterator.java:421) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.convertFeaturesOrLabels(RecordReaderMultiDataSetIterator.java:360) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.nextMultiDataSet(RecordReaderMultiDataSetIterator.java:333) at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.next(RecordReaderMultiDataSetIterator.java:213) at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:378) at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:453) at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:85) at org.nd4j.linalg.dataset.AsyncDataSetIterator$AsyncPrefetchThread.run(AsyncDataSetIterator.java:411) Process finished with exit code 1 ``` What could be the reason of it ? Format of my dataset is: > ``` > time,gFx,gFy,gFz,wx,wy,wz,speed,label > 0.0,-0.2727,0.0442,0.9382,-0.0053,-0.0077,-0.0331,0.0,1.0 > 0.0100000070759929,-0.2727,0.0442,0.9382,-0.0053,-0.0077,-0.0331,0.0,1.0 > > ``` ---
**Author:** ![agibsonccc](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/agibsonccc/32/697_2.png) [@agibsonccc](https://community.konduit.ai/u/agibsonccc)\ **Post date:** [September 22, 2020, 11:32am UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/2 "2020-09-22T11:32:39Z")
Could you try using: [https://deeplearning4j.org/api/latest/org/deeplearning4j/datasets/iterator/AsyncShieldDataSetIterator.html](https://deeplearning4j.org/api/latest/org/deeplearning4j/datasets/iterator/AsyncShieldDataSetIterator.html) There might be a bug we’re not seeing with your environment. ---
**Author:** ![SaviorD7](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@SaviorD7](https://community.konduit.ai/u/SaviorD7)\ **Post date:** [September 22, 2020, 12:26pm UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/3 "2020-09-22T12:26:24Z")
I made next:\> > RecordReader rr = new CSVRecordReader(); > rr.initialize(new FileSplit(new File( “scs\_TRAIN.csv”))); > DataSetIterator trainIter = new RecordReaderDataSetIterator(rr, batchSize, 7,5); > DataSetIterator trainI = new AsyncShieldDataSetIterator(trainIter); > //Load the test/evaluation data: > RecordReader rrTest = new CSVRecordReader(); > rrTest.initialize(new FileSplit(new File(“scs\_TEST.csv”))); > DataSetIterator testIter = new RecordReaderDataSetIterator(rrTest, batchSize, 7,5); > DataSetIterator testI = new AsyncShieldDataSetIterator(testIter); And also have an error: > ``` > o.d.o.l.ScoreIterationListener - Score at iteration 9100 is 3.191389376297593E-4 > o.d.o.l.ScoreIterationListener - Score at iteration 9200 is 0.0023097645491361616 > o.d.o.l.ScoreIterationListener - Score at iteration 9300 is 9.434095583856106E-4 > Exception in thread "main" java.lang.IllegalArgumentException: Invalid indices: cannot get [1,5] from a [20, 5] NDArray > at org.nd4j.linalg.api.shape.Shape.getOffsetUnsafe(Shape.java:1093) > at org.nd4j.linalg.api.ndarray.BaseNDArray.putScalar(BaseNDArray.java:1421) > at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.convertWritablesBatched(RecordReaderMultiDataSetIterator.java:421) > at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.convertFeaturesOrLabels(RecordReaderMultiDataSetIterator.java:360) > at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.nextMultiDataSet(RecordReaderMultiDataSetIterator.java:333) > at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.next(RecordReaderMultiDataSetIterator.java:213) > at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:378) > at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:453) > at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:85) > at org.deeplearning4j.datasets.iterator.AsyncShieldDataSetIterator.next(AsyncShieldDataSetIterator.java:166) > at org.deeplearning4j.datasets.iterator.AsyncShieldDataSetIterator.next(AsyncShieldDataSetIterator.java:35) > at org.deeplearning4j.nn.multilayer.MultiLayerNetwork.fitHelper(MultiLayerNetwork.java:1684) > at org.deeplearning4j.nn.multilayer.MultiLayerNetwork.fit(MultiLayerNetwork.java:1636) > at org.deeplearning4j.nn.multilayer.MultiLayerNetwork.fit(MultiLayerNetwork.java:1623) > at org.deeplearning4j.examples.quickstart.modeling.feedforward.classification.scs.main(scs.java:104) > > Process finished with exit code 1 > > ``` ---
**Author:** ![agibsonccc](https://yyz1.discourse-cdn.com/flex035/user_avatar/community.konduit.ai/agibsonccc/32/697_2.png) [@agibsonccc](https://community.konduit.ai/u/agibsonccc)\ **Post date:** [September 22, 2020, 12:41pm UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/4 "2020-09-22T12:41:01Z")
Thanks a lot for confirming then. Could you give me something end to end reproducible to look at? ---
**Author:** ![SaviorD7](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@SaviorD7](https://community.konduit.ai/u/SaviorD7)\ **Post date:** [September 22, 2020, 1:38pm UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/5 "2020-09-22T13:38:03Z")
Do you need all code example ? Wait a second. ---
**Author:** ![SaviorD7](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@SaviorD7](https://community.konduit.ai/u/SaviorD7)\ **Post date:** [September 22, 2020, 1:45pm UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/6 "2020-09-22T13:45:20Z")
So, there is my java class: [package org.deeplearning4j.examples.quickstart.modeling.feedforward.classificati - Pastebin.com](https://pastebin.com/8fsMRpkW) ---
**Author:** ![SaviorD7](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@SaviorD7](https://community.konduit.ai/u/SaviorD7)\ **Post date:** [September 23, 2020, 7:25am UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/8 "2020-09-23T07:25:02Z")
Hope I found mistake. Will reply what the reason later. ---
**Author:** ![SaviorD7](https://avatars.discourse-cdn.com/v4/letter/s/5e9695/32.png) [@SaviorD7](https://community.konduit.ai/u/SaviorD7)\ **Post date:** [September 24, 2020, 3:06pm UTC](https://community.konduit.ai/t/exception-in-thread-adsi-prefetch-thread-exception-in-thread-main-java-lang-runtimeexception-java-lang-illegalargumentexception-invalid-indices-cannot-get-1-5-from-a-20-5-ndarray/874/9 "2020-09-24T15:06:43Z")
So, I just not sure that all my data is correctly. It has some broken data that is meaningless in training stage.