I am getting the following org.nd4j.linalg.factory.Nd4jBackend$NoAvailableBackendException when launching an dl4j-examples with GPU:
o.n.l.f.Nd4jBackend - Skipped [JCublasBackend] backend (unavailable): java.lang.UnsatisfiedLinkError: /home/asad/.javacpp/cache/cuda-10.2-7.6-1.5.3-linux-x86_64.jar/org/bytedeco/cuda/linux-x86_64/libjnicudart.so: libcudart.so.10.2: cannot open shared object file: No such file or directory
Exception in thread “main” java.lang.ExceptionInInitializerError
at org.datavec.api.util.ndarray.RecordConverter.toMinibatchArray(RecordConverter.java:217)
at org.deeplearning4j.datasets.datavec.RecordReaderMultiDataSetIterator.next(RecordReaderMultiDataSetIterator.java:160)
at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:378)
at
org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:453)
at org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:85)
at org.deeplearning4j.examples.quickstart.modeling.feedforward.classification.IrisClassifier.main(IrisClassifier.java:74)
Caused by: java.lang.RuntimeException: org.nd4j.linalg.factory.Nd4jBackend$NoAvailableBackendException: Please ensure that you have an nd4j backend on your classpath. Please see: https://deeplearning4j.konduit.ai/nd4j/backend
at org.nd4j.linalg.factory.Nd4j.initContext(Nd4j.java:5094)
at org.nd4j.linalg.factory.Nd4j.(Nd4j.java:270)
… 6 more
Caused by: org.nd4j.linalg.factory.Nd4jBackend$NoAvailableBackendException: Please ensure that you have an nd4j backend on your classpath. Please see: https://deeplearning4j.konduit.ai/nd4j/backend
at org.nd4j.linalg.factory.Nd4jBackend.load(Nd4jBackend.java:221)
at org.nd4j.linalg.factory.Nd4j.initContext(Nd4j.java:5091)
… 7 more
I have install NVidia driver on ubuntu, but cuda version 11.2 instead of 10.2. I am afraid this is happening because of the cuda version.
So to fix the problem should I install 10.2 version or there are some other solutions?
saudet, thanks for your reply. I have added dependency as you said.
Now I am getting following error:
o.n.l.f.Nd4jBackend - Loaded [JCublasBackend] backend
o.n.n.NativeOpsHolder - Number of threads used for linear algebra: 32
o.n.l.a.o.e.DefaultOpExecutioner - Backend used: [CUDA]; OS: [Linux]
o.n.l.a.o.e.DefaultOpExecutioner - Cores: [10]; Memory: [17.5GB];
o.n.l.a.o.e.DefaultOpExecutioner - Blas vendor: [CUBLAS]
o.n.l.j.JCublasBackend - ND4J CUDA build version: 10.2.89
o.n.l.j.JCublasBackend - CUDA device 0: [GeForce GTX 660]; cc: [3.0]; Total memory: [3163815936]
o.d.n.g.ComputationGraph - Starting ComputationGraph with WorkspaceModes set to [training: ENABLED; inference: ENABLED], cacheMode set to [NONE]
o.d.n.l.c.ConvolutionLayer - Could not initialize CudnnConvolutionHelper
java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.deeplearning4j.nn.layers.convolution.ConvolutionLayer.initializeHelper(ConvolutionLayer.java:78)
Caused by: java.lang.UnsatisfiedLinkError: no jnicudnn in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1860)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:1631)
at org.bytedeco.javacpp.Loader.load(Loader.java:1265)
Caused by: java.lang.UnsatisfiedLinkError: /home/asad/.javacpp/cache/cuda-10.2-7.6-1.5.3-linux-x86_64.jar/org/bytedeco/cuda/linux-x86_64/libjnicudnn.so: libcudnn.so.7: cannot open shared object file: No such file or directory
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1934)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1817)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
o.d.n.l.c.s.SubsamplingLayer - Could not initialize CudnnSubsamplingHelper
I have installed cuDNN from developer.nvidia.com/rdp/cudnn-download libcudnn8_8.0.5.39-1+cuda10.2_amd64.deb, and libcudnn8-dev_8.0.5.39-1+cuda10.2_amd64.deb by dpkg -i … . But it doesn’t seems to be working.
libcudnn.so.7 is in the redist package too. Make sure that it’s actually on your class path. Also try to set the “org.bytedeco.javacpp.logger.debug” system property to “true” get more messages about what it’s trying to load.
o.d.e.a.m.c.MultiDigitNumberRecognition - /home/asad/Projects/deeplearning4j-examples/out/models/validateCodeCheckModel.json
Debug: Loading class org.bytedeco.javacpp.presets.javacpp
Debug: Loading class org.bytedeco.javacpp.Loader
Debug: Loading /home/asad/.javacpp/cache/javacpp-1.5.3-linux-x86_64.jar/org/bytedeco/javacpp/linux-x86_64/libjnijavacpp.so
Debug: Loading class org.bytedeco.javacpp.presets.javacpp
Debug: Loading class org.bytedeco.javacpp.Pointer
Debug: Loading class org.bytedeco.javacpp.presets.javacpp
Debug: Loading class org.bytedeco.cuda.global.cudart
Debug: Loading /usr/local/cuda-10.2/lib64/libcudart.so.10.2
Debug: Loading /home/asad/.javacpp/cache/cuda-10.2-7.6-1.5.3-linux-x86_64.jar/org/bytedeco/cuda/linux-x86_64/libjnicudart.so
Debug: Loading class org.bytedeco.javacpp.presets.javacpp
Debug: Loading class org.bytedeco.cuda.global.cudart
Debug: Loading class org.bytedeco.cuda.global.cublas
Debug: Loading class org.bytedeco.javacpp.presets.javacpp
Debug: Loading class org.bytedeco.cuda.global.cudart
Debug: Loading class org.bytedeco.cuda.global.cublas
Debug: Loading library cublasLt
Debug: Failed to load for cublasLt@.10: java.lang.UnsatisfiedLinkError: no cublasLt in java.library.path
Debug: Loading library cublas
Debug: Failed to load for cublas@.10: java.lang.UnsatisfiedLinkError: no cublas in java.library.path
Debug: Loading /home/asad/.javacpp/cache/cuda-10.2-7.6-1.5.3-linux-x86_64.jar/org/bytedeco/cuda/linux-x86_64/libjnicublas.so
Debug: Loading library cublasLt
Debug: Failed to load for cublasLt@.10: java.lang.UnsatisfiedLinkError: no cublasLt in java.library.path
Debug: Loading library cublas
Debug: Failed to load for cublas@.10: java.lang.UnsatisfiedLinkError: no cublas in java.library.path
o.n.l.f.Nd4jBackend - Loaded [JCublasBackend] backend
Debug: Loading class org.nd4j.nativeblas.Nd4jCuda
Debug: Loading library cublasLt
Debug: Failed to load for cublasLt@.10: java.lang.UnsatisfiedLinkError: no cublasLt in java.library.path
Debug: Loading library cublas
Debug: Failed to load for cublas@.10: java.lang.UnsatisfiedLinkError: no cublas in java.library.path
Debug: Loading library cusolver
Debug: Failed to load for cusolver@.10: java.lang.UnsatisfiedLinkError: no cusolver in java.library.path
Debug: Loading library cusparse
Debug: Failed to load for cusparse@.10: java.lang.UnsatisfiedLinkError: no cusparse in java.library.path
Debug: Loading library cudnn
Debug: Failed to load for cudnn@.7: java.lang.UnsatisfiedLinkError: no cudnn in java.library.path
Debug: Loading /home/asad/.javacpp/cache/nd4j-cuda-10.2-1.0.0-beta7-linux-x86_64.jar/org/nd4j/nativeblas/linux-x86_64/libgomp.so.1
Debug: Loading /home/asad/.javacpp/cache/nd4j-cuda-10.2-1.0.0-beta7-linux-x86_64.jar/org/nd4j/nativeblas/linux-x86_64/libnd4jcuda.so
Debug: Loading /home/asad/.javacpp/cache/nd4j-cuda-10.2-1.0.0-beta7-linux-x86_64.jar/org/nd4j/nativeblas/linux-x86_64/libjnind4jcuda.so
o.n.n.NativeOpsHolder - Number of threads used for linear algebra: 32
Debug: Loading class org.bytedeco.javacpp.presets.javacpp
Debug: Loading class org.bytedeco.javacpp.PointerPointer
Debug: Registering org.bytedeco.javacpp.PointerPointer[address=0x7f9cedceff60,position=0,limit=13,capacity=13,deallocator=org.bytedeco.javacpp.Pointer$NativeDeallocator[ownerAddress=0x7f9cedceff60,deallocatorAddress=0x7f9d9c4d7500]]
Debug: Loading class org.nd4j.nativeblas.Nd4jCuda
Debug: Loading class org.nd4j.nativeblas.Nd4jCuda$Environment
Debug: Loading library cublasLt
o.n.l.a.o.e.DefaultOpExecutioner - Backend used: [CUDA]; OS: [Linux]
o.n.l.a.o.e.DefaultOpExecutioner - Cores: [10]; Memory: [17.5GB];
o.n.l.a.o.e.DefaultOpExecutioner - Blas vendor: [CUBLAS]
Debug: Failed to load for cublasLt@.10: java.lang.UnsatisfiedLinkError: no cublasLt in java.library.path
Debug: Loading library cublas
Debug: Failed to load for cublas@.10: java.lang.UnsatisfiedLinkError: no cublas in java.library.path
Debug: Loading library cusolver
Debug: Failed to load for cusolver@.10: java.lang.UnsatisfiedLinkError: no cusolver in java.library.path
Debug: Loading library cusparse
ebug: Failed to load for cusparse@.10: java.lang.UnsatisfiedLinkError: no cusparse in java.library.path
Debug: Loading library cudnn
Debug: Failed to load for cudnn@.7: java.lang.UnsatisfiedLinkError: no cudnn in java.library.path
o.n.l.j.JCublasBackend - ND4J CUDA build version: 10.2.89
o.n.l.j.JCublasBackend - CUDA device 0: [GeForce GTX 660]; cc: [3.0]; Total memory: [3163815936]
o.d.n.g.ComputationGraph - Starting ComputationGraph with WorkspaceModes set to [training: ENABLED; inference: ENABLED], cacheMode set to [NONE]
Debug: Loading class org.bytedeco.javacpp.presets.javacpp
Debug: Loading class org.bytedeco.javacpp.LongPointer
Debug: Registering org.bytedeco.javacpp.LongPointer[address=0x7f9cd6d38690,position=0,limit=2,capacity=2,deallocator=org.bytedeco.javacpp.Pointer$NativeDeallocator[ownerAddress=0x7f9cd6d38690,deallocatorAddress=0x7f9d9c4d7460]]