Using ML models with Amazon EMR

DL4J
20

@agibsonccc I am using SBT and my machine is Linux.
This is my build.sbt :

import scala.collection.immutable.Seq

ThisBuild / version := "0.1.0-SNAPSHOT"

ThisBuild / scalaVersion := "2.13.13"

libraryDependencies ++= Seq(
  "org.deeplearning4j" % "deeplearning4j-core" % "1.0.0-M2.1",
  "org.deeplearning4j" % "deeplearning4j-modelimport" % "1.0.0-M2.1",
  "org.nd4j" % "nd4j-backends" % "1.0.0-M2.1" % "pom",
  "org.bytedeco" % "hdf5" % "1.12.1-1.5.7",
  "org.bytedeco" % "hdf5-platform" % "1.12.1-1.5.7",
  "org.deeplearning4j" % "deeplearning4j-nn" % "1.0.0-M2.1",
  "org.nd4j" % "nd4j-native-platform" % "1.0.0-M2.1",
  //"org.nd4j" % "nd4j-native" % "1.0.0-M2.1"

)

Compile / mainClass  := Some("ten")
assembly / mainClass := Some("ten")

// removed code for discarding unwanted jars; refer u
assemblyMergeStrategy in assembly := {
  case PathList("META-INF", xs @ _*) => MergeStrategy.discard
  case x => MergeStrategy.first
}

lazy val root = (project in file("."))
  .settings(
    name := "untitled1"
  )

I have posted the remaining details here - Caused by: java.lang.RuntimeException: org.nd4j.linalg.factory.Nd4jBackend$NoAvailableBackendException: Please ensure that you have an nd4j backend on your classpath. Please see: https://deeplearning4j.konduit.ai/nd4j/backend