[Question] MXNet on Scala Spark and Maven Repository

[dnzprmksz]

Hello, MXNet newbie here 👋

I am trying to run a PoC with MXNet using Scala/Spark on AWS EMR, however I cannot find a way to import Spark integration under scala-package using the distribution on Maven Repository.

I searched it a lot on Google, but could not find any valuable information. I started to believe that I need to compile from source code with USE_DIST_KVSTORE=1 flag and add it to the project. But what is the reason that it is not available on Maven and is there any roadmap item to have it on Maven?

Thanks!

[haojin2]

@lanking520

[lanking520]

@dnzprmksz Currently, we do not publish the Spark packge to maven. You may need to build from source with Maven to use the Spark package.

[dnzprmksz]

I tried building from source before asking the question but took me many hours and could not build due to dependencies somehow. Any plan on roadmap to release it on maven?