spark: error when submitting new script action

I followed the tutorial and instructions in .NET for Apache Spark 101 and .NET for Apache Spark-hdinsight-deployment to deploy a app on HDInsight. But when submmitting script action, it installed failed with the following information:

"error_log": "/var/lib/ambari-agent/data/errors-895.txt",

and

"error_log": "/var/lib/ambari-agent/data/errors-896.txt",

I followed the option selection in the tutorial, and meet with failure. Is there anything I missed or did wrong? If it is, how could I fix this issue.

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 15 (4 by maintainers)

Most upvoted comments

@imback82 @elvaliuliuliu Thanks a lot, I have found the reason. The parameters for script action is wrong. I directly use the copy of the uri of Microsoft.Spark.Worker.netcoreapp3.1.linux-x64-0.10.0.tar.gz from the property of it in azure storage explorer. But the right format is wasbs://containername@… After changing this, it worked!

yuejli on Apr 12, 2020

Can you follow instruction in #470? I think the install script is out of date and @Niharikadutta is planning to update it asap.

imback82 on Apr 12, 2020