dolphinscheduler: [Bug] [Task Plugin] hive sql execute failed

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

I got the following error when using sql node to execute hive sql

[ERROR] 2021-11-29 04:56:17.926 org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[210] - task scheduler failure
java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.conf.Configuration
        at org.apache.dolphinscheduler.plugin.task.util.CommonUtils.loadKerberosConf(CommonUtils.java:84)
        at org.apache.dolphinscheduler.plugin.task.datasource.hive.HiveDatasourceProcessor.getConnection(HiveDatasourceProcessor.java:129)
        at org.apache.dolphinscheduler.plugin.task.datasource.DatasourceUtil.getConnection(DatasourceUtil.java:59)
        at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeFuncAndSql(SqlTask.java:184)
        at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.handle(SqlTask.java:155)
        at org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread.run(TaskExecuteThread.java:192)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

What you expected to happen

hive sql execute successfully.

How to reproduce

using sql node to execute hive sql.

Anything else

After copy lib/*.jar to lib/plugin/task/sql/,everything works fine.

Version

2.0.0

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Comments: 15 (13 by maintainers)

Most upvoted comments

@zhongjiajie It’s already fixed in 2.0.1-release.thanks.I will close it.