dolphinscheduler: [Bug] [Task Plugin] hive sql execute failed
Search before asking
- I had searched in the issues and found no similar issues.
What happened
I got the following error when using sql node to execute hive sql
[ERROR] 2021-11-29 04:56:17.926 org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[210] - task scheduler failure
java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.conf.Configuration
at org.apache.dolphinscheduler.plugin.task.util.CommonUtils.loadKerberosConf(CommonUtils.java:84)
at org.apache.dolphinscheduler.plugin.task.datasource.hive.HiveDatasourceProcessor.getConnection(HiveDatasourceProcessor.java:129)
at org.apache.dolphinscheduler.plugin.task.datasource.DatasourceUtil.getConnection(DatasourceUtil.java:59)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeFuncAndSql(SqlTask.java:184)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.handle(SqlTask.java:155)
at org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread.run(TaskExecuteThread.java:192)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
What you expected to happen
hive sql execute successfully.
How to reproduce
using sql node to execute hive sql.
Anything else
After copy lib/*.jar to lib/plugin/task/sql/,everything works fine.
Version
2.0.0
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project’s Code of Conduct
About this issue
- Original URL
- State: closed
- Created 5 years ago
- Comments: 15 (13 by maintainers)
@zhongjiajie It’s already fixed in 2.0.1-release.thanks.I will close it.