starrocks: Hudi exception reading data. com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null

Instructions Follow the Hudi Docker Quickstart. https://hudi.apache.org/docs/docker_demo

Modifed docker-compose_hadoop284_hive233_spark244_mac_aarch64.yml to include starrocks in the hudi docker compose. Also you need to apply https://github.com/apache/hudi/issues/8700 if they haven’t merged it in yet.

  starrocks:
    image: registry.starrocks.io/starrocks/allin1-ubuntu
    hostname: starrocks-fe
    container_name: allin1-ubuntu
    ports:
      - 8030:8030
      - 8040:8040
      - 9030:9030

Do all the steps in the hudi docker compose quickstart. When you can do a show tables with beehive, you know that tables are ready and SR should be able to connect.

login to the SR container within the hudi docker compose

mysql -P9030 -h127.0.0.1 -uroot --prompt="StarRocks > "

then execute the sql commands.

CREATE EXTERNAL CATALOG hudi_catalog_hms PROPERTIES (     "type" = "hudi",     "aws.s3.use_instance_profile" = "true",     "aws.s3.region" = "us-west-2",     "hive.metastore.uris" = "thrift://hivemetastore:9083" );
set catalog hudi_catalog_hms;
use default;
select count(*) from stock_ticks_cow;
2023-05-13 00:42:13,997 INFO (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [PlannerProfile.addCustomProperties():159] Background collect hive column statistics profile: [HMS.PARTITIONS.getPartitionsByNames.stock_ticks_cow:1 partitions]
2023-05-13 00:42:14,004 INFO (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [HiveMetaStoreThriftClient.open():450] Trying to connect to metastore with URI thrift://hivemetastore.hudi:9083
2023-05-13 00:42:14,005 INFO (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [HiveMetaStoreThriftClient.open():530] Opened a connection to metastore, current connections: 2
2023-05-13 00:42:14,005 INFO (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [HiveMetaStoreThriftClient.open():585] Connected to metastore.
2023-05-13 00:42:14,015 WARN (starrocks-mysql-nio-pool-2|161) [HiveMetaClient.getPartitionsByNames():233] Expect to fetch 1 partition on [default.stock_ticks_cow], but actually fetched 0 partition
2023-05-13 00:42:14,016 ERROR (starrocks-mysql-nio-pool-2|161) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.getPartitionByPartitionKeys(HiveMetastoreOperations.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.getEstimatedRowCount(HiveStatisticsProvider.java:148) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.getTableStatistics(HiveStatisticsProvider.java:101) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hudi.HudiMetadata.getTableStatistics(HudiMetadata.java:150) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.lambda$getTableStatistics$3(MetadataMgr.java:170) ~[starrocks-fe.jar:?]
at java.util.Optional.map(Optional.java:265) ~[?:?]
at com.starrocks.server.MetadataMgr.getTableStatistics(MetadataMgr.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.computeHMSTableScanNode(StatisticsCalculator.java:372) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:340) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:153) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.logical.LogicalHudiScanOperator.accept(LogicalHudiScanOperator.java:86) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.estimatorStats(StatisticsCalculator.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.DeriveStatsTask.execute(DeriveStatsTask.java:57) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.SeriallyTaskScheduler.executeTasks(SeriallyTaskScheduler.java:68) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.memoOptimize(Optimizer.java:456) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimizeByCost(Optimizer.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:109) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:140) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 42 more
2023-05-13 00:42:14,021 ERROR (starrocks-mysql-nio-pool-2|161) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.getPartitionByPartitionKeys(HiveMetastoreOperations.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.getEstimatedRowCount(HiveStatisticsProvider.java:148) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.getTableStatistics(HiveStatisticsProvider.java:101) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hudi.HudiMetadata.getTableStatistics(HudiMetadata.java:150) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.lambda$getTableStatistics$3(MetadataMgr.java:170) ~[starrocks-fe.jar:?]
at java.util.Optional.map(Optional.java:265) ~[?:?]
at com.starrocks.server.MetadataMgr.getTableStatistics(MetadataMgr.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.computeHMSTableScanNode(StatisticsCalculator.java:372) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:340) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:153) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.logical.LogicalHudiScanOperator.accept(LogicalHudiScanOperator.java:86) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.estimatorStats(StatisticsCalculator.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.DeriveStatsTask.execute(DeriveStatsTask.java:57) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.SeriallyTaskScheduler.executeTasks(SeriallyTaskScheduler.java:68) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.memoOptimize(Optimizer.java:456) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimizeByCost(Optimizer.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:109) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:140) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 33 more
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 33 more
2023-05-13 00:42:14,021 WARN (starrocks-mysql-nio-pool-2|161) [HudiMetadata.getTableStatistics():157] Failed to get table column statistics on [HudiTable{resourceName='hudi_catalog_hms', catalogName='hudi_catalog_hms', hiveDbName='default', hiveTableName='stock_ticks_cow', id=100000001, name='stock_ticks_cow', type=HUDI, createTime=1683938484}]. error : com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
2023-05-13 00:42:14,027 WARN (starrocks-mysql-nio-pool-2|161) [HiveMetaClient.getPartitionsByNames():233] Expect to fetch 1 partition on [default.stock_ticks_cow], but actually fetched 0 partition
2023-05-13 00:42:14,027 ERROR (starrocks-mysql-nio-pool-2|161) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.getPartitionByPartitionKeys(HiveMetastoreOperations.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.getEstimatedRowCount(HiveStatisticsProvider.java:148) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.createUnknownStatistics(HiveStatisticsProvider.java:185) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hudi.HudiMetadata.getTableStatistics(HudiMetadata.java:163) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.lambda$getTableStatistics$3(MetadataMgr.java:170) ~[starrocks-fe.jar:?]
at java.util.Optional.map(Optional.java:265) ~[?:?]
at com.starrocks.server.MetadataMgr.getTableStatistics(MetadataMgr.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.computeHMSTableScanNode(StatisticsCalculator.java:372) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:340) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:153) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.logical.LogicalHudiScanOperator.accept(LogicalHudiScanOperator.java:86) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.estimatorStats(StatisticsCalculator.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.DeriveStatsTask.execute(DeriveStatsTask.java:57) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.SeriallyTaskScheduler.executeTasks(SeriallyTaskScheduler.java:68) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.memoOptimize(Optimizer.java:456) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimizeByCost(Optimizer.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:109) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:140) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 42 more
2023-05-13 00:42:14,027 ERROR (starrocks-mysql-nio-pool-2|161) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.getPartitionByPartitionKeys(HiveMetastoreOperations.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.getEstimatedRowCount(HiveStatisticsProvider.java:148) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveStatisticsProvider.createUnknownStatistics(HiveStatisticsProvider.java:185) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hudi.HudiMetadata.getTableStatistics(HudiMetadata.java:163) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.lambda$getTableStatistics$3(MetadataMgr.java:170) ~[starrocks-fe.jar:?]
at java.util.Optional.map(Optional.java:265) ~[?:?]
at com.starrocks.server.MetadataMgr.getTableStatistics(MetadataMgr.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.computeHMSTableScanNode(StatisticsCalculator.java:372) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:340) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.visitLogicalHudiScan(StatisticsCalculator.java:153) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.logical.LogicalHudiScanOperator.accept(LogicalHudiScanOperator.java:86) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.statistics.StatisticsCalculator.estimatorStats(StatisticsCalculator.java:169) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.DeriveStatsTask.execute(DeriveStatsTask.java:57) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.task.SeriallyTaskScheduler.executeTasks(SeriallyTaskScheduler.java:68) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.memoOptimize(Optimizer.java:456) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimizeByCost(Optimizer.java:167) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.Optimizer.optimize(Optimizer.java:109) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:140) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 33 more
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 33 more
2023-05-13 00:42:14,027 WARN (starrocks-mysql-nio-pool-2|161) [HiveStatisticsProvider.createUnknownStatistics():187] Failed to estimate row count on table [HudiTable{resourceName='hudi_catalog_hms', catalogName='hudi_catalog_hms', hiveDbName='default', hiveTableName='stock_ticks_cow', id=100000001, name='stock_ticks_cow', type=HUDI, createTime=1683938484}]
2023-05-13 00:42:14,036 WARN (starrocks-mysql-nio-pool-2|161) [HiveMetaClient.getPartitionsByNames():233] Expect to fetch 1 partition on [default.stock_ticks_cow], but actually fetched 0 partition
2023-05-13 00:42:14,036 ERROR (starrocks-mysql-nio-pool-2|161) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.getPartitionByPartitionKeys(HiveMetastoreOperations.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hudi.HudiMetadata.getRemoteFileInfos(HudiMetadata.java:124) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.getRemoteFileInfos(MetadataMgr.java:183) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.getRemoteFileInfos(MetadataMgr.java:174) ~[starrocks-fe.jar:?]
at com.starrocks.connector.RemoteScanRangeLocations.setupScanRangeLocations(RemoteScanRangeLocations.java:174) ~[starrocks-fe.jar:?]
at com.starrocks.planner.HudiScanNode.setupScanRangeLocations(HudiScanNode.java:70) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:863) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:345) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.physical.PhysicalHudiScanOperator.accept(PhysicalHudiScanOperator.java:62) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visit(PlanFragmentBuilder.java:362) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.translate(PlanFragmentBuilder.java:356) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder.createPhysicalPlan(PlanFragmentBuilder.java:204) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:154) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 37 more
2023-05-13 00:42:14,037 ERROR (starrocks-mysql-nio-pool-2|161) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.getPartitionByPartitionKeys(HiveMetastoreOperations.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hudi.HudiMetadata.getRemoteFileInfos(HudiMetadata.java:124) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.getRemoteFileInfos(MetadataMgr.java:183) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.getRemoteFileInfos(MetadataMgr.java:174) ~[starrocks-fe.jar:?]
at com.starrocks.connector.RemoteScanRangeLocations.setupScanRangeLocations(RemoteScanRangeLocations.java:174) ~[starrocks-fe.jar:?]
at com.starrocks.planner.HudiScanNode.setupScanRangeLocations(HudiScanNode.java:70) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:863) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:345) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.physical.PhysicalHudiScanOperator.accept(PhysicalHudiScanOperator.java:62) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visit(PlanFragmentBuilder.java:362) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.translate(PlanFragmentBuilder.java:356) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder.createPhysicalPlan(PlanFragmentBuilder.java:204) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:154) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 28 more
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 28 more
2023-05-13 00:42:14,037 ERROR (starrocks-mysql-nio-pool-2|161) [MetadataMgr.getRemoteFileInfos():185] Failed to list remote file's metadata on catalog [hudi_catalog_hms], table [HudiTable{resourceName='hudi_catalog_hms', catalogName='hudi_catalog_hms', hiveDbName='default', hiveTableName='stock_ticks_cow', id=100000001, name='stock_ticks_cow', type=HUDI, createTime=1683938484}]
com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.getPartitionByPartitionKeys(HiveMetastoreOperations.java:73) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hudi.HudiMetadata.getRemoteFileInfos(HudiMetadata.java:124) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.getRemoteFileInfos(MetadataMgr.java:183) ~[starrocks-fe.jar:?]
at com.starrocks.server.MetadataMgr.getRemoteFileInfos(MetadataMgr.java:174) ~[starrocks-fe.jar:?]
at com.starrocks.connector.RemoteScanRangeLocations.setupScanRangeLocations(RemoteScanRangeLocations.java:174) ~[starrocks-fe.jar:?]
at com.starrocks.planner.HudiScanNode.setupScanRangeLocations(HudiScanNode.java:70) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:863) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:345) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.physical.PhysicalHudiScanOperator.accept(PhysicalHudiScanOperator.java:62) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visit(PlanFragmentBuilder.java:362) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.translate(PlanFragmentBuilder.java:356) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder.createPhysicalPlan(PlanFragmentBuilder.java:204) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:154) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 28 more
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionsByNames(CachingHiveMetastore.java:249) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsByNames(CachingHiveMetastore.java:261) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$000(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$1.loadAll(CachingHiveMetastore.java:137) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 28 more
2023-05-13 00:42:14,037 WARN (starrocks-mysql-nio-pool-2|161) [PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan():869] Hudi scan node get scan range locations failed : com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
2023-05-13 00:42:14,037 WARN (starrocks-mysql-nio-pool-2|161) [PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan():870] com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
2023-05-13 00:42:14,038 WARN (starrocks-mysql-nio-pool-2|161) [StmtExecutor.execute():411] New planner error: select * from stock_ticks_cow
com.starrocks.sql.common.StarRocksPlannerException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:871) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:345) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.physical.PhysicalHudiScanOperator.accept(PhysicalHudiScanOperator.java:62) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visit(PlanFragmentBuilder.java:362) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.translate(PlanFragmentBuilder.java:356) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder.createPhysicalPlan(PlanFragmentBuilder.java:204) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:154) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
2023-05-13 00:42:14,038 WARN (starrocks-mysql-nio-pool-2|161) [StmtExecutor.execute():558] execute Exception, sql select * from stock_ticks_cow
com.starrocks.sql.common.StarRocksPlannerException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:871) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visitPhysicalHudiScan(PlanFragmentBuilder.java:345) ~[starrocks-fe.jar:?]
at com.starrocks.sql.optimizer.operator.physical.PhysicalHudiScanOperator.accept(PhysicalHudiScanOperator.java:62) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.visit(PlanFragmentBuilder.java:362) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder$PhysicalPlanTranslator.translate(PlanFragmentBuilder.java:356) ~[starrocks-fe.jar:?]
at com.starrocks.sql.plan.PlanFragmentBuilder.createPhysicalPlan(PlanFragmentBuilder.java:204) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.createQueryPlan(StatementPlanner.java:154) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.planQuery(StatementPlanner.java:115) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:90) ~[starrocks-fe.jar:?]
at com.starrocks.sql.StatementPlanner.plan(StatementPlanner.java:55) ~[starrocks-fe.jar:?]
at com.starrocks.qe.StmtExecutor.execute(StmtExecutor.java:396) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:348) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.dispatch(ConnectProcessor.java:462) ~[starrocks-fe.jar:?]
at com.starrocks.qe.ConnectProcessor.processOnce(ConnectProcessor.java:728) ~[starrocks-fe.jar:?]
at com.starrocks.mysql.nio.ReadListener.lambda$handleEvent$0(ReadListener.java:69) ~[starrocks-fe.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
2023-05-13 00:42:14,038 INFO (starrocks-mysql-nio-pool-2|161) [MetadataMgr.removeQueryMetadata():94] Succeed to deregister query level connector metadata on query id: 00e7e84d-f127-11ed-884e-0242ac1d0005
2023-05-13 00:42:14,051 WARN (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [HiveMetaClient.getPartitionsByNames():233] Expect to fetch 1 partition on [default.stock_ticks_cow], but actually fetched 0 partition
2023-05-13 00:42:14,051 INFO (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [PlannerProfile$ScopedTimer.printBackgroundLog():104] Get partitions or partition statistics cost time: 54
2023-05-13 00:42:14,051 ERROR (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionStatistics(CachingHiveMetastore.java:293) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsStatistics(CachingHiveMetastore.java:324) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$200(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$2.loadAll(CachingHiveMetastore.java:154) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionStatistics(CachingHiveMetastore.java:293) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.lambda$getPartitionStatistics$3(HiveMetastoreOperations.java:105) ~[starrocks-fe.jar:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionStatistics(HiveMetastore.java:153) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsStatistics(CachingHiveMetastore.java:324) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$200(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$2.loadAll(CachingHiveMetastore.java:154) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 16 more
2023-05-13 00:42:14,052 ERROR (background-get-partitions-statistics-hudi_catalog_hms-default-stock_ticks_cow|174) [CachingHiveMetastore.getAll():459] Error occurred when loading cache
com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionStatistics(CachingHiveMetastore.java:293) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastoreOperations.lambda$getPartitionStatistics$3(HiveMetastoreOperations.java:105) ~[starrocks-fe.jar:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4079) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionStatistics(CachingHiveMetastore.java:293) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsStatistics(CachingHiveMetastore.java:324) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$200(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$2.loadAll(CachingHiveMetastore.java:154) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 7 more
Caused by: java.lang.NullPointerException: null value in entry: date=2018-08-31=null
at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:32) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:171) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:281) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionsByNames(HiveMetastore.java:126) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.HiveMetastore.getPartitionStatistics(HiveMetastore.java:153) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsStatistics(CachingHiveMetastore.java:324) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$200(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$2.loadAll(CachingHiveMetastore.java:154) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.getAll(LocalCache.java:4032) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache$LocalLoadingCache.getAll(LocalCache.java:4960) ~[spark-dpp-1.0.0.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getAll(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.getPartitionStatistics(CachingHiveMetastore.java:293) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.loadPartitionsStatistics(CachingHiveMetastore.java:324) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore.access$200(CachingHiveMetastore.java:60) ~[starrocks-fe.jar:?]
at com.starrocks.connector.hive.CachingHiveMetastore$2.loadAll(CachingHiveMetastore.java:154) ~[starrocks-fe.jar:?]
at com.google.common.cache.CacheLoader$1.loadAll(CacheLoader.java:211) ~[spark-dpp-1.0.0.jar:?]
at com.google.common.cache.LocalCache.loadAll(LocalCache.java:4069) ~[spark-dpp-1.0.0.jar:?]
... 7 more
2023-05-13 00:42:19,606 INFO (leaderCheckpointer|91) [BDBJEJournal.getFinalizedJournalId():275] database names: 1 
2023-05-13 00:42:19,607 INFO (leaderCheckpointer|91) [Checkpoint.runAfterCatalogReady():95] checkpoint imageVersion 0, checkPointVersion 0
2023-05-13 00:42:19,620 INFO (colocate group clone checker|99) [ColocateTableBalancer.matchGroup():856] finished to match colocate group. cost: 0 ms, in lock time: 0 ms
2023-05-13 00:42:19,636 INFO (tablet checker|34) [TabletChecker.doCheck():409] finished to check tablets. checkInPrios: true, unhealthy/total/added/in_sched/not_ready: 0/0/0/0/0, cost: 0 ms, in lock time: 0 ms
2023-05-13 00:42:19,636 INFO (tablet checker|34) [TabletChecker.doCheck():409] finished to check tablets. checkInPrios: false, unhealthy/total/added/in_sched/not_ready: 0/30/0/0/0, cost: 0 ms, in lock time: 0 ms
2023-05-13 00:42:19,637 INFO (tablet checker|34) [TabletChecker.runAfterCatalogReady():200] TStat :
TStat num of tablet check round: 13 (+1)
TStat cost of tablet check(ms): 6 (+0)
TStat num of tablet checked in tablet checker: 270 (+30)
TStat num of unhealthy tablet checked in tablet checker: 0 (+0)
TStat num of tablet being added to tablet scheduler: 0 (+0)
TStat num of tablet schedule round: 240 (+20)
TStat cost of tablet schedule(ms): 17 (+1)
TStat num of tablet being scheduled: 0 (+0)
TStat num of tablet being scheduled succeeded: 0 (+0)

About this issue

  • Original URL
  • State: closed
  • Created 4 years ago
  • Comments: 18 (12 by maintainers)

Commits related to this issue

Most upvoted comments

This issue is due to starrocks relying on metadata from hive metatsore for hudi queries. We will fix this issue later. Currently, there is a solution: After hudi sync hms using run_sync_tool.sh , using hive or spark to run msck repair table stock_ticks_cow, then query stock_ticks_cow in starrocks will work well, if not, plz run refresh external table stock_ticks_cow in starrocks