seatunnel: [Bug] [Connector-Paimon] sink paimon java.lang.OutOfMemoryError: Java heap space

Search before asking

• I had searched in the issues and found no similar issues.

What happened

source:oracle sink:paimon sink paimon java.lang.OutOfMemoryError: Java heap space

SeaTunnel Version

2.3.3

SeaTunnel Config

env {
  execution.parallelism = 1
  job.mode = "BATCH"
}

source {
  Jdbc {
        url = "jdbc:oracle:thin:@******:1521/WFLDBDEV"
        driver = "oracle.jdbc.OracleDriver"
        user = "biods"
        password = "******"
        query = "SELECT * FROM BIODS.EKKN"
    }
}

sink {
  Paimon {
    warehouse = "hdfs://******:9820/paimon"
    database = "biods"
    table = "ekkn"
  }
}

Running Command

./seatunnel.sh --config ../config/v2.batch.config.template -e local

Error Exception

2023-09-07 11:13:03,608 INFO  org.apache.seatunnel.core.starter.utils.ConfigShadeUtils - Load config shade spi: [base64]
2023-09-07 11:13:03,650 INFO  org.apache.seatunnel.core.starter.utils.ConfigBuilder - Parsed config file: {
    "env" : {
        "execution.parallelism" : 1,
        "job.mode" : "BATCH"
    },
    "source" : [
        {
            "password" : "******",
            "driver" : "oracle.jdbc.OracleDriver",
            "query" : "SELECT * FROM BIODS.EKKN",
            "plugin_name" : "Jdbc",
            "user" : "biods",
            "url" : "jdbc:oracle:thin:@******:1521/WFLDBDEV"
        }
    ],
    "sink" : [
        {
            "database" : "biods",
            "warehouse" : "hdfs://******:9820/paimon",
            "plugin_name" : "Paimon",
            "table" : "ekkn"
        }
    ]
}

2023-09-07 11:13:03,672 INFO  org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory'
2023-09-07 11:13:03,672 INFO  org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory'
2023-09-07 11:13:03,676 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load SeaTunnelSink Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel
2023-09-07 11:13:03,680 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Jdbc at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar
2023-09-07 11:13:03,681 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Paimon at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar
2023-09-07 11:13:03,684 INFO  org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start generating all sources.
2023-09-07 11:13:03,685 INFO  org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory'
2023-09-07 11:13:03,703 INFO  org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory'
2023-09-07 11:13:03,705 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load SeaTunnelSource Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel
2023-09-07 11:13:03,712 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Jdbc at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar
2023-09-07 11:13:03,717 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load plugin: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='Jdbc'} from classpath
2023-09-07 11:13:04,132 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-748082] [5.1] This node become a new active master node, begin init coordinator service
2023-09-07 11:13:04,170 INFO  com.hazelcast.internal.partition.impl.PartitionStateManager - [localhost]:5801 [seatunnel-748082] [5.1] Initializing cluster partition table arrangement...
2023-09-07 11:13:04,474 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource - The partition_column parameter is not configured, and the source parallelism is set to 1
2023-09-07 11:13:04,509 INFO  org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start generating all transforms.
2023-09-07 11:13:04,509 INFO  org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start generating all sinks.
2023-09-07 11:13:04,510 INFO  org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory'
2023-09-07 11:13:04,514 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load SeaTunnelSink Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel
2023-09-07 11:13:04,515 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Paimon at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar
2023-09-07 11:13:04,517 INFO  org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load plugin: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Paimon'} from classpath
2023-09-07 11:13:04,669 WARN  org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2023-09-07 11:13:05,608 INFO  org.apache.seatunnel.engine.client.job.ClientJobProxy - Start submit job, job id: 752003406054293505, with plugin jar [file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar, file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar]
2023-09-07 11:13:05,619 INFO  org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - Init ResourceManager
2023-09-07 11:13:05,619 INFO  org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - initWorker...
2023-09-07 11:13:05,619 INFO  org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - initWorker live nodes: [[localhost]:5801]
2023-09-07 11:13:05,620 INFO  org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - registerWorker: {[localhost]:5801=WorkerProfile(address=[localhost]:5801, profile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=1029177344}}, unassignedResource=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=1029177344}}, assignedSlots=[], unassignedSlots=[])}
2023-09-07 11:13:05,640 INFO  org.apache.seatunnel.engine.server.master.JobMaster - Init JobMaster for Job SeaTunnel_Job (752003406054293505)
2023-09-07 11:13:05,640 INFO  org.apache.seatunnel.engine.server.master.JobMaster - Job SeaTunnel_Job (752003406054293505) needed jar urls [file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar, file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar]
2023-09-07 11:13:05,819 INFO  org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - Path /tmp/seatunnel/checkpoint_snapshot/752003406054293505 is not a directory
2023-09-07 11:13:05,819 INFO  org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - No checkpoint found for job, job id is: 752003406054293505
2023-09-07 11:13:05,822 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] is in state CREATED when init state future
2023-09-07 11:13:05,823 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] is in state CREATED when init state future
2023-09-07 11:13:05,824 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] is in state CREATED when init state future
2023-09-07 11:13:05,826 INFO  org.apache.seatunnel.engine.client.job.ClientJobProxy - Submit job finished, job id: 752003406054293505, job name: SeaTunnel
2023-09-07 11:13:05,828 INFO  org.apache.seatunnel.engine.server.master.JobMaster - Job Job SeaTunnel_Job (752003406054293505) waiting for scheduler finished
2023-09-07 11:13:05,831 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job SeaTunnel_Job (752003406054293505) turn from state CREATED to SCHEDULED.
2023-09-07 11:13:05,835 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] turn from state CREATED to SCHEDULED.
2023-09-07 11:13:05,839 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from CREATED to SCHEDULED
2023-09-07 11:13:05,842 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state CREATED to SCHEDULED.
2023-09-07 11:13:05,848 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] state from CREATED to SCHEDULED
2023-09-07 11:13:05,849 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] turn from state CREATED to SCHEDULED.
2023-09-07 11:13:05,850 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from CREATED to SCHEDULED
2023-09-07 11:13:05,851 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state CREATED to SCHEDULED.
2023-09-07 11:13:05,859 WARN  org.apache.seatunnel.engine.client.job.JobMetricsRunner - Failed to get job metrics summary, it maybe first-run
2023-09-07 11:13:05,859 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] turn from state SCHEDULED to DEPLOYING.
2023-09-07 11:13:05,862 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from SCHEDULED to DEPLOYING
2023-09-07 11:13:05,863 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state SCHEDULED to DEPLOYING.
2023-09-07 11:13:05,865 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] state from SCHEDULED to DEPLOYING
2023-09-07 11:13:05,867 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] turn from state SCHEDULED to DEPLOYING.
2023-09-07 11:13:05,868 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from SCHEDULED to DEPLOYING
2023-09-07 11:13:05,869 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state SCHEDULED to DEPLOYING.
2023-09-07 11:13:05,883 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] received deploying task executionId [752003415764107265]
2023-09-07 11:13:05,894 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] received deploying task executionId [752003415764172801]
2023-09-07 11:13:05,904 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=1}, executionId [752003415764107265]
2023-09-07 11:13:05,904 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=1} init success
2023-09-07 11:13:05,905 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] received deploying task executionId [752003415764238337]
2023-09-07 11:13:05,909 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=1} success
2023-09-07 11:13:05,910 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from DEPLOYING to RUNNING
2023-09-07 11:13:05,910 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - starting seatunnel source split enumerator task, source name: pipeline-1 [Source[0]-Jdbc-default-identifier]
2023-09-07 11:13:05,912 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state DEPLOYING to RUNNING.
2023-09-07 11:13:05,931 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=3}, executionId [752003415764172801]
2023-09-07 11:13:05,932 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=3} init success
2023-09-07 11:13:05,932 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=3} success
2023-09-07 11:13:05,934 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] state from DEPLOYING to RUNNING
2023-09-07 11:13:05,935 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] turn from state DEPLOYING to RUNNING.
2023-09-07 11:13:05,955 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}, executionId [752003415764238337]
2023-09-07 11:13:05,956 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} init success
2023-09-07 11:13:05,957 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} success
2023-09-07 11:13:05,957 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from DEPLOYING to RUNNING
2023-09-07 11:13:05,960 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state DEPLOYING to RUNNING.
2023-09-07 11:13:05,960 INFO  org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] turn from state DEPLOYING to RUNNING.
2023-09-07 11:13:05,961 INFO  org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask - starting seatunnel transform task, index 0
2023-09-07 11:13:05,961 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job SeaTunnel_Job (752003406054293505) turn from state SCHEDULED to RUNNING.
2023-09-07 11:13:05,962 INFO  org.apache.seatunnel.engine.server.master.JobMaster - Job SeaTunnel_Job (752003406054293505) scheduler finished
2023-09-07 11:13:05,969 INFO  org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask - starting seatunnel source task, index 0
2023-09-07 11:13:06,332 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}, taskID=60000, index=0}
2023-09-07 11:13:07,017 INFO  org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received enough reader, starting enumerator...
2023-09-07 11:13:07,019 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Starting to calculate splits.
2023-09-07 11:13:07,020 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Assigning JdbcSourceSplit(parameterValues=null, splitId=0) to 0 reader.
2023-09-07 11:13:07,021 INFO  org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Assign splits [JdbcSourceSplit(parameterValues=null, splitId=0)] to reader 0
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid57818.hprof ...
Heap dump file created [72102428 bytes in 0.305 secs]
2023-09-07 11:13:08,678 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] Exception in org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@1a7e3661
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:3236) ~[?:1.8.0_221]
        at org.apache.paimon.data.AbstractBinaryWriter.grow(AbstractBinaryWriter.java:262) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.AbstractBinaryWriter.ensureCapacity(AbstractBinaryWriter.java:194) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.AbstractBinaryWriter.writeSegmentsToVarLenPart(AbstractBinaryWriter.java:203) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.AbstractBinaryWriter.writeString(AbstractBinaryWriter.java:71) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.BinaryRowWriter.writeString(BinaryRowWriter.java:25) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.BinaryWriter.write(BinaryWriter.java:121) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.serializer.InternalRowSerializer.toBinaryRow(InternalRowSerializer.java:155) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:170) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:39) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.sort.BinaryInMemorySortBuffer.write(BinaryInMemorySortBuffer.java:176) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.mergetree.SortBufferWriteBuffer.put(SortBufferWriteBuffer.java:106) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:146) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:53) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.operation.AbstractFileStoreWrite.write(AbstractFileStoreWrite.java:93) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.table.sink.TableWriteImpl.writeAndReturn(TableWriteImpl.java:94) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.paimon.table.sink.TableWriteImpl.write(TableWriteImpl.java:83) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:109) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:49) ~[connector-paimon-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:227) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:61) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:39) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:27) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue$$Lambda$2035/1935579074.accept(Unknown Source) ~[?:?]
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:76) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.collect(IntermediateBlockingQueue.java:51) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.collect(IntermediateQueueFlowLifeCycle.java:52) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.collect(TransformSeaTunnelTask.java:73) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.call(TransformSeaTunnelTask.java:78) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) ~[seatunnel-starter.jar:2.3.3]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_221]
2023-09-07 11:13:08,694 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] taskDone, taskId = 70000, taskGroup = TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}
2023-09-07 11:13:08,695 WARN  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@292ee6d0
java.lang.RuntimeException: java.lang.InterruptedException
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.received(IntermediateBlockingQueue.java:41) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.received(IntermediateQueueFlowLifeCycle.java:46) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.received(IntermediateQueueFlowLifeCycle.java:28) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SeaTunnelSourceCollector.sendRecordToNext(SeaTunnelSourceCollector.java:139) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SeaTunnelSourceCollector.collect(SeaTunnelSourceCollector.java:67) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceReader.pollNext(JdbcSourceReader.java:64) ~[connector-jdbc-2.3.3.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:150) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:95) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:100) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) [seatunnel-starter.jar:2.3.3]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_221]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_221]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_221]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_221]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]
Caused by: java.lang.InterruptedException
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_221]
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_221]
        at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:353) ~[?:1.8.0_221]
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:76) ~[seatunnel-starter.jar:2.3.3]
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.received(IntermediateBlockingQueue.java:39) ~[seatunnel-starter.jar:2.3.3]
        ... 15 more
2023-09-07 11:13:08,696 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] taskDone, taskId = 60000, taskGroup = TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}
2023-09-07 11:13:08,696 INFO  org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] Task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} complete with state FAILED
2023-09-07 11:13:08,696 INFO  org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-748082] [5.1] Received task end from execution TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}, state FAILED
2023-09-07 11:13:08,700 INFO  org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn to end state FAILED.
2023-09-07 11:13:08,700 ERROR org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] end with state FAILED and Exception: java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:3236)
        at org.apache.paimon.data.AbstractBinaryWriter.grow(AbstractBinaryWriter.java:262)
        at org.apache.paimon.data.AbstractBinaryWriter.ensureCapacity(AbstractBinaryWriter.java:194)
        at org.apache.paimon.data.AbstractBinaryWriter.writeSegmentsToVarLenPart(AbstractBinaryWriter.java:203)
        at org.apache.paimon.data.AbstractBinaryWriter.writeString(AbstractBinaryWriter.java:71)
        at org.apache.paimon.data.BinaryRowWriter.writeString(BinaryRowWriter.java:25)
        at org.apache.paimon.data.BinaryWriter.write(BinaryWriter.java:121)
        at org.apache.paimon.data.serializer.InternalRowSerializer.toBinaryRow(InternalRowSerializer.java:155)
        at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:170)
        at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:39)
        at org.apache.paimon.sort.BinaryInMemorySortBuffer.write(BinaryInMemorySortBuffer.java:176)
        at org.apache.paimon.mergetree.SortBufferWriteBuffer.put(SortBufferWriteBuffer.java:106)
        at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:146)
        at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:53)
        at org.apache.paimon.operation.AbstractFileStoreWrite.write(AbstractFileStoreWrite.java:93)
        at org.apache.paimon.table.sink.TableWriteImpl.writeAndReturn(TableWriteImpl.java:94)
        at org.apache.paimon.table.sink.TableWriteImpl.write(TableWriteImpl.java:83)
        at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:109)
        at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:49)
        at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:227)
        at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:61)
        at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:39)
        at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:27)
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue$$Lambda$2035/1935579074.accept(Unknown Source)
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:76)
        at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.collect(IntermediateBlockingQueue.java:51)
        at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.collect(IntermediateQueueFlowLifeCycle.java:52)
        at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.collect(TransformSeaTunnelTask.java:73)
        at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168)
        at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.call(TransformSeaTunnelTask.java:78)
        at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

2023-09-07 11:13:08,700 ERROR org.apache.seatunnel.engine.server.dag.physical.SubPlan - Task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} Failed in Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline.
2023-09-07 11:13:08,700 WARN  org.apache.seatunnel.engine.server.dag.physical.SubPlan - start cancel job Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] count = 0

Zeta or Flink or Spark Version

flink 1.17

Java or Scala Version

javaversion:1.8

Screenshots

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project’s Code of Conduct