trino: Iceberg queries stuck in the planning phase for long time
Our Iceberg queries are getting stuck in the planning phase for 2 to 3 minutes, although they eventually run successfully. We are currently upgrading Trino from version 444 to 454. This issue has been occurring since Trino version 451 (we went back and tried different versions).
Our Iceberg stack --> Storage: s3 File format: parquet Catalog: Hive
Query explain:
Trino version: 454
Fragment 0 [SINGLE]
Output layout: [expr]
Output partitioning: SINGLE []
Output[columnNames = [_col0]]
│ Layout: [expr:integer]
│ Estimates: {rows: 1 (5B), cpu: 0, memory: 0B, network: 0B}
│ _col0 := expr
└─ Project[]
│ Layout: [expr:integer]
│ Estimates: {rows: 1 (5B), cpu: 5, memory: 0B, network: 0B}
│ expr := integer '1'
└─ Limit[count = 1]
│ Layout: []
│ Estimates: {rows: 1 (0B), cpu: 0, memory: 0B, network: 0B}
└─ LocalExchange[partitioning = SINGLE]
│ Layout: []
│ Estimates: {rows: 1 (0B), cpu: 0, memory: 0B, network: 0B}
└─ RemoteSource[sourceFragmentIds = [1]]
Layout: []
Fragment 1 [SOURCE]
Output layout: []
Output partitioning: SINGLE []
LimitPartial[count = 1]
│ Layout: []
│ Estimates: {rows: 1 (0B), cpu: 0, memory: 0B, network: 0B}
└─ TableScan[table = table_name$data@2183018889107447028 constraint on [dt] LIMIT 1]
Layout: []
Estimates: {rows: 8499944 (0B), cpu: 0, memory: 0B, network: 0B}
83:dt:varchar
:: [[2024-08-30T13:00:00Z, 2024-08-30T14:00:00Z)]
(1 row)
Query 20240830_150248_35329_wgfii, FINISHED, 1 node
Splits: 1 total, 1 done (100.00%)
3:23 [0 rows, 0B] [0 rows/s, 0B/s]
Query info: https://gist.github.com/sriharshaj/f26e655f233b84754da8216be2ae0172
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 21 (11 by maintainers)
@krvikash I tried the fix, it worked. Planning time is in milliseconds. Thank you for the fix.
Great!! Thanks @sriharshaj for reporting this and verifying the fix.
@krvikash Sure, I will try this fix today.
Hi @sriharshaj, I did not get a chance to looked into yet. I will take a look in this week.