ClickHouse: IN operator much slower on 23.6.1 than on 23.4.2.11

(you don’t have to strictly follow this form)

Describe the unexpected behaviour I have a merge table (say) t_merge, and a memory table t_memory. on version 23.4.2.11, I use IN operator to query records from t_merge, by "where (xx, xxx) in t_memory). It is really quick than “t_merge left semi join t_memory”. that is 100ms vs 6s. but when upgrade to version 23.6.1, the IN operator slow down to 6s, almost same as “left semi join”. what is wrong?

How to reproduce

• Which ClickHouse server version to use - 23.6.1
• Which interface to use, if matters - JetBrains DataGrip with http
• Non-default settings, if any
• CREATE TABLE statements for all tables involved
• Sample data for all these tables, use clickhouse-obfuscator if necessary
• Queries to run that lead to unexpected result

Expected behavior IN operator performance better.

Error message and/or stacktrace If applicable, add screenshots to help explain your problem.

Additional context there is some signal may related: that seems clickhouse server return rows quickly just as former version, (not sure all or just part of them). then after several seconds it show query finished. maybe server finished work already, but block for a while then finish the query process?