ClickHouse: Segmentation fault after upgrade from v20.5.5.74 to v20.6.4.44

2020.08.25 12:14:14.924784 [ 10386 ] {} <Fatal> BaseDaemon: ########################################
2020.08.25 12:14:14.924879 [ 10386 ] {} <Fatal> BaseDaemon: (version 20.6.4.44 (official build), no build id) (from thread 10231) (no query) Received signal Segmentation fault (11)
2020.08.25 12:14:14.924933 [ 10386 ] {} <Fatal> BaseDaemon: Address: 0x7fa55fcb0000 Access: read. Attempted access has violated the permissions assigned to the memory area.
2020.08.25 12:14:14.924971 [ 10386 ] {} <Fatal> BaseDaemon: Stack trace: 0xf57c528 0xc510217 0xc635179 0xc510cb3 0xc634c24 0xae6ee25 0xf1a2bb2 0xf1a51ed 0xf3f63cf 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af 0xede92cd 0xf3f63af
2020.08.25 12:14:14.925045 [ 10386 ] {} <Fatal> BaseDaemon: 3. DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0xf57c528 in /usr/bin/clickhouse
2020.08.25 12:14:14.925101 [ 10386 ] {} <Fatal> BaseDaemon: 4. DB::FunctionIf::executeGeneric(DB::ColumnVector<char8_t> const*, DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0xc510217 in /usr/bin/clickhouse
2020.08.25 12:14:14.925133 [ 10386 ] {} <Fatal> BaseDaemon: 5. DB::FunctionIf::executeImpl(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0xc635179 in /usr/bin/clickhouse
2020.08.25 12:14:14.925154 [ 10386 ] {} <Fatal> BaseDaemon: 6. DB::FunctionIf::executeForNullableThenElse(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0xc510cb3 in /usr/bin/clickhouse
2020.08.25 12:14:14.925182 [ 10386 ] {} <Fatal> BaseDaemon: 7. DB::FunctionIf::executeImpl(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0xc634c24 in /usr/bin/clickhouse
2020.08.25 12:14:14.925216 [ 10386 ] {} <Fatal> BaseDaemon: 8. DB::ExecutableFunctionAdaptor::execute(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long, bool) @ 0xae6ee25 in /usr/bin/clickhouse
2020.08.25 12:14:14.925280 [ 10386 ] {} <Fatal> BaseDaemon: 9. DB::ExpressionAction::execute(DB::Block&, bool) const @ 0xf1a2bb2 in /usr/bin/clickhouse
2020.08.25 12:14:14.925315 [ 10386 ] {} <Fatal> BaseDaemon: 10. DB::ExpressionActions::execute(DB::Block&, bool) const @ 0xf1a51ed in /usr/bin/clickhouse
2020.08.25 12:14:14.925341 [ 10386 ] {} <Fatal> BaseDaemon: 11. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63cf in /usr/bin/clickhouse
2020.08.25 12:14:14.925448 [ 10386 ] {} <Fatal> BaseDaemon: 12. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925481 [ 10386 ] {} <Fatal> BaseDaemon: 13. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925531 [ 10386 ] {} <Fatal> BaseDaemon: 14. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925564 [ 10386 ] {} <Fatal> BaseDaemon: 15. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925582 [ 10386 ] {} <Fatal> BaseDaemon: 16. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925595 [ 10386 ] {} <Fatal> BaseDaemon: 17. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925608 [ 10386 ] {} <Fatal> BaseDaemon: 18. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925622 [ 10386 ] {} <Fatal> BaseDaemon: 19. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925639 [ 10386 ] {} <Fatal> BaseDaemon: 20. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925652 [ 10386 ] {} <Fatal> BaseDaemon: 21. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925710 [ 10386 ] {} <Fatal> BaseDaemon: 22. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925729 [ 10386 ] {} <Fatal> BaseDaemon: 23. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925744 [ 10386 ] {} <Fatal> BaseDaemon: 24. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925761 [ 10386 ] {} <Fatal> BaseDaemon: 25. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925818 [ 10386 ] {} <Fatal> BaseDaemon: 26. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925844 [ 10386 ] {} <Fatal> BaseDaemon: 27. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925859 [ 10386 ] {} <Fatal> BaseDaemon: 28. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925876 [ 10386 ] {} <Fatal> BaseDaemon: 29. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse
2020.08.25 12:14:14.925901 [ 10386 ] {} <Fatal> BaseDaemon: 30. DB::IBlockInputStream::read() @ 0xede92cd in /usr/bin/clickhouse
2020.08.25 12:14:14.925929 [ 10386 ] {} <Fatal> BaseDaemon: 31. DB::ExpressionBlockInputStream::readImpl() @ 0xf3f63af in /usr/bin/clickhouse

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 55 (27 by maintainers)

Most upvoted comments

Here is a log from version with asan (this is sufficient to identify the issue) ?

alter table lake.items update state='test3' where id=1 - mutation that caused the issue.

clickhouse-server.log

> 2020.08.31 08:48:02.647391 [ 13711 ] {} <Fatal> BaseDaemon: 18. /build/obj-x86_64-linux-gnu/../src/DataStreams/MaterializingBlockInputStream.cpp:25: DB::MaterializingBlockInputStream::readImpl() @ 0x1b711589 in /usr/bin/clickhouse
2020.08.31 08:48:02.648867 [ 13711 ] {} <Fatal> BaseDaemon: 19. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/vector:1383: DB::IBlockInputStream::read() @ 0x1ac902ca in /usr/bin/clickhouse 
2020.08.31 08:48:46.506596 [ 13833 ] {} <Fatal> BaseDaemon: ########################################
2020.08.31 08:48:46.506627 [ 13813 ] {} <Debug> metadata_lake.extract: Loading mutation: mutation_61.txt entry, commands size: 1
2020.08.31 08:48:46.506647 [ 13833 ] {} <Fatal> BaseDaemon: (version 20.6.4.45 (official build), no build id) (from thread 13729) (no query) Received signal Unknown signal -3 (-3)
2020.08.31 08:48:46.506667 [ 13833 ] {} <Fatal> BaseDaemon: Sanitizer trap.
2020.08.31 08:48:46.506703 [ 13833 ] {} <Fatal> BaseDaemon: Stack trace: 0xbf97e57 0x1a755200 0xbe69d96 0xbe51709 0xbe531be 0xbe53a88 0x1c0db014 0x12eb40de 0x12e93b60 0x12ea31f4 0x12e93028 0xdee3ec8 0x1b71cea7 0x1b7299fe 0x1bd5ad36 0x1ac902ca 0x1bd5acd4 0x1ac902ca 0x1b711589 0x1ac902ca 0x1c962110 0x1c94fe11 0x1c4443d2 0x1c4472d4 0x1c7cbc1e 0x1c7ccdc5 0xbfcb374 0xbfd3108 0x7fd040ac8ea5 0x7fd0403e58dd
2020.08.31 08:48:46.507021 [ 13833 ] {} <Fatal> BaseDaemon: 0. /build/obj-x86_64-linux-gnu/../src/Common/StackTrace.cpp:291: StackTrace::StackTrace() @ 0xbf97e57 in /usr/bin/clickhouse
2020.08.31 08:48:46.509014 [ 13813 ] {} <Debug> metadata_lake.extract: Loading mutation: mutation_133.txt entry, commands size: 1
2020.08.31 08:48:46.509026 [ 13833 ] {} <Fatal> BaseDaemon: 1. /build/obj-x86_64-linux-gnu/../src/Common/CurrentThread.h:81: sanitizerDeathCallback() @ 0x1a755200 in /usr/bin/clickhouse 
2020.08.31 08:48:46.512011 [ 13833 ] {} <Fatal> BaseDaemon: 2. __sanitizer::Die() @ 0xbe69d96 in /usr/bin/clickhouse
2020.08.31 08:48:46.529136 [ 13833 ] {} <Fatal> BaseDaemon: 8. DB::FunctionIf::executeImpl(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0x12e93b60 in /usr/bin/clickhouse
2020.08.31 08:48:46.533562 [ 13833 ] {} <Fatal> BaseDaemon: 9. DB::FunctionIf::executeForNullableThenElse(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0x12ea31f4 in /usr/bin/clickhouse
2020.08.31 08:48:46.534205 [ 13713 ] {} <Information> DatabaseOrdinary (onea_lake): Total 25 tables and 0 dictionaries.
2020.08.31 08:48:46.535807 [ 13777 ] {} <Debug> onea_lake.categories_lt: Loading data parts
2020.08.31 08:48:46.536519 [ 13833 ] {} <Fatal> BaseDaemon: 10. DB::FunctionIf::executeImpl(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0x12e93028 in /usr/bin/clickhouse

2020.08.31 08:48:46.540187 [ 13833 ] {} <Fatal> BaseDaemon: 11. DB::ExecutableFunctionAdaptor::execute(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long, bool) @ 0xdee3ec8 in /usr/bin/clickhouse

2020.08.31 08:48:46.543473 [ 13833 ] {} <Fatal> BaseDaemon: 12. /build/obj-x86_64-linux-gnu/../src/Interpreters/ExpressionActions.cpp:0: DB::ExpressionAction::execute(DB::Block&, bool) const @ 0x1b71cea7 in /usr/bin/clickhouse

clickhouse-server.err.log

2020.08.31 08:48:02.599050 [ 13711 ] {} <Fatal> BaseDaemon: ########################################
2020.08.31 08:48:02.599121 [ 13711 ] {} <Fatal> BaseDaemon: (version 20.6.4.45 (official build), no build id) (from thread 13530) (no query) Received signal Unknown signal -3 (-3)
2020.08.31 08:48:02.599154 [ 13711 ] {} <Fatal> BaseDaemon: Sanitizer trap.
2020.08.31 08:48:02.599194 [ 13711 ] {} <Fatal> BaseDaemon: Stack trace: 0xbf97e57 0x1a755200 0xbe69d96 0xbe51709 0xbe531be 0xbe53a88 0x1c0db014 0x12eb40de 0x12e93b60 0x12ea31f4 0x12e93028 0xdee3ec8 0x1b71cea7 0x1b7299fe 0x1bd5ad36 0x1ac902ca 0x1bd5acd4 0x1ac902ca 0x1b711589 0x1ac902ca 0x1c962110 0x1c94fe11 0x1c4443d2 0x1c4472d4 0x1c7cbc1e 0x1c7ccdc5 0xbfcb374 0xbfd3108 0x7fc6e3bf9ea5 0x7fc6e35168dd
2020.08.31 08:48:02.599405 [ 13711 ] {} <Fatal> BaseDaemon: 0. /build/obj-x86_64-linux-gnu/../src/Common/StackTrace.cpp:291: StackTrace::StackTrace() @ 0xbf97e57 in /usr/bin/clickhouse
2020.08.31 08:48:02.601307 [ 13711 ] {} <Fatal> BaseDaemon: 1. /build/obj-x86_64-linux-gnu/../src/Common/CurrentThread.h:81: sanitizerDeathCallback() @ 0x1a755200 in /usr/bin/clickhouse
2020.08.31 08:48:02.604276 [ 13711 ] {} <Fatal> BaseDaemon: 2. __sanitizer::Die() @ 0xbe69d96 in /usr/bin/clickhouse
2020.08.31 08:48:02.607210 [ 13711 ] {} <Fatal> BaseDaemon: 3. ? @ 0xbe51709 in /usr/bin/clickhouse
2020.08.31 08:48:02.611438 [ 13711 ] {} <Fatal> BaseDaemon: 4. __asan::ReportGenericError(unsigned long, unsigned long, unsigned long, unsigned long, bool, unsigned long, unsigned int, bool) @ 0xbe531be in /usr/bin/clickhouse
2020.08.31 08:48:02.615351 [ 13711 ] {} <Fatal> BaseDaemon: 5. __asan_report_load8 @ 0xbe53a88 in /usr/bin/clickhouse
2020.08.31 08:48:02.618396 [ 13711 ] {} <Fatal> BaseDaemon: 6. /build/obj-x86_64-linux-gnu/../src/Columns/ColumnString.h:0: DB::ColumnString::insertFrom(DB::IColumn const&, unsigned long) @ 0x1c0db014 in /usr/bin/clickhouse
2020.08.31 08:48:02.621862 [ 13711 ] {} <Fatal> BaseDaemon: 7. DB::FunctionIf::executeGeneric(DB::ColumnVector<char8_t> const*, DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0x12eb40de in /usr/bin/clickhouse
2020.08.31 08:48:02.625621 [ 13711 ] {} <Fatal> BaseDaemon: 8. DB::FunctionIf::executeImpl(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0x12e93b60 in /usr/bin/clickhouse
2020.08.31 08:48:02.628731 [ 13711 ] {} <Fatal> BaseDaemon: 9. DB::FunctionIf::executeForNullableThenElse(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0x12ea31f4 in /usr/bin/clickhouse
2020.08.31 08:48:02.631698 [ 13711 ] {} <Fatal> BaseDaemon: 10. DB::FunctionIf::executeImpl(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long) @ 0x12e93028 in /usr/bin/clickhouse
2020.08.31 08:48:02.634673 [ 13711 ] {} <Fatal> BaseDaemon: 11. DB::ExecutableFunctionAdaptor::execute(DB::Block&, std::__1::vector<unsigned long, std::__1::allocator<unsigned long> > const&, unsigned long, unsigned long, bool) @ 0xdee3ec8 in /usr/bin/clickhouse
2020.08.31 08:48:02.636629 [ 13711 ] {} <Fatal> BaseDaemon: 12. /build/obj-x86_64-linux-gnu/../src/Interpreters/ExpressionActions.cpp:0: DB::ExpressionAction::execute(DB::Block&, bool) const @ 0x1b71cea7 in /usr/bin/clickhouse
2020.08.31 08:48:02.638963 [ 13711 ] {} <Fatal> BaseDaemon: 13. /build/obj-x86_64-linux-gnu/../src/Interpreters/ExpressionActions.cpp:684: DB::ExpressionActions::execute(DB::Block&, bool) const @ 0x1b7299fe in /usr/bin/clickhouse
2020.08.31 08:48:02.640773 [ 13711 ] {} <Fatal> BaseDaemon: 14. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/vector:1293: DB::ExpressionBlockInputStream::readImpl() @ 0x1bd5ad36 in /usr/bin/clickhouse
2020.08.31 08:48:02.642362 [ 13711 ] {} <Fatal> BaseDaemon: 15. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/vector:1383: DB::IBlockInputStream::read() @ 0x1ac902ca in /usr/bin/clickhouse
2020.08.31 08:48:02.644150 [ 13711 ] {} <Fatal> BaseDaemon: 16. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/vector:656: DB::ExpressionBlockInputStream::readImpl() @ 0x1bd5acd4 in /usr/bin/clickhouse
2020.08.31 08:48:02.645659 [ 13711 ] {} <Fatal> BaseDaemon: 17. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/vector:1383: DB::IBlockInputStream::read() @ 0x1ac902ca in /usr/bin/clickhouse
2020.08.31 08:48:02.647391 [ 13711 ] {} <Fatal> BaseDaemon: 18. /build/obj-x86_64-linux-gnu/../src/DataStreams/MaterializingBlockInputStream.cpp:25: DB::MaterializingBlockInputStream::readImpl() @ 0x1b711589 in /usr/bin/clickhouse
2020.08.31 08:48:02.648867 [ 13711 ] {} <Fatal> BaseDaemon: 19. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/vector:1383: DB::IBlockInputStream::read() @ 0x1ac902ca in /usr/bin/clickhouse
2020.08.31 08:48:02.652694 [ 13711 ] {} <Fatal> BaseDaemon: 20. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/vector:1383: DB::MergeTreeDataMergerMutator::mutateSomePartColumns(std::__1::shared_ptr<DB::IMergeTreeDataPart const> const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::__1::set<std::__1::shared_ptr<DB::IMergeTreeIndex const>, std::__1::less<std::__1::shared_ptr<DB::IMergeTreeIndex const> >, std::__1::allocator<std::__1::shared_ptr<DB::IMergeTreeIndex const> > > const&, DB::Block const&, std::__1::shared_ptr<DB::IMergeTreeDataPart>, std::__1::shared_ptr<DB::IBlockInputStream>, long, std::__1::shared_ptr<DB::ICompressionCodec> const&, DB::MergeListEntry&, bool) const @ 0x1c962110 in /usr/bin/clickhouse
2020.08.31 08:48:02.655822 [ 13711 ] {} <Fatal> BaseDaemon: 21. /build/obj-x86_64-linux-gnu/../src/Storages/MergeTree/MergeTreeDataMergerMutator.cpp:1147: DB::MergeTreeDataMergerMutator::mutatePartToTemporaryPart(DB::FutureMergedMutatedPart const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::MutationCommands const&, DB::MergeListEntry&, long, DB::Context const&, std::__1::unique_ptr<DB::IReservation, std::__1::default_delete<DB::IReservation> > const&, std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&) @ 0x1c94fe11 in /usr/bin/clickhouse
2020.08.31 08:48:02.658468 [ 13711 ] {} <Fatal> BaseDaemon: 22. /build/obj-x86_64-linux-gnu/../src/Storages/StorageMergeTree.cpp:832: DB::StorageMergeTree::tryMutatePart() @ 0x1c4443d2 in /usr/bin/clickhouse
2020.08.31 08:48:02.661212 [ 13711 ] {} <Fatal> BaseDaemon: 23. /build/obj-x86_64-linux-gnu/../src/Storages/StorageMergeTree.cpp:0: DB::StorageMergeTree::mergeMutateTask() @ 0x1c4472d4 in /usr/bin/clickhouse
2020.08.31 08:48:02.663359 [ 13711 ] {} <Fatal> BaseDaemon: 24. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:0: DB::BackgroundProcessingPool::workLoopFunc() @ 0x1c7cbc1e in /usr/bin/clickhouse
2020.08.31 08:48:02.665583 [ 13711 ] {} <Fatal> BaseDaemon: 25. /build/obj-x86_64-linux-gnu/../src/Storages/MergeTree/BackgroundProcessingPool.cpp:0: std::__1::__function::__func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundProcessingPool::BackgroundProcessingPool(int, DB::BackgroundProcessingPool::PoolSettings const&, char const*, char const*)::$_0>(DB::BackgroundProcessingPool::BackgroundProcessingPool(int, DB::BackgroundProcessingPool::PoolSettings const&, char const*, char const*)::$_0&&)::'lambda'(), std::__1::allocator<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundProcessingPool::BackgroundProcessingPool(int, DB::BackgroundProcessingPool::PoolSettings const&, char const*, char const*)::$_0>(DB::BackgroundProcessingPool::BackgroundProcessingPool(int, DB::BackgroundProcessingPool::PoolSettings const&, char const*, char const*)::$_0&&)::'lambda'()>, void ()>::operator()() @ 0x1c7ccdc5 in /usr/bin/clickhouse
2020.08.31 08:48:02.665768 [ 13711 ] {} <Fatal> BaseDaemon: 26. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/atomic:1036: ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xbfcb374 in /usr/bin/clickhouse
2020.08.31 08:48:02.666170 [ 13711 ] {} <Fatal> BaseDaemon: 27. /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2615: void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()> >(void*) @ 0xbfd3108 in /usr/bin/clickhouse
2020.08.31 08:48:02.666221 [ 13711 ] {} <Fatal> BaseDaemon: 28. start_thread @ 0x7ea5 in /usr/lib64/libpthread-2.17.so
2020.08.31 08:48:02.666255 [ 13711 ] {} <Fatal> BaseDaemon: 29. clone @ 0xfe8dd in /usr/lib64/libc-2.17.so

/var/log/clickhouse-server/clickhouse-server.log | grep -F ‘[ 13530 ]’

2020.08.31 08:48:02.567591 [ 13530 ] {} <Debug> DiskLocal: Reserving 3.29 MiB on disk `default`, having unreserved 145.90 GiB.
2020.08.31 08:48:02.568793 [ 13530 ] {} <Debug> lake.items (SelectExecutor): Key condition: (column 0 in [1, 1])
2020.08.31 08:48:02.568819 [ 13530 ] {} <Debug> lake.items (SelectExecutor): MinMax index condition: unknown
2020.08.31 08:48:02.568905 [ 13530 ] {} <Debug> lake.items (SelectExecutor): Selected 1 parts by date, 1 parts by key, 1 marks to read from 1 ranges
2020.08.31 08:48:02.568997 [ 13530 ] {} <Trace> MergeTreeSelectProcessor: Reading 1 ranges from part 201608_1_8756_6669_125627, approx. 8192 rows starting from 0
2020.08.31 08:48:02.569064 [ 13530 ] {} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
2020.08.31 08:48:02.570379 [ 13530 ] {} <Trace> AggregatingTransform: Aggregating
2020.08.31 08:48:02.570410 [ 13530 ] {} <Trace> Aggregator: Aggregation method: without_key
2020.08.31 08:48:02.570511 [ 13530 ] {} <Trace> AggregatingTransform: Aggregated. 1 to 1 rows (from 9.00 B) in 0.001098388 sec. (910.4250956856775 rows/sec., 8.00 KiB/sec.)
2020.08.31 08:48:02.570536 [ 13530 ] {} <Trace> Aggregator: Merging aggregated data
2020.08.31 08:48:02.570980 [ 13530 ] {} <Trace> lake.items (MergerMutator): Mutating part 201608_1_8756_6669_125627 to mutation version 125630
2020.08.31 08:48:02.572592 [ 13530 ] {} <Debug> lake.items (SelectExecutor): Key condition: unknown
2020.08.31 08:48:02.572620 [ 13530 ] {} <Debug> lake.items (SelectExecutor): MinMax index condition: unknown
2020.08.31 08:48:02.572660 [ 13530 ] {} <Debug> lake.items (SelectExecutor): Selected 1 parts by date, 1 parts by key, 3 marks to read from 1 ranges
2020.08.31 08:48:02.572744 [ 13530 ] {} <Trace> MergeTreeSelectProcessor: Reading 1 ranges from part 201608_1_8756_6669_125627, approx. 24576 rows starting from 0
2020.08.31 08:48:02.572794 [ 13530 ] {} <Trace> InterpreterSelectQuery: FetchColumns -> Complete

radiatorius on Aug 31, 2020