ByConity: DB::Exception: Not found column in block

When i write data into ByConity, the byconity-server’s error log show the error below all the time.

2023.07.10 17:37:35.031644 [ 117761 ] {} <Error> apm.middleware_dubbo_service_request_rt (b6707077-6451-4f45-928d-3e69e20776be)(PartGCThread): virtual void DB::CnchPartGCThread::runImpl(): Code: 10, e.displayText() = DB::Exception: Not found column _time in block: while executing 'INPUT : 0 -> _time Int64 : 0' SQLSTATE: 22000, Stack trace (when copying this message, always include the lines below):

0. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x19e02db2 in /opt/byconity/bin/clickhouse
1. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xb665400 in /opt/byconity/bin/clickhouse
2. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) @ 0xb70a564 in /opt/byconity/bin/clickhouse
3. DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x144aed6a in /opt/byconity/bin/clickhouse
4. DB::ExpressionActions::execute(DB::Block&, bool) const @ 0x144af097 in /opt/byconity/bin/clickhouse
5. DB::CnchPartGCThread::tryMarkExpiredPartitions(DB::StorageCnchMergeTree&, std::__1::vector<std::__1::shared_ptr<DB::ServerDataPart const>, std::__1::allocator<std::__1::shared_ptr<DB::ServerDataPart const> > > const&) @ 0x143ea7f6 in /opt/byconity/bin/clickhouse
6. DB::CnchPartGCThread::clearOldPartsByPartition(std::__1::shared_ptr<DB::IStorage> const&, DB::StorageCnchMergeTree&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, bool, DB::TxnTimestamp) @ 0x143e7c40 in /opt/byconity/bin/clickhouse
7. DB::CnchPartGCThread::runImpl() @ 0x143e66cc in /opt/byconity/bin/clickhouse
8. DB::ICnchBGThread::run() @ 0x13c01671 in /opt/byconity/bin/clickhouse
9. DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x13e2bede in /opt/byconity/bin/clickhouse
10. DB::BackgroundSchedulePool::threadFunction() @ 0x13e2e287 in /opt/byconity/bin/clickhouse
11. ? @ 0x13e2e8f7 in /opt/byconity/bin/clickhouse
12. ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xb69c67f in /opt/byconity/bin/clickhouse
13. ? @ 0xb6a095a in /opt/byconity/bin/clickhouse
14. start_thread @ 0x7fa3 in /lib/x86_64-linux-gnu/libpthread-2.28.so
15. __clone @ 0xf906f in /lib/x86_64-linux-gnu/libc-2.28.so
 (version 21.8.7.1)

table struct:

CREATE TABLE apm.middleware_dubbo_service_request_rt
(
    `_time` Int64 COMMENT 'null',
    `_app` LowCardinality(String) COMMENT 'null',
    `_ip` LowCardinality(String) COMMENT 'null',
    `_region` LowCardinality(String) COMMENT 'null',
    `_max` Float64 COMMENT 'null',
    `_mean` Float64 COMMENT 'null',
    `operation_name` LowCardinality(String) COMMENT 'null',
    `operation_side` LowCardinality(String) COMMENT 'null'
)
ENGINE = CnchMergeTree
PARTITION BY toDate(_time / 1000)
ORDER BY (_time, _app, _ip, _region, operation_name, operation_side)
TTL toDate(_time / 1000) + toIntervalDay(14)
SETTINGS index_granularity = 8192, storage_policy = 'cnch_default_hdfs'

And i found error throw by this file. image

But the write and read is still normal. Should i care about this error ?

byconity version: 0.1.0-GA

os version: Linux version 4.14.105-19-0018 (root@VM_197_173_centos) (gcc version 4.8.2 20140120 (Red Hat 4.8.2-16) (GCC)) #1 SMP Thu Dec 3 09:59:51 CST 2020

About this issue

  • Original URL
  • State: closed
  • Created a year ago
  • Comments: 15 (2 by maintainers)

Most upvoted comments

Hi @hustnn , this problem is fixed in branch cnch-ce-merge. It will be solved after code sync

Hi @xingcici , it will work fine. Or you can create table with out ttl now. And later alter table to add TTL

Thanks for reporting, it maybe a bug, we will check. yes, the write and read are still working but the ttl may not work as expected, you can check it.

OK, i will also look into the problem.