milvus: [Bug]: Fail to load collection after release
Is there an existing issue for this?
- I have searched the existing issues
Environment
- Milvus version:2.1.4
- Deployment mode(standalone or cluster):cluster
- SDK version(e.g. pymilvus v2.0.0rc2):2.1.3
- OS(Ubuntu or CentOS): Ubuntu
- CPU/Memory: Intel(R) Core(TM) i9-10980XE CPU @ 3.00GHz / 32Gb DDR4 - 2133 MHz
- GPU:
- Others:
Current Behavior
I can create a collection about 3M vectors of dim 512, IVF_FLAT index and do search well on the collection. However, after releasing the collection, it seems hard to load the collection again to query nodes. The query nodes might be stuck at loading segments. Below is log i get from query coord and query nodes at loading time.
Query Coord logs:
[2022/10/18 02:51:47.570 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222120] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:47 AM [2022/10/18 02:51:47.570 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:47 AM [2022/10/18 02:51:47.570 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:48 AM [2022/10/18 02:51:48.572 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222134]
10/18/2022 9:51:48 AM [2022/10/18 02:51:48.572 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222134] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:48 AM [2022/10/18 02:51:48.572 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:48 AM [2022/10/18 02:51:48.573 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:49 AM [2022/10/18 02:51:49.571 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222148]
10/18/2022 9:51:49 AM [2022/10/18 02:51:49.572 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222148] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:49 AM [2022/10/18 02:51:49.572 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:49 AM [2022/10/18 02:51:49.573 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:50 AM [2022/10/18 02:51:50.573 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222162]
10/18/2022 9:51:50 AM [2022/10/18 02:51:50.574 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222162] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:50 AM [2022/10/18 02:51:50.575 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:50 AM [2022/10/18 02:51:50.575 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:51 AM [2022/10/18 02:51:51.487 +00:00] [WARN] [grpcclient/client.go:251] ["querynode ClientBase ReCall grpc first call get error "] [error="err: rpc error: code = DeadlineExceeded desc = context deadline exceeded\n, /go/src/github.com/milvus-io/milvus/internal/util/trace/stack_trace.go:51 github.com/milvus-io/milvus/internal/util/trace.StackTrace\n/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:250 github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n/go/src/github.com/milvus-io/milvus/internal/distributed/querynode/client/client.go:269 github.com/milvus-io/milvus/internal/distributed/querynode/client.(*Client).GetMetrics\n/go/src/github.com/milvus-io/milvus/internal/querycoord/querynode.go:294 github.com/milvus-io/milvus/internal/querycoord.(*queryNode).getNodeInfo\n/go/src/github.com/milvus-io/milvus/internal/querycoord/cluster.go:568 github.com/milvus-io/milvus/internal/querycoord.(*queryNodeCluster).GetNodeInfoByID\n/go/src/github.com/milvus-io/milvus/internal/querycoord/query_coord.go:615 github.com/milvus-io/milvus/internal/querycoord.(*QueryCoord).loadBalanceSegmentLoop\n/usr/local/go/src/runtime/asm_amd64.s:1371 runtime.goexit\n"]
10/18/2022 9:51:51 AM [2022/10/18 02:51:51.487 +00:00] [WARN] [querycoord/query_coord.go:617] ["loadBalanceSegmentLoop: get node info from QueryNode failed"] [nodeID=23] [collection=436746844364341249] [replica=436728525035929746] [error="context deadline exceeded"]
10/18/2022 9:51:51 AM [2022/10/18 02:51:51.499 +00:00] [INFO] [querycoord/query_coord.go:646] ["loadBalanceSegmentLoop: memory usage rate of all online QueryNode"] [collection=436746844364341249] [replica=436728525035929746] ["mem rate"="{\"22\":0.025320922575985897,\"24\":0.0033836700718145826}"]
10/18/2022 9:51:51 AM [2022/10/18 02:51:51.575 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222176]
10/18/2022 9:51:51 AM [2022/10/18 02:51:51.575 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222176] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:51 AM [2022/10/18 02:51:51.576 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:51 AM [2022/10/18 02:51:51.576 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:52 AM [2022/10/18 02:51:52.500 +00:00] [WARN] [grpcclient/client.go:251] ["querynode ClientBase ReCall grpc first call get error "] [error="err: rpc error: code = DeadlineExceeded desc = context deadline exceeded\n, /go/src/github.com/milvus-io/milvus/internal/util/trace/stack_trace.go:51 github.com/milvus-io/milvus/internal/util/trace.StackTrace\n/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:250 github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n/go/src/github.com/milvus-io/milvus/internal/distributed/querynode/client/client.go:269 github.com/milvus-io/milvus/internal/distributed/querynode/client.(*Client).GetMetrics\n/go/src/github.com/milvus-io/milvus/internal/querycoord/querynode.go:294 github.com/milvus-io/milvus/internal/querycoord.(*queryNode).getNodeInfo\n/go/src/github.com/milvus-io/milvus/internal/querycoord/cluster.go:568 github.com/milvus-io/milvus/internal/querycoord.(*queryNodeCluster).GetNodeInfoByID\n/go/src/github.com/milvus-io/milvus/internal/querycoord/query_coord.go:615 github.com/milvus-io/milvus/internal/querycoord.(*QueryCoord).loadBalanceSegmentLoop\n/usr/local/go/src/runtime/asm_amd64.s:1371 runtime.goexit\n"]
10/18/2022 9:51:52 AM [2022/10/18 02:51:52.500 +00:00] [WARN] [querycoord/query_coord.go:617] ["loadBalanceSegmentLoop: get node info from QueryNode failed"] [nodeID=23] [collection=436732014366818305] [replica=436728525035929835] [error="context deadline exceeded"]
10/18/2022 9:51:52 AM [2022/10/18 02:51:52.500 +00:00] [INFO] [querycoord/query_coord.go:646] ["loadBalanceSegmentLoop: memory usage rate of all online QueryNode"] [collection=436732014366818305] [replica=436728525035929835] ["mem rate"="{\"22\":0.025320922575985897,\"24\":0.0033836700718145826}"]
10/18/2022 9:51:52 AM [2022/10/18 02:51:52.575 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222190]
10/18/2022 9:51:52 AM [2022/10/18 02:51:52.576 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222190] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:52 AM [2022/10/18 02:51:52.576 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:52 AM [2022/10/18 02:51:52.577 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:53 AM [2022/10/18 02:51:53.577 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222204]
10/18/2022 9:51:53 AM [2022/10/18 02:51:53.578 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222204] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:53 AM [2022/10/18 02:51:53.578 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:53 AM [2022/10/18 02:51:53.578 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:54 AM [2022/10/18 02:51:54.577 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222218]
10/18/2022 9:51:54 AM [2022/10/18 02:51:54.578 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222218] [inMemoryPercentage="[100,0]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:54 AM [2022/10/18 02:51:54.578 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=0]
10/18/2022 9:51:54 AM [2022/10/18 02:51:54.578 +00:00] [INFO] [querycoord/impl.go:193] ["show collection end"] [role=querycoord] [collectionIDs="[]"] [msgID=0] [inMemoryPercentage="[0,100]"] [queryServiceAvailable="[true,true]"]
10/18/2022 9:51:55 AM [2022/10/18 02:51:55.579 +00:00] [INFO] [querycoord/impl.go:138] ["show collection start"] [role=querycoord] [collectionIDs="[]"] [msgID=436747372559222232]
Query node logs:
[2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_14]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_20]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_0]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_15]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_1]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_10]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_16]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_11]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_17]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_12]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_18]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_13]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_19]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.484 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_2]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.502 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_22]
10/18/2022 9:50:09 AM [2022/10/18 02:50:09.503 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_23]
10/18/2022 9:50:13 AM [2022/10/18 02:50:13.092 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:50:13 AM [2022/10/18 02:50:13.093 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:50:13 AM [2022/10/18 02:50:13.195 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_24]
10/18/2022 9:50:13 AM [2022/10/18 02:50:13.215 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_25]
10/18/2022 9:50:21 AM [2022/10/18 02:50:21.500 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:50:21 AM [2022/10/18 02:50:21.503 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748004154933249] [tSafe_p=2022/10/18 02:50:17.217 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:50:38 AM [2022/10/18 02:50:38.384 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748005937512449] [tSafe_p=2022/10/18 02:50:24.017 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:50:44 AM [2022/10/18 02:50:44.354 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:50:44 AM [2022/10/18 02:50:44.355 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:50:44 AM [2022/10/18 02:50:44.355 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:50:44 AM [2022/10/18 02:50:44.360 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748007720091649] [tSafe_p=2022/10/18 02:50:30.817 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:50:51 AM [2022/10/18 02:50:51.445 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:50:51 AM [2022/10/18 02:50:51.445 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748009188098049] [tSafe_p=2022/10/18 02:50:36.417 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:51:00 AM [2022/10/18 02:51:00.750 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:51:05 AM [2022/10/18 02:51:05.615 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748013228785665] [tSafe_p=2022/10/18 02:50:51.831 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:51:09 AM [2022/10/18 02:51:09.553 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748017733992449] [tSafe_p=2022/10/18 02:51:09.017 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:51:11 AM [2022/10/18 02:51:11.768 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:51:14 AM [2022/10/18 02:51:14.711 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:51:23 AM [2022/10/18 02:51:23.090 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:51:24 AM [2022/10/18 02:51:24.982 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_26]
10/18/2022 9:51:24 AM [2022/10/18 02:51:24.983 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748018677710849] [tSafe_p=2022/10/18 02:51:12.617 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:51:30 AM [2022/10/18 02:51:30.487 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748021928296449] [tSafe_p=2022/10/18 02:51:25.017 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:51:30 AM [2022/10/18 02:51:30.488 +00:00] [DEBUG] [querynode/segment_loader.go:473] ["load index file"] [path=file/index_files/436733009136975874/1/436732014366818306/436733003868930051/RAW_DATA_27]
10/18/2022 9:51:38 AM [2022/10/18 02:51:38.916 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:51:39 AM [2022/10/18 02:51:39.785 +00:00] [DEBUG] [querynode/flow_graph_service_time_node.go:71] ["update tSafe:"] [collectionID=436732014366818305] [tSafe=436748025545621505] [tSafe_p=2022/10/18 02:51:38.816 +00:00] [channel=by-dev-rootcoord-dml_2_436732014366818305v0]
10/18/2022 9:51:44 AM [2022/10/18 02:51:44.546 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:51:46 AM [2022/10/18 02:51:46.664 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
10/18/2022 9:51:55 AM [2022/10/18 02:51:55.403 +00:00] [DEBUG] [querynode/impl.go:64] ["Get QueryNode component state done"] [stateCode=Healthy]
Expected Behavior
Load collection smoothly after release.
Steps To Reproduce
1. Create a collection, two columns: ID, Vector of dim 512
2. Create IVF_FLAT index.
3. Insert 3M vectors
4. Release collection.
5. Try to reload collection.
Milvus Log
No response
Anything else?
This might affect to load balancing, high availability feature of Milvus cluster.
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 23 (12 by maintainers)
/assign @TaQuangTu can you upload the querynode logs before the restart above?