milvus: [Bug]: It takes more than 5 minutes to load into memory
Is there an existing issue for this?
- I have searched the existing issues
Environment
- Milvus version:2.2
- Deployment mode(standalone or cluster):
- SDK version(e.g. pymilvus v2.0.0rc2):pymilvus v2.2
- OS(Ubuntu or CentOS):
- CPU/Memory:
- GPU:
- Others:
Current Behavior
1.I’ve set up an index 2.The load code used is: collection.load(partition_names=[xxx,xxx])
3.I created five partitions, three of which had zero data.I don’t know if it will affect
Expected Behavior
No response
Steps To Reproduce
No response
Milvus Log
[2022/12/12 09:55:29.535 +00:00] [DEBUG] [proxy/impl.go:829] [“GetCollectionStatistics received”] [traceID=489f0c53fd449c57] [role=proxy] [db=] [collection=xiaowei_platform] [2022/12/12 09:55:29.535 +00:00] [DEBUG] [proxy/impl.go:856] [“GetCollectionStatistics enqueued”] [traceID=489f0c53fd449c57] [role=proxy] [msgID=438000400339304456] [BeginTS=438000400339304456] [EndTS=438000400339304456] [db=] [collection=xiaowei_platform] [2022/12/12 09:55:29.535 +00:00] [INFO] [datacoord/services.go:282] [“received request to get collection statistics”] [traceID=489f0c53fd449c57] [module=DataCoord] [2022/12/12 09:55:29.535 +00:00] [INFO] [datacoord/services.go:295] [“success to get collection statistics”] [traceID=489f0c53fd449c57] [module=DataCoord] [response="stats:<key:"row_count" value:"142011" > status:<> "] [2022/12/12 09:55:29.536 +00:00] [DEBUG] [proxy/impl.go:889] [“GetCollectionStatistics done”] [traceID=489f0c53fd449c57] [role=proxy] [msgID=438000400339304456] [BeginTS=438000400339304456] [EndTS=438000400339304456] [db=] [collection=xiaowei_platform] [2022/12/12 09:55:29.536 +00:00] [DEBUG] [proxy/impl.go:2376] [“GetIndexState received”] [traceID=202b0335e2bf1b97] [role=proxy] [db=] [collection=xiaowei_platform] [field=] [“index name”=] [2022/12/12 09:55:29.537 +00:00] [DEBUG] [proxy/impl.go:2407] [“GetIndexState enqueued”] [traceID=202b0335e2bf1b97] [role=proxy] [MsgID=438000400339304457] [BeginTs=438000400339304457] [EndTs=438000400339304457] [db=] [collection=xiaowei_platform] [field=] [“index name”=] [2022/12/12 09:55:29.537 +00:00] [INFO] [indexcoord/index_coord.go:490] [“IndexCoord get index state”] [collectionID=437728473907200070] [indexName=_default_idx] [2022/12/12 09:55:29.537 +00:00] [ERROR] [indexcoord/index_coord.go:506] [“IndexCoord get index state fail”] [collectionID=437728473907200070] [indexName=_default_idx] [“fail reason”=“there is no index on collection: 437728473907200070 with the index name: _default_idx”] [stack=“github.com/milvus-io/milvus/internal/indexcoord.(*IndexCoord).GetIndexState\n\t/go/src/github.com/milvus-io/milvus/internal/indexcoord/index_coord.go:506\ngithub.com/milvus-io/milvus/internal/distributed/indexcoord.(*Server).GetIndexState\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/indexcoord/service.go:256\ngithub.com/milvus-io/milvus/internal/proto/indexpb._IndexCoord_GetIndexState_Handler.func1\n\t/go/src/github.com/milvus-io/milvus/internal/proto/indexpb/index_coord.pb.go:2448\ngithub.com/milvus-io/milvus/internal/util/logutil.UnaryTraceLoggerInterceptor\n\t/go/src/github.com/milvus-io/milvus/internal/util/logutil/grpc_interceptor.go:22\ngithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25\ngithub.com/grpc-ecosystem/go-grpc-middleware/tracing/opentracing.UnaryServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/tracing/opentracing/server_interceptors.go:38\ngithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:25\ngithub.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.3.0/chain.go:34\ngithub.com/milvus-io/milvus/internal/proto/indexpb._IndexCoord_GetIndexState_Handler\n\t/go/src/github.com/milvus-io/milvus/internal/proto/indexpb/index_coord.pb.go:2450\ngoogle.golang.org/grpc.(*Server).processUnaryRPC\n\t/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1283\ngoogle.golang.org/grpc.(*Server).handleStream\n\t/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1620\ngoogle.golang.org/grpc.(*Server).serveStreams.func1.2\n\t/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922”] [2022/12/12 09:55:29.538 +00:00] [DEBUG] [proxy/impl.go:2443] [“GetIndexState done”] [traceID=202b0335e2bf1b97] [role=proxy] [MsgID=438000400339304457] [BeginTs=438000400339304457] [EndTs=438000400339304457] [db=] [collection=xiaowei_platform] [field=] [“index name”=_default_idx]
Anything else?
No response
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 25 (13 by maintainers)
@binbinlv My scenario is that the collection has been used normally for a while, and then release it -> load it. In this case, the load is slow.