milvus: [Bug]: [Nightly]Load collection failed with error message 'wait for loading collection timeout'

Is there an existing issue for this?

• I have searched the existing issues

Environment

- Milvus version:29f2ed6
- Deployment mode(standalone or cluster):cluster
- SDK version(e.g. pymilvus v2.0.0rc2):2.2.0.dev69
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

Load collection failed with error message ‘wait for loading collection timeout’.

[2022-11-01T19:19:18.324Z] [2022-11-01 18:24:02 - ERROR - pymilvus.decorators]: RPC error: [wait_for_loading_collection], <MilvusException: (code=1, message=wait for loading collection timeout, collection: search_collection_3HtD3MeA)>, <Time:{'RPC start': '2022-11-01 18:23:42.234751', 'RPC error': '2022-11-01 18:24:02.314642'}> (decorators.py:108)
[2022-11-01T19:19:18.324Z] [2022-11-01 18:24:02 - WARNING - pymilvus.decorators]: Retry timeout: 20s (decorators.py:79)
[2022-11-01T19:19:18.324Z] [2022-11-01 18:24:02 - ERROR - pymilvus.decorators]: RPC error: [load_collection], <MilvusException: (code=1, message=Retry timeout: 20s, message=wait for loading collection timeout, collection: search_collection_3HtD3MeA)>, <Time:{'RPC start': '2022-11-01 18:23:42.222611', 'RPC error': '2022-11-01 18:24:02.315429'}> (decorators.py:108)
[2022-11-01T19:19:18.324Z] [2022-11-01 18:24:02 - ERROR - ci_test]: Traceback (most recent call last):
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 50, in handler
[2022-11-01T19:19:18.324Z]     return func(self, *args, **kwargs)
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/client/grpc_handler.py", line 668, in load_collection
[2022-11-01T19:19:18.324Z]     self.wait_for_loading_collection(collection_name, timeout)
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 109, in handler
[2022-11-01T19:19:18.324Z]     raise e
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 105, in handler
[2022-11-01T19:19:18.324Z]     return func(*args, **kwargs)
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 136, in handler
[2022-11-01T19:19:18.324Z]     ret = func(self, *args, **kwargs)
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 85, in handler
[2022-11-01T19:19:18.324Z]     raise e
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 50, in handler
[2022-11-01T19:19:18.324Z]     return func(self, *args, **kwargs)
[2022-11-01T19:19:18.324Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/client/grpc_handler.py", line 690, in wait_for_loading_collection
[2022-11-01T19:19:18.325Z]     raise MilvusException(message=f"wait for loading collection timeout, collection: {collection_name}")
[2022-11-01T19:19:18.325Z] pymilvus.exceptions.MilvusException: <MilvusException: (code=1, message=wait for loading collection timeout, collection: search_collection_3HtD3MeA)>
[2022-11-01T19:19:18.325Z] 
[2022-11-01T19:19:18.325Z] The above exception was the direct cause of the following exception:
[2022-11-01T19:19:18.325Z] 
[2022-11-01T19:19:18.325Z] Traceback (most recent call last):
[2022-11-01T19:19:18.325Z]   File "/home/jenkins/agent/workspace/tests/python_client/utils/api_request.py", line 26, in inner_wrapper
[2022-11-01T19:19:18.325Z]     res = func(*args, **_kwargs)
[2022-11-01T19:19:18.325Z]   File "/home/jenkins/agent/workspace/tests/python_client/utils/api_request.py", line 57, in api_request
[2022-11-01T19:19:18.325Z]     return func(*arg, **kwargs)
[2022-11-01T19:19:18.325Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/orm/collection.py", line 476, in load
[2022-11-01T19:19:18.325Z]     conn.load_collection(self._name, replica_number=replica_number, timeout=timeout, **kwargs)
[2022-11-01T19:19:18.325Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 109, in handler
[2022-11-01T19:19:18.325Z]     raise e
[2022-11-01T19:19:18.325Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 105, in handler
[2022-11-01T19:19:18.325Z]     return func(*args, **kwargs)
[2022-11-01T19:19:18.325Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 136, in handler
[2022-11-01T19:19:18.325Z]     ret = func(self, *args, **kwargs)
[2022-11-01T19:19:18.325Z]   File "/usr/local/lib/python3.8/site-packages/pymilvus/decorators.py", line 80, in handler
[2022-11-01T19:19:18.325Z]     raise MilvusException(e.code, f"{timeout_msg}, message={e.message}") from e
[2022-11-01T19:19:18.325Z] pymilvus.exceptions.MilvusException: <MilvusException: (code=1, message=Retry timeout: 20s, message=wait for loading collection timeout, collection: search_collection_3HtD3MeA)>
[2022-11-01T19:19:18.325Z]  (api_request.py:39)
[2022-11-01T19:19:18.325Z] [2022-11-01 18:24:02 - ERROR - ci_test]: (api_response) : <MilvusException: (code=1, message=Retry timeout: 20s, message=wait for loading collection timeout, collection: search_collection_3HtD3MeA)> (api_request.py:40)

Expected Behavior

PASS

Steps To Reproduce

nightly: https://jenkins.milvus.io:18080/blue/organizations/jenkins/Milvus Nightly CI/detail/master/180/pipeline/155

Milvus Log

1. log: artifacts-milvus-distributed-kafka-nightly-180-pymilvus-e2e-logs.tar.gz
2. collection name: search_collection_3HtD3MeA
3. failed time: [2022-11-01T18:24:02.638Z] [gw4] [ 51%] FAILED testcases/test_search.py::TestCollectionSearch::test_search_collection_after_release_load[5000-2-8-True-False]

Anything else?

No response