milvus: [Bug]: Nightly tests hang [standalone]

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version: dd24ea3
- Deployment mode(standalone or cluster): standalone
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

On standalone mode, nightly test cases (L0, L1, L2) are hanging.

Previously maximum dim and partition numbers test cases are skipped.

And in cluster mode, tests hangs for issue 11304.

While in standalone mode, it hangs. But from test client, it is no any errors which is different from cluster mode, so file another issue to track this in case of different root cause.

Logs: standalone mode https://ci.milvus.io:18080/jenkins/job/milvus-nightly-ci/job/master/206/

Expected Behavior

No tests hang

Steps To Reproduce

Run nightly tests

Anything else?

No response

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 24 (24 by maintainers)

Most upvoted comments

@congqixia any updates?

And could you please update what you have found in this issue? Thanks.

Nightly 210 and 212 both hang when datanode tried to Seek using MqttMsgstream. In distributed cases, the under-hood component should be pulsar. Still trying to find the root cause.