milvus: [Bug]:[Memory] memory leak on 2.0.0-rc8

Is there an existing issue for this?

I have searched the existing issues

Environment

- Milvus version: 2.0.0-rc8 
- Deployment mode(standalone or cluster):standalone
- SDK version(e.g. pymilvus v2.0.0rc2):2.0.0rc8
- OS(Ubuntu or CentOS): Ubuntu
- CPU/Memory: 128G
- GPU: N/A
- Others:

Current Behavior

When I ran Milvus 2.0.0-rc8 in standalone mode on ubuntu 20.2. I noticed followings: 1.Memory leak, both with/without loading the collection, there is about 3-4 GB memory lost. The lost memory seems to be added to buff/cache. Following is a snapshot after several days run. The system has been idle during the time. MiB Mem : 127350.3 total, 98087.9 free, 2992.0 used, 26270.4 buff/cache

Can someone help take a look at this issue? Thanks.

Expected Behavior

No outstanding memory leak.

Steps To Reproduce

1. installation steps:
https://milvus.io/docs/install_standalone-docker.md

2. load vector, about 2k

3.system run idle and use top to check the memory usage

Anything else?

No response

About this issue

Original URL
State: closed
Created 3 years ago
Comments: 20 (12 by maintainers)

Most upvoted comments

The data increase is a expect behavior, even if user didn’t ingest any data, the system will ingest time tick into it every 100ms. Rmq will purge expired data after 7 days, you may want to reduce the time by change rocksmq.retentionTimeInMinutes.

However, the 3-4GB memory leakage is weird, I will investigating on that

xiaofan-luan on Nov 30, 2021