sidekiq-statistic: The gem does not scale
We deployed this gem on a fairly busy sidekiq app. It wound up shooting our memory usage up to 1.9 GB after 3 weeks. After removing sidekiq-statistic and all of the large-sized :timeslist stores, it brought our memory usage down to under 30 MB. I’m not sure if there is a solution for this, maybe limiting the data that can be retrieved over time, however it should be known that sidekiq-statistic is definitely not suitable for high usage apps.
About this issue
- Original URL
- State: closed
- Created 9 years ago
- Reactions: 4
- Comments: 16 (4 by maintainers)
I’ve posted a potential solution for this issue at https://github.com/davydovanton/sidekiq-statistic/pull/107.
Running into similar issue. Maybe apply date range when storing stats in redis – store only stats data for last x months/days/year. Is that possible?