sidekiq-statistic: The gem does not scale

We deployed this gem on a fairly busy sidekiq app. It wound up shooting our memory usage up to 1.9 GB after 3 weeks. After removing sidekiq-statistic and all of the large-sized :timeslist stores, it brought our memory usage down to under 30 MB. I’m not sure if there is a solution for this, maybe limiting the data that can be retrieved over time, however it should be known that sidekiq-statistic is definitely not suitable for high usage apps.

About this issue

  • Original URL
  • State: closed
  • Created 9 years ago
  • Reactions: 4
  • Comments: 16 (4 by maintainers)

Most upvoted comments

I’ve posted a potential solution for this issue at https://github.com/davydovanton/sidekiq-statistic/pull/107.

Running into similar issue. Maybe apply date range when storing stats in redis – store only stats data for last x months/days/year. Is that possible?