redis: Redis client fails to process all the requests.
We are migrating our system from Redis++ to Boost.Redis. We have a problem processing a relatively large number (~800) of HSET requests. About 80 of them are processed successfully, and after them the client seems to disconnect and all of them failed with ‘Operation canceled’ error.
Any suggestions on how we can improve the implementation so that all our requests are processed without problems? The same use case works fine with Redis++.
A simplified version of our code:
auto stream = "stream";
for (const auto& [key, value]: map) {
auto req = make_shared<boost::redis::request>();
req.push("HSET", stream, key, payload(value));
_redis_client.async_exec(*req, boost::redis::ignore, [req](auto& ec, auto){ std::cerr<< (ec?"Failure":"Success") << '\n';}_
}
If we try to push all our changes in the same request and send it to redis only once, it always fails.
About this issue
- Original URL
- State: closed
- Created 7 months ago
- Comments: 30
Thank you for the feedback and code example. I’ve updated my example to factor out Redis and minimize API to communicate with it. I used
asio::postsimilar to our internal use case. This version works very well, including very large values (I tested 8k requests with 300k payload each).I think the issue is solved now, so I’m closing it. Thank you once again for your help!
Also just wanted to mention what a pleasure it is to read your code!
The benchmark is now available at https://github.com/tsar-rec/boost-redis-benchmark. If compiled as described there, it can process 20 HSET requests of size 1000 each, but almost always fails (stuck) with 200 requests of size 1000 or larger request size.