orleans: Failing reminders

I got this error multiple times. Is this type of failing reminder (every 3 minutes) to be expected as a normal course of operation?

fail: Orleans.Runtime.ReminderService.LocalReminderService[102915]
      Could not deliver reminder tick for [http://feeds.twincities.com/mngi/rss/CustomRssServlet/569/201033.xml, GrainReference:*grn/9FC29EAA/0000000000000000000000000000000003ffffff9fc29eaa-0x5ECFF8A5, 00:03:00, 2020-08-25 09:00:26.339 GMT, cbc7a65a-0c80-4c1a-b68f-9541c07522b3, 76, Ticking], next 8/25/2020 9:03:56 AM.
      System.TimeoutException: Response did not arrive on time in 00:00:30 for message: Request S127.0.0.1:11111:336041936*stg/0/00000000@S00000000->S127.0.0.1:11111:336041936*grn/9FC29EAA/00000000@5d6415b6 #440. Target History is: <S127.0.0.1:11111:336041936:*grn/9FC29EAA/00000000:@5d6415b6>.
         at Orleans.Runtime.ReminderService.LocalReminderService.LocalReminderData.OnTimerTick()

The relevant code is here

About this issue

Original URL
State: closed
Created 4 years ago
Comments: 15 (7 by maintainers)

Most upvoted comments

OK thanks - I’ll file this under “don’t worry about it”.

dodyg on Sep 1, 2020

Years ago, we tested and found that we could easily hold on the order of 300K -500K reminders per silo. I imagine it should be much higher now with all the performance and memory management improvements both in Orleans and .NET Core.

sergeybykov on Aug 31, 2020

The grain just has a single http call per url to fetch an RSS feed. Let me adjust the HttpClient timeout to 10 seconds (the default is 100 seconds) and see if I still get this time out.

dodyg on Aug 26, 2020