librealsense: "RuntimeError: Frame didn't arrive within 5000" with D415 and D435

Required Info
Camera Model	D415 and D435
Firmware Version	05.12.14.50 and 5.12.12.100
Operating System & Version	Win 10
Platform	PC (Optiplex 7080 with Intel I5)
SDK Version	2.48.0.3381
Language	Python v3.7

Issue Description

When retrieving the color stream of our D415 and D435 camera we often get the error:

RuntimeError: Frame didn't arrive within 5000

This usually happens when we start our system and do the first request of the color frame but sometimes also after the system was already running for a while. The error seemingly shows up randomly. It not just happens in our python code but also from time to time in the Realsense Viewer (here the video visibly lags and sometimes shows the error message “No frames received”). We have been running into this issue for half a year now, so this was already the case for older firmware and SDK versions.

We have tried unplugging our camera or doing a hardware reset in our python code, but it usually does not solve the issue. Changing the USB cable also doesn’t do anything. Sometimes it does however help to restart our PC. We usually just take a break when it happens and after a while it will often work again. It is really annoying though.

We are aware of other issues about this error (#9270, #8691, #5181, #2168, #6628, and #927) but none of the proposed solutions have worked for us.

We are using the cameras for live video streaming not for recording videos.