frigate: [Support]: Camera feeds keep crashing

Describe the problem you are having

I have had frigate for a while. It started intermittently losing connection to my cameras. I upgraded to latest version, which included upgrading all my HomeAssistant Notifications. Now that I am on the latest version, I am still having intermittent issues where one (or more) of my cameras start showing “no frames have been received, check error logs”

Rightnow its affecting only 1 of my cameras. But it does sometimes affect others. Logs below reflect current state, where only the “Frontdoor” camera is offline.

Version

0.12.1-367D724

Frigate config file

mqtt:
  host: 192.168.4.81
  port: 1883
  user: 
  password: 
detectors:
  coral:
    type: edgetpu
    device: usb
birdseye: 
  enabled: True
  mode: continuous
cameras:
  REDACTED:
    ffmpeg:
      hwaccel_args: -c:v h264_cuvid
      inputs:
        - path: rtsp://admin:REDACTED@192.168.4.252:554/cam/realmonitor?channel=1&subtype=0
    record: 
      enabled: True
      retain: 
        days: 2
      events:
        retain:
          default: 3
          mode: motion
    snapshots:
      enabled: True
    rtmp: 
      enabled: False
    detect:
      width: 640
      height: 480
  Backyard:
    ffmpeg:
      hwaccel_args: -c:v h264_cuvid
      inputs:
        - path: rtsp://admin:REDACTED!@192.168.7.180:554/cam/realmonitor?channel=1&subtype=0
    record: 
      enabled: True
      retain: 
        days: 2
      events:
        retain:
          default: 4
          mode: motion
    snapshots:
      enabled: True
    rtmp: 
      enabled: False
    detect:
      width: 640
      height: 480
    motion:
      mask:
        - 0,321,21,293,32,242,85,221,124,197,128,156,144,140,165,137,157,93,120,63,137,38,149,0,0,0
        - 225,0,358,0,350,53,325,62,307,83,267,72,241,66,231,47,229,0
    objects:
      track:
        - person
        - dog      
  REDACTED:
    ffmpeg:
      hwaccel_args: -c:v h264_cuvid
      inputs:
        - path: rtsp://admin:REDACTED@192.168.5.5:554/cam/realmonitor?channel=1&subtype=0
    record: 
      enabled: True
      retain: 
        days: 2
      events:
        retain:
          default: 3
          mode: motion
    snapshots:
      enabled: True
    rtmp: 
      enabled: False
    motion:
      mask:
        - 0,0,0,379,63,176,74,99,122,0
    detect:
      width: 640
      height: 480
  Frontdoor:
    ffmpeg:
      hwaccel_args: -c:v h264_cuvid
      inputs:
        - path: rtsp://admin:REDACTED@192.168.7.166:554/cam/realmonitor?channel=1&subtype=0
    record: 
      enabled: True
      retain: 
        days: 2
      events:
        retain:
          default: 4
          mode: motion
    snapshots:
      enabled: True
    rtmp: 
      enabled: False
    detect:
      width: 720
      height: 576
    objects:
      track:
        - person
        - dog
  Garage:
    ffmpeg:
      hwaccel_args: -c:v h264_cuvid
      inputs:
        - path: rtsp://admin:REDACTED@192.168.4.202:554/cam/realmonitor?channel=1&subtype=0
    record: 
      enabled: True
      retain: 
        days: 2
      events:
        retain:
          default: 4
          mode: motion
    snapshots:
      enabled: True
    rtmp: 
      enabled: False
    detect:
      width: 1280
      height: 720

Relevant log output

Here's what looks relevant to me.

2023-08-30 16:51:04.742161520  [2023-08-30 16:51:04] frigate.video                  ERROR   : Frontdoor: Unable to read frames from ffmpeg process.
2023-08-30 16:51:04.742491216  [2023-08-30 16:51:04] frigate.video                  ERROR   : Frontdoor: ffmpeg process is not running. exiting capture thread...
2023-08-30 16:51:09.726873377  [2023-08-30 16:51:09] watchdog.Frontdoor             ERROR   : Ffmpeg process crashed unexpectedly for Frontdoor.
2023-08-30 16:51:09.727454843  [2023-08-30 16:51:09] watchdog.Frontdoor             ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-08-30 16:51:09.727714029  [2023-08-30 16:51:09] ffmpeg.Frontdoor.detect        ERROR   : [tcp @ 0x5597d305d540] Connection to tcp://192.168.7.166:554?timeout=5000000 failed: Connection timed out
2023-08-30 16:51:09.728317532  [2023-08-30 16:51:09] ffmpeg.Frontdoor.detect        ERROR   : rtsp://*:*@192.168.7.166:554/cam/realmonitor?channel=1&subtype=0: Connection timed out
2023-08-30 16:51:12.809836361  [2023-08-30 16:51:12] frigate.video                  ERROR   : Frontdoor: Unable to read frames from ffmpeg process.
2023-08-30 16:51:12.810162091  [2023-08-30 16:51:12] frigate.video                  ERROR   : Frontdoor: ffmpeg process is not running. exiting capture thread...
2023-08-30 16:51:19.755044528  [2023-08-30 16:51:19] watchdog.Frontdoor             ERROR   : Ffmpeg process crashed unexpectedly for Frontdoor.
2023-08-30 16:51:19.755337704  [2023-08-30 16:51:19] watchdog.Frontdoor             ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-08-30 16:51:19.755588413  [2023-08-30 16:51:19] ffmpeg.Frontdoor.detect        ERROR   : [tcp @ 0x563a1d090540] Connection to tcp://192.168.7.166:554?timeout=5000000 failed: No route to host
2023-08-30 16:51:19.755815259  [2023-08-30 16:51:19] ffmpeg.Frontdoor.detect        ERROR   : rtsp://*:*@192.168.7.166:554/cam/realmonitor?channel=1&subtype=0: No route to host
2023-08-30 16:51:24.783033304  [2023-08-30 16:51:24] frigate.video                  ERROR   : Frontdoor: Unable to read frames from ffmpeg process.
2023-08-30 16:51:24.783146871  [2023-08-30 16:51:24] frigate.video                  ERROR   : Frontdoor: ffmpeg process is not running. exiting capture thread...
2023-08-30 16:51:29.765519222  [2023-08-30 16:51:29] watchdog.Frontdoor             ERROR   : Ffmpeg process crashed unexpectedly for Frontdoor.
2023-08-30 16:51:29.765769357  [2023-08-30 16:51:29] watchdog.Frontdoor             ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-08-30 16:51:29.765955917  [2023-08-30 16:51:29] ffmpeg.Frontdoor.detect        ERROR   : [tcp @ 0x55c5ad61a540] Connection to tcp://192.168.7.166:554?timeout=5000000 failed: Connection timed out
2023-08-30 16:51:29.766172144  [2023-08-30 16:51:29] ffmpeg.Frontdoor.detect        ERROR   : rtsp://*:*@192.168.7.166:554/cam/realmonitor?channel=1&subtype=0: Connection timed out
2023-08-30 16:51:31.671919661  [2023-08-30 16:51:31] frigate.video                  ERROR   : Frontdoor: Unable to read frames from ffmpeg process.
2023-08-30 16:51:31.672140085  [2023-08-30 16:51:31] frigate.video                  ERROR   : Frontdoor: ffmpeg process is not running. exiting capture thread...
2023-08-30 16:51:39.774300671  [2023-08-30 16:51:39] watchdog.Frontdoor             ERROR   : Ffmpeg process crashed unexpectedly for Frontdoor.
2023-08-30 16:51:39.774324526  [2023-08-30 16:51:39] watchdog.Frontdoor             ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2023-08-30 16:51:39.774390231  [2023-08-30 16:51:39] ffmpeg.Frontdoor.detect        ERROR   : [AVHWDeviceContext @ 0x556aa3253e80] cu->cuInit(0) failed -> CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected
2023-08-30 16:51:39.774403269  [2023-08-30 16:51:39] ffmpeg.Frontdoor.detect        ERROR   : Error while opening decoder for input stream #0:0 : Generic error in an external library
2023-08-30 16:51:41.487462987  [2023-08-30 16:51:41] frigate.video                  ERROR   : Frontdoor: Unable to read frames from ffmpeg process.
2023-08-30 16:51:41.487813125  [2023-08-30 16:51:41] frigate.video                  ERROR   : Frontdoor: ffmpeg process is not running. exiting capture thread...
2023-08-30 16:51:49.782399265  [2023-08-30 16:51:49] watchdog.Frontdoor             ERROR   : Ffmpeg process crashed unexpectedly for Frontdoor.

FFprobe output from your camera

For the camera that's currently offline:

[{"return_code":0,"stderr":"","stdout":{"programs":[],"streams":[{"avg_frame_rate":"15/1","codec_long_name":"H.264/AVC/MPEG-4AVC/MPEG-4part10","height":1920,"width":2560},{"avg_frame_rate":"0/0","bit_rate":"128000","codec_long_name":"PCMmu-law/G.711mu-law"}]}}]

Frigate stats

{
    "Backyard": {
        "camera_fps": 5,
        "capture_pid": 739,
        "detection_enabled": 1,
        "detection_fps": 0.5,
        "ffmpeg_pid": 378677,
        "pid": 729,
        "process_fps": 5.1,
        "skipped_fps": 0
    },
    "Frontdoor": {
        "camera_fps": 0,
        "capture_pid": 747,
        "detection_enabled": 1,
        "detection_fps": 0,
        "ffmpeg_pid": 690852,
        "pid": 732,
        "process_fps": 6.1,
        "skipped_fps": 0
    },
    "Garage": {
        "camera_fps": 5,
        "capture_pid": 755,
        "detection_enabled": 1,
        "detection_fps": 0,
        "ffmpeg_pid": 378639,
        "pid": 734,
        "process_fps": 5,
        "skipped_fps": 0
    },
    "REDACTED": {
        "camera_fps": 5.1,
        "capture_pid": 735,
        "detection_enabled": 1,
        "detection_fps": 0,
        "ffmpeg_pid": 378640,
        "pid": 727,
        "process_fps": 5.1,
        "skipped_fps": 0
    },
    "REDACTED": {
        "camera_fps": 5.1,
        "capture_pid": 744,
        "detection_enabled": 1,
        "detection_fps": 0,
        "ffmpeg_pid": 378641,
        "pid": 731,
        "process_fps": 5.1,
        "skipped_fps": 0
    },
    "cpu_usages": {
        "1": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "15": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "17": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "24": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "25": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "26": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "27": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "28": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "29": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "30": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "31": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "32": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "41": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "42": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "79": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "80": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "82": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "89": {
            "cpu": "0.0",
            "mem": "0.1"
        },
        "97": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "98": {
            "cpu": "2.0",
            "mem": "1.2"
        },
        "112": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "134": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "135": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "136": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "137": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "146": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "160": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "191": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "239": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "281": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "320": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "356": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "397": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "430": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "468": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "502": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "532": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "715": {
            "cpu": "0.0",
            "mem": "0.2"
        },
        "721": {
            "cpu": "0.7",
            "mem": "0.0"
        },
        "724": {
            "cpu": "1.0",
            "mem": "0.2"
        },
        "727": {
            "cpu": "0.7",
            "mem": "0.2"
        },
        "728": {
            "cpu": "0.0",
            "mem": "0.1"
        },
        "729": {
            "cpu": "0.7",
            "mem": "0.2"
        },
        "730": {
            "cpu": "0.0",
            "mem": "0.1"
        },
        "731": {
            "cpu": "0.7",
            "mem": "0.2"
        },
        "732": {
            "cpu": "0.0",
            "mem": "0.2"
        },
        "733": {
            "cpu": "0.0",
            "mem": "0.1"
        },
        "734": {
            "cpu": "1.0",
            "mem": "0.3"
        },
        "735": {
            "cpu": "1.0",
            "mem": "0.2"
        },
        "736": {
            "cpu": "0.0",
            "mem": "0.1"
        },
        "739": {
            "cpu": "0.7",
            "mem": "0.2"
        },
        "742": {
            "cpu": "0.0",
            "mem": "0.1"
        },
        "744": {
            "cpu": "1.0",
            "mem": "0.2"
        },
        "747": {
            "cpu": "0.7",
            "mem": "0.2"
        },
        "750": {
            "cpu": "0.0",
            "mem": "0.1"
        },
        "755": {
            "cpu": "1.7",
            "mem": "0.2"
        },
        "378639": {
            "cpu": "22.0",
            "mem": "0.5"
        },
        "378640": {
            "cpu": "18.3",
            "mem": "0.4"
        },
        "378641": {
            "cpu": "18.7",
            "mem": "0.4"
        },
        "378677": {
            "cpu": "24.7",
            "mem": "0.4"
        },
        "560792": {
            "cpu": "0.0",
            "mem": "0.8"
        },
        "690832": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "690870": {
            "cpu": "0.0",
            "mem": "0.0"
        },
        "%Cpu(s):": {
            "cpu": "id,",
            "mem": "0.0"
        },
        "MiB": {
            "cpu": "28995.2",
            "mem": "avail"
        },
        "PID": {
            "cpu": "%CPU",
            "mem": "%MEM"
        },
        "Tasks:": {
            "cpu": "stopped,",
            "mem": "0"
        },
        "top": {
            "cpu": "users,",
            "mem": "load"
        }
    },
    "detection_fps": 0.5,
    "detectors": {
        "coral": {
            "detection_start": 0,
            "inference_speed": 9.75,
            "pid": 560792
        }
    },
    "gpu_usages": {
        "error-gpu": {
            "gpu": -1,
            "mem": -1
        }
    },
    "service": {
        "last_updated": 1693511264,
        "latest_version": "0.12.1",
        "storage": {
            "/dev/shm": {
                "free": 112.5,
                "mount_type": "tmpfs",
                "total": 134.2,
                "used": 21.7
            },
            "/media/frigate/clips": {
                "free": 337449.5,
                "mount_type": "ext4",
                "total": 982820.9,
                "used": 595371.3
            },
            "/media/frigate/recordings": {
                "free": 337449.5,
                "mount_type": "ext4",
                "total": 982820.9,
                "used": 595371.3
            },
            "/tmp/cache": {
                "free": 983.5,
                "mount_type": "tmpfs",
                "total": 1000,
                "used": 16.5
            }
        },
        "temperatures": {},
        "uptime": 523519,
        "version": "0.12.1-367d724"
    }
}

Operating system

Other Linux

Install method

Docker Compose

Coral version

USB

Network connection

Wired

Camera make and model

Amcrest AD110

Any other information that may be helpful

No response

About this issue

  • Original URL
  • State: closed
  • Created 10 months ago
  • Comments: 97

Most upvoted comments

Yes, multiple containers can access the nvidia gpu at the same

+1
NickM-27 on Oct 5, 2023

5fps is plenty for my re-streaming purposes. So then I wont bother with the go2rtc since I can use HA to get 5fps on all my cameras using the frigate card. That works for me. I will stop making changes for now I guess. I am comfortable with my re-streaming situation and my HA notifications. Hopefully the updated plugin setting you mentioned keeps the cameras online for longer. Thank you again for this discussion.

+1
Maxxell on Aug 31, 2023
Read more comments on GitHub
← frigate: [Support]: bug with Proxmox (takes down Proxmox entirely with a green screen)
frigate: [Support]: Clips from notifications cause error 'wait' error on HA Android (but clips still play) →