frigate: [Support]: Missing objects

Describe the problem you are having

Sometimes Frigate misses a car coming on to my drive and has happened both day and night. Here is a screenshot to help show how a car would enter the drive: https://d.pr/i/mnwAJ1. It only happens with the light blue car, so one thing I can think of is the light blue car is able to drive in quicker due to the angle, so perhaps it isn’t getting picked up on the drive entance zone (closest to the road). Another is maybe the car tracking is lost due to the white van and then not being picked back up after. Or perhaps a mix of both. Does this seem a possibility, or perhaps something else at play?

Version

0.11.0-c461c9e (RC 2)

Frigate config file

mqtt:
  host:
  user:
  password:

cameras:
  front:
    ffmpeg:
      hwaccel_args: -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format yuv420p
      inputs:
        - path: rtsp://...
          roles:
            - detect
            - rtmp
        - path: rtsp://...
          roles:
            - record
    detect:
      width: 704
      height: 480
      fps: 5
    motion:
      threshold: 20 # default 25
      # improve_contrast: True
      mask:
        - 0,174,0,0,74,0,142,0,149,78,181,76,231,84,138,144,0,229
        - 704,159,704,480,558,480,583,133
        - 705,35,705,0,510,0,510,35
    objects:
      track:
        - person
        - car
      filters:
        person:
          min_score: 0.65
        car:
          min_score: 0.65
    zones:
      drive_entrance:
        coordinates: 598,116,601,154,445,124,467,96
        objects:
          - car
      drive:
        coordinates: 573,480,187,480,102,303,86,261,283,118,357,119,445,128,431,150,590,188
        objects:
          - person
    record:
      enabled: True 
      events:
        required_zones:
          - drive_entrance
          - drive
        retain:
          default: 10
          mode: active_objects
          objects:
            car: 2

    snapshots:
      enabled: True
      bounding_box: True
      required_zones:
        - drive_entrance
        - drive
    mqtt:
      required_zones:
        - drive_entrance
        - drive

detectors:
  coral:
    type: edgetpu
    device: usb

Relevant log output

[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
[2022-09-17 20:48:16] frigate.app                    INFO    : Starting Frigate (0.11.0-c461c9e)
Starting migrations
[2022-09-17 20:48:16] peewee_migrate                 INFO    : Starting migrations
There is nothing to migrate
[2022-09-17 20:48:16] peewee_migrate                 INFO    : There is nothing to migrate
[2022-09-17 20:48:16] ws4py                          INFO    : Using epoll
[2022-09-17 20:48:16] frigate.app                    INFO    : Output process started: 218
[2022-09-17 20:48:16] frigate.app                    INFO    : Camera processor started for front: 224
[2022-09-17 20:48:16] frigate.app                    INFO    : Capture process started for front: 227
[2022-09-17 20:48:17] ws4py                          INFO    : Using epoll
[2022-09-17 20:48:16] detector.coral                 INFO    : Starting detection process: 216
[2022-09-17 20:48:16] frigate.edgetpu                INFO    : Attempting to load TPU as usb
[2022-09-17 20:48:19] frigate.edgetpu                INFO    : TPU found
[2022-09-17 20:48:29] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43360]
[2022-09-17 20:48:31] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43360]
[2022-09-17 20:51:13] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43362]
[2022-09-17 21:03:25] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43362]
[2022-09-18 08:43:28] frigate.watchdog               INFO    : Detection appears to be stuck. Restarting detection process...
[2022-09-18 08:43:28] root                           INFO    : Waiting for detection process to exit gracefully...
[2022-09-18 08:43:58] root                           INFO    : Detection process didnt exit. Force killing...
[2022-09-18 08:43:58] detector.coral                 INFO    : Starting detection process: 13290
[2022-09-18 08:43:58] frigate.edgetpu                INFO    : Attempting to load TPU as usb
[2022-09-18 08:44:01] frigate.edgetpu                INFO    : TPU found
[2022-09-18 09:22:56] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43364]
[2022-09-18 09:23:39] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43364]
[2022-09-18 12:49:43] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43368]
[2022-09-18 12:49:53] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43368]
[2022-09-18 17:59:49] frigate.watchdog               INFO    : Detection appears to be stuck. Restarting detection process...
[2022-09-18 17:59:49] root                           INFO    : Waiting for detection process to exit gracefully...
[2022-09-18 18:00:19] root                           INFO    : Detection process didnt exit. Force killing...
[2022-09-18 18:00:19] detector.coral                 INFO    : Starting detection process: 23412
[2022-09-18 18:00:19] frigate.edgetpu                INFO    : Attempting to load TPU as usb
[2022-09-18 18:00:22] frigate.edgetpu                INFO    : TPU found
[2022-09-18 19:33:35] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43370]
[2022-09-18 19:40:16] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43370]
[2022-09-19 11:57:41] frigate.watchdog               INFO    : Detection appears to be stuck. Restarting detection process...
[2022-09-19 11:57:41] root                           INFO    : Waiting for detection process to exit gracefully...
[2022-09-19 11:58:11] root                           INFO    : Detection process didnt exit. Force killing...
[2022-09-19 11:58:11] detector.coral                 INFO    : Starting detection process: 42914
[2022-09-19 11:58:11] frigate.edgetpu                INFO    : Attempting to load TPU as usb
[2022-09-19 11:58:14] frigate.edgetpu                INFO    : TPU found
[2022-09-19 14:51:26] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43372]
[2022-09-19 14:51:28] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:8082 | Remote => 127.0.0.1:41870]
[2022-09-19 14:51:29] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:8082 | Remote => 127.0.0.1:41870]
[2022-09-19 14:52:49] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43374]
[2022-09-19 14:52:52] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43374]
[2022-09-19 14:55:31] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43372]
[2022-09-19 20:45:26] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43376]
[2022-09-19 20:45:35] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:8082 | Remote => 127.0.0.1:41872]
[2022-09-19 20:45:52] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:8082 | Remote => 127.0.0.1:41872]
[2022-09-19 20:46:01] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43376]
[2022-09-19 20:49:20] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43378]
[2022-09-19 20:49:36] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43378]
[cont-finish.d] executing container finish scripts...
[cont-finish.d] done.
[s6-finish] waiting for services.
[2022-09-19 20:49:36] frigate.video                  ERROR   : front: Unable to read frames from ffmpeg process.
[2022-09-19 20:49:36] frigate.video                  ERROR   : front: ffmpeg process is not running. exiting capture thread...
[s6-finish] sending all processes the TERM signal.
[s6-finish] sending all processes the KILL signal and exiting.
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
[2022-09-19 20:49:43] frigate.app                    INFO    : Starting Frigate (0.11.0-c461c9e)
Starting migrations
[2022-09-19 20:49:43] peewee_migrate                 INFO    : Starting migrations
There is nothing to migrate
[2022-09-19 20:49:43] peewee_migrate                 INFO    : There is nothing to migrate
[2022-09-19 20:49:43] frigate.app                    INFO    : Output process started: 217
[2022-09-19 20:49:43] frigate.app                    INFO    : Camera processor started for front: 220
[2022-09-19 20:49:43] frigate.app                    INFO    : Capture process started for front: 222
[2022-09-19 20:49:43] ws4py                          INFO    : Using epoll
[2022-09-19 20:49:43] ws4py                          INFO    : Using epoll
[2022-09-19 20:49:43] detector.coral                 INFO    : Starting detection process: 215
[2022-09-19 20:49:43] frigate.edgetpu                INFO    : Attempting to load TPU as usb
[2022-09-19 20:49:46] frigate.edgetpu                INFO    : TPU found
[2022-09-19 20:49:53] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43380]
[2022-09-19 20:49:57] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43380]
[2022-09-19 21:07:32] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43382]
[2022-09-19 21:07:35] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43382]
[2022-09-19 21:52:30] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43384]
[2022-09-19 21:52:36] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43384]
[2022-09-19 21:52:36] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43386]
[2022-09-19 21:52:37] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43386]
[2022-09-19 21:52:37] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43388]
[2022-09-19 21:52:37] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43388]
[2022-09-19 21:52:37] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43390]
[2022-09-19 21:52:37] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43390]
[2022-09-19 21:52:37] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:43392]

FFprobe output from your camera

Tried in the Frigate container and on my Mac, couldn't seem to get this to work.

Frigate stats

{
  "detection_fps": 0,
  "detectors": {
    "coral": {
      "detection_start": 0,
      "inference_speed": 9.36,
      "pid": 215
    }
  },
  "front": {
    "camera_fps": 5.1,
    "capture_pid": 222,
    "detection_fps": 0,
    "pid": 220,
    "process_fps": 5.1,
    "skipped_fps": 0
  },
  "service": {
    "latest_version": "0.10.1",
    "storage": {
      "/dev/shm": {
        "free": 133.1,
        "mount_type": "tmpfs",
        "total": 134.2,
        "used": 1.1
      },
      "/media/frigate/clips": {
        "free": 83890.4,
        "mount_type": "ext4",
        "total": 102221.2,
        "used": 13847.4
      },
      "/media/frigate/recordings": {
        "free": 83890.4,
        "mount_type": "ext4",
        "total": 102221.2,
        "used": 13847.4
      },
      "/tmp/cache": {
        "free": 991.1,
        "mount_type": "tmpfs",
        "total": 1000,
        "used": 8.9
      }
    },
    "temperatures": {},
    "uptime": 1072,
    "version": "0.11.0-c461c9e"
  }
}

Operating system

Proxmox

Install method

Docker Compose

Coral version

USB

Network connection

Wired

Camera make and model

Amcrest IP8M-T2599EW

Any other information that may be helpful

Proxmox setup:

VM with HAOS on + Frigate proxy addon. LXC with Debian + Docker, this is where Frigate runs.

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 15 (2 by maintainers)

Most upvoted comments

I’ve dialed down the intensity of the IR right down so the whites are less blown out incase it helps for the night detection. I just spotted the car wasn’t detected whilst parked so I’ve lowered the threshold to 55%. It’s picked back up now settled at 60% so that could do the trick also. I should be able to monitor some day time activity tomrrow and over the weekend. Appreciate the help so far trying to figure this out, determined to get to the bottom of it!

@markgoodyear If you are going to do that, make sure that motion boxes are enabled too