[Support]: Prior Events and Recordings Disappearing on Reboot

[robotgoat]

Describe the problem you are having

I have recently updated to the latest Frigate 0.13.2 version and have adjusted my Docker/Podman run command as necessary. Frigate runs as expected, builds its database files in the ".../config" directory, and presents no issues with the initial creation and running of the container. Events are triggered, clips are recorded, and snapshots are taken. However, if I restart either the container or the system itself, the past events and recordings are gone from the Frigate web UI. It is as if the database gets cleared and remade on restart. The old recordings are still present on the disk however as Frigate reports several hundred GB still being occupied on disk after the restart. I did not have this happening on the prior stable release.

Version

0.13.2-6476f8a

Frigate config file

mqtt:
  host: 127.0.0.1
  port: 1883
  user: "{FRIGATE_MQTT_USER}"
  password: "{FRIGATE_MQTT_PASSWORD}"

detectors:
  coral:
    type: edgetpu
    device: pci

ffmpeg:
  hwaccel_args: preset-vaapi
  output_args:
    record: preset-record-generic-audio-copy

timestamp_style:
  position: "tl"
  format: "%Y-%m-%d %H:%M:%S"
  color:
    red: 255
    green: 255
    blue: 255
  thickness: 2
  effect: "shadow"

birdseye:
  enabled: True
  mode: motion

objects:
  track:
    - person
    - bicycle
    - motorcycle
    - airplane
    - car
    - boat
    - cat
    - dog
    - horse

go2rtc:
  streams:
    frontyard:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{SOME IP}:554/cam/realmonitor?channel=1&subtype=0
    frontyard_sub:
      - rtsp://{FRIGATE_RTSP_USER}:{FRIGATE_RTSP_PASSWORD}@{SOME IP}:554/cam/realmonitor?channel=1&subtype=1

cameras:
  frontyard:
    enabled: True
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/frontyard
          input_args: preset-rtsp-restream
          roles: 
            - record
        - path: rtsp://127.0.0.1:8554/frontyard_sub
          input_args: preset-rtsp-restream
          roles:
            - detect

    zones:
      driveway:
        coordinates: 640,480,640,358,591,299,218,297,66,480
        inertia: 10
    record:
      enabled: True
      retain:
        days: 30
        mode: all
      events:
        required_zones:
          - driveway
        retain:
          default: 60
          mode: active_objects
    motion:
      threshold: 100
        
    detect:
      enabled: True
      width: 640
      height: 480
    snapshots:
      enabled: True
      timestamp: False
      bounding_box: True
      required_zones:
        - driveway
      retain:
        default: 30

Relevant log output

2024-03-03 21:23:30.407714064  [INFO] Preparing Frigate...
2024-03-03 21:23:30.413582778  [INFO] Starting Frigate...
2024-03-03 21:23:31.468961315  [2024-03-03 21:23:31] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-03-03 21:23:31.469030907  [2024-03-03 21:23:31] frigate.app                    INFO    : Creating directory: /config/model_cache
2024-03-03 21:23:31.509464150  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Starting migrations
2024-03-03 21:23:31.510975433  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "001_create_events_table"
2024-03-03 21:23:31.511058300  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE TABLE IF NOT EXISTS "event" ("id" VARCHAR(30) NOT NULL PRIMARY KEY, "label" VARCHAR(20) NOT NULL, "camera" VARCHAR(20) NOT NULL, "start_time" DATETIME NOT NULL, "end_time" DATETIME NOT NULL, "top_score" REAL NOT NULL, "false_positive" INTEGER NOT NULL, "zones" JSON NOT NULL, "thumbnail" TEXT NOT NULL)',)
2024-03-03 21:23:31.511147688  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX IF NOT EXISTS "event_label" ON "event" ("label")',)
2024-03-03 21:23:31.511282783  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX IF NOT EXISTS "event_camera" ON "event" ("camera")',)
2024-03-03 21:23:31.511627544  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 001_create_events_table
2024-03-03 21:23:31.512435709  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "002_add_clip_snapshot"
2024-03-03 21:23:31.512438214  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'has_clip', <BooleanField: Event.has_clip>)
2024-03-03 21:23:31.514044145  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'has_snapshot', <BooleanField: Event.has_snapshot>)
2024-03-03 21:23:31.515505975  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 002_add_clip_snapshot
2024-03-03 21:23:31.515703277  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "003_create_recordings_table"
2024-03-03 21:23:31.515787516  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE TABLE IF NOT EXISTS "recordings" ("id" VARCHAR(30) NOT NULL PRIMARY KEY, "camera" VARCHAR(20) NOT NULL, "path" VARCHAR(255) NOT NULL, "start_time" DATETIME NOT NULL, "end_time" DATETIME NOT NULL, "duration" REAL NOT NULL)',)
2024-03-03 21:23:31.515872316  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX IF NOT EXISTS "recordings_camera" ON "recordings" ("camera")',)
2024-03-03 21:23:31.515981783  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE UNIQUE INDEX IF NOT EXISTS "recordings_path" ON "recordings" ("path")',)
2024-03-03 21:23:31.516093223  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX IF NOT EXISTS "recordings_start_time_end_time" ON "recordings" (start_time, end_time)',)
2024-03-03 21:23:31.516379764  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 003_create_recordings_table
2024-03-03 21:23:31.516934441  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "004_add_bbox_region_area"
2024-03-03 21:23:31.517018189  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'region', <JSONField: Event.region>)
2024-03-03 21:23:31.518279991  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'box', <JSONField: Event.box>)
2024-03-03 21:23:31.519481188  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'area', <IntegerField: Event.area>)
2024-03-03 21:23:31.520714216  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 004_add_bbox_region_area
2024-03-03 21:23:31.521076199  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "005_make_end_time_nullable"
2024-03-03 21:23:31.521150279  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'end_time')
2024-03-03 21:23:31.522181055  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 005_make_end_time_nullable
2024-03-03 21:23:31.522636384  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "006_add_motion_active_objects"
2024-03-03 21:23:31.522723679  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('recordings', 'objects', <IntegerField: Recordings.objects>)
2024-03-03 21:23:31.522963813  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('recordings', 'motion', <IntegerField: Recordings.motion>)
2024-03-03 21:23:31.523287644  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 006_add_motion_active_objects
2024-03-03 21:23:31.523713147  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "007_add_retain_indefinitely"
2024-03-03 21:23:31.523756669  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'retain_indefinitely', <BooleanField: Event.retain_indefinitely>)
2024-03-03 21:23:31.525339407  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 007_add_retain_indefinitely
2024-03-03 21:23:31.525748239  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "008_add_sub_label"
2024-03-03 21:23:31.525791530  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'sub_label', <CharField: Event.sub_label>)
2024-03-03 21:23:31.526208538  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 008_add_sub_label
2024-03-03 21:23:31.526642427  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "009_add_object_filter_ratio"
2024-03-03 21:23:31.526681260  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'ratio', <FloatField: Event.ratio>)
2024-03-03 21:23:31.528436523  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 009_add_object_filter_ratio
2024-03-03 21:23:31.528926268  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "010_add_plus_image_id"
2024-03-03 21:23:31.528977234  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'plus_id', <CharField: Event.plus_id>)
2024-03-03 21:23:31.529313980  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 010_add_plus_image_id
2024-03-03 21:23:31.529624636  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "011_update_indexes"
2024-03-03 21:23:31.529664341  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "event_start_time_end_time" ON "event" ("start_time" DESC, "end_time" DESC)',)
2024-03-03 21:23:31.529824423  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('DROP INDEX recordings_start_time_end_time',)
2024-03-03 21:23:31.529952846  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_end_time_start_time" ON "recordings" ("end_time" DESC, "start_time" DESC)',)
2024-03-03 21:23:31.530236581  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 011_update_indexes
2024-03-03 21:23:31.530684587  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "012_add_segment_size"
2024-03-03 21:23:31.530728249  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('recordings', 'segment_size', <FloatField: Recordings.segment_size>)
2024-03-03 21:23:31.532682989  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 012_add_segment_size
2024-03-03 21:23:31.533178194  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "013_create_timeline_table"
2024-03-03 21:23:31.533282100  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE TABLE IF NOT EXISTS "timeline" ("timestamp" DATETIME NOT NULL, "camera" VARCHAR(20) NOT NULL, "source" VARCHAR(20) NOT NULL, "source_id" VARCHAR(30), "class_type" VARCHAR(50) NOT NULL, "data" JSON)',)
2024-03-03 21:23:31.533336262  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX IF NOT EXISTS "timeline_camera" ON "timeline" ("camera")',)
2024-03-03 21:23:31.533380826  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX IF NOT EXISTS "timeline_source" ON "timeline" ("source")',)
2024-03-03 21:23:31.533500913  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX IF NOT EXISTS "timeline_source_id" ON "timeline" ("source_id")',)
2024-03-03 21:23:31.533740124  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 013_create_timeline_table
2024-03-03 21:23:31.534307044  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "014_event_updates_for_fp"
2024-03-03 21:23:31.534394219  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'score', <FloatField: Event.score>)
2024-03-03 21:23:31.534544032  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'model_hash', <CharField: Event.model_hash>)
2024-03-03 21:23:31.534752696  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'detector_type', <CharField: Event.detector_type>)
2024-03-03 21:23:31.534942283  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'model_type', <CharField: Event.model_type>)
2024-03-03 21:23:31.535159363  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'area')
2024-03-03 21:23:31.536380428  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'false_positive')
2024-03-03 21:23:31.537567489  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : apply_default ('event', 'false_positive', <BooleanField: Event.false_positive>)
2024-03-03 21:23:31.537822480  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 014_event_updates_for_fp
2024-03-03 21:23:31.538224439  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "015_event_refactor"
2024-03-03 21:23:31.538264074  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'top_score')
2024-03-03 21:23:31.539823548  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'score')
2024-03-03 21:23:31.541139802  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'region')
2024-03-03 21:23:31.542559432  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'box')
2024-03-03 21:23:31.543932544  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'area')
2024-03-03 21:23:31.545346102  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : drop_not_null ('event', 'ratio')
2024-03-03 21:23:31.546714916  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('event', 'data', <JSONField: Event.data>)
2024-03-03 21:23:31.548538158  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 015_event_refactor
2024-03-03 21:23:31.548972077  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "016_sublabel_increase"
2024-03-03 21:23:31.549004107  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : change_column ('event', 'sub_label', <CharField: Event.sub_label>)
2024-03-03 21:23:31.550708544  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 016_sublabel_increase
2024-03-03 21:23:31.551033227  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "017_update_indexes"
2024-03-03 21:23:31.551063584  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_camera_segment_size" ON "recordings" ("camera", "segment_size")',)
2024-03-03 21:23:31.551427972  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 017_update_indexes
2024-03-03 21:23:31.551829180  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "018_add_dbfs"
2024-03-03 21:23:31.551863164  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : add_column ('recordings', 'dBFS', <IntegerField: Recordings.dBFS>)
2024-03-03 21:23:31.552325727  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 018_add_dbfs
2024-03-03 21:23:31.552601097  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "019_create_regions_table"
2024-03-03 21:23:31.552667242  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE TABLE IF NOT EXISTS "regions" ("camera" VARCHAR(20) NOT NULL PRIMARY KEY, "last_update" DATETIME NOT NULL, "grid" JSON)',)
2024-03-03 21:23:31.553318751  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 019_create_regions_table
2024-03-03 21:23:31.553371070  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Migrate "020_update_index_recordings"
2024-03-03 21:23:31.553417027  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('DROP INDEX recordings_end_time_start_time',)
2024-03-03 21:23:31.553482861  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_camera_start_time_end_time" ON "recordings" ("camera", "start_time" DESC, "end_time" DESC)',)
2024-03-03 21:23:31.553627524  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_api_recordings_summary" ON "recordings" ("camera", "start_time" DESC, "duration", "motion", "objects")',)
2024-03-03 21:23:31.553742211  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : sql ('CREATE INDEX "recordings_start_time" ON "recordings" ("start_time")',)
2024-03-03 21:23:31.554050152  [2024-03-03 21:23:31] peewee_migrate.logs            INFO    : Done 020_update_index_recordings
2024-03-03 21:23:31.554327095  [2024-03-03 21:23:31] frigate.app                    INFO    : Running database vacuum
2024-03-03 21:23:31.560058274  [2024-03-03 21:23:31] frigate.app                    INFO    : Recording process started: 583
2024-03-03 21:23:31.562301358  [2024-03-03 21:23:31] frigate.app                    INFO    : go2rtc process pid: 84
2024-03-03 21:23:31.579503289  [2024-03-03 21:23:31] detector.coral                 INFO    : Starting detection process: 593
2024-03-03 21:23:31.585308948  [2024-03-03 21:23:31] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as pci
2024-03-03 21:23:31.585476224  [2024-03-03 21:23:31] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-03-03 21:23:31.585919811  [2024-03-03 21:23:31] frigate.app                    INFO    : Output process started: 595
2024-03-03 21:23:31.591906401  [2024-03-03 21:23:31] frigate.app                    INFO    : Camera processor started for frontyard: 611

FFprobe output from your camera

NA

Frigate stats

No response

Operating system

Debian

Install method

Docker CLI

Coral version

PCIe

Network connection

Wired

Camera make and model

Amcrest

Any other information that may be helpful

Running in Debian 12 in rootful podman container.

[NickM-27]

need to see your docker cli command, this usually indicates an error with the DB mount

[robotgoat]

This is my cli command for Podman:

sudo podman run -d \
  --name frigate \
  --pod=homeassistantpod \
  --restart=unless-stopped \
  --mount type=tmpfs,target=/tmp/cache,tmpfs-size=1000000000 \
  --device /dev/apex_0:/dev/apex_0 \
  --device /dev/dri/renderD128 \
  -v "/mnt/NVR/Frigate/storage:/media/frigate" \
  -v "/mnt/NVR/Frigate/config:/config" \
  -v "/etc/localtime:/etc/localtime:ro" \
  -e FRIGATE_MQTT_USER="{frigate user}" \
  -e FRIGATE_MQTT_PASSWORD="{frigate mqtt passwowrd}" \
  -e FRIGATE_RTSP_USER="{rtsp user}" \
  -e FRIGATE_RTSP_PASSWORD="{rtsp password}" \
  -e LIBVA_DRIVER_NAME=radeonsi \
  --label io.containers.autoupdate=registry \
  --ipc=private \
  ghcr.io/blakeblackshear/frigate:stable

[NickM-27]

okay, your config directory map looks correct. We can tell from your logs that the database is being recreated which means somewhere along the way frigate is not seeing /config/frigate.db when it restarts

[robotgoat]

I removed the "--ipc=private" setting and that seems to have fixed the issue. From my testing, the database is not rebuilt when the system undergoes a hard reboot, the container/pod is restarted, the container/pod are deleted and recreated with the same settings. The issue that led me to add the "--ipc=private" setting seems to have been fixed in the latest stable. If I recall, it was a problem concerning gortc.