[Bug]: System Metrics Storage not showing correct usage per camera #16825
Replies: 9 comments 23 replies
-
|
This is not a bug. As indicated in the tooltip in the UI, Frigate tracks recording usage based on the information in its database. It does not spin up your disk to keep track of file usage. There are a number of reasons for possible discrepancies, but if the UI is showing no usage, you can safely delete any files in those directories. |
Beta Was this translation helpful? Give feedback.
-
|
So why would database have incorrect size in? What do I need to check to find out? |
Beta Was this translation helpful? Give feedback.
-
|
If recordings are disabled for a camera, it will not produce database entries. What kind of files are in your |
Beta Was this translation helpful? Give feedback.
-
|
Recordings were never disabled for camera. All camera configs are the same. Flies are timestamped mp4 files. 05.14.mp4 10.43.mp4 16.13.mp4 21.43.mp4 27.14.mp4 32.44.mp4 38.13.mp4 43.43.mp4 49.13.mp4 54.44.mp4 |
Beta Was this translation helpful? Give feedback.
-
|
What are the sizes of these files? Can you paste the output of |
Beta Was this translation helpful? Give feedback.
-
|
-rw-r--r-- 1 root root 17342 Feb 24 00:58 58.24.mp4 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '59.53.mp4': |
Beta Was this translation helpful? Give feedback.
-
|
The ffprobe output looks fine. You only have a small number of segments for the whole hour. There should be many more if frigate was actually recording on this camera during this time. Edit: apologies, I'm guessing you just didn't post the entire directory listing, which is fine. 17kb seems like a very small video file. Does it actually play any video if you download it and watch it? |
Beta Was this translation helpful? Give feedback.
-
|
I only sent a few as an example: |
Beta Was this translation helpful? Give feedback.
-
|
Can you provide the output of |
Beta Was this translation helpful? Give feedback.
-
|
{ |
Beta Was this translation helpful? Give feedback.
-
|
This API output is indicating the database has no recordings stored for several of your cameras. The calculation for this API call is very simple: Line 69 in d0e9bcb This returns
|
Beta Was this translation helpful? Give feedback.
-
|
so something must go wrong here: There is no debug what OSError might be causing this though. |
Beta Was this translation helpful? Give feedback.
-
|
If you can get inside your container, just add: to that portion of the code so you can see what it says. |
Beta Was this translation helpful? Give feedback.
-
|
Seems like it is not failing on this one.. Will have to look further where it fails. This one never failed for those few CAM's... I'll look further and let you know |
Beta Was this translation helpful? Give feedback.
-
|
I checked and segments are getting written to the actual storage, but usage is still null |
Beta Was this translation helpful? Give feedback.
-
|
the best way to debug will be to do a manual query of the database to see what it returns, we can help if needed |
Beta Was this translation helpful? Give feedback.
-
|
What would you like to get from database? I have executed following query on two cameras, one that shows usage and one that not: Doing the SUM without the size != 0 check would return following:
|
Beta Was this translation helpful? Give feedback.
-
|
we just need to see the recordings rows of ones that sum to 0 |
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
-
|
Here I have printed out size of cache_path and calculated segment_size. As you can see, some size of cache_path is too small and results in rounding to 0.0 2025-02-27 11:36:48.347316372 [2025-02-27 11:36:48] frigate.record.maintainer ERROR : GetSizei: 641782 |
Beta Was this translation helpful? Give feedback.
-
|
I have created PR #16851 |
Beta Was this translation helpful? Give feedback.
-
|
Great work. Thanks for your help and for the contribution. |
Beta Was this translation helpful? Give feedback.
-
|
I just wonder if my PR is OK? (seems I should have rebased it before as it shows Merging is Blocked) |
Beta Was this translation helpful? Give feedback.
-
|
And thank you for the help as well! Much appreciated! |
Beta Was this translation helpful? Give feedback.
-
|
PR should be just fine. I approved and will merge once the tests are complete. |
Beta Was this translation helpful? Give feedback.
-
Checklist
Describe the problem you are having
In System Metrics storage view I see few cameras that show as if they are using 0 of storage which by looking at the actual recordings on disk is incorrect.
Steps to reproduce
...
Version
0.15.0
In which browser(s) are you experiencing the issue with?
No response
Frigate config file
docker-compose file or Docker CLI command
Relevant Frigate log output
Relevant go2rtc log output
Operating system
Other Linux
Install method
Docker Compose
Network connection
Wired
Camera make and model
AXIS M3215
Screenshots of the Frigate UI's System metrics pages
Any other information that may be helpful
Output of du of s single hour in a day:
/shared/recordings/recordings/2025-02-25/00$ du -h | sort -r -k2
3.9G ./CAM9
21M ./CAM8
34M ./CAM7
24M ./CAM6
796M ./CAM53
841M ./CAM52
432M ./CAM51
820M ./CAM50
20M ./CAM5
804M ./CAM49
515M ./CAM46
470M ./CAM45
622M ./CAM44
404M ./CAM43
217M ./CAM42
474M ./CAM41
722M ./CAM39
367M ./CAM36
369M ./CAM35
6.8M ./CAM33
577M ./CAM32
493M ./CAM31
60M ./CAM30
85M ./CAM29
51M ./CAM28
6.8M ./CAM27
6.8M ./CAM26
88M ./CAM25
5.7M ./CAM24
6.8M ./CAM21
6.8M ./CAM20
203M ./CAM19
389M ./CAM18
467M ./CAM17
232M ./CAM16
181M ./CAM15
421M ./CAM14
399M ./CAM13
333M ./CAM12
358M ./CAM11
163M ./CAM10
16G .
Beta Was this translation helpful? Give feedback.
All reactions