[Config Support]: audio config for stream

[enigma746]

Describe the problem you are having

Hey guys,
I try to make my stream in the home app (iPhone) and frigate in HA sending the sound the camera records. I tryed to use the docs for audio support (https://docs.frigate.video/configuration/live/#audio-support) but it seems I'm not able to do the correct config. I hope someone can help me out here.
I use a Reolink camera and in the reolink-stream via Reolink-app or in homeassistant its sending sound. Just frigate is not sending sound. I tryed out the streams i used for rtsp and there is sound aswell. I think i did something wrong in the config.
Thanks for you help guys!
Best regards
Timo

Version

0.15.0-cea210d

Frigate config file

mqtt:
  host: 192.168.178.125          #mqttserver ohne port
  user: timo                     #mqttuser                                              
  password: XXXXXXXX           #mqttpassword
database:
  path: /config/frigate.db

detectors:
  ov:
    type: openvino
    device: GPU

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  path: /openvino-model/ssdlite_mobilenet_v2.xml
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

go2rtc:
  streams:
    KameraKinderzimmer:
      - rtsp://192.168.178.49:554/h264Preview_01_sub
      - "ffmpeg:rtsp_cam#audio=aac"

cameras:
  KameraKinderzimmer:                                                            #Kameraname
    ffmpeg:
      inputs:
        - path: rtsp://admin:XXXXXXXX@192.168.178.49:554/h264Preview_01_main    #RTSP Stream High Res
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://admin:XXXXXXXX@192.168.178.49:554/h264Preview_01_sub          #RTPS Stream Low Res
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
    audio:
      enabled: true
    detect:
      enabled: true
      width: 640
      height: 360
      fps: 10
    objects:
      track:
        - person
        - cat
        - dog
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 90
    record:
      enabled: true
      alerts:
        retain:
          days: 90
      detections:
        retain:
          days: 90
    zones: {}
    review: {}

  KameraHof:                                                            #Kameraname
    ffmpeg:
      inputs:
        - path: rtsp://admin:4gGr0iPott(@192.168.178.65:554/h264Preview_01_main    #RTSP Stream High Res
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://admin:4gGr0iPott(@192.168.178.65:554/h264Preview_01_sub          #RTPS Stream Low Res
          input_args: preset-rtsp-restream
          roles:
            - detect

    detect:
      enabled: true
      width: 640
      height: 360
      fps: 10
    objects:
      track:
        - person
        - cat
        - dog
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 90
    record:
      enabled: true
      alerts:
        retain:
          days: 90
      detections:
        retain:
          days: 90
    zones:
      Hof:
        coordinates: 0.698,0.401,0.072,0.59,0.125,1,0.984,1,1,0.811
        loitering_time: 0
        inertia: 3
    motion:
      mask:
        - 0.642,0.076,1,0.288,0.997,0.005,0.653,0
        - 0.648,0.395,0.792,0.346,1,0.286,0.668,0.069
      threshold: 30
      contour_area: 10
      improve_contrast: 'true'
    review:
      alerts:
        labels:
          - person
        required_zones: Hof
      detections:
        required_zones: Hof
version: 0.15-1
semantic_search:
  enabled: true
  reindex: false
  model_size: small
  

Relevant Frigate log output

2025-02-26 19:42:44.605590762  [INFO] Preparing Frigate...
2025-02-26 19:42:44.758393775  [INFO] Starting Frigate...
2025-02-26 19:42:48.314392090  [2025-02-26 20:42:48] frigate.util.config            INFO    : Checking if frigate config needs migration...
2025-02-26 19:42:48.339657189  [2025-02-26 20:42:48] frigate.util.config            INFO    : frigate config does not need migration...
2025-02-26 19:42:48.577852002  [2025-02-26 20:42:48] frigate.util.services          INFO    : Automatically detected vaapi hwaccel for video decoding
2025-02-26 19:42:48.585622981  [2025-02-26 20:42:48] frigate.app                    INFO    : Starting Frigate (0.15.0-cea210d)
2025-02-26 19:42:48.585973384  [2025-02-26 20:42:48] frigate.app                    INFO    : Creating directory: /tmp/cache
2025-02-26 19:42:48.597079336  [2025-02-26 20:42:48] peewee_migrate.logs            INFO    : Starting migrations
2025-02-26 19:42:48.597465891  [2025-02-26 20:42:48] peewee_migrate.logs            INFO    : There is nothing to migrate
2025-02-26 19:42:48.610292593  [2025-02-26 20:42:48] frigate.app                    INFO    : Recording process started: 411
2025-02-26 19:42:48.611684306  [2025-02-26 20:42:48] frigate.app                    INFO    : Review process started: 413
2025-02-26 19:42:48.615860625  [2025-02-26 20:42:48] frigate.app                    INFO    : go2rtc process pid: 97
2025-02-26 19:42:48.631879476  [2025-02-26 20:42:48] detector.ov                    INFO    : Starting detection process: 427
2025-02-26 19:42:48.632419542  [2025-02-26 20:42:48] frigate.app                    INFO    : Embedding process started: 429
2025-02-26 19:42:48.663160934  [2025-02-26 20:42:48] frigate.app                    INFO    : Output process started: 449
2025-02-26 19:42:48.684207240  [2025-02-26 20:42:48] frigate.util.downloader        INFO    : Downloading model file from: https://huggingface.co/jinaai/jina-clip-v1/resolve/main/onnx/text_model_fp16.onnx
2025-02-26 19:42:48.694892989  [2025-02-26 20:42:48] frigate.util.downloader        INFO    : Downloading model file from: https://huggingface.co/jinaai/jina-clip-v1/resolve/main/onnx/vision_model_quantized.onnx
2025-02-26 19:42:48.764101408  [2025-02-26 20:42:48] frigate.app                    INFO    : Camera processor started for KameraKinderzimmer: 489
2025-02-26 19:42:48.787441233  [2025-02-26 20:42:48] frigate.app                    INFO    : Camera processor started for KameraHof: 497
2025-02-26 19:42:48.816974960  [2025-02-26 20:42:48] frigate.app                    INFO    : Capture process started for KameraKinderzimmer: 502
2025-02-26 19:42:48.868095913  [2025-02-26 20:42:48] frigate.app                    INFO    : Capture process started for KameraHof: 510
2025-02-26 19:42:48.925336441  [2025-02-26 20:42:48] frigate.audio_manager          INFO    : Audio processor started (pid: 512)
2025-02-26 19:42:51.021788850  [2025-02-26 20:42:51] frigate.api.fastapi_app        INFO    : Starting FastAPI app
2025-02-26 19:42:51.275957147  [2025-02-26 20:42:51] frigate.api.fastapi_app        INFO    : FastAPI started

Relevant go2rtc log output

2025-02-26 19:42:44.604390154  [INFO] Preparing new go2rtc config...
2025-02-26 19:42:44.665085420  [INFO] Got IP address from supervisor: 192.168.178.125
2025-02-26 19:42:44.734496467  [INFO] Got WebRTC port from supervisor: 8555
2025-02-26 19:42:45.576073048  [INFO] Starting go2rtc...
2025-02-26 19:42:45.746003092  20:42:45.745 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2025-02-26 19:42:45.746391911  20:42:45.745 INF config path=/dev/shm/go2rtc.yaml
2025-02-26 19:42:45.746815008  20:42:45.746 INF [rtsp] listen addr=:8554
2025-02-26 19:42:45.747080842  20:42:45.746 INF [api] listen addr=:1984
2025-02-26 19:42:45.747311165  20:42:45.747 INF [webrtc] listen addr=:8555/tcp
2025-02-26 19:42:54.606871122  [INFO] Starting go2rtc healthcheck service...

Frigate stats

No response

Operating system

HassOS

Install method

HassOS Addon

docker-compose file or Docker CLI command

Dont know

Object Detector

Coral

Screenshots of the Frigate UI's System metrics pages

No response

Any other information that may be helpful

No response

[hawkeye217]

You need to match the go2rtc stream name (right now you have cameras) with the name of your camera (KameraKinderzimmer) or use the stream_name directive: https://docs.frigate.video/configuration/live/#setting-stream-for-live-ui

[enigma746]

ok thanks for your reply.
I fixed that. Still think my rtsp stream path is not correct. I dont know why in the docs the paths are different for go2rtc and inputs.

[NickM-27]

They're different because the input pulls a stream from go2rtc

[enigma746]

Where do I get my go2rtc path from? The one in my config is made by me and is not working.

[hawkeye217]

What about it is not working?

[enigma746]

I got no sound when i open the live view for my kamera KameraKinderzimmer

[hawkeye217]

Right, as I indicated above, you either need to do this:

go2rtc:
  streams:
    KameraKinderzimmer:
      - rtsp://192.168.178.49:554/h264Preview_01_sub
      - "ffmpeg:rtsp_cam#audio=aac"


cameras:
  KameraKinderzimmer:                                                            #Kameraname
    ffmpeg:
      inputs:
        - path: rtsp://admin:XXXXXXXX@192.168.178.49:554/h264Preview_01_main    #RTSP Stream High Res
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://admin:XXXXXXXX@192.168.178.49:554/h264Preview_01_sub          #RTPS Stream Low Res
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
  ...

or this:

go2rtc:
  streams:
    cameras:
      - rtsp://192.168.178.49:554/h264Preview_01_sub
      - "ffmpeg:rtsp_cam#audio=aac"


cameras:
  KameraKinderzimmer:                                                            #Kameraname
    ffmpeg:
      inputs:
        - path: rtsp://admin:XXXXXXXX@192.168.178.49:554/h264Preview_01_main    #RTSP Stream High Res
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://admin:XXXXXXXX@192.168.178.49:554/h264Preview_01_sub          #RTPS Stream Low Res
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
    live:
      stream_name: cameras
  ...

[enigma746]

I did an update from my config above, still not working.

The rtsp path in go2rtc is manually created by me. I just took the rtsp path from inputs and deleted the "admin:" and passoword. Both paths do not work, no matter if i copy the path from inputs or delete the login data. I still dont know what path i have to use for go2rtc.

[hawkeye217]

What is your current config?

[enigma746]

The Frigate Config is whats on top of this threat. I edited the first post

[hawkeye217]

Change your go2rtc config to this:

go2rtc:
  streams:
    KameraKinderzimmer:
      - rtsp://192.168.178.49:554/h264Preview_01_sub
      - "ffmpeg:KameraKinderzimmer#audio=aac"