Are restreamed rtsp streams available outside Frigate?

[Cold-Lemonade]

I am running Frigate 0.14.1 without issue and have configured it to restream the hi-res rtsp streams using the built-in go2rtc. Are these restreams available outside the Frigate container to services running elsewhere on my network? For example, suppose one of my restreams is rtsp://10.57.1.5:8554/front_south. Should I be able to access this rtsp restream using vlc on a separate machine in the same subnet?

[NickM-27]

assuming you have exposed the port in the docker config, yes

https://docs.frigate.video/configuration/restream#rtsp

[Cold-Lemonade]

I have tried adding hardward acceleration, but I think I'm doing something wrong because the following code just throws and bunch of errors:

ffmpeg \
    -init_hw_device vaapi=va:/dev/dri/renderD128,kernel_driver=i915 \
    -filter_hw_device va \
    -hwaccel vaapi -hwaccel_output_format vaapi -rtsp_transport tcp -thread_queue_size 24000000 -i rtsp://10.10.1.25:8554/cam101 \
    -hwaccel vaapi -hwaccel_output_format vaapi -rtsp_transport tcp -thread_queue_size 24000000 -i rtsp://10.10.1.25:8554/cam102 \
    -hwaccel vaapi -hwaccel_output_format vaapi -rtsp_transport tcp -thread_queue_size 24000000 -i rtsp://10.10.1.25:8554/cam103 \
    -hwaccel vaapi -hwaccel_output_format vaapi -rtsp_transport tcp -thread_queue_size 24000000 -i rtsp://10.10.1.25:8554/cam104 \
    -filter_complex " \
        [0:v] setpts=PTS-STARTPTS,format=nv12,scale_vaapi=w=960:h=540 [upperleft]; \
        [1:v] setpts=PTS-STARTPTS,format=nv12,scale_vaapi=w=960:h=540 [upperright]; \
        [2:v] setpts=PTS-STARTPTS,format=nv12,scale_vaapi=w=960:h=540 [lowerleft]; \
        [3:v] setpts=PTS-STARTPTS,format=nv12,scale_vaapi=w=960:h=540 [lowerright]; \
        [upperleft][upperright]hstack_vaapi=inputs=2 [upperline]; \
        [lowerleft][lowerright]hstack_vaapi=inputs=2 [lowerline]; \
        [upperline][lowerline]vstack_vaapi=inputs=2 [mosaic]" \
    -map "[mosaic]" -c:v libx264 -af asetpts=N/SR/TB -preset superfast -crf 18 -f matroska - | ffplay -

[Cold-Lemonade]

In case others are interested. After much trial and error, I got it working with this code. The problem is that there is some sort of format inconsistency across the 4 rtsp streams coming from the Frigate restream so that I cannot use hardware acceleration to join all the streams together and have to do that using the cpu. So the resulting video plays at 0.4x. Perhaps someone who knows ffmpeg far better than me can suggest improvements. Maybe there is some way to format the streams consistently when I restream them in Frigate?

ffmpeg \
    -init_hw_device vaapi=va:/dev/dri/renderD128,kernel_driver=i915 \
    -filter_hw_device va \
    -rtsp_transport tcp -thread_queue_size 4096 -r 15 -i rtsp://10.10.1.25:8554/cam101 \
    -rtsp_transport tcp -thread_queue_size 4096 -r 15 -i rtsp://10.10.1.25:8554/cam102 \
    -rtsp_transport tcp -thread_queue_size 4096 -r 15 -i rtsp://10.10.1.25:8554/cam103 \
    -rtsp_transport tcp -thread_queue_size 4096 -r 15 -i rtsp://10.10.1.25:8554/cam104 \
    -filter_complex " \
        [0:v] hwupload,scale_vaapi=w=960:h=540 [upperleft]; \
        [1:v] hwupload,scale_vaapi=w=960:h=540 [upperright]; \
        [2:v] hwupload,scale_vaapi=w=960:h=540 [lowerleft]; \
        [3:v] hwupload,scale_vaapi=w=960:h=540 [lowerright]; \
        [upperleft][upperright] hstack_vaapi=inputs=2 [upperline]; \
        [lowerleft][lowerright] hstack_vaapi=inputs=2 [lowerline]; \
        [upperline][lowerline] vstack_vaapi=inputs=2,hwdownload [mosaic]" \
    -map "[mosaic]" \
    -c:v libx264 -preset ultrafast -crf 28 -threads 0 -f matroska - | ffplay -

[Cold-Lemonade]

I've been looking closer at the vlc logs. It seems that vlc requires that rtsp streams use "real/helix" rtsp servers:

[00007c5218001580] main stream debug: net: connecting to 10.10.1.25 port 8554
[00007c5218001580] main stream debug: connection succeeded (socket = 11)
[00007c5218001580] access_realrtsp stream warning: Cseq mismatch, got 1, assumed 0
[00007c5218001580] access_realrtsp stream debug: rtsp connected
[00007c5218001580] access_realrtsp stream warning: only real/helix rtsp servers supported for now

What kind of rtsp server does Frigate's restream use?

[NickM-27]

What system is this installed on? I don't have this issue on MacOS or Windows VLC

[Cold-Lemonade]

Ubuntu server 24.04 on bare metal.