V4l2h264enc missing from tdx-ref-multimedia-image

[chipbrommer]

Apalis Model: iMX8QM 4GB IT

I am trying to stream video from a FLIR camera using gstreamer. When using jpegenc I use about 80% of CPU. So I have started to look into alternatives that use the hardware acceleration (i.e. v4l2h264enc ) to encode the video before streaming it but my system cannot find that encoder.

I have these additional recipes added:
v4l-utils \ python3 \ python3-numpy \ python3-pygobject \ python3-pip \ opencv \ aravis \ gstreamer1.0 \ gstreamer1.0-plugins-base \ gstreamer1.0-plugins-good \ gstreamer1.0-plugins-bad \ gstreamer1.0-plugins-ugly \ gstreamer1.0-libav \ imx-gst1.0-plugin \ gobject-introspection \

Also setting the preferred version for base plugins from NXP.
PREFERRED_VERSION_gstreamer1.0-plugins-base = “1.20.3.imx”

Any help or information would be great, thanks in advance.

[eric.tx]

Hey @chipbrommer,

Can you share some of the errors are are receiving?

Looks like a customer was able to get this working via Torizon and some containers. For reference

Hardware accelerated encoding using gstreamer within a docker container

I can do GPU encoding with the multimedia reference image using the gstreamer plugin v4l2h264enc. However, none of the example containers from the toradex documentation nor gstreamer example container have gstreamer v4l2h264enc. I have also tried installing the gstreamer1.0-plugins-good-imx package on the wayland-base-vivante:2 container. Currently streaming using the x264enc in a docker container results in maxed out CPU loads. How can I install imx’s v4l2h264enc in a docker container? HW: Apa…

-Eric

[chipbrommer]

Thanks for the response. I am trying to avoid a docker based image because the end goal is to go with a minimal based image with only the recipes that are needed.

In the answer to that post, (this link: How to use Gstreamer on Torizon OS | Toradex Developer Center) I see there are some additional g-streamer plugins I do not install. I will test adding those to the image if I can find suitable recipes and report back.

[eric.tx]

Hey @chipbrommer,

How are you doing with this topic?

-Eric

[chipbrommer]

Eric, thanks for checking in.
Currently still struggling to get this working.
Navigated via the suggested ticket, to this link: How to use Gstreamer on Torizon OS | Toradex Developer Center

Seems there is not much support in terms of pre-existing recipes for the apt installs.

Still working on this to find a solution on gstreamer with hardware acceleration that does not result in running a container.