Missing Gstreamer vpu decoder plugin

[Mcdev]

Hi community!

I am working with Apalis iMX8QM and trying to develop a video player app. I have already tried several Torizon containers with Vivante support to use VPU/GPU hardware acceleration, but I am facing an issue with the plugins. For VPU decoding, I need the v4l2h264dec and also to convert imxvideoconvert_g2d GStreamer plugins, but none of the example containers(wayland-base-vivante, qt5-wayland-vivante, qt6-wayland-vivante, qt5-wayland-examples-vivante etc.) seem to have these plugins.

I have followed this article but the result is same.

Apalis iMX8-QM 4GB V1.1C (also V1.1B)
Ixora Carrier Board V1.2A
Torison OS 6.7.0-build.18

Best regards,
MC

[ToradexAI]

Hi, I’m the Toradex AI Assistant. The Toradex Support team will follow up with you shortly!

Did you like my answer?

---

Hi MC,

It seems like you’re encountering an issue with missing GStreamer plugins for VPU decoding and video conversion on your Apalis iMX8QM module. Here are a few steps you can take to resolve this issue:

1. Verify Plugin Availability:
   First, ensure that the required plugins (v4l2h264dec and imxvideoconvert_g2d) are indeed missing. You can use the gst-inspect-1.0 tool to list all available plugins:

   gst-inspect-1.0 | grep v4l2h264dec
   gst-inspect-1.0 | grep imxvideoconvert_g2d
   

2. Install Missing Plugins:
   If the plugins are missing, you may need to install additional GStreamer packages. You can do this by modifying your Dockerfile to include the necessary packages. For example:

   FROM torizon/wayland-base-vivante:2
   RUN apt-get update && apt-get install -y \
       gstreamer1.0-plugins-bad \
       gstreamer1.0-plugins-ugly \
       gstreamer1.0-plugins-good \
       gstreamer1.0-plugins-base \
       gstreamer1.0-libav \
       gstreamer1.0-vaapi \
       gstreamer1.0-tools \
       gstreamer1.0-gl \
       gstreamer1.0-gtk3 \
       gstreamer1.0-qt5 \
       gstreamer1.0-pulseaudio \
       gstreamer1.0-plugins-imx
   

3. Check Compatibility:
   Ensure that the versions of the GStreamer plugins you are installing are compatible with your TorizonCore version. Sometimes, specific versions of plugins are required to work with the hardware acceleration features of the i.MX8QM.

4. Use the Correct Container Image:
   Make sure you are using the correct container image that supports hardware acceleration. The torizon/wayland-base-vivante image is typically used for i.MX8 modules with Vivante GPU support.

5. Custom Build:
   If the required plugins are not available in the pre-built images, you might need to build a custom Docker image with the necessary plugins. You can refer to the Torizon documentation for instructions on building custom images.

6. Consult Documentation:
   Refer to the following articles for more detailed instructions and troubleshooting tips:

   • How to use GStreamer on Torizon OS
   • Video Encoding and Playback With GStreamer (Linux)

If you have followed these steps and are still encountering issues, please provide more details about the errors you are seeing, and any logs that might help diagnose the problem further.

Best regards,
[Your Name]

Please, also check if these links can help you solve your problem:

Chromium is not accelerated ( webgl not activated )

Hello all, I want to evaluate the colibri-imx8x capabilities with chromium , for an application which use webgl ( check GPU support ) and video playback ( check VPU support ) and after some tests, it seems that the chromium version inside the official torizon core 5.1.0 image is not GPU-VPU accelerated. I have just installed with toradex easy installer the version : TorizonCore 5.1.0 with evaluation containers for V1.0C HW ( 5.1.0+build.1.container ( 2021-01-06 ) I tried to launch chromium wi…

Qtmultimedia USB Camera Video Lagging

I’m trying to run Camera Example of Qt6 in Apalis iMX8QM 4GB WB IT v1.1 B with Ixora V1.1A Career board. I have Torizoncore running and i got the example cross compiled and running with docker image. But the video feed of the camera in Qt application is very slow like 1 to 5 frames per second. I checked the camera output with gstreamer with following command and it works fine on same docker image. gst-launch-1.0 v4l2src device=/dev/video2 ! videoconvert! videoscale ! video/x-raw, framerate=30/1…

How to use Gstreamer on Torizon OS | Toradex Developer Center.

[jeremias.tx]

Greetings @Mcdev,

I have followed this article but the result is same.

When you followed this article did you go and try the sample container here: torizon-samples/vpu/generic/vpuGeneric at bookworm-new · toradex/torizon-samples · GitHub

I just tried this myself on Apalis-imx8 and it works fine for me. The resulting container image built from this sample has both the v4l2h264dec and imxvideoconvert_g2d plugins available for use. The vputests script that’s included in the sample also uses these plugins, I was able to execute this script successfully as well.

Some notes. As the README in the sample says, make sure to set the MACHINE variable in the Dockerfile prior to building. Also in the Dockerfile set BASE_VERSION to 3.3. This version works the best for accelerated VPU at the moment.

Best Regards,
Jeremias

[Mcdev]

Dear @jeremias.tx,

Thank you for the quick response. After reviewing your test results, I revisited the repo and realized that we had missed some device group rules and volume bindings. Since we weren’t using a compose file, we didn’t fully understand the importance of these rules. For future readers facing similar issues, it’s important to pay attention to the steps regarding bindings and device group rules in the compose file!

Thanks again,
MC

[jeremias.tx]

Perfect, glad to hear you were able to get things going.

Best Regards,
Jeremias