Imx6ull mwifiex_sdio Firmware wakeup failure

Technical Support
, , , ,
1

Hi

I have some problems with the onboard wifi/bt device on a Colibri iMX6ULL. After some time the driver crashes and does not recover with following message.

mwifiex_sdio mmc1:0001:1: Firmware wakeup failed

Steps to reproduce:

  1. Build Yocto BSP3.0 image
  2. Configure WiFi using systemd-networkd (I am not using connman, probably this does not matter, because it seems to be a driver issue)
  3. Let the device run multiple days (or weeks?)

Best regards,
Tonio

2

Hi Tonio

Thanks for writing to Toradex Community!

We will try to reproduce the issue.
Are you able to reproduce this issue with Bsp 2.8 too?

Best regards,
Jaski

3

Hi @jaski.tx

We are only maintaining Bsp 3.0, thus, I cannot tell for Bsp 2.8.

Best regards,
Tonio

4

If of any help, here is the complete journal output related to this issue.

Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: Firmware wakeup failed
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: info: shutdown mwifiex...
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: card is removed
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: card is removed
Jan 12 11:02:35 colibri-imx6ull kernel: mwifiex_sdio mmc1:0001:1: PREP_CMD: card is removed
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.790087] mwifiex_sdio mmc1:0001:1: Firmware wakeup failed
Jan 12 11:02:35 colibri-imx6ull systemd-networkd[313]: mlan0: Lost carrier
Jan 12 11:02:35 colibri-imx6ull wpa_supplicant[343]: mlan0: CTRL-EVENT-DISCONNECTED bssid=4c:5e:0c:11:21:f2 reason=0 locally_generated=1
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.800334] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.809232] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.815831] mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.822079] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.828463] mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.834582] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.840937] mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.846945] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.853334] mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.859400] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.865763] mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.871853] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.878134] mwifiex_sdio mmc1:0001:1: deleting the crypto keys
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.900309] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.906545] mwifiex_sdio mmc1:0001:1: PREP_CMD: FW in reset state
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.916065] mwifiex_sdio mmc1:0001:1: info: shutdown mwifiex...
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.947289] mwifiex_sdio mmc1:0001:1: PREP_CMD: card is removed
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416662.970214] mwifiex_sdio mmc1:0001:1: PREP_CMD: card is removed
Jan 12 11:02:35 colibri-imx6ull kernel[156]: [416663.030856] mwifiex_sdio mmc1:0001:1: PREP_CMD: card is removed

I have now a dummy script in place, rebooting the system if Firmware wakeup failed pops up in the logs.

As you can see in the following image (showing system uptime), the problem occurs irregularly.

2007-screenshot-20200114-083850.png
2007-screenshot-20200114-083850.png1787×846 68.4 KB

5

Thanks for the Input. Bsp 3.0 is beta/development version. For the production, you should stick to Bsp 2.8b6.

Best regards,
Jaski

6

@jaski.tx have you opened a corresponding ticket for Bsp 3.0? Are you gonna try to solve this problem?

We are still in development phase and have chosen Bsp 3.0, because of its tighter alignment to Yocto (Poky based). When will Bsp 3.0 be production ready?

Best regards,
Tonio

7

Hi Jaski

Thanks for the update and good to know, that you will reintroduce backports for Bsp 3.0.

Looking forward to it!

Best regards,
Tonio

8

Hi Tonio

You are welcome.

Best regards,
Jaski

9

Hi Tonio

The corresponding ticket for this issue was opened for Bsp 3.0 and I have some news.

We decided to reintroduce backports for Bsp 3.0, which will be done in Q2/2020. Also the stable release for Bsp 3.0 is estimated after Q2/2020.

Best regards,
Jaski