Mmcblk0: error -110 sending stop command, original cmd response 0x900, card status 0x400e00

We are using Colibri iMX6S version 1.1A as hardware und Qt for device creation 5.14.2 with Linux kernel 4.14.159. Currently about 100 installations are in use worldwide.
Recently two customers return their boards because the boards were not bootable. The dmesg output shows that both boards run into the same error situation:


[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 4.14.159-00041-g1f43bce17a57-dirty (colibri@schall-linux-18) (gcc version 8.2.1 20180802 (GNU Toolchain for the A-profile Architecture 8.2-2019.01 (arm-rel-8.28))) #33 SMP Mon Mar 8 17:07:58 CET 2021
[    0.000000] CPU: ARMv7 Processor [412fc09a] revision 10 (ARMv7), cr=10c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[    0.000000] OF: fdt: Machine model: Toradex Colibri iMX6DL/S on Colibri Evaluation Board V3
[    0.000000] Memory policy: Data cache writeback
[    0.000000] OF: reserved mem: failed to allocate memory for node 'linux,cma'
[    0.000000] cma: Reserved 128 MiB at 0x18000000
[    0.000000] CPU: All CPU(s) started in SVC mode.
[    0.000000] percpu: Embedded 15 pages/cpu s30796 r8192 d22452 u61440
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 65024
[    0.000000] Kernel command line: enable_wait_mode=off galcore.contiguousSize=50331648 ip=off root=/dev/mmcblk0p2 rw,noatime rootfstype=ext3 rootwait fec_mac=00:14:2d:a3:36:a1 no_console_suspend=1 console=ttymxc0,115200n8 video=mxcfb0:dev=lcd,1280x800M@60,if=RGB24 video=mxcfb1:off fbmem=32M
[    0.000000] PID hash table entries: 1024 (order: 0, 4096 bytes)
[    0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
[    0.000000] Memory: 116028K/262144K available (8192K kernel code, 494K rwdata, 2040K rodata, 1024K init, 411K bss, 15044K reserved, 131072K cma-reserved, 0K highmem)
[    0.000000] Virtual kernel memory layout:
[    0.000000]     vector  : 0xffff0000 - 0xffff1000   (   4 kB)
[    0.000000]     fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
[    0.000000]     vmalloc : 0x90800000 - 0xff800000   (1776 MB)
[    0.000000]     lowmem  : 0x80000000 - 0x90000000   ( 256 MB)
[    0.000000]     pkmap   : 0x7fe00000 - 0x80000000   (   2 MB)
[    0.000000]     modules : 0x7f000000 - 0x7fe00000   (  14 MB)
[    0.000000]       .text : 0x80008000 - 0x80900000   (9184 kB)
[    0.000000]       .init : 0x80b00000 - 0x80c00000   (1024 kB)
[    0.000000]       .data : 0x80c00000 - 0x80c7bb80   ( 495 kB)
[    0.000000]        .bss : 0x80c7bb80 - 0x80ce2838   ( 412 kB)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU event tracing is enabled.
[    0.000000]  RCU restricting CPUs from NR_CPUS=4 to nr_cpu_ids=2.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] L2C: DT/platform modifies aux control register: 0x32050000 -> 0x32450000
[    0.000000] L2C-310 erratum 769419 enabled
[    0.000000] L2C-310 enabling early BRESP for Cortex-A9
[    0.000000] L2C-310 full line of zeros enabled for Cortex-A9
[    0.000000] L2C-310 ID prefetch enabled, offset 16 lines
[    0.000000] L2C-310 dynamic clock gating enabled, standby mode enabled
[    0.000000] L2C-310 cache controller enabled, 16 ways, 512 kB
[    0.000000] L2C-310: CACHE_ID 0x410000c8, AUX_CTRL 0x76450001
[    0.000000] Switching to timer-based delay loop, resolution 333ns
[    0.000007] sched_clock: 32 bits at 3000kHz, resolution 333ns, wraps every 715827882841ns
[    0.000024] clocksource: mxc_timer1: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 637086815595 ns
[    0.001606] Console: colour dummy device 80x30
[    0.001631] Calibrating delay loop (skipped), value calculated using timer frequency.. 6.00 BogoMIPS (lpj=30000)
[    0.001647] pid_max: default: 32768 minimum: 301
[    0.001779] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.001797] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.002380] CPU: Testing write buffer coherency: ok
[    0.002422] CPU0: Spectre v2: using BPIALL workaround
[    0.002768] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[    0.003202] Setting up static identity map for 0x10100000 - 0x10100060
[    0.003345] Hierarchical SRCU implementation.
[    0.003935] smp: Bringing up secondary CPUs ...
[    0.004461] smp: Brought up 1 node, 1 CPU
[    0.004473] SMP: Total of 1 processors activated (6.00 BogoMIPS).
[    0.004484] CPU: All CPU(s) started in SVC mode.
[    0.005291] devtmpfs: initialized
[    0.014602] random: get_random_u32 called from bucket_table_alloc+0x108/0x238 with crng_init=0
[    0.015121] VFP support v0.3: implementor 41 architecture 3 part 30 variant 9 rev 4
[    0.015377] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.015398] futex hash table entries: 512 (order: 3, 32768 bytes)
[    0.020137] pinctrl core: initialized pinctrl subsystem
[    0.021035] NET: Registered protocol family 16
[    0.028107] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.028873] cpuidle: using governor menu
[    0.029191] CPU identified as i.MX6DL, silicon rev 1.4
[    0.036140] vdd1p1: supplied by regulator-dummy
[    0.036646] vdd3p0: supplied by regulator-dummy
[    0.037081] vdd2p5: supplied by regulator-dummy
[    0.037512] vddarm: supplied by regulator-dummy
[    0.038006] vddpu: supplied by regulator-dummy
[    0.038449] vddsoc: supplied by regulator-dummy
[    0.049197] hw-breakpoint: found 5 (+1 reserved) breakpoint and 1 watchpoint registers.
[    0.049210] hw-breakpoint: maximum watchpoint size is 4 bytes.
[    0.050092] imx6dl-pinctrl 20e0000.iomuxc: initialized IMX pinctrl driver
[    0.075800] SCSI subsystem initialized
[    0.076007] usbcore: registered new interface driver usbfs
[    0.076058] usbcore: registered new interface driver hub
[    0.076175] usbcore: registered new device driver usb
[    0.076363] usb_phy_generic 2000000.aips-bus:usbphy_nop1: 2000000.aips-bus:usbphy_nop1 supply vcc not found, using dummy regulator
[    0.076524] usb_phy_generic 2000000.aips-bus:usbphy_nop2: 2000000.aips-bus:usbphy_nop2 supply vcc not found, using dummy regulator
[    0.077353] i2c-gpio i2c@0: using pins 109 (SDA) and 108 (SCL)
[    0.078272] i2c i2c-0: IMX I2C adapter registered
[    0.078290] i2c i2c-0: can't use DMA, using PIO instead.
[    0.079010] i2c i2c-1: IMX I2C adapter registered
[    0.079027] i2c i2c-1: can't use DMA, using PIO instead.
[    0.079229] Linux video capture interface: v2.00
[    0.079287] pps_core: LinuxPPS API ver. 1 registered
[    0.079295] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.079317] PTP clock support registered
[    0.109644] imx-ipuv3 2400000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
[    0.110959] mxc_vdoa 21e4000.vdoa: i.MX Video Data Order Adapter(VDOA) driver probed
[    0.111249] MIPI CSI2 driver module loaded
[    0.111399] Advanced Linux Sound Architecture Driver Initialized.
[    0.113266] clocksource: Switched to clocksource mxc_timer1
[    0.113371] VFS: Disk quotas dquot_6.6.0
[    0.113451] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.121594] NET: Registered protocol family 2
[    0.122179] TCP established hash table entries: 2048 (order: 1, 8192 bytes)
[    0.122214] TCP bind hash table entries: 2048 (order: 2, 16384 bytes)
[    0.122253] TCP: Hash tables configured (established 2048 bind 2048)
[    0.122360] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    0.122386] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    0.122535] NET: Registered protocol family 1
[    0.122911] RPC: Registered named UNIX socket transport module.
[    0.122922] RPC: Registered udp transport module.
[    0.122930] RPC: Registered tcp transport module.
[    0.122938] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.123732] hw perfevents: no interrupt-affinity property for /soc/pmu, guessing.
[    0.123905] hw perfevents: enabled with armv7_cortex_a9 PMU driver, 7 counters available
[    0.125446] Bus freq driver module loaded
[    0.126640] workingset: timestamp_bits=30 max_order=16 bucket_order=0
[    0.131033] NFS: Registering the id_resolver key type
[    0.131061] Key type id_resolver registered
[    0.131069] Key type id_legacy registered
[    0.131086] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.131590] ntfs: driver 2.1.32 [Flags: R/W].
[    0.131873] fuse init (API version 7.26)
[    0.139971] io scheduler noop registered
[    0.139985] io scheduler deadline registered
[    0.140144] io scheduler cfq registered (default)
[    0.140155] io scheduler mq-deadline registered
[    0.140164] io scheduler kyber registered
[    0.142145] imx-weim 21b8000.weim: Driver registered.
[    0.143921] pwm-backlight backlight: backlight supply power not found, using dummy regulator
[    0.146607] fbcvt: 1280x800@60: CVT Name - 1.024MA
[    0.146634] mxc_sdc_fb fb@0: registered mxc display driver lcd
[    0.155467] mxc_sdc_fb fb@0: 1280x800 h_sync,r,l: 128,72,200  v_sync,l,u: 6,3,22 pixclock=83500000 Hz
[    0.183358] imx-ipuv3 2400000.ipu: IPU DMFC DP HIGH RESOLUTION: 1(0,1), 5B(2~5), 5F(6,7)
[    0.217364] mxc_sdc_fb fb@0: 1280x800 h_sync,r,l: 128,72,200  v_sync,l,u: 6,3,22 pixclock=83500000 Hz
[    0.254386] Console: switching to colour frame buffer device 160x50
[    0.288947] mxc_sdc_fb fb@1: mxcfb1 is turned off!
[    0.291080] imx-pgc-pd imx-pgc-power-domain.0: Linked as a consumer to 20dc000.gpc
[    0.291620] PU : no governor for states
[    0.291641] imx-pgc-pd imx-pgc-power-domain.1: Linked as a consumer to 20dc000.gpc
[    0.293314] pfuze100-regulator 0-0008: Full layer: 2, Metal layer: 1
[    0.294058] pfuze100-regulator 0-0008: FAB: 0, FIN: 0
[    0.294071] pfuze100-regulator 0-0008: pfuze100 found.
[    0.315759] 2020000.serial: ttymxc0 at MMIO 0x2020000 (irq = 24, base_baud = 5000000) is a IMX
[    1.187278] console [ttymxc0] enabled
[    1.191997] 21e8000.serial: ttymxc1 at MMIO 0x21e8000 (irq = 68, base_baud = 5000000) is a IMX
[    1.201299] 21ec000.serial: ttymxc2 at MMIO 0x21ec000 (irq = 69, base_baud = 5000000) is a IMX
[    1.210468] 21f0000.serial: ttymxc3 at MMIO 0x21f0000 (irq = 70, base_baud = 5000000) is a IMX
[    1.219632] 21f4000.serial: ttymxc4 at MMIO 0x21f4000 (irq = 71, base_baud = 5000000) is a IMX
[    1.229769] [drm] Initialized vivante 1.0.0 20120216 for platform:Vivante GCCore on minor 0
[    1.238196] [drm] Initialized vivante 1.0.0 20120216 on minor 0
[    1.252277] brd: module loaded
[    1.264648] loop: module loaded
[    1.269480] libphy: Fixed MDIO Bus: probed
[    1.274028] vcan: Virtual CAN interface driver
[    1.278482] CAN device driver interface
[    1.283833] fec 2188000.ethernet: 2188000.ethernet supply phy not found, using dummy regulator
[    1.292944] pps pps0: new PPS source ptp0
[    1.298116] libphy: fec_enet_mii_bus: probed
[    1.303528] fec 2188000.ethernet eth0: registered PHC device 0
[    1.309804] usbcore: registered new interface driver asix
[    1.315333] usbcore: registered new interface driver ax88179_178a
[    1.321466] usbcore: registered new interface driver cdc_ether
[    1.327410] usbcore: registered new interface driver net1080
[    1.333108] usbcore: registered new interface driver cdc_subset
[    1.339111] usbcore: registered new interface driver zaurus
[    1.344783] usbcore: registered new interface driver cdc_ncm
[    1.350448] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.356998] ehci-mxc: Freescale On-Chip EHCI Host driver
[    1.362489] usbcore: registered new interface driver usb-storage
[    1.368623] usbcore: registered new interface driver usbserial
[    1.374517] usbcore: registered new interface driver usbserial_generic
[    1.381074] usbserial: USB Serial support registered for generic
[    1.387133] usbcore: registered new interface driver ftdi_sio
[    1.392906] usbserial: USB Serial support registered for FTDI USB Serial Device
[    1.400267] usbcore: registered new interface driver pl2303
[    1.405894] usbserial: USB Serial support registered for pl2303
[    1.412977] usbmisc_imx 2184800.usbmisc: 2184800.usbmisc supply vbus-wakeup not found, using dummy regulator
[    1.423904] imx_usb 2184000.usb: 2184000.usb supply vbus not found, using dummy regulator
[    1.435894] ci_hdrc ci_hdrc.0: EHCI Host Controller
[    1.440806] ci_hdrc ci_hdrc.0: new USB bus registered, assigned bus number 1
[    1.473289] ci_hdrc ci_hdrc.0: USB 2.0 started, EHCI 1.00
[    1.479477] hub 1-0:1.0: USB hub found
[    1.483328] hub 1-0:1.0: 1 port detected
[    1.605543] Goodix-TS 1-005d: ID 928, version: 1060
[    1.626038] random: fast init done
[    1.636458] input: Goodix Capacitive TouchScreen as /devices/soc0/soc/2100000.aips-bus/21a8000.i2c/i2c-1/1-005d/input/input0
[    1.651984] rtc-ds1307 1-0068: registered as rtc0
[    1.657457] snvs_rtc 20cc000.snvs:snvs-rtc-lp: registered as rtc1
[    1.663795] i2c /dev entries driver
[    1.667983] IR NEC protocol handler initialized
[    1.672522] IR RC5(x/sz) protocol handler initialized
[    1.677644] IR RC6 protocol handler initialized
[    1.682180] IR JVC protocol handler initialized
[    1.686733] IR Sony protocol handler initialized
[    1.691354] IR SANYO protocol handler initialized
[    1.696076] IR Sharp protocol handler initialized
[    1.700783] IR MCE Keyboard/mouse protocol handler initialized
[    1.706631] IR XMP protocol handler initialized
[    1.711731] mxc_v4l2_output v4l2_out: V4L2 device registered as video16
[    1.718517] mxc_v4l2_output v4l2_out: V4L2 device registered as video17
[    1.726649] imx2-wdt 20bc000.wdog: timeout 60 sec (nowayout=0)
[    1.733111] sdhci: Secure Digital Host Controller Interface driver
[    1.739337] sdhci: Copyright(c) Pierre Ossman
[    1.743714] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.750397] sdhci-esdhc-imx 2190000.usdhc: Got CD GPIO
[    1.814507] mmc1: SDHCI controller on 2190000.usdhc [2190000.usdhc] using ADMA
[    1.883335] mmc0: SDHCI controller on 2198000.usdhc [2198000.usdhc] using ADMA
[    1.897340] mxc_vpu 2040000.vpu_fsl: VPU initialized
[    1.903792] galcore: clk_get vg clock failed, disable vg!
[    1.911157] Galcore version 6.2.4.190076
[    2.127546] caam 2100000.caam: ERA source: CAAMVID.
[    2.132488] caam 2100000.caam: AXI pipeline throttling enabled.
[    2.139618] caam 2100000.caam: device ID = 0x0a16010000000100 (Era 4)
[    2.146111] caam 2100000.caam: job rings = 2, qi = 0, dpaa2 = no
[    2.156261] caam_jr 2101000.jr0: Entropy delay = 3200
[    2.178885] mmc0: new DDR MMC card at address 0001
[    2.184824] mmcblk0: mmc0:0001 Q2J54A 3.64 GiB
[    2.190456] mmcblk0boot0: mmc0:0001 Q2J54A partition 1 2.00 MiB
[    2.197645] mmcblk0boot1: mmc0:0001 Q2J54A partition 2 2.00 MiB
[    2.205086]  mmcblk0: p1 p2
[    2.222152] caam_jr 2101000.jr0: Instantiated RNG4 SH0.
[    2.282907] caam_jr 2101000.jr0: Instantiated RNG4 SH1.
[    2.295595] caam algorithms registered in /proc/crypto
[    2.304818] caam_jr 2101000.jr0: registering rng-caam
[    2.310965] caam-snvs 20cc000.caam-snvs: can't get snvs clock
[    2.317161] caam-snvs 20cc000.caam-snvs: violation handlers armed - non-secure state
[    2.325253] hidraw: raw HID events driver (C) Jiri Kosina
[    2.330787] usbcore: registered new interface driver usbhid
[    2.336425] usbhid: USB HID core driver
[    2.343825] sgtl5000 0-000a: sgtl5000 revision 0x11
[    2.378177] fsl-ssi-dai 2028000.ssi: No cache defaults, reading back from HW
[    2.399910] imx-sgtl5000 sound: sgtl5000 <-> 2028000.ssi mapping ok
[    2.407481] ip_tables: (C) 2000-2006 Netfilter Core Team
[    2.413412] NET: Registered protocol family 10
[    2.418831] Segment Routing with IPv6
[    2.422586] ip6_tables: (C) 2000-2006 Netfilter Core Team
[    2.428106] NET: Registered protocol family 17
[    2.432567] can: controller area network core (rev 20170425 abi 9)
[    2.438850] NET: Registered protocol family 29
[    2.443327] can: raw protocol (rev 20170425)
[    2.447603] can: broadcast manager protocol (rev 20170425 t)
[    2.453287] can: netlink gateway (rev 20170425) max_hops=1
[    2.459106] Key type dns_resolver registered
[    2.465142] Registering SWP/SWPB emulation handler
[    2.479439] imx_usb 2184000.usb: 2184000.usb supply vbus not found, using dummy regulator
[    2.491880] ci_hdrc ci_hdrc.1: EHCI Host Controller
[    2.496872] ci_hdrc ci_hdrc.1: new USB bus registered, assigned bus number 2
[    2.533302] ci_hdrc ci_hdrc.1: USB 2.0 started, EHCI 1.00
[    2.539322] hub 2-0:1.0: USB hub found
[    2.543109] hub 2-0:1.0: 1 port detected
[    2.548217] (NULL device *): hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[    2.560658] imx_thermal 2000000.aips-bus:tempmon: Commercial CPU temperature grade - max:95C critical:95C passive:85C
[    2.573787] rtc-ds1307 1-0068: setting system clock to 2022-03-04 09:40:50 UTC (1646386850)
[    2.582573] ALSA device list:
[    2.585583]   #0: imx6dl-colibri-sgtl5000
[    2.597900] EXT4-fs (mmcblk0p2): mounting ext3 file system using the ext4 subsystem
[    2.606279] EXT4-fs (mmcblk0p2): INFO: recovery required on readonly filesystem
[    2.613639] EXT4-fs (mmcblk0p2): write access will be enabled during recovery
[    2.706381] EXT4-fs (mmcblk0p2): recovery complete
[    8.134971] mmcblk0: error -110 sending stop command, original cmd response 0x900, card status 0x400e00
[    8.427015] random: crng init done

After booting linux from a SD card the eMMC root partition of one the boards mounts without any problems making the board bootable too without the need to run fsck file check. So it seems not to be a problem of the ext4 file system but of the eMMC itsself.
Diving into the Linux kernel I see that this error is emitted by the function mmc_blk_cmd_recovery() in file drivers/mmc/core/block.c. This function queries eMMC to get the state of eMMC, recognises an error but classifies the state as continuable to the calling function. The calling function makes some further checks and apparently stops excecution. As the eMMC state is not reset now booting loops.
The last two years we hit on the problem ourselves (2 or 3 times). I’m very sure that the problem arises if the device is switched off shortly after switching it on.
Any idea how to solve the problem.

Hello @eschall ,

Sorry for the delay.

Thank you for the detailed information. We are aware of such behavior and our team is already investigating.
We do not have a confirmed solution yet, but it seems like the use of Linux Kernel 5.4 the recovery mechanism is capable of fixing the issue. Our team is still testing this so this solution is not fully approved yet.

It seems like the error occurs when a partition is not properly unmounted. The behavior after that is caused by some interactions with kernel 4.14.

You could try to give the new kernel a try and let us know any new information you might get.

We’ll follow up on this as soon as we have more information.

Best Regards
Kevin

Hello @kevin.tx,

the error is not reproducable. Currently there is only one board available to me which runs into the error case. Replacing the kernel on the board with Linux Kernel 5.4 may probably recover the board.
Any idea how to test the kernel without replace it?

Regards
Eric

Hi @eschall

Before we dive deeper into kernel 5.4, I have some more questions I would like to ask you.

The module from which you extracted the log you provided is this one fixed?
Is it booting successfully into Linux now?
If so could you provide a log of it?

At any time during those two years, did an error get stuck? Or could you resolve these errors?

Could you define “shortly”? During the booting process of the module?

Best Regards
Kevin

Hi @kevin.tx,
the module from which I extract the log is fixed now. Booting from SD card followed by mounting the eMMC root file system solves the problem. You find the new dmesg output at the end of this reply.
In the past I solve the problem by reflashing the boards.
Shortly means that the device is switched off during the boot process of the module probably 2 - 5 seconds after the device is switched on.

U-Boot 2015.04-dirty (Mar 15 2021 - 12:08:50)

CPU:   Freescale i.MX6SOLO rev1.4 at 792 MHz
CPU:   Temperature 28 C
Reset cause: POR
I2C:   ready
DRAM:  256 MiB
PMIC: device id: 0x10, revision id: 0x21
PMIC: programmed
MMC:   FSL_SDHC: 0, FSL_SDHC: 1
Display: Winstar (1280x800)
In:    serial
Out:   serial
Err:   serial
Model: Toradex Colibri iMX6 Solo 256MB V1.1A, Serial# 10696353
Net:   using PHY at 0
FEC [PRIME]
Normal Boot
Hit any key to stop autoboot:  0
Booting from internal eMMC chip...
reading imx6dl-colibri-eval-v3.dtb
51014 bytes read in 18 ms (2.7 MiB/s)
reading uImage
5683800 bytes read in 205 ms (26.4 MiB/s)
## Booting kernel from Legacy Image at 11000000 ...
   Image Name:   Linux-4.14.159-00041-g1f43bce17a
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    5683736 Bytes = 5.4 MiB
   Load Address: 10008000
   Entry Point:  10008000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 12000000
   Booting using the fdt blob at 0x12000000
   Loading Kernel Image ... OK
   Using Device Tree in place at 12000000, end 1200f745

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 4.14.159-00041-g1f43bce17a57-dirty (colibri@schall-linux-18) (gcc version 8.2.1 20180802 (GNU Toolchain for the A-profile Architecture 8.2-2019.01 (arm-rel-8.28))) #33 SMP Mon Mar 8 17:07:58 CET 2021
[    0.000000] CPU: ARMv7 Processor [412fc09a] revision 10 (ARMv7), cr=10c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[    0.000000] OF: fdt: Machine model: Toradex Colibri iMX6DL/S on Colibri Evaluation Board V3
[    0.000000] Memory policy: Data cache writeback
[    0.000000] OF: reserved mem: failed to allocate memory for node 'linux,cma'
[    0.000000] cma: Reserved 128 MiB at 0x18000000
[    0.000000] CPU: All CPU(s) started in SVC mode.
[    0.000000] percpu: Embedded 15 pages/cpu s30796 r8192 d22452 u61440
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 65024
[    0.000000] Kernel command line: enable_wait_mode=off galcore.contiguousSize=50331648 ip=off root=/dev/mmcblk0p2 rw,noatime rootfstype=ext3 rootwait fec_mac=00:14:2d:a3:36:a1 no_console_suspend=1 console=ttymxc0,115200n8 video=mxcfb0:dev=lcd,1280x800M@60,if=RGB24 video=mxcfb1:off fbmem=32M
[    0.000000] PID hash table entries: 1024 (order: 0, 4096 bytes)
[    0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
[    0.000000] Memory: 116028K/262144K available (8192K kernel code, 494K rwdata, 2040K rodata, 1024K init, 411K bss, 15044K reserved, 131072K cma-reserved, 0K highmem)
[    0.000000] Virtual kernel memory layout:
[    0.000000]     vector  : 0xffff0000 - 0xffff1000   (   4 kB)
[    0.000000]     fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
[    0.000000]     vmalloc : 0x90800000 - 0xff800000   (1776 MB)
[    0.000000]     lowmem  : 0x80000000 - 0x90000000   ( 256 MB)
[    0.000000]     pkmap   : 0x7fe00000 - 0x80000000   (   2 MB)
[    0.000000]     modules : 0x7f000000 - 0x7fe00000   (  14 MB)
[    0.000000]       .text : 0x80008000 - 0x80900000   (9184 kB)
[    0.000000]       .init : 0x80b00000 - 0x80c00000   (1024 kB)
[    0.000000]       .data : 0x80c00000 - 0x80c7bb80   ( 495 kB)
[    0.000000]        .bss : 0x80c7bb80 - 0x80ce2838   ( 412 kB)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU event tracing is enabled.
[    0.000000]  RCU restricting CPUs from NR_CPUS=4 to nr_cpu_ids=2.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] L2C: DT/platform modifies aux control register: 0x32050000 -> 0x32450000
[    0.000000] L2C-310 erratum 769419 enabled
[    0.000000] L2C-310 enabling early BRESP for Cortex-A9
[    0.000000] L2C-310 full line of zeros enabled for Cortex-A9
[    0.000000] L2C-310 ID prefetch enabled, offset 16 lines
[    0.000000] L2C-310 dynamic clock gating enabled, standby mode enabled
[    0.000000] L2C-310 cache controller enabled, 16 ways, 512 kB
[    0.000000] L2C-310: CACHE_ID 0x410000c8, AUX_CTRL 0x76450001
[    0.000000] Switching to timer-based delay loop, resolution 333ns
[    0.000007] sched_clock: 32 bits at 3000kHz, resolution 333ns, wraps every 715827882841ns
[    0.000024] clocksource: mxc_timer1: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 637086815595 ns
[    0.001603] Console: colour dummy device 80x30
[    0.001627] Calibrating delay loop (skipped), value calculated using timer frequency.. 6.00 BogoMIPS (lpj=30000)
[    0.001645] pid_max: default: 32768 minimum: 301
[    0.001775] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.001792] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.002369] CPU: Testing write buffer coherency: ok
[    0.002413] CPU0: Spectre v2: using BPIALL workaround
[    0.002762] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[    0.003202] Setting up static identity map for 0x10100000 - 0x10100060
[    0.003351] Hierarchical SRCU implementation.
[    0.003942] smp: Bringing up secondary CPUs ...
[    0.004460] smp: Brought up 1 node, 1 CPU
[    0.004472] SMP: Total of 1 processors activated (6.00 BogoMIPS).
[    0.004481] CPU: All CPU(s) started in SVC mode.
[    0.005295] devtmpfs: initialized
[    0.014599] random: get_random_u32 called from bucket_table_alloc+0x108/0x238 with crng_init=0
[    0.015118] VFP support v0.3: implementor 41 architecture 3 part 30 variant 9 rev 4
[    0.015373] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.015394] futex hash table entries: 512 (order: 3, 32768 bytes)
[    0.019950] pinctrl core: initialized pinctrl subsystem
[    0.020845] NET: Registered protocol family 16
[    0.027895] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.028666] cpuidle: using governor menu
[    0.028986] CPU identified as i.MX6DL, silicon rev 1.4
[    0.035948] vdd1p1: supplied by regulator-dummy
[    0.036445] vdd3p0: supplied by regulator-dummy
[    0.036881] vdd2p5: supplied by regulator-dummy
[    0.037308] vddarm: supplied by regulator-dummy
[    0.037794] vddpu: supplied by regulator-dummy
[    0.038239] vddsoc: supplied by regulator-dummy
[    0.048987] hw-breakpoint: found 5 (+1 reserved) breakpoint and 1 watchpoint registers.
[    0.049000] hw-breakpoint: maximum watchpoint size is 4 bytes.
[    0.049897] imx6dl-pinctrl 20e0000.iomuxc: initialized IMX pinctrl driver
[    0.075612] SCSI subsystem initialized
[    0.075818] usbcore: registered new interface driver usbfs
[    0.075870] usbcore: registered new interface driver hub
[    0.075987] usbcore: registered new device driver usb
[    0.076173] usb_phy_generic 2000000.aips-bus:usbphy_nop1: 2000000.aips-bus:usbphy_nop1 supply vcc not found, using dummy regulator
[    0.076333] usb_phy_generic 2000000.aips-bus:usbphy_nop2: 2000000.aips-bus:usbphy_nop2 supply vcc not found, using dummy regulator
[    0.077167] i2c-gpio i2c@0: using pins 109 (SDA) and 108 (SCL)
[    0.078099] i2c i2c-0: IMX I2C adapter registered
[    0.078119] i2c i2c-0: can't use DMA, using PIO instead.
[    0.078850] i2c i2c-1: IMX I2C adapter registered
[    0.078868] i2c i2c-1: can't use DMA, using PIO instead.
[    0.079070] Linux video capture interface: v2.00
[    0.079128] pps_core: LinuxPPS API ver. 1 registered
[    0.079137] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.079157] PTP clock support registered
[    0.109655] imx-ipuv3 2400000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
[    0.110979] mxc_vdoa 21e4000.vdoa: i.MX Video Data Order Adapter(VDOA) driver probed
[    0.111268] MIPI CSI2 driver module loaded
[    0.111416] Advanced Linux Sound Architecture Driver Initialized.
[    0.113294] clocksource: Switched to clocksource mxc_timer1
[    0.113400] VFS: Disk quotas dquot_6.6.0
[    0.113478] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.121663] NET: Registered protocol family 2
[    0.122248] TCP established hash table entries: 2048 (order: 1, 8192 bytes)
[    0.122280] TCP bind hash table entries: 2048 (order: 2, 16384 bytes)
[    0.122320] TCP: Hash tables configured (established 2048 bind 2048)
[    0.122429] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    0.122456] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    0.122609] NET: Registered protocol family 1
[    0.122991] RPC: Registered named UNIX socket transport module.
[    0.123002] RPC: Registered udp transport module.
[    0.123011] RPC: Registered tcp transport module.
[    0.123019] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.123817] hw perfevents: no interrupt-affinity property for /soc/pmu, guessing.
[    0.123983] hw perfevents: enabled with armv7_cortex_a9 PMU driver, 7 counters available
[    0.125511] Bus freq driver module loaded
[    0.126706] workingset: timestamp_bits=30 max_order=16 bucket_order=0
[    0.131107] NFS: Registering the id_resolver key type
[    0.131133] Key type id_resolver registered
[    0.131142] Key type id_legacy registered
[    0.131159] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.131669] ntfs: driver 2.1.32 [Flags: R/W].
[    0.131955] fuse init (API version 7.26)
[    0.140024] io scheduler noop registered
[    0.140039] io scheduler deadline registered
[    0.140193] io scheduler cfq registered (default)
[    0.140205] io scheduler mq-deadline registered
[    0.140214] io scheduler kyber registered
[    0.142219] imx-weim 21b8000.weim: Driver registered.
[    0.144014] pwm-backlight backlight: backlight supply power not found, using dummy regulator
[    0.146718] fbcvt: 1280x800@60: CVT Name - 1.024MA
[    0.146745] mxc_sdc_fb fb@0: registered mxc display driver lcd
[    0.155468] mxc_sdc_fb fb@0: 1280x800 h_sync,r,l: 128,72,200  v_sync,l,u: 6,3,22 pixclock=83500000 Hz
[    0.183432] imx-ipuv3 2400000.ipu: IPU DMFC DP HIGH RESOLUTION: 1(0,1), 5B(2~5), 5F(6,7)
[    0.217430] mxc_sdc_fb fb@0: 1280x800 h_sync,r,l: 128,72,200  v_sync,l,u: 6,3,22 pixclock=83500000 Hz
[    0.254421] Console: switching to colour frame buffer device 160x50
[    0.289021] mxc_sdc_fb fb@1: mxcfb1 is turned off!
[    0.291156] imx-pgc-pd imx-pgc-power-domain.0: Linked as a consumer to 20dc000.gpc
[    0.291699] PU : no governor for states
[    0.291722] imx-pgc-pd imx-pgc-power-domain.1: Linked as a consumer to 20dc000.gpc
[    0.293405] pfuze100-regulator 0-0008: Full layer: 2, Metal layer: 1
[    0.294130] pfuze100-regulator 0-0008: FAB: 0, FIN: 0
[    0.294143] pfuze100-regulator 0-0008: pfuze100 found.
[    0.315891] 2020000.serial: ttymxc0 at MMIO 0x2020000 (irq = 24, base_baud = 5000000) is a IMX
[    1.187408] console [ttymxc0] enabled
[    1.192129] 21e8000.serial: ttymxc1 at MMIO 0x21e8000 (irq = 68, base_baud = 5000000) is a IMX
[    1.201423] 21ec000.serial: ttymxc2 at MMIO 0x21ec000 (irq = 69, base_baud = 5000000) is a IMX
[    1.210597] 21f0000.serial: ttymxc3 at MMIO 0x21f0000 (irq = 70, base_baud = 5000000) is a IMX
[    1.219760] 21f4000.serial: ttymxc4 at MMIO 0x21f4000 (irq = 71, base_baud = 5000000) is a IMX
[    1.229912] [drm] Initialized vivante 1.0.0 20120216 for platform:Vivante GCCore on minor 0
[    1.238341] [drm] Initialized vivante 1.0.0 20120216 on minor 0
[    1.252384] brd: module loaded
[    1.264827] loop: module loaded
[    1.269658] libphy: Fixed MDIO Bus: probed
[    1.274205] vcan: Virtual CAN interface driver
[    1.278659] CAN device driver interface
[    1.284008] fec 2188000.ethernet: 2188000.ethernet supply phy not found, using dummy regulator
[    1.293116] pps pps0: new PPS source ptp0
[    1.298305] libphy: fec_enet_mii_bus: probed
[    1.303731] fec 2188000.ethernet eth0: registered PHC device 0
[    1.309997] usbcore: registered new interface driver asix
[    1.315524] usbcore: registered new interface driver ax88179_178a
[    1.321655] usbcore: registered new interface driver cdc_ether
[    1.327599] usbcore: registered new interface driver net1080
[    1.333346] usbcore: registered new interface driver cdc_subset
[    1.339302] usbcore: registered new interface driver zaurus
[    1.344972] usbcore: registered new interface driver cdc_ncm
[    1.350637] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.357188] ehci-mxc: Freescale On-Chip EHCI Host driver
[    1.362682] usbcore: registered new interface driver usb-storage
[    1.368816] usbcore: registered new interface driver usbserial
[    1.374711] usbcore: registered new interface driver usbserial_generic
[    1.381270] usbserial: USB Serial support registered for generic
[    1.387328] usbcore: registered new interface driver ftdi_sio
[    1.393102] usbserial: USB Serial support registered for FTDI USB Serial Device
[    1.400464] usbcore: registered new interface driver pl2303
[    1.406094] usbserial: USB Serial support registered for pl2303
[    1.413188] usbmisc_imx 2184800.usbmisc: 2184800.usbmisc supply vbus-wakeup not found, using dummy regulator
[    1.424119] imx_usb 2184000.usb: 2184000.usb supply vbus not found, using dummy regulator
[    1.436058] ci_hdrc ci_hdrc.0: EHCI Host Controller
[    1.440971] ci_hdrc ci_hdrc.0: new USB bus registered, assigned bus number 1
[    1.473317] ci_hdrc ci_hdrc.0: USB 2.0 started, EHCI 1.00
[    1.479501] hub 1-0:1.0: USB hub found
[    1.483352] hub 1-0:1.0: 1 port detected
[    1.605572] Goodix-TS 1-005d: ID 928, version: 1060
[    1.626064] random: fast init done
[    1.636486] input: Goodix Capacitive TouchScreen as /devices/soc0/soc/2100000.aips-bus/21a8000.i2c/i2c-1/1-005d/input/input0
[    1.652008] rtc-ds1307 1-0068: registered as rtc0
[    1.657491] snvs_rtc 20cc000.snvs:snvs-rtc-lp: registered as rtc1
[    1.663827] i2c /dev entries driver
[    1.668012] IR NEC protocol handler initialized
[    1.672552] IR RC5(x/sz) protocol handler initialized
[    1.677671] IR RC6 protocol handler initialized
[    1.682208] IR JVC protocol handler initialized
[    1.686761] IR Sony protocol handler initialized
[    1.691382] IR SANYO protocol handler initialized
[    1.696103] IR Sharp protocol handler initialized
[    1.700810] IR MCE Keyboard/mouse protocol handler initialized
[    1.706660] IR XMP protocol handler initialized
[    1.711755] mxc_v4l2_output v4l2_out: V4L2 device registered as video16
[    1.718543] mxc_v4l2_output v4l2_out: V4L2 device registered as video17
[    1.726677] imx2-wdt 20bc000.wdog: timeout 60 sec (nowayout=0)
[    1.733143] sdhci: Secure Digital Host Controller Interface driver
[    1.739371] sdhci: Copyright(c) Pierre Ossman
[    1.743749] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.750441] sdhci-esdhc-imx 2190000.usdhc: Got CD GPIO
[    1.814535] mmc1: SDHCI controller on 2190000.usdhc [2190000.usdhc] using ADMA
[    1.883347] mmc0: SDHCI controller on 2198000.usdhc [2198000.usdhc] using ADMA
[    1.897357] mxc_vpu 2040000.vpu_fsl: VPU initialized
[    1.903813] galcore: clk_get vg clock failed, disable vg!
[    1.911176] Galcore version 6.2.4.190076
[    2.128583] caam 2100000.caam: ERA source: CAAMVID.
[    2.133602] caam 2100000.caam: AXI pipeline throttling enabled.
[    2.143053] caam 2100000.caam: device ID = 0x0a16010000000100 (Era 4)
[    2.149564] caam 2100000.caam: job rings = 2, qi = 0, dpaa2 = no
[    2.163713] caam_jr 2101000.jr0: Entropy delay = 3200
[    2.178893] mmc0: new DDR MMC card at address 0001
[    2.184849] mmcblk0: mmc0:0001 Q2J54A 3.64 GiB
[    2.190487] mmcblk0boot0: mmc0:0001 Q2J54A partition 1 2.00 MiB
[    2.197668] mmcblk0boot1: mmc0:0001 Q2J54A partition 2 2.00 MiB
[    2.205101]  mmcblk0: p1 p2
[    2.229618] caam_jr 2101000.jr0: Instantiated RNG4 SH0.
[    2.290368] caam_jr 2101000.jr0: Instantiated RNG4 SH1.
[    2.302999] caam algorithms registered in /proc/crypto
[    2.312354] caam_jr 2101000.jr0: registering rng-caam
[    2.318573] caam-snvs 20cc000.caam-snvs: can't get snvs clock
[    2.324794] caam-snvs 20cc000.caam-snvs: violation handlers armed - non-secure state
[    2.332800] hidraw: raw HID events driver (C) Jiri Kosina
[    2.338417] usbcore: registered new interface driver usbhid
[    2.344048] usbhid: USB HID core driver
[    2.351429] sgtl5000 0-000a: sgtl5000 revision 0x11
[    2.385794] fsl-ssi-dai 2028000.ssi: No cache defaults, reading back from HW
[    2.407427] imx-sgtl5000 sound: sgtl5000 <-> 2028000.ssi mapping ok
[    2.414994] ip_tables: (C) 2000-2006 Netfilter Core Team
[    2.420834] NET: Registered protocol family 10
[    2.426346] Segment Routing with IPv6
[    2.430103] ip6_tables: (C) 2000-2006 Netfilter Core Team
[    2.435623] NET: Registered protocol family 17
[    2.440084] can: controller area network core (rev 20170425 abi 9)
[    2.446366] NET: Registered protocol family 29
[    2.450819] can: raw protocol (rev 20170425)
[    2.455118] can: broadcast manager protocol (rev 20170425 t)
[    2.460789] can: netlink gateway (rev 20170425) max_hops=1
[    2.466624] Key type dns_resolver registered
[    2.472628] Registering SWP/SWPB emulation handler
[    2.487512] imx_usb 2184000.usb: 2184000.usb supply vbus not found, using dummy regulator
[    2.499939] ci_hdrc ci_hdrc.1: EHCI Host Controller
[    2.504925] ci_hdrc ci_hdrc.1: new USB bus registered, assigned bus number 2
[    2.533331] ci_hdrc ci_hdrc.1: USB 2.0 started, EHCI 1.00
[    2.539347] hub 2-0:1.0: USB hub found
[    2.543137] hub 2-0:1.0: 1 port detected
[    2.548251] (NULL device *): hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[    2.560692] imx_thermal 2000000.aips-bus:tempmon: Commercial CPU temperature grade - max:95C critical:95C passive:85C
[    2.573816] rtc-ds1307 1-0068: setting system clock to 2022-03-17 07:38:52 UTC (1647502732)
[    2.582598] ALSA device list:
[    2.585608]   #0: imx6dl-colibri-sgtl5000
[    2.597954] EXT4-fs (mmcblk0p2): mounting ext3 file system using the ext4 subsystem
[    2.606376] EXT4-fs (mmcblk0p2): INFO: recovery required on readonly filesystem
[    2.613735] EXT4-fs (mmcblk0p2): write access will be enabled during recovery
[    2.624909] EXT4-fs (mmcblk0p2): recovery complete
[    2.733087] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Opts: (null)
[    2.741556] VFS: Mounted root (ext3 filesystem) readonly on device 179:2.
[    2.753112] devtmpfs: mounted
[    2.759020] Freeing unused kernel memory: 1024K
[    2.943563] systemd[1]: systemd 241-214-gd1cc09a+ running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid)
[    2.966719] systemd[1]: Detected architecture arm.

Welcome to Boot to Qt for Embedded Linux 2.7.3 (warrior)!

[    3.003926] systemd[1]: Set hostname to <b2qt-colibri-imx6>.
[    3.392509] random: systemd: uninitialized urandom read (16 bytes read)
[    3.399793] systemd[1]: Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Socket (/dev/log).
[    3.433588] random: systemd: uninitialized urandom read (16 bytes read)
[    3.440701] systemd[1]: Listening on udev Control Socket.
[  OK  ] Listening on udev Control Socket.
[    3.473474] random: systemd: uninitialized urandom read (16 bytes read)
[    3.481008] systemd[1]: Created slice User and Session Slice.
[  OK  ] Created slice User and Session Slice.
[    3.513578] systemd[1]: Reached target Slices.
[  OK  ] Reached target Slices.
[    3.543848] systemd[1]: Listening on initctl Compatibility Named Pipe.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[    3.583899] systemd[1]: Reached target Remote File Systems.
[  OK  ] Reached target Remote File Systems.
[    3.624219] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started Dispatch Password …ts to Console Directory Watch.
[  OK  ] Reached target Swap.
[  OK  ] Listening on Syslog Socket.
[  OK  ] Listening on udev Kernel Socket.
[  OK  ] Created slice system-serial\x2dgetty.slice.
[  OK  ] Started Forward Password R…uests to Wall Directory Watch.
[  OK  ] Listening on Journal Socket.
         Mounting Temporary Directory (/tmp)...
         Mounting Kernel Debug File System...
         Starting Create list of re…odes for the current kernel...
         Starting Load Kernel Modules...
[  OK  ] Reached target Paths.
         Starting File System Check on Root Device...
         Starting udev Coldplug all Devices...
[  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
[  OK  ] Reached target Network is Online.
         Starting Journal Service...
[    4.110315] random: crng init done
[    4.113808] random: 7 urandom warning(s) missed due to ratelimiting
[  OK  ] Mounted Temporary Directory (/tmp).
[  OK  ] Mounted Kernel Debug File System.
[  OK  ] Started Create list of req… nodes for the current kernel.
[  OK  ] Started Load Kernel Modules.
[  OK  ] Started File System Check on Root Device.
         Starting Remount Root and Kernel File Systems...
         Mounting FUSE Control File System...
         Starting Apply Kernel Variables...
         Mounting Kernel Configuration File System...
[  OK  ] Mounted     4.407751] EXT4-fs (mmcblk0p2): re-mounted. Opts: (null)
39mFUSE Control File System.
[  OK  ] Mounted Kernel Configuration File System.
[  OK  ] Started Remount Root and Kernel File Systems.
[  OK  ] Started Journal Service.
[  OK  ] Started Apply Kernel Variables.
         Starting Create Static Device Nodes in /dev...
         Starting Flush Journal to Persistent Storage...
[  OK  ] Started Create Static Device Nodes in /dev.
[  OK  ] Reached target Local File Systems (Pre).
[  OK  ] Reached target Containers.
         Mounting /var/volatile...
         Starting udev Kernel Device Manager...
[  OK  ] Started udev Coldplug all Devices.
[  OK  ] Started udev Kernel Device Manager.
[  OK  ] Mounted /var/volatile.
[    4.943109] systemd-journald[177]: Received request to flush runtime journal from PID 1
         Starting Load/Save Random Seed...
[  OK  ] Reached target Local File Systems.
[  OK  ] Started Flush Journal to Persistent Storage.
         Starting Create Volatile Files and Directories...
[  OK  ] Started Load/Save Random Seed.
[  OK  ] Started Create Volatile Files and Directories.
[  OK  ] Created slice system-systemd\x2dbacklight.slice.
         Starting Load/Save Screen …ness of backlight:backlight...
         Starting Update UTMP about System Boot/Shutdown...
[    5.573627] imx-sdma 20ec000.sdma: no iram assigned, using external mem
[  OK  ] Found device  imx-sdma 20ec000.sdma: loaded firmware 3.5
[0;1;39m/dev/ttymxc0.
[  OK  ] Started Load/Save Screen B…htness of backlight:backlight.
[  OK  ] Started Update UTMP about System Boot/Shutdown.
[  OK  ] Listening on Load/Save RF …itch Status /dev/rfkill Watch.
[  OK  ] Reached target System Initialization.
[  OK  ] Listening on dropbear.socket.
[  OK  ] Listening on RPCbind Server Activation Socket.
[  OK  ] Listening on D-Bus System Message Bus Socket.
[  OK  ] Reached target Sockets.
[  OK  ] Reached target Basic System.
         Starting Start Zimmer Software...
[  OK  ] Started Kernel Logging Service.
         Starting Samba NMB Daemon...
         Starting Permit User Sessions...
         Starting Login Service...
[  OK  ] Started D-Bus System Message Bus.
[  OK  ] Started Daily Cleanup of Temporary Directories.
[  OK  ] Reached target Timers.
         Starting Save/Restore Sound Card State...
[  OK  ] Started System Logging Service.
[  OK  ] Started Permit User Sessions.
[  OK  ] Started Save/Restore Sound Card State.
[  OK  ] Started Serial Getty on ttymxc0.
[  OK  ] Reached target Login Prompts.
[FAILED] Failed to start Start Zimmer Software.
See 'systemctl status zm_app.service' for details.
[  OK  ] Created slice User Slice of UID 0.
         Starting User Runtime Directory /run/user/0...
[  OK  ] Reached target Sound Card.
[  OK  ] Started Login Service.
[  OK  ] Started User Runtime Directory /run/user/0.
         Starting User Manager for UID 0...
[  OK  ] Started User Manager for UID 0.

Boot to Qt for Embedded Linux 2.7.3 b2qt-colibri-imx6 ttymxc0

b2qt-colibri-imx6 login:

Hi @eschall ,

Thank you for providing more information.

I will forward this to the investigating team.

We will reach out to you as soon as be have any news or further questions.

Best Regards
Kevin

Hi @eschall ,

would it be possible for you to ship any module with this error to us so we can perform an indepth analysis on the issue?
We would really appreciate it.

You can find all information about returning to module here:

Best Regards
Kevin

Hi @eschall ,

We received your module. Thanks for shipping it.

We let you know as soon as we have an update.

Best Regards
Kevin

Hi @eschall ,

Thank you for your patience.

I would like to give you some information on what is going on in this issue.

Unfortunately, there’s no significant update yet. We are still investigating what might cause this behaviour. We escalated the issue further up the ladder. As soon as we get any new intel on it, I’ll let you know as soon as possible.

Did you come across additional units that show this behaviour in the meantime?

Have a great day

Best Regards
Kevin

I want to know if this problem has been solved?

Hi @kake,

would you be ready to jump in a call to discuss your case?

Best Regards
Kevin

Hi all!

FYI, this patch for this issue was accepted upstream and Toradex’s kernels already have them applied.

https://lore.kernel.org/all/CAPDyKFqXa_nVBTSXwUqecAAiDkFxdqHjq1QOWbe0Oa9kkvpEZA@mail.gmail.com/

Best regards,

Hello @henrique.tx,

We have been receiving reports from customers regarding issues with systems failing to complete the boot process. The logs collected indicate that the modules are experiencing a fault quite similar to the one described in this thread. Specifically, the affected modules are of model Apalis iMX6 Quad 2GB IT V1.1C, running the Linux Kernel at version 4.1.15.

Our teams have gathered the following logs via the serial port:

U-Boot 2015.04+fslc+g46aa70c (Dec 31 2020 - 20:07:05)

CPU:   Freescale i.MX6Q rev1.6 at 792 MHz
CPU:   Temperature 40 C
Reset cause: POR
I2C:   ready
DRAM:  2 GiB
PMIC: device id: 0x10, revision id: 0x21
PMIC: programmed
MMC:   FSL_SDHC: 0, FSL_SDHC: 1, FSL_SDHC: 2
auto-detected panel G104X1
Display: G104X1 (1024x768)
In:    serial
Out:   serial
Err:   serial
Model: Toradex Apalis iMX6 Quad 2GB IT V1.1C, Serial# 10832755
Net:   using PHY at 7
FEC [PRIME]
Normal Boot
Hit any key to stop autoboot:  0
starting USB...
USB0:   USB EHCI 1.00
scanning bus 0 for devices... 1 USB Device(s) found
USB1:   USB EHCI 1.00
scanning bus 1 for devices... 3 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found
       scanning usb for ethernet devices... 0 Ethernet Device(s) found
** Bad device usb 0 **
** Bad device usb 0 **
Booting from internal eMMC chip...
reading imx6q-apalis-art-hmi-img3.dtb
50756 bytes read in 32 ms (1.5 MiB/s)
reading uImage_img3
4519128 bytes read in 134 ms (32.2 MiB/s)

## Booting kernel from Legacy Image at 11000000 ...
   Image Name:   Linux-4.1.15-v2.6b2+g0ff849d86eb
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    4519064 Bytes = 4.3 MiB
   Load Address: 10008000
   Entry Point:  10008000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 12000000
   Booting using the fdt blob at 0x12000000
   Loading Kernel Image ... OK
   Using Device Tree in place at 12000000, end 1200f643

Starting kernel ...

Booting Linux on physical CPU 0x0
Initializing cgroup subsys cpuacct
Linux version 4.1.15-v2.6b2+g0ff849d86eb3 (art@artvivsrvbuild01) (gcc version 5.3.0 (GCC) ) #1 SMP Fri Apr 1 14:43:22 UTC 2022
CPU: ARMv7 Processor [412fc09a] revision 10 (ARMv7), cr=10c53c7d
CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
Machine model: Toradex Apalis iMX6Q/D Module on ART HMI Board
Reserved memory: created CMA memory pool at 0x62000000, size 320 MiB
Reserved memory: initialized node linux,cma, compatible id shared-dma-pool
Memory policy: Data cache writealloc
PERCPU: Embedded 11 pages/cpu @d0f00000 s16140 r8192 d20724 u45056
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 521024
Kernel command line: enable_wait_mode=off vmalloc=400M ip=off root=/dev/mmcblk0p5 rw,noatime rootfstype=ext3 rootwait fec_mac=00:14:2d:a5:4b:73 consoleblank=0 no_console_suspend=1 console=tty1 console=ttymxc0,115200n8 ${vidargs_lvds}
PID hash table entries: 4096 (order: 2, 16384 bytes)
Dentry cache hash table entries: 262144 (order: 8, 1048576 bytes)
Inode-cache hash table entries: 131072 (order: 7, 524288 bytes)
Memory: 1741724K/2097152K available (5799K kernel code, 198K rwdata, 1988K rodata, 328K init, 407K bss, 27748K reserved, 327680K cma-reserved, 425984K highmem)
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
    vmalloc : 0xe6800000 - 0xff000000   ( 392 MB)
    lowmem  : 0x80000000 - 0xe6000000   (1632 MB)
    pkmap   : 0x7fe00000 - 0x80000000   (   2 MB)
    modules : 0x7f000000 - 0x7fe00000   (  14 MB)
      .text : 0x80008000 - 0x807a304c   (7789 kB)
      .init : 0x807a4000 - 0x807f6000   ( 328 kB)
      .data : 0x807f6000 - 0x80827be0   ( 199 kB)
       .bss : 0x80827be0 - 0x8088d900   ( 408 kB)
SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
Hierarchical RCU implementation.
NR_IRQS:16 nr_irqs:16 16
L2C-310 erratum 769419 enabled
L2C-310 enabling early BRESP for Cortex-A9
L2C-310 full line of zeros enabled for Cortex-A9
L2C-310 ID prefetch enabled, offset 16 lines
L2C-310 dynamic clock gating enabled, standby mode enabled
L2C-310 cache controller enabled, 16 ways, 1024 kB
L2C-310: CACHE_ID 0x410000c7, AUX_CTRL 0x76070001
mxc_clocksource_init 3000000
Switching to timer-based delay loop, resolution 333ns
sched_clock: 32 bits at 3000kHz, resolution 333ns, wraps every 715827882841ns
clocksource mxc_timer1: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 637086815595 ns
Console: colour dummy device 80x30
console [tty1] enabled
Calibrating delay loop (skipped), value calculated using timer frequency.. 6.00 BogoMIPS (lpj=30000)
pid_max: default: 32768 minimum: 301
Mount-cache hash table entries: 4096 (order: 2, 16384 bytes)
Mountpoint-cache hash table entries: 4096 (order: 2, 16384 bytes)
Initializing cgroup subsys freezer
Initializing cgroup subsys debug
CPU: Testing write buffer coherency: ok
CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
Setting up static identity map for 0x10008280 - 0x100082d8
CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
CPU2: thread -1, cpu 2, socket 0, mpidr 80000002
CPU3: thread -1, cpu 3, socket 0, mpidr 80000003
Brought up 4 CPUs
SMP: Total of 4 processors activated (24.00 BogoMIPS).
CPU: All CPU(s) started in SVC mode.
devtmpfs: initialized
VFP support v0.3: implementor 41 architecture 3 part 30 variant 9 rev 4
clocksource jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
pinctrl core: initialized pinctrl subsystem
NET: Registered protocol family 16
DMA: preallocated 256 KiB pool for atomic coherent allocations
cpuidle: using governor ladder
cpuidle: using governor menu
CPU identified as i.MX6Q, silicon rev 0.6
imx6q-pinctrl 20e0000.iomuxc: initialized IMX pinctrl driver
vgaarb: loaded
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
i2c-gpio i2c@0: using pins 80 (SDA) and 62 (SCL)
i2c i2c-1: IMX I2C adapter registered
i2c i2c-1: can't use DMA
stmpe-i2c 2-0041: stmpe811 detected, chip id: 0x811
stmpe-i2c 2-0041: platform wants blocks (0x8) not present on variant
i2c i2c-2: IMX I2C adapter registered
i2c i2c-2: can't use DMA
i2c i2c-3: IMX I2C adapter registered
i2c i2c-3: can't use DMA
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
imx-ipuv3 2400000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
imx-ipuv3 2800000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
MIPI CSI2 driver module loaded
Advanced Linux Sound Architecture Driver Initialized.
Switched to clocksource mxc_timer1
NET: Registered protocol family 2
TCP established hash table entries: 16384 (order: 4, 65536 bytes)
TCP bind hash table entries: 16384 (order: 5, 131072 bytes)
TCP: Hash tables configured (established 16384 bind 16384)
UDP hash table entries: 1024 (order: 3, 32768 bytes)
UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes)
NET: Registered protocol family 1
RPC: Registered named UNIX socket transport module.
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
imx rpmsg driver is registered.
Bus freq driver module loaded
futex hash table entries: 1024 (order: 4, 65536 bytes)
NFS: Registering the id_resolver key type
Key type id_resolver registered
Key type id_legacy registered
bounce: pool size: 64 pages
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
keyboard_backlight supply power not found, using dummy regulator
lcd_backlight supply power not found, using dummy regulator
MIPI DSI driver module loaded
mxc_sdc_fb fb@0: registered mxc display driver ldb
imx-ipuv3 2800000.ipu: IPU DMFC DP HIGH RESOLUTION: 1(0,1), 5B(2~5), 5F(6,7)
Console: switching to colour frame buffer device 128x48
imx-sdma 20ec000.sdma: no iram assigned, using external mem
imx-sdma 20ec000.sdma: no event needs to be remapped
imx-sdma 20ec000.sdma: loaded firmware 3.3
imx-sdma 20ec000.sdma: initialized
pfuze100-regulator 2-0008: Full layer: 2, Metal layer: 1
pfuze100-regulator 2-0008: FAB: 0, FIN: 0
pfuze100-regulator 2-0008: pfuze100 found.
2020000.serial: ttymxc0 at MMIO 0x2020000 (irq = 27, base_baud = 5000000) is a IMX
console [ttymxc0] enabled
21e8000.serial: ttymxc1 at MMIO 0x21e8000 (irq = 298, base_baud = 5000000) is a IMX
21f0000.serial: ttymxc3 at MMIO 0x21f0000 (irq = 299, base_baud = 5000000) is a IMX
21f4000.serial: ttymxc4 at MMIO 0x21f4000 (irq = 300, base_baud = 5000000) is a IMX
imx sema4 driver is registered.
[drm] Initialized drm 1.1.0 20060810
brd: module loaded
loop: module loaded
at24 1-0007: 256 byte 24c02 EEPROM, writable, 1 bytes/write
ahci-imx 2200000.sata: fsl,transmit-level-mV not specified, using 00000024
ahci-imx 2200000.sata: fsl,transmit-boost-mdB not specified, using 00000480
ahci-imx 2200000.sata: fsl,transmit-atten-16ths not specified, using 00002000
ahci-imx 2200000.sata: fsl,receive-eq-mdB not specified, using 05000000
ahci-imx 2200000.sata: SSS flag set, parallel bus scan disabled
ahci-imx 2200000.sata: AHCI 0001.0300 32 slots 1 ports 3 Gbps 0x1 impl platform mode
ahci-imx 2200000.sata: flags: ncq sntf stag pm led clo only pmp pio slum part ccc apst
scsi host0: ahci-imx
ata1: SATA max UDMA/133 mmio [mem 0x02200000-0x02203fff] port 0x100 irq 310
spi_imx 2008000.ecspi: probed
spi_imx 200c000.ecspi: probed
tun: Universal TUN/TAP device driver, 1.6
tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
CAN device driver interface
2090000.flexcan supply xceiver not found, using dummy regulator
flexcan 2090000.flexcan: device registered (reg_base=e6a80000, irq=34)
2094000.flexcan supply xceiver not found, using dummy regulator
flexcan 2094000.flexcan: device registered (reg_base=e6a88000, irq=35)
2188000.ethernet supply phy not found, using dummy regulator
pps pps0: new PPS source ptp0
libphy: fec_enet_mii_bus: probed
fec 2188000.ethernet eth0: registered PHC device 0
usbcore: registered new interface driver cdc_ether
usbcore: registered new interface driver cdc_ncm
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
ehci-pci: EHCI PCI platform driver
ehci-platform: EHCI generic platform driver
ehci-mxc: Freescale On-Chip EHCI Host driver
usbcore: registered new interface driver usb-storage
usbcore: registered new interface driver usbserial
usbcore: registered new interface driver usbserial_generic
usbserial: USB Serial support registered for generic
usbcore: registered new interface driver ftdi_sio
usbserial: USB Serial support registered for FTDI USB Serial Device
usbcore: registered new interface driver option
usbserial: USB Serial support registered for GSM modem (1-port)
usbcore: registered new interface driver pl2303
usbserial: USB Serial support registered for pl2303
usbcore: registered new interface driver qcserial
usbserial: USB Serial support registered for Qualcomm USB modem
2184800.usbmisc supply vbus-wakeup not found, using dummy regulator
ci_hdrc ci_hdrc.0: EHCI Host Controller
ci_hdrc ci_hdrc.0: new USB bus registered, assigned bus number 1
ci_hdrc ci_hdrc.0: USB 2.0 started, EHCI 1.00
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 1 port detected
usb_host_vbus: supplied by usb_host_vbus_hub
ci_hdrc ci_hdrc.1: EHCI Host Controller
ci_hdrc ci_hdrc.1: new USB bus registered, assigned bus number 2
ci_hdrc ci_hdrc.1: USB 2.0 started, EHCI 1.00
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 1 port detected
mousedev: PS/2 mouse device common for all mice
input: stmpe-ts as /devices/soc0/soc/2100000.aips-bus/21a4000.i2c/i2c-2/2-0041/stmpe-ts/input/input0
rtc-ds1307 1-0068: rtc core: registered m41t00 as rtc0
snvs_rtc 20cc000.snvs:snvs-rtc-lp: rtc core: registered 20cc000.snvs:snvs-r as rtc1
i2c /dev entries driver
imx2-wdt 20bc000.wdog: timeout 60 sec (nowayout=0)
sdhci: Secure Digital Host Controller Interface driver
sdhci: Copyright(c) Pierre Ossman
usbcore: registered new interface driver ushc
sdhci-pltfm: SDHCI platform and OF driver helper
/soc/aips-bus@02100000/usdhc@02194000: voltage-ranges unspecified
sdhci-esdhc-imx 2194000.usdhc: No vqmmc regulator found
mmc1: SDHCI controller on 2194000.usdhc [2194000.usdhc] using ADMA
ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
/soc/aips-bus@02100000/usdhc@02198000: voltage-ranges unspecified
ata1.00: ATA-8: InnoDisk Corp. - mSATA 3SE, S130710, max UDMA/133
ata1.00: 3928176 sectors, multi 16: LBA48 NCQ (depth 31/32)
sdhci-esdhc-imx 2198000.usdhc: No vqmmc regulator found
ata1.00: configured for UDMA/133
scsi 0:0:0:0: Direct-Access     ATA      InnoDisk Corp. - 710  PQ: 0 ANSI: 5
sd 0:0:0:0: [sda] 3928176 512-byte logical blocks: (2.01 GB/1.87 GiB)
mmc0: SDHCI controller on 2198000.usdhc [2198000.usdhc] using ADMA
mxc_vpu 2040000.vpu_fsl: VPU initialized
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sda: sda1 sda2 sda3 sda4
sd 0:0:0:0: [sda] Attached SCSI disk
mxc_vdoa 21e4000.vdoa: i.MX Video Data Order Adapter(VDOA) driver probed
Galcore version 5.0.11.41671
usb 2-1: new high-speed USB device number 2 using ci_hdrc
hub 2-1:1.0: USB hub found
hub 2-1:1.0: 4 ports detected
mmc0: MAN_BKOPS_EN bit is not set
mmc0: new DDR MMC card at address 0001
mmcblk0: mmc0:0001 Q2J54A 3.58 GiB
mmcblk0boot0: mmc0:0001 Q2J54A partition 1 16.0 MiB
mmcblk0boot1: mmc0:0001 Q2J54A partition 2 16.0 MiB
mmcblk0rpmb: mmc0:0001 Q2J54A partition 3 512 KiB
 mmcblk0: p1 p2 p3 p4 < p5 p6 p7 >
usb 2-1.3: new high-speed USB device number 3 using ci_hdrc
leds_pwm pwmleds: unable to request PWM for PWM2: -517
hidraw: raw HID events driver (C) Jiri Kosina
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
sgtl5000 2-000a: sgtl5000 revision 0x11
fsl-hdmi-dai soc:hdmi_audio@00120000: failed to probe. Load HDMI-video first.
fsl-hdmi-dai: probe of soc:hdmi_audio@00120000 failed with error -12
sgtl5000 2-000a: Using internal LDO instead of VDDD
imx-sgtl5000 sound: sgtl5000 <-> 2028000.ssi mapping ok
imx-audio-hdmi sound-hdmi: initialize HDMI-audio failed. load HDMI-video first!
NET: Registered protocol family 17
can: controller area network core (rev 20120528 abi 9)
NET: Registered protocol family 29
can: raw protocol (rev 20120528)
can: broadcast manager protocol (rev 20120528 t)
can: netlink gateway (rev 20130117) max_hops=1
Key type dns_resolver registered
leds_pwm pwmleds: unable to request PWM for PWM2: -517
rtc-ds1307 1-0068: hctosys: unable to read the hardware clock
ALSA device list:
  #0: imx6q-apalis-sgtl5000
EXT3-fs (mmcblk0p5): recovery required on readonly filesystem
EXT3-fs (mmcblk0p5): write access will be enabled during recovery
random: nonblocking pool is initialized
kjournald starting.  Commit interval 5 seconds
mmcblk0: error -110 sending stop command, original cmd response 0x900, card status 0x400e00

We acknowledge that the eMMC driver patch could potentially resolve the issue. Unfortunately, we haven’t been able to replicate the problem in our lab to test whether a patched kernel would effectively solve it.

Do you have any suggestions or hints on how we might replicate the issue? Any specific conditions or steps that could help simulate the problem would be greatly appreciated.

Thank you for your support in resolving this matter.

Hi @ian.escobar ,

Since this ticket is old, we will keep supporting you on your other question via personal e-mail.

Best regards,
Daniel Morais