Apalis TK1 without Bootloader

Has anyone, from Toradex or from the community, managed to boot straight into the Linux kernel without going through u-boot? We’re looking at ways of significantly improving the boot time of our end product and one of the areas I’m considering is whether u-boot can be removed entirely.

Apalis TK1 U_boot source code is available, So you can build a minimalistic boot loader. However it will save you just a hundred milliseconds of boot time in a best case.