Taking YOCTO from the scratch I was able to build the complete YOCTO Project (from the Source Code), which I downloaded from here: http://developer.toradex.com/knowledge-base/board-support-package/openembedded-(core)#Installation
There were around 5 to 10 bugs/errors breaking YOCTO build (host machine INTEL i5 HP notebook, on bare metal Fedora 26 x86_64 installed) , but I was able to prevail all of these myself, and to install all of this mess to the SD Card (USB stick for some reason did not work from the U-Boot). The pointers I use are here: http://developer.toradex.com/knowledge-base/flashing-linux-on-imx6-modules#Preparation
I was able to make http://docs.toradex.com/102284-colibri-evaluation-board-datasheet.pdf all this to work with LXDE DT using X11/Xorg Xwindows, and Xorg Server. Home alone.
I have problems with half DVI (digital display I/F), but at this point of time it is not too important (I have analog VGA working with 19" monitor). I think I need more to tighten flat cable going from comm express to the development board!
Now… I need Pyro 2.3 (and much higher kernel that 4.1.x → maybe 4.10.y). Do you have any experimental YOCTO repo I can download and start experimenting for TORADEX Colibri iMX6 with development board V3.2B?