I have not continued much with testing here, but I could confirm that manually copying the ostree repo to the imx95 and deploying from there works without any issues.
I’m building from scratch, because I need to apply a kernel patch to add jumbo frames support. See iMX95 MTU limit - #3 by Florens. I was only using TorizonCore Builder as a convenience to deploy a bit quicker.