My advice on the WSL about the relationship between the number of cores and RAM also applies to your server.
When the build is running you should monitor your RAM usage (for example with htop). When it gets too high the build process gets in a deadlock situation.
To reduce the RAM usage you have to reduce the count of used cores on your server. How to do this please see this thread: https://community.nxp.com/t5/i-MX-Processors/How-can-I-reduce-the-number-of-parallel-yocto-builds/m-p/1068774/highlight/true#M157026
Best regards,
Markus