Yes, drive strength change fixed it for me too in both 4.1.35 (bsp v2.7) and 3.14.52 (bsp v2.6) kernel versions (previous patches removed). On 3.14 kernel recording is also working fine. We have started stress tests on our boards, after around 4 hours even across reboots no swapping detected. Looks like this issue is solved. I will post back if any contradictory result is found.
Thanks for the patches.