Downloaded OCCT stress tester, so essentially force it to cough up whats wrong and 5 mins of full speed on CPU/GPU showed no errors. On the other hand, testing the memory immediately flagged up errors.

I have disabled the XMP for now and it shows no errors now. I hope that is the reason and not just a symptom.