Also that "ban" also happens if you quit out too much from Rivals when self-relegating.

Usually sorts itself out after about 30-60 minutes. Sometimes quicker if you turn your PS4 off/disconnect then re-connect to the internet.