I fixed the issue. I deleted the RDP and ICA connections in Terminal Services Configuration and recreated them. I also fixed the hardcoded ports on the switch to both be Auto and Full Duplex. Works like a charm. I guess that I get the 500 points since I fixed it myself ;-)