If you are using a USB connection, that would explain everything going on.
Basically, switch to Ethernet and things will immediately improve.
Some previous discussions on the USB world of hurt: