google-cloud-python: Connection reset by peer (httplib2 issue)

I’ve been attempting to batch upload just over a million entities (split into groups of 100-500 at a time) into datastore but I keep running into a socket.error: [Errno 104] Connection reset by peer error. I’ve also been experiencing this when attempting to query and pull down all entities of a single kind.

Is there some throttling that should be happening that’s not? Any suggestions on how to better utilize the gcloud lib?