tusd: S3-Store: Slow transfer-speed in some environments

Question For a customer running Netapp StorageGrid as the s3-solution, we see slow transfer-speeds, around 2.5 Mb/sec. Same speed both for chunked uploads, as well as non-chunked uploads.

This is within the local network, so we would expect a lot faster transfers. Other applications running in the same network and using the same s3-bucket achieve the expected speeds.

In other environments, we see great speed with tusd, so I am not really sure what the problem might be.

Do you have any tips for how we might go about debugging the slow transfer-speeds? Or any hunches about what might be the cause?

In #344 it was mentioned that there were some ideas as to how to increase the efficiency of the transfers, without going into any details.

If you are able to share some of the ideas, I might be able put in some time to implement them and contribute to this project.

Setup details

Please provide following details, if applicable to your situation:

• Operating System: Container-less destribution (linux), Kubernetes-environment.
• Used tusd version: 1.1.0
• Used tusd data storage: S3-compatible (specifically a NetApp StorageGrid
• Used tusd configuration: custom-build, but here is the relevant s3-config used:

s3 := s3store.S3Store{
		Bucket:            bucket,
		Service:           service,
		ObjectPrefix:      objectPrefix,
		MaxPartSize:       5 * 1024 * 1024 * 1024,
		MinPartSize:       5 * 1024 * 1024,
		MaxMultipartParts: 10000,
		MaxObjectSize:     5 * 1024 * 1024 * 1024 * 1024,
		BaseConfig:        base,
	}