distribution/registry/storage/driver
Noah Treuhaft 63468ef4a8 Use multipart upload API in S3 Move method
This change to the S3 Move method uses S3's multipart upload API to copy
objects whose size exceeds a threshold.  Parts are copied concurrently.
The level of concurrency, part size, and threshold are all configurable
with reasonable defaults.

Using the multipart upload API has two benefits.

* The S3 Move method can now handle objects over 5 GB, fixing #886.

* Moving most objects, and espectially large ones, is faster.  For
  example, moving a 1 GB object averaged 30 seconds but now averages 10.

Signed-off-by: Noah Treuhaft <noah.treuhaft@docker.com>
2016-08-16 10:53:24 -07:00
..
azure Update missing blob error checking with latest Azure API 2016-03-14 15:59:03 -07:00
base Implement regulator in filesystem driver 2016-05-03 09:33:22 -07:00
factory Add documentation for how to register new StorageDrivers 2016-03-29 14:42:19 -07:00
filesystem Don't wrap thead limits when using a negative int 2016-05-03 16:03:44 -07:00
gcs StorageDriver: GCS: allow Cancel on a closed FileWriter 2016-05-06 13:04:30 +01:00
inmemory Adds new storagedriver.FileWriter interface 2016-03-08 16:37:44 -08:00
middleware fix typos 2016-06-02 23:03:27 +08:00
oss Support FileWriter interface for OSS storage driver 2016-03-08 16:38:39 -08:00
s3-aws Use multipart upload API in S3 Move method 2016-08-16 10:53:24 -07:00
s3-goamz Adds new storagedriver.FileWriter interface 2016-03-08 16:37:44 -08:00
swift [swift] support different user-domain and tenant-domain 2016-08-15 11:21:42 +02:00
testdriver StorageDriver: Test case for #1698 2016-05-06 13:04:30 +01:00
testsuites testutil, storage: use math/rand.Read where possible 2016-08-10 14:26:12 -07:00
fileinfo.go Move storagedriver package to registry/storage/driver 2015-02-11 12:43:04 -08:00
storagedriver.go Remove the example 2016-03-29 14:42:28 -07:00