63468ef4a8
This change to the S3 Move method uses S3's multipart upload API to copy objects whose size exceeds a threshold. Parts are copied concurrently. The level of concurrency, part size, and threshold are all configurable with reasonable defaults. Using the multipart upload API has two benefits. * The S3 Move method can now handle objects over 5 GB, fixing #886. * Moving most objects, and espectially large ones, is faster. For example, moving a 1 GB object averaged 30 seconds but now averages 10. Signed-off-by: Noah Treuhaft <noah.treuhaft@docker.com> |
||
---|---|---|
.. | ||
azure | ||
base | ||
factory | ||
filesystem | ||
gcs | ||
inmemory | ||
middleware | ||
oss | ||
s3-aws | ||
s3-goamz | ||
swift | ||
testdriver | ||
testsuites | ||
fileinfo.go | ||
storagedriver.go |