distribution/registry/storage/driver
Stefan Majewsky 1f03d4e77d [Swift] add simple heuristic to detect incomplete DLOs during read ops
This is similar to waitForSegmentsToShowUp which is called during
Close/Commit. Intuitively, you wouldn't expect missing segments to be a
problem during read operations, since the previous Close/Commit
confirmed that all segments are there.

But due to the distributed nature of Swift, the read request could be
hitting a different storage node of the Swift cluster, where the
segments are still missing.

Load tests on my team's staging Swift cluster have shown this to occur
about once every 100-200 layer uploads when the Swift proxies are under
high load. The retry logic, borrowed from waitForSegmentsToShowUp, fixes
this temporary inconsistency.

Signed-off-by: Stefan Majewsky <stefan.majewsky@sap.com>
2016-07-08 13:47:41 +02:00
..
azure Update missing blob error checking with latest Azure API 2016-03-14 15:59:03 -07:00
base Implement regulator in filesystem driver 2016-05-03 09:33:22 -07:00
factory Add documentation for how to register new StorageDrivers 2016-03-29 14:42:19 -07:00
filesystem Don't wrap thead limits when using a negative int 2016-05-03 16:03:44 -07:00
gcs StorageDriver: GCS: allow Cancel on a closed FileWriter 2016-05-06 13:04:30 +01:00
inmemory Adds new storagedriver.FileWriter interface 2016-03-08 16:37:44 -08:00
middleware fix typos 2016-06-02 23:03:27 +08:00
oss Support FileWriter interface for OSS storage driver 2016-03-08 16:38:39 -08:00
s3-aws fixed s3 Delete bug due to read-after-delete inconsistency 2016-06-28 14:22:15 -07:00
s3-goamz Adds new storagedriver.FileWriter interface 2016-03-08 16:37:44 -08:00
swift [Swift] add simple heuristic to detect incomplete DLOs during read ops 2016-07-08 13:47:41 +02:00
testdriver StorageDriver: Test case for #1698 2016-05-06 13:04:30 +01:00
testsuites StorageDriver: Testsuite: call Close before getting Size 2016-03-08 16:38:38 -08:00
fileinfo.go Move storagedriver package to registry/storage/driver 2015-02-11 12:43:04 -08:00
storagedriver.go Remove the example 2016-03-29 14:42:28 -07:00