distribution/registry/storage
Milos Gajdos ebc4234fd5
Delete S3 keys incrementally in batches
Instead of first collecting all keys and then batch deleting them,
we will do the incremental delete _online_ per max allowed batch.
Doing this prevents frequent allocations for large S3 keyspaces
and OOM-kills that might happen as a result of those.

This commit introduces storagedriver.Errors type that allows to return
multierrors as a single error from any storage driver implementation.

Signed-off-by: Milos Gajdos <milosthegajdos@gmail.com>
2022-10-30 19:10:24 +00:00
..
cache go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
driver Delete S3 keys incrementally in batches 2022-10-30 19:10:24 +00:00
blob_test.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
blobserver.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
blobstore.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
blobwriter.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
blobwriter_nonresumable.go bump up golang v1.17 2021-10-27 15:51:30 +08:00
blobwriter_resumable.go bump up golang v1.17 2021-10-27 15:51:30 +08:00
catalog.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
catalog_test.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
doc.go Move storage package under registry package 2015-02-11 12:43:04 -08:00
error.go Remove old walk function 2018-01-18 13:06:07 -08:00
filereader.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
filereader_test.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
garbagecollect.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
garbagecollect_test.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
io.go close the io.ReadCloser from storage drive 2021-03-24 17:58:35 +08:00
linkedblobstore.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
linkedblobstore_test.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
manifestlisthandler.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
manifeststore.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
manifeststore_test.go Incorrect variable in test output 2022-03-27 11:05:47 +01:00
ocimanifesthandler.go registry: verify digest and check blob presence when put manifest 2021-04-16 16:11:52 +08:00
ocimanifesthandler_test.go registry: verify digest and check blob presence when put manifest 2021-04-16 16:11:52 +08:00
paths.go fixes to make layersPathSpec work 2019-12-05 20:48:33 +01:00
paths_test.go Add unit tests for BlobEnumerator 2019-12-06 09:38:13 +01:00
purgeuploads.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
purgeuploads_test.go disable insecure cipher suites 2022-01-25 17:18:44 +08:00
registry.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
schema2manifesthandler.go registry: verify digest and check blob presence when put manifest 2021-04-16 16:11:52 +08:00
schema2manifesthandler_test.go registry: verify digest and check blob presence when put manifest 2021-04-16 16:11:52 +08:00
signedmanifesthandler.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
tagstore.go Add tag delete API 2021-05-27 23:27:02 +01:00
tagstore_test.go Add tag delete API 2021-05-27 23:27:02 +01:00
v1unsupportedhandler.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00
vacuum.go go.mod: change imports to github.com/distribution/distribution/v3 2021-02-08 18:30:46 +01:00