distribution/registry/storage/driver/s3-aws
James Hewitt e22f7cbc73
Pass the last paging flag to storage drivers
Storage drivers may be able to take advantage of the hint to start
their walk more efficiently.

For S3: The API takes a start-after parameter. Registries with many
repositories can drastically reduce calls to s3 by telling s3 to only
list results lexographically after the last parameter.

For the fallback: We can start deeper in the tree and avoid statting
the files and directories before the hint in a walk. For a filesystem
this improves performance a little, but many of the API based drivers
are currently treated like a filesystem, so this drastically improves
the performance of GCP and Azure blob.

Signed-off-by: James Hewitt <james.hewitt@uk.ibm.com>
2023-08-29 11:27:42 +01:00
..
s3.go Pass the last paging flag to storage drivers 2023-08-29 11:27:42 +01:00
s3_test.go Pass the last paging flag to storage drivers 2023-08-29 11:27:42 +01:00
s3_v2_signer.go Fix gometalint errors 2019-02-04 16:01:04 -08:00