distribution/docs/content/about
Liang Zheng a2afe23f38 add concurrency limits for tag lookup and untag
Harbor is using the distribution for it's (harbor-registry) registry component.
The harbor GC will call into the registry to delete the manifest, which in turn
then does a lookup for all tags that reference the deleted manifest.
To find the tag references, the registry will iterate every tag in the repository
and read it's link file to check if it matches the deleted manifest (i.e. to see
if uses the same sha256 digest). So, the more tags in repository, the worse the
performance will be (as there will be more s3 API calls occurring for the tag
directory lookups and tag file reads).

Therefore, we can use concurrent lookup and untag to optimize performance as described in https://github.com/goharbor/harbor/issues/12948.

P.S. This optimization was originally contributed by @Antiarchitect, now I would like to take it over.
Thanks @Antiarchitect's efforts with PR https://github.com/distribution/distribution/pull/3890.

Signed-off-by: Liang Zheng <zhengliang0901@gmail.com>
2024-04-26 22:32:21 +08:00
..
_index.md And other content... 2023-10-12 12:00:15 +01:00
architecture.md docs: fix markup and broken links 2023-10-12 09:32:37 +02:00
compatibility.md docs: fix markup and broken links 2023-10-12 09:32:37 +02:00
configuration.md add concurrency limits for tag lookup and untag 2024-04-26 22:32:21 +08:00
deploying.md docs: fix broken links and improve link resolution 2024-01-14 21:33:55 +01:00
garbage-collection.md docs: fix broken links and improve link resolution 2024-01-14 21:33:55 +01:00
glossary.md And other content... 2023-10-12 12:00:15 +01:00
help.md docs: fix markup and broken links 2023-10-12 09:32:37 +02:00
insecure.md docs: fix broken links and improve link resolution 2024-01-14 21:33:55 +01:00
notifications.md Update notifications.md 2024-02-28 13:32:59 -05:00