Replicate objects only if HEAD response means object missing #23

Open
opened 2023-01-20 18:54:00 +00:00 by carpawell · 2 comments
carpawell commented 2023-01-20 18:54:00 +00:00 (Migrated from github.com)

Revise replication logic. Currently, any error that is not NotFound leads to replication, even if the HEAD response:

  1. says AccessDenied;
  2. could not answer at all until timeout expiration;
  3. *any other reason that says nothing about object presence*.

That leads to network operations that could be useless. Also if a cluster is under critical load, continuous replication made that even worse.

Maybe that is an arch issue and we should allow SN's HEADs always.

Revise replication logic. Currently, any error that is not `NotFound` leads to replication, even if the `HEAD` response: 1. says `AccessDenied`; 2. could not answer at all until timeout expiration; 3. \*any other reason that says nothing about object presence\*. That leads to network operations that could be useless. Also if a cluster is under critical load, continuous replication made that even worse. Maybe that is an arch issue and we should allow SN's `HEAD`s _always_.
alexvanin commented 2023-01-27 12:18:08 +00:00 (Migrated from github.com)
Related to https://github.com/TrueCloudLab/frostfs-api/issues/5
fyrchik added this to the vNext milestone 2023-05-18 08:51:21 +00:00
fyrchik added the
frostfs-node
label 2024-05-16 12:22:41 +00:00
Owner

Suggest closing this with won't fix.
With APE there should be no Access Denied errors.
And the goal of policer is to handle any failure.

Suggest closing this with won't fix. With APE there should be no Access Denied errors. And the goal of policer is to handle _any_ failure.
Sign in to join this conversation.
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: TrueCloudLab/frostfs-node#23
No description provided.