TrueCloudLab/frostfs-node

Fork 27

node: Policer detect thombstone as a redundant local copy #142

New issue

Closed

opened 2023-03-16 14:29:43 +00:00 by acid-ant · 3 comments

acid-ant commented

2023-03-16 14:29:43 +00:00

Member

Related to https://github.com/nspcc-dev/neofs-node/issues/2236
Steps to reproduce:

Put object

COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/wallet_config.yml object put --rpc-endpoint '172.26.160.201:8080' --wallet '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/38f95662-62d4-479d-9fbf-9338d7703296.json' --cid '9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3' --file '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/207db0c4-bc95-4478-abb6-938679babfae' --no-progress
RETCODE: 0

STDOUT:
[/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/207db0c4-bc95-4478-abb6-938679babfae] Object successfully stored
  OID: CRmu9M7vxykYDZWhzCn76jM1sP7uSobahdWC2Ev1aTDN
  CID: 9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3

Search object

COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.160.201:8080' --wallet '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/38f95662-62d4-479d-9fbf-9338d7703296.json' --cid '9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3' --root
RETCODE: 0

STDOUT:
Found 1 objects.
CRmu9M7vxykYDZWhzCn76jM1sP7uSobahdWC2Ev1aTDN

Delete Objects

COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/wallet_config.yml object delete --rpc-endpoint '172.26.160.201:8080' --wallet '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/38f95662-62d4-479d-9fbf-9338d7703296.json' --cid '9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3' --oid 'CRmu9M7vxykYDZWhzCn76jM1sP7uSobahdWC2Ev1aTDN'
RETCODE: 0

STDOUT:
Object removed successfully.
  ID: CMT89NZBbVv3piaTWHWSrvQcSJuJNUjGP6tX8iGDDvFF
  CID: 9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3

Found in logs that redundant local object copy detected:

Mar 15 14:53:04 az frostfs-node[7702]: 2023-03-15T14:53:04.840Z        info        policer/check.go:131        redundant local object copy detected        {"component": "Object Policer", "object": "9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3/CMT89NZBbVv3piaTWHWSrvQcSJuJNUjGP6tX8iGDDvFF"}

Related to https://github.com/nspcc-dev/neofs-node/issues/2236 Steps to reproduce: - Put object ``` COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/wallet_config.yml object put --rpc-endpoint '172.26.160.201:8080' --wallet '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/38f95662-62d4-479d-9fbf-9338d7703296.json' --cid '9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3' --file '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/207db0c4-bc95-4478-abb6-938679babfae' --no-progress RETCODE: 0 STDOUT: [/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/207db0c4-bc95-4478-abb6-938679babfae] Object successfully stored OID: CRmu9M7vxykYDZWhzCn76jM1sP7uSobahdWC2Ev1aTDN CID: 9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3 ``` - Search object ``` COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.160.201:8080' --wallet '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/38f95662-62d4-479d-9fbf-9338d7703296.json' --cid '9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3' --root RETCODE: 0 STDOUT: Found 1 objects. CRmu9M7vxykYDZWhzCn76jM1sP7uSobahdWC2Ev1aTDN ``` - Delete Objects ``` COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/wallet_config.yml object delete --rpc-endpoint '172.26.160.201:8080' --wallet '/jenkins/workspace/sbercloud_test/tmp.eAVWjx7LcT/frostfs-testcases/TemporaryDir/38f95662-62d4-479d-9fbf-9338d7703296.json' --cid '9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3' --oid 'CRmu9M7vxykYDZWhzCn76jM1sP7uSobahdWC2Ev1aTDN' RETCODE: 0 STDOUT: Object removed successfully. ID: CMT89NZBbVv3piaTWHWSrvQcSJuJNUjGP6tX8iGDDvFF CID: 9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3 ``` - Found in logs that redundant local object copy detected: ``` Mar 15 14:53:04 az frostfs-node[7702]: 2023-03-15T14:53:04.840Z info policer/check.go:131 redundant local object copy detected {"component": "Object Policer", "object": "9wurLMfVEecmK8FQG6aPdyU1fXTT3mTSkDU68thGVsr3/CMT89NZBbVv3piaTWHWSrvQcSJuJNUjGP6tX8iGDDvFF"} ```

acid-ant added the

triage

label 2023-03-16 14:29:43 +00:00

acid-ant commented

2023-03-16 14:31:46 +00:00

Author

Member

Logs

redundant.zip

1.3 MiB

acid-ant commented

2023-03-16 14:35:02 +00:00

Author

Member

Version:

service@az:~$ sudo apt info frostfs-storage
Package: frostfs-storage
Version: 0.0.1~221~gb4582239-bullseye
...

Version: ``` service@az:~$ sudo apt info frostfs-storage Package: frostfs-storage Version: 0.0.1~221~gb4582239-bullseye ... ```

fyrchik added this to the v0.38.0 milestone 2023-05-18 08:33:56 +00:00

fyrchik added

frostfs-node

and removed

triage

labels 2024-02-12 06:31:03 +00:00

fyrchik commented

2024-02-12 06:31:53 +00:00

Owner

Closed via #796

fyrchik closed this issue

2024-02-12 06:31:54 +00:00

No labels

No milestone

No project

No assignees

2 participants

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: TrueCloudLab/frostfs-node#142

No description provided.