TrueCloudLab/frostfs-node

Fork 27

Deleted SIMPLE object can be found in container (frostfs-cli object search --root) #799

New issue

Closed

opened 2023-11-10 07:31:00 +00:00 by anikeev-yadro · 0 comments

anikeev-yadro commented

2023-11-10 07:31:00 +00:00

Member

Expected Behavior

Deleted object can't be found in container using following 'neofs-cli object search --root' command

Current Behavior

Deleted object can found in container using following 'neofs-cli object search --root' command

Steps to Reproduce (for bugs)

Create container

COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml container create --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --await --policy 'REP 2 IN X CBF 1 SELECT 4 FROM * AS X'
RETCODE: 0

STDOUT:
container ID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV
awaiting...
container has been persisted on sidechain

STDERR:

Start / End / Elapsed	 00:26:06.989076 / 00:26:15.382751 / 0:00:08.393675

Put object

COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object put --rpc-endpoint '172.26.161.217:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --file 'TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626' --no-progress
RETCODE: 0

STDOUT:
[TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626] Object successfully stored
  OID: 5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T
  CID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV

STDERR:

Start / End / Elapsed	 00:26:15.747679 / 00:26:16.164126 / 0:00:00.416447

Delete object

COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object delete --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid '5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T'
RETCODE: 0

STDOUT:
Object removed successfully.
  ID: zBQmr5BoFm9qcJuqj4kJQ4dpnGtqqX1kRkFmypxvkSu
  CID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV

STDERR:

Start / End / Elapsed	 00:26:16.532755 / 00:26:16.985045 / 0:00:00.452290

Tick epoch

HOST: 172.26.160.245
COMMAND:
 sudo frostfs-adm --config /home/service/config.yaml morph force-new-epoch 
RC:
 0
STDOUT:
 Current epoch: 8, increase to 9.
 Waiting for transactions to persist...

STDERR:

Start / End / Elapsed	 00:26:18.125824 / 00:26:23.678905 / 0:00:05.553081

Try to search objects in container

COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --root
RETCODE: 0

STDOUT:
Found 1 objects.
5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T

STDERR:

Start / End / Elapsed	 00:26:34.053288 / 00:26:34.416378 / 0:00:00.363090

Context

This was autimatic test testsuites.object.test_object_api.TestObjectApi#test_object_search_should_return_tombstone_items

Regression

Yes

Version

0.37.0-rc.1-9-geac61fe9

Your Environment

4 nodes
Virtual

Related to https://github.com/nspcc-dev/neofs-node/issues/2236 ## Expected Behavior Deleted object can't be found in container using following 'neofs-cli object search --root' command ## Current Behavior Deleted object can found in container using following 'neofs-cli object search --root' command ## Steps to Reproduce (for bugs) 1. Create container ``` COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml container create --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --await --policy 'REP 2 IN X CBF 1 SELECT 4 FROM * AS X' RETCODE: 0 STDOUT: container ID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV awaiting... container has been persisted on sidechain STDERR: Start / End / Elapsed 00:26:06.989076 / 00:26:15.382751 / 0:00:08.393675 ``` 2. Put object ``` COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object put --rpc-endpoint '172.26.161.217:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --file 'TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626' --no-progress RETCODE: 0 STDOUT: [TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626] Object successfully stored OID: 5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T CID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV STDERR: Start / End / Elapsed 00:26:15.747679 / 00:26:16.164126 / 0:00:00.416447 ``` 3. Delete object ``` COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object delete --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid '5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T' RETCODE: 0 STDOUT: Object removed successfully. ID: zBQmr5BoFm9qcJuqj4kJQ4dpnGtqqX1kRkFmypxvkSu CID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV STDERR: Start / End / Elapsed 00:26:16.532755 / 00:26:16.985045 / 0:00:00.452290 ``` 4. Tick epoch ``` HOST: 172.26.160.245 COMMAND: sudo frostfs-adm --config /home/service/config.yaml morph force-new-epoch RC: 0 STDOUT: Current epoch: 8, increase to 9. Waiting for transactions to persist... STDERR: Start / End / Elapsed 00:26:18.125824 / 00:26:23.678905 / 0:00:05.553081 ``` 5. Try to search objects in container ``` COMMAND: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --root RETCODE: 0 STDOUT: Found 1 objects. 5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T STDERR: Start / End / Elapsed 00:26:34.053288 / 00:26:34.416378 / 0:00:00.363090 ``` ## Context This was autimatic test testsuites.object.test_object_api.TestObjectApi#test_object_search_should_return_tombstone_items ## Regression Yes ## Version ``` 0.37.0-rc.1-9-geac61fe9 ``` ## Your Environment 4 nodes Virtual

Test_log.txt

14 KiB

anikeev-yadro added the

bug

triage

labels 2023-11-10 07:31:00 +00:00

fyrchik removed the

triage

label 2023-11-10 07:45:42 +00:00

fyrchik added this to the v0.38.0 milestone 2023-11-10 07:45:44 +00:00

fyrchik added the

frostfs-node

label 2023-11-10 07:45:49 +00:00

acid-ant self-assigned this 2023-11-14 06:54:30 +00:00

~~acid-ant referenced this issue 2023-11-16 12:29:53 +00:00~~

engine, policer: Properly process error already removed #813

acid-ant referenced this issue from a pull request that will close it,

2023-11-16 12:30:19 +00:00

engine, policer: Properly process error already removed #813

fyrchik changed title from ~~Deleted SIMPLE object can be found in container (neofs-cli object search --root)~~ to Deleted SIMPLE object can be found in container (frostfs-cli object search --root)

2024-01-24 07:54:38 +00:00

fyrchik closed this issue

2024-02-01 17:49:26 +00:00

fyrchik referenced this issue from a commit

2024-02-01 17:49:27 +00:00

[#799] policer: Refactor method `processNodes`

fyrchik referenced this issue from a commit

2024-02-01 17:49:27 +00:00

[#799] engine: Skip put when object removed from shard

anikeev-yadro referenced this issue

2024-02-28 07:59:42 +00:00

Deleted COMPLEX object can be found in container (frostfs-cli object search --root) #1010