00:26:05 [INFO] Execute command "sudo echo 'password: "Ebb7f2mQ"' > /tmp/s01-config.yaml" on "172.26.160.245" 00:26:05 [INFO] Execute command "sudo echo 'password: "0uq2mMB3"' > /tmp/s02-config.yaml" on "172.26.160.137" 00:26:05 [INFO] Execute command "sudo echo 'password: "xEOP86Nq"' > /tmp/s03-config.yaml" on "172.26.160.147" 00:26:05 [INFO] Execute command "sudo echo 'password: "c4wr8tjf"' > /tmp/s04-config.yaml" on "172.26.160.7" 00:26:06 [INFO] HOST: 172.26.160.147 COMMAND: sudo echo 'password: "xEOP86Nq"' > /tmp/s03-config.yaml RC: 0 STDOUT: STDERR: Start / End / Elapsed 00:26:05.737053 / 00:26:06.001725 / 0:00:00.264672 00:26:06 [INFO] Execute command "sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s03-config.yaml" on "172.26.160.147" 00:26:06 [INFO] HOST: 172.26.160.245 COMMAND: sudo echo 'password: "Ebb7f2mQ"' > /tmp/s01-config.yaml RC: 0 STDOUT: STDERR: Start / End / Elapsed 00:26:05.736164 / 00:26:06.022305 / 0:00:00.286141 00:26:06 [INFO] HOST: 172.26.160.137 COMMAND: sudo echo 'password: "0uq2mMB3"' > /tmp/s02-config.yaml RC: 0 STDOUT: STDERR: Start / End / Elapsed 00:26:05.736608 / 00:26:06.022611 / 0:00:00.286003 00:26:06 [INFO] HOST: 172.26.160.7 COMMAND: sudo echo 'password: "c4wr8tjf"' > /tmp/s04-config.yaml RC: 0 STDOUT: STDERR: Start / End / Elapsed 00:26:05.737667 / 00:26:06.048444 / 0:00:00.310777 00:26:06 [INFO] Execute command "sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s02-config.yaml" on "172.26.160.137" 00:26:06 [INFO] Execute command "sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s01-config.yaml" on "172.26.160.245" 00:26:06 [INFO] Execute command "sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s04-config.yaml" on "172.26.160.7" 00:26:06 [INFO] HOST: 172.26.160.7 COMMAND: sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s04-config.yaml RC: 0 STDOUT: Network status: ONLINE Health status: READY STDERR: Start / End / Elapsed 00:26:06.117684 / 00:26:06.970917 / 0:00:00.853233 00:26:06 [INFO] HOST: 172.26.160.245 COMMAND: sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s01-config.yaml RC: 0 STDOUT: Network status: ONLINE Health status: READY STDERR: Start / End / Elapsed 00:26:06.070337 / 00:26:06.971185 / 0:00:00.900848 00:26:06 [INFO] HOST: 172.26.160.137 COMMAND: sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s02-config.yaml RC: 0 STDOUT: Network status: ONLINE Health status: READY STDERR: Start / End / Elapsed 00:26:06.054371 / 00:26:06.986597 / 0:00:00.932226 00:26:06 [INFO] HOST: 172.26.160.147 COMMAND: sudo /usr/bin/frostfs-cli control healthcheck --endpoint localhost:8091 --wallet /etc/frostfs/storage/wallet.json --config /tmp/s03-config.yaml RC: 0 STDOUT: Network status: ONLINE Health status: READY STDERR: Start / End / Elapsed 00:26:06.002494 / 00:26:06.986756 / 0:00:00.984262 00:26:06 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml container create --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --await --policy 'REP 2 IN X CBF 1 SELECT 4 FROM * AS X' 00:26:15 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml container create --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --await --policy 'REP 2 IN X CBF 1 SELECT 4 FROM * AS X' Success: return code: 0 Output: container ID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV awaiting... container has been persisted on sidechain 00:26:15 [INFO] Container created; waiting until it is persisted in the sidechain 00:26:15 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml container list --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' 00:26:15 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml container list --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' Success: return code: 0 Output: eN61XpqbvkAWFvKtLLhV4MPf2PFPa1uR3kLUNWJSLof 2TjEQu2FqPsFnSY6UzDhi9ihvwcQsfBUJKGmW8WNEASK 2gZ7FBxJZHmj6CFWUrR86nF1Wq3gcmS6oUnGNQGSEbSN 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV 8KPxqDsvd8EQmz8HR6N624zkrwCSh9qSUtBuc7WuhTME 9hCRwAfSbBnZxL65SCRknX2qKjj7uYvff7bFicM6hEAN ADyJz7cDr1GbBk8DvhCo1jYqRmyFBQSoCk4Q11La4cFa AjFnHgEDJ73MzbXBALu3PBgVK34eBpzMrxQi1B3Hkkwz AyzPDZGWCWuLPrzETjhcxBB1mt4MpCw4mUFjzxecUwhN BM3kjoJECSdL8MceeSYaMdqervUdzpVcAXKGyZT8pkrx CQ7CJSVpUAJicfTzn8jzggcUXcYqKyxKQKqXjZyqPgRC CfPXEHkSM8DFsQDRVRWMGcgmrksBwNvHq5CLc62N7qvL DaCoMjuuyp39HtqUPfuXExTbqakDzYwaoE3C2GGNDcSd 00:26:15 [INFO] Containers: CommandResult(stdout='eN61XpqbvkAWFvKtLLhV4MPf2PFPa1uR3kLUNWJSLof\n2TjEQu2FqPsFnSY6UzDhi9ihvwcQsfBUJKGmW8WNEASK\n2gZ7FBxJZHmj6CFWUrR86nF1Wq3gcmS6oUnGNQGSEbSN\n4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV\n8KPxqDsvd8EQmz8HR6N624zkrwCSh9qSUtBuc7WuhTME\n9hCRwAfSbBnZxL65SCRknX2qKjj7uYvff7bFicM6hEAN\nADyJz7cDr1GbBk8DvhCo1jYqRmyFBQSoCk4Q11La4cFa\nAjFnHgEDJ73MzbXBALu3PBgVK34eBpzMrxQi1B3Hkkwz\nAyzPDZGWCWuLPrzETjhcxBB1mt4MpCw4mUFjzxecUwhN\nBM3kjoJECSdL8MceeSYaMdqervUdzpVcAXKGyZT8pkrx\nCQ7CJSVpUAJicfTzn8jzggcUXcYqKyxKQKqXjZyqPgRC\nCfPXEHkSM8DFsQDRVRWMGcgmrksBwNvHq5CLc62N7qvL\nDaCoMjuuyp39HtqUPfuXExTbqakDzYwaoE3C2GGNDcSd\n', stderr='', return_code=0) 00:26:15 [INFO] File with size 1000 bytes has been generated: TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626 00:26:15 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object put --rpc-endpoint '172.26.161.217:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --file 'TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626' --no-progress 00:26:16 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object put --rpc-endpoint '172.26.161.217:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --file 'TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626' --no-progress Success: return code: 0 Output: [TemporaryDir/c00d846d-6d13-4c1a-8f27-34274106e626] Object successfully stored OID: 5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T CID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV 00:26:16 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --root 00:26:16 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --root Success: return code: 0 Output: Found 1 objects. 5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T 00:26:16 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object delete --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid '5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T' 00:26:16 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object delete --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid '5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T' Success: return code: 0 Output: Object removed successfully. ID: zBQmr5BoFm9qcJuqj4kJQ4dpnGtqqX1kRkFmypxvkSu CID: 4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV 00:26:16 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object head --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid 'zBQmr5BoFm9qcJuqj4kJQ4dpnGtqqX1kRkFmypxvkSu' --json 00:26:17 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object head --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid 'zBQmr5BoFm9qcJuqj4kJQ4dpnGtqqX1kRkFmypxvkSu' --json Success: return code: 0 Output: {"objectID":{"value":"DqXgaXkvloJ1xKETKKVOYSnrwkSk3HmtYa7bFTXT3AI="}, "signature":{"key":"AoZmQL8jeFSTR1O3abwrikaVOQm7BkAw83jzZctHfYxN", "signature":"BCRzM4I3vxMyTkBnJnk88HvcDhgHzlwYzi+heCHMOVhB+NU4pvHAvLFIjbWSa+eZZmGO/QHRJRrBGgsF7irc1kM=", "scheme":"ECDSA_SHA512"}, "header":{"version":{"major":2, "minor":13}, "containerID":{"value":"Miw+eL7JCQxWbOSDTozoS7kwj5B+2GA6Bde3OS83azQ="}, "ownerID":{"value":"NQHztCsFhVCkyBtxaVcIQaH0Ps/ghXcxdQ=="}, "creationEpoch":"8", "payloadLength":"39", "payloadHash":{"type":"SHA256", "sum":"01v7tjdLhL8UPAv5ptvmAzCWvnmucimfZYjhp1jN9/Q="}, "objectType":"TOMBSTONE", "homomorphicHash":null, "sessionToken":{"body":{"id":"jJHVHNLNR0CnCdLoH2MVvA==", "ownerID":{"value":"NQHztCsFhVCkyBtxaVcIQaH0Ps/ghXcxdQ=="}, "lifetime":{"exp":"18", "nbf":"8", "iat":"8"}, "sessionKey":"AoZmQL8jeFSTR1O3abwrikaVOQm7BkAw83jzZctHfYxN", "object":{"verb":"DELETE", "target":{"container":{"value":"Miw+eL7JCQxWbOSDTozoS7kwj5B+2GA6Bde3OS83azQ="}, "objects":[{"value":"PcPdmPvPG7KVEx383yxHWt/qur1rw1p2Nj+D/hCHWyg="}]}}}, "signature":{"key":"AnFbWNrqYpQgltHafcZ22iN1F7iaVCTkDXd5JiGT7uDP", "signature":"BApBqdZRyFm8/0cuqV8WLVh1W39++hwX6Orru1HzsIs+9bQVBuMk3WxYr0agwc2q9j7nzUbKElhw3K1oDsiTVyk=", "scheme":"ECDSA_SHA512"}}, "attributes":[{"key":"__SYSTEM__EXPIRATION_EPOCH", "value":"1016"}], "split":null}, "payload":""} 00:26:17 [INFO] decoding tombstone 00:26:17 [INFO] Header Session OIDs is ['5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T'] 00:26:17 [INFO] OID is 5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T 00:26:18 [INFO] Execute command "sudo frostfs-adm --config /home/service/config.yaml morph force-new-epoch " on "172.26.160.245" 00:26:23 [INFO] HOST: 172.26.160.245 COMMAND: sudo frostfs-adm --config /home/service/config.yaml morph force-new-epoch RC: 0 STDOUT: Current epoch: 8, increase to 9. Waiting for transactions to persist... STDERR: Start / End / Elapsed 00:26:18.125824 / 00:26:23.678905 / 0:00:05.553081 00:26:33 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object get --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid '5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T' --file 'TemporaryDir/f94574b1-6fc9-4faa-919d-292bf78c49e0' --no-progress 00:26:34 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object get --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --oid '5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T' --file 'TemporaryDir/f94574b1-6fc9-4faa-919d-292bf78c49e0' --no-progress Error: return code: 1 Output: rpc error: read object header: status: code = 2052 message = object already removed 00:26:34 [INFO] Executing command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --root 00:26:34 [INFO] Command: frostfs-cli --config /jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/wallet_config.yml object search --rpc-endpoint '172.26.161.140:8080' --wallet '/jenkins/workspace/sbercloud_functional_tests_nightly/tmp.OA08xwvHZG/frostfs-testcases/TemporaryDir/dc7846d0-253c-4a67-9689-c0c6324e74a0.json' --cid '4NrWqtT4dS8Q36trL8TQ88QWiZShFo2TavHuK5ZVZvTV' --root Success: return code: 0 Output: Found 1 objects. 5A76TaN4ae1eRn6b2Ev85DPg38foy7jSXFYQ1RLnok6T