anurindm
/
frostfs-testcases
forked from TrueCloudLab/frostfs-testcases
1
0
Fork 0
Code Pull Requests Activity
639 Commits
8 Branches
8 Tags
2.2 MiB
Commit Graph

639 Commits (fix-shard-control-test-v039)

Author SHA1 Message Date
Vladimir Domnich eff4b032a5 Refactor fixture that checks cloud environment 
Now it relies on presence of sbercloud configuration rather than on free storage setting.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:31:22 +03:00
Vladimir Domnich e1d7999313 Cleanup sbercloud config 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:31:22 +03:00
Vladimir Domnich 47c55f0060 Remove redundant variables 
Small refactoring that includes:
 - Removed variables that are not used any more.
 - Cleanup in helper functions' names.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:31:17 +03:00
a.y.volkov 642af0a888 Add test for network failover 
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 5f53e80f93 Fixes in tests to enable them to run in a cloud environment 
Few small fixes were made:
 - Fix path to binaries on storage node in cloud env.
 - Add logic to prepend ssh command with sudo.
 - Make re-encoding of homomorphic hash conditional.
 - Increase ssh timeout.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 892b8f227a Add helper function to wait for GC pass on storage nodes 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 05da181998 Add retries when checking presence of buckets in list 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 8a7d8f7c39 Disable automatic pagination in aws cli client 
This should prevent output truncation if response contains too many items.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich d8911f2490 Fix parsing of CLI output 
Formatting has been changed in CLI tools in version v0.30 and it required us to
change logic in tests:
 - Fix authmate output parsing.
 - Fix format of container name in assert.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich cccfc41409 [#268]: Rename neofs-cli parameter to expire-at 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 6357554ed9 Fix logic that collects versions of binaries 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 279bb3dedd Add delays after s3 operations 
Delays were added after:
 - S3 container create/delete.
 - S3 object create/delete.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 46b593b02e Fix endpoint parameter 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
a.y.volkov 3f12bd75f6 Add storage nodes health check before tests run 
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich d701e2cb62 Remove redundant environment variables 
Along with that few tweaks were made:
 - Increase wait time as it seems to take more time for complex object.
 - Increase timeout for create_bucket as it fails periodically.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich ae9c9947b6 Fix logic that checks presense of node in netmap 
We are now checking by node's public key as it is represented in netmap.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 18e87e3a13 Add delays to http gateway tests 
There were 2 delays added:
 - Waiting for GC pass is driven by system design.
 - Waiting after HTTP upload is just termporary workaround.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 08081a8629 Fix cleanup of versioned s3 bucket 
Add logic that deletes all objects versions from the bucket before attempting to
delete the bucket itself. This is required per AWS S3 specification.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 8afba7fca6 Fix assert that checks presence of node in netmap 
We should be looking for node host rather than for node name that we assigned in tests code.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 568b4421ce Fix object lifetime tests 
We should wait for GC pass on storage nodes, because object with expiration is garbage collected
only after epoch ticks.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 2c232c222c Fix node management tests 
When we call storage node's control endpoint we need to override storage wallet path.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Avdeev eb5532c08e Extend allure logging for failover tests 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich b6b95b86e8 Add markers for failover tests 
This allows us to skip failover tests during regular run of integration tests.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Avdeev 7026b93c37 Fix SberCloud failovers 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich ab85389d59 Use neofs-adm to tick epoch 
This is a more convenient way to tick epoch when we have multiple moprh blockchain nodes.
Approach that we use in devenv would require multi-signed transaction which is cumbersome.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Avdeev cbaecc60dc Fix usage of generate_file, prepare_wallet_and_deposit fixtures 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich f60020f5aa Fix usage of temp_dir fixture 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Avdeev 93a52b4a66 Add failover tests for storage nodes 
The tests are aimed to work on cloud infrastructure (SberCloud VMs)

Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich 014a1fee95 Enable configuration of wallets directories 
Add new variables to common.py that allow:
 - Make paths to wallets configurable.
 - Make devenv services path configurable.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:31 +03:00
Vladimir Domnich be39480ade Fix node management tests 
Remote connection was created to the 1st storage node only. While in reality
we want to create connection to a specific node.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:30 +03:00
Vladimir Domnich 68cbb7deea Update variables for node management tests 
New variables allow us:
1. To configure path of CLI binaries and config file on storage node.
2. Update variable names for storage node endpoints.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-05 13:29:30 +03:00
Vladimir Domnich d9d74baa72 Add test suites for acl, container and node management 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>

commit f7c68cfb423e3213179521954dccb6053fc6382d
Merge: e234b61 99bfe6b
    Merge branch 'avolkov/add_ssh' into internal_tmp_b

commit 99bfe6b56cd75590f868313910068cf1a80bd43f
    Tick one more epoch.

commit bd70bc49391d578cdda727edb4dcd181b832bf1e
    Start nodes in case of test fail.

commit b3888ec62cfc3c18b1dff58962a94a3094342186
    Catch json decode error.

commit c18e415b783ec3e4ce804f43c19246240c186a97
    Add ssh-key access.

commit 7dbdeb653b7d5b7ab3874b546e05a48b502c2460
    Add some tests.

commit 844367c68638c7f97ba4860dd0069c07f499d66d
    Add some tests for nodes management.

commit 1b84b37048dcd3cc0888aa54639975fc11fb2d75
    Add some tests for nodes management.

commit b30c1336a6919e0c8e500bdf2a9be3d5a14470ea
    Add ssh execution option.

commit 2df40eca74ee20bd668778715185ffddda63cb05
    Change AWS cli v1 to cli v2.

commit 7403da3d7c2a5963cfbb12b7c0f3d1d641f52a7e
    Change AWS cli v1 to cli v2.

commit b110dcdb655a585e6c53e6ebc3eae7bf1f1e792f
    Change AWS cli v1 to cli v2.

commit 6183756a4c064c932ee193c2e08a79343017fa49
    Change AWS cli v1 to cli v2.

commit 398006544d60896faa3fc6e6a9dbb51ada06759c
    Fix container run.

commit e7202136dabbe7e2d3da508e0a2ec55a0d5cb67a
    Added tests with AWS CLI.

commit 042e1478ee1fd700c8572cbc6d0d9e6b312b8e8d
    Fix PR comments.

commit e234b61dbb9b8b10812e069322ab03615af0d44e
    Add debug for env.

commit 14febd06713dc03a8207bb80384acb4a7d32df0e
    Move env variables for pytest docker into env file.

commit bafdc6131b5ac855a43b672be194cde2ccf6f75b
    Move env variables for pytest docker into env file.

commit 27c2c6b11f51d2e3c085d44b814cb4c00f81b376
    Move env variables for pytest docker into env file.

commit e4db4948978e092adb83aeacdf06619f5ca2f242
    Merge branch 'master' into avolkov/try_pytest

commit c83a7e625e8daba3a40b65a1d69b2b1323e9ae28
    WIP.

commit 42489bbf8058acd2926cdb04074dc9a8ff86a0a0
    Merge branch 'avolkov/try_pytest' into internal_tmp_b

commit 62526d94dc2bf72372125bea119fa66f670cf7e1
    Improve allure attachments.

commit 4564dae697cb069ac45bc4ba7eb0b5bbdcf1d153
    Merge branch 'avolkov/try_pytest' into internal_tmp_b

commit ab65810b23410ca7382ed4bdd257addfa6619659
    Added tests for S3 API.

commit 846c495a846c977f3e5f0bada01e5a9691a81e3d
    Let's get NEOFS_IR_CONTRACTS_NEOFS from env.

commit c39bd88568b70ffcb76b76d68531b17d3747829d
    Added S3 test for versioning.

commit d7c9f351abc7e02d4ebf162475604a2d6b46e712
    Merge remote-tracking branch 'origin/avolkov/try_pytest' into internal_tmp_b

commit bfbed22a50ce4cb6a49de383cfef66452ba9f4c1
    Added some tests for S3 API and curl tests for HTTP.

commit 1c49def3ddd0b3f7cf97f131e269ad465c70a680
    Add yadro submodule

commit 2a91685f9108101ab523e05cc9287d0f5a20196b
    Fix.

commit 33fc2813e205766e69ef74a42a10850db6c63ce6
    Add debug.

commit aaaceca59e4c67253ecd4a741667b7327d1fb679
    Add env variables for data nodes.

commit 001cb26bcc22c8543fb2672564e898928d20622b
Merge: b48a87d c70da26
    Merge branch 'avolkov/try_pytest' into tmp_b

commit b48a87d9a09309fea671573ba6cf303c31b11b6a
    Added submodule

commit c70da265d319950977774e34740276f324eb57a7
    Added tests for S3 bucket API.

commit 3d335abe6de45d1859454f1ddf85a97514667b8f
    Added tests for S3 object API.

commit 2ac829c700f5bc20c28953f1d40cd953fed8b390
    flake8 changes for python_keywords module.

commit 2de5963e96b13a5e944906b695e5d9c0829de9ad
    Add pytest tests.

commit 4472c079b9dfd979b7c101bea32893c80cb1fe57
    Add pytest tests.

Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
 2022-08-05 13:29:30 +03:00
anastasia prasolova dd98eb3d9d [#271] fixed key for eacl filter test 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-08-04 15:01:16 +03:00
anastasia prasolova bebbc42187 [#271] removed `setup_teardown.robot` imports from testcases 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-08-04 15:01:16 +03:00
anastasia prasolova a0df145134 [#271] removed Setup and Teardown from CLI, Container, Network, Payment suites 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-08-04 15:01:16 +03:00
anastasia prasolova 9aa16ffc5b [#271] removed Setup and Teardown from Object suite 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-08-04 15:01:16 +03:00
anastasia prasolova e7409a65a5 [#271] removed Setup and Teardown from ACL suite 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-08-04 15:01:16 +03:00
Elizaveta Chichindaeva 1ce470d3b1 Remove unnecessary args in Get Range 
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-08-03 15:29:00 +03:00
Elizaveta Chichindaeva da9b723498 [#246] Get pubkey 
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-07-25 18:06:56 +03:00
anastasia prasolova a5764da57b added pytest instructions into readme 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-07-22 13:33:25 +03:00
Elizaveta Chichindaeva 6394d9e362 [#191] EACL_KEY -> WALLET_ALLOW 
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-07-19 15:34:26 +03:00
anastasia prasolova dddffdc95a updated `requirements.txt` for venv.localtest 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-07-15 17:04:42 +03:00
Elizaveta Chichindaeva 708a4f51c5 [#245] Fix access tests for IR 
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-07-14 14:44:44 +03:00
Vladimir Domnich 84230d12e3 Replace prepare_container*** fixtures with a function. 
The change is motivated by variety of standard ACLs that will be hard to manage with set of fixtures.

Remove logic that initializes wallet from remote devenv host.
This setup action should be handled outside tests.

Add ability to establish SSH connection using SSH key instead of password.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-07-14 10:02:28 +03:00
anastasia prasolova ffa40112a1 fixed miscellaneous errors 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-07-11 14:14:47 +03:00
Vladimir Domnich 2f774f5995 Fix library name after module renaming. 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-07-11 14:04:16 +03:00
Vladimir Domnich 6e23e7d454 Simplify test checks and fixtures: 
Remove default SSH key path.
Replace multiple fixtures for file generation with single function.
Rename references to keyword modules.
Update pytest test cases to be consistent with new keywords.
Remove gas balance checks from container operations.
Add logic to run initial gas transfer only if storage is not free.
Remove robot testsuites for s3 and http gateways.
S3 and http tests are covered and will be maintained in the future in pytest.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-07-08 17:45:32 +03:00
a.y.volkov 8acf738147 Remove dockerfile and removed docker run command from Makefile to keep testcases environment agnostic. 
Add logic to retrieve mainnet wallet file from control node as WIF for this wallet is not available in config anymore.

Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
 2022-07-08 17:45:32 +03:00
Vladimir Domnich 6b1e1ab28d Add pytest tests. 
Change AWS cli v1 to cli v2.
Improve allure attachments.
Add tests for S3 API.

Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
 2022-07-08 17:45:32 +03:00
anastasia prasolova 7abb2761c9 [#184] finally got rid of neofs.py 
Signed-off-by: anastasia prasolova <anastasia@nspcc.ru>
 2022-07-06 15:30:27 +03:00