anikeev-yadro
abe73fcc96
Update pytest_tests/helpers/file_helper.py
...
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
2022-10-25 09:56:36 +03:00
anikeev-yadro
77ebf95434
Update pytest_tests/helpers/file_helper.py
...
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
2022-10-25 09:56:36 +03:00
0e86d55806
Add get arbitrary range from file
...
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-10-25 09:56:36 +03:00
3f41fbc14b
Correct paths, add load mark to pytest.ini
...
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-21 08:58:33 +04:00
93e5cb5f46
Add Load library, new params for common.py, new load tests, Adapt K6, remote_process for Hosting
...
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-19 23:59:42 +03:00
3de4d574d3
Fix code that constructs paths
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-18 16:32:53 +04:00
48e53b3d86
Switch failover test to hosting from testlib
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-14 20:35:26 +04:00
bfd02531ef
Integrate with hosting from testlib
...
Replace service_helper with hosting class from the testlib.
Instead of invoking commands on remote via ssh_helper, we now use
shell from the hosting.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-14 20:35:26 +04:00
cf748bf785
Fix 'datetime.datetime' is not iterable
...
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-14 13:01:42 +03:00
7ab737b595
Parsing k6 results + dataclass for K6 results
...
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-14 12:15:53 +03:00
5eeb8b4058
[ #350 ] Move file-related functions to file_helper
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-12 10:18:44 +04:00
0aeb998be9
[ #350 ] Cleanup utility keywords
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-11 18:14:58 +04:00
bb62299945
[ #312 ] Add new tagging tests for s3
...
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-10 08:58:53 +03:00
2ebe3192e2
Change SberCloud api call (get id by ip)
...
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-04 10:07:48 +03:00
f1d3aa6098
[ #334 ] Disable automatic retries in S3 clients
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-03 16:38:50 +04:00
987df42542
[ #312 ] add new ACL test to s3
...
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-03 09:42:57 +03:00
147cac0ebc
[ #314 ] Format all files with black and isort
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-09-30 13:45:25 +04:00
fed50cb96d
Set limit to 1000 in GET VM details query to sbercloud
...
By default sbercloud API returns only first 25 VMs per query
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-09-27 12:19:36 +03:00
588292dfb5
[ #314 ] Fix tools config
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-09-26 17:33:42 +04:00
2452cccba0
adding k6 + remote_process helper
...
Why script file:
We have script file for debug after test is finished
We don't need too long strings for passing environment variables
We can easy get PID
https://serverfault.com/questions/420905/nohup-multiple-sequential-commands
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-09-23 18:23:23 +03:00
ee2ed667c6
[ #312 ] add new test for s3
...
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-09-23 15:54:57 +03:00
926a7a5779
Add eACL tests using bearer token
...
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-09-07 12:11:49 +04:00
Elizaveta Chichindaeva
92cbc2e11b
[226] Tests: test for session token for object
...
A test for session token for object rewritten in pytest.
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
2022-09-05 14:36:01 +03:00
7e31610462
Change log collection fixture to put all logs into archive
...
When collecting logs we dump all of the logs into a directory, because it is RAM-intensive
to keep entire set of logs in memory, especially in a large cluster.
And we attach logs to Allure not as individual files, but as single zip archive, because it
is more convenient to download, attach to bugs, etc.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-30 13:36:28 +04:00
94d6ec6b12
Add fixture to collect logs after test execution
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-30 13:36:28 +04:00
590a5cfb0e
Exclude content-length header from request signature
...
Despite of SberCloud sample for python, content-length header is not accounted for
when calculating signature.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-22 18:52:04 +04:00
9454c5eb95
Implement access key authentication in SberCloud API
...
Replaced insecture login/password authentication in SberCloud API with authentication
via access key. This is more secture and is the recommended approach for authentication
from an application.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-22 18:52:04 +04:00
0ca45d1ba8
Rename variable for GC waiting
...
We need just an aggregate variable that allows to wait until GC pass occurs on
a storage node, rather than a variable for specific shard. Also, we need to account
for a time that GC session itself takes.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
b270f39387
Fix node transition to online state
...
Node hangs up if we attempt to transfer it to online state immediately after start.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
a76614b40d
Add asserts for error status codes in grpc responses
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
b6b1644fd6
Refactor privileges for ssh commands
...
Remove logic that checks for root login and prepends command with sudo, because
we should not use root login at all and all commands (that require higher permissions
should be prefixed with sudo anyways).
Add sudo prefix to privileged commands that require it.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
f9ba463d2e
Refactor container tests
...
Use wellknown ACL constants.
Remove 0x prefix from ACL, because neofs CLI changed formatting.
Remove redundant comments.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
6110de9268
Refactor devenv service helper
...
Use docker API to operate with remote devenv, this makes code cleaner and more uniform
between local devenv and remote devenv.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
b597937286
Fix container filtering by name in devenv
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
453dcb99fa
Fix container wait logic in devenv
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
c131bb04ba
Fix node cleanup step
...
The intention of the test was not to delete node entirely, but just to erase it's data.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
d6861f4f62
Refactor env properties
...
Encapculate reading/writing environment.properties in helper.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
a.y.volkov
9fea2efe83
Check binaries versions
...
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-08-15 18:49:05 +04:00
ce099c61a4
Move node deletion logic to service helper
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
91197335ba
Add tests that start or stop services on remote vm
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
e1d7999313
Cleanup sbercloud config
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:31:22 +03:00
a.y.volkov
642af0a888
Add test for network failover
...
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-08-05 13:29:31 +03:00
5f53e80f93
Fixes in tests to enable them to run in a cloud environment
...
Few small fixes were made:
- Fix path to binaries on storage node in cloud env.
- Add logic to prepend ssh command with sudo.
- Make re-encoding of homomorphic hash conditional.
- Increase ssh timeout.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
892b8f227a
Add helper function to wait for GC pass on storage nodes
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
2c232c222c
Fix node management tests
...
When we call storage node's control endpoint we need to override storage wallet path.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
7026b93c37
Fix SberCloud failovers
...
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-05 13:29:31 +03:00
93a52b4a66
Add failover tests for storage nodes
...
The tests are aimed to work on cloud infrastructure (SberCloud VMs)
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-05 13:29:31 +03:00
d9d74baa72
Add test suites for acl, container and node management
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
commit f7c68cfb423e3213179521954dccb6053fc6382d
Merge: e234b61 99bfe6b
Merge branch 'avolkov/add_ssh' into internal_tmp_b
commit 99bfe6b56cd75590f868313910068cf1a80bd43f
Tick one more epoch.
commit bd70bc49391d578cdda727edb4dcd181b832bf1e
Start nodes in case of test fail.
commit b3888ec62cfc3c18b1dff58962a94a3094342186
Catch json decode error.
commit c18e415b783ec3e4ce804f43c19246240c186a97
Add ssh-key access.
commit 7dbdeb653b7d5b7ab3874b546e05a48b502c2460
Add some tests.
commit 844367c68638c7f97ba4860dd0069c07f499d66d
Add some tests for nodes management.
commit 1b84b37048dcd3cc0888aa54639975fc11fb2d75
Add some tests for nodes management.
commit b30c1336a6919e0c8e500bdf2a9be3d5a14470ea
Add ssh execution option.
commit 2df40eca74ee20bd668778715185ffddda63cb05
Change AWS cli v1 to cli v2.
commit 7403da3d7c2a5963cfbb12b7c0f3d1d641f52a7e
Change AWS cli v1 to cli v2.
commit b110dcdb655a585e6c53e6ebc3eae7bf1f1e792f
Change AWS cli v1 to cli v2.
commit 6183756a4c064c932ee193c2e08a79343017fa49
Change AWS cli v1 to cli v2.
commit 398006544d60896faa3fc6e6a9dbb51ada06759c
Fix container run.
commit e7202136dabbe7e2d3da508e0a2ec55a0d5cb67a
Added tests with AWS CLI.
commit 042e1478ee1fd700c8572cbc6d0d9e6b312b8e8d
Fix PR comments.
commit e234b61dbb9b8b10812e069322ab03615af0d44e
Add debug for env.
commit 14febd06713dc03a8207bb80384acb4a7d32df0e
Move env variables for pytest docker into env file.
commit bafdc6131b5ac855a43b672be194cde2ccf6f75b
Move env variables for pytest docker into env file.
commit 27c2c6b11f51d2e3c085d44b814cb4c00f81b376
Move env variables for pytest docker into env file.
commit e4db4948978e092adb83aeacdf06619f5ca2f242
Merge branch 'master' into avolkov/try_pytest
commit c83a7e625e8daba3a40b65a1d69b2b1323e9ae28
WIP.
commit 42489bbf8058acd2926cdb04074dc9a8ff86a0a0
Merge branch 'avolkov/try_pytest' into internal_tmp_b
commit 62526d94dc2bf72372125bea119fa66f670cf7e1
Improve allure attachments.
commit 4564dae697cb069ac45bc4ba7eb0b5bbdcf1d153
Merge branch 'avolkov/try_pytest' into internal_tmp_b
commit ab65810b23410ca7382ed4bdd257addfa6619659
Added tests for S3 API.
commit 846c495a846c977f3e5f0bada01e5a9691a81e3d
Let's get NEOFS_IR_CONTRACTS_NEOFS from env.
commit c39bd88568b70ffcb76b76d68531b17d3747829d
Added S3 test for versioning.
commit d7c9f351abc7e02d4ebf162475604a2d6b46e712
Merge remote-tracking branch 'origin/avolkov/try_pytest' into internal_tmp_b
commit bfbed22a50ce4cb6a49de383cfef66452ba9f4c1
Added some tests for S3 API and curl tests for HTTP.
commit 1c49def3ddd0b3f7cf97f131e269ad465c70a680
Add yadro submodule
commit 2a91685f9108101ab523e05cc9287d0f5a20196b
Fix.
commit 33fc2813e205766e69ef74a42a10850db6c63ce6
Add debug.
commit aaaceca59e4c67253ecd4a741667b7327d1fb679
Add env variables for data nodes.
commit 001cb26bcc22c8543fb2672564e898928d20622b
Merge: b48a87d c70da26
Merge branch 'avolkov/try_pytest' into tmp_b
commit b48a87d9a09309fea671573ba6cf303c31b11b6a
Added submodule
commit c70da265d319950977774e34740276f324eb57a7
Added tests for S3 bucket API.
commit 3d335abe6de45d1859454f1ddf85a97514667b8f
Added tests for S3 object API.
commit 2ac829c700f5bc20c28953f1d40cd953fed8b390
flake8 changes for python_keywords module.
commit 2de5963e96b13a5e944906b695e5d9c0829de9ad
Add pytest tests.
commit 4472c079b9dfd979b7c101bea32893c80cb1fe57
Add pytest tests.
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-08-05 13:29:30 +03:00
84230d12e3
Replace prepare_container*** fixtures with a function.
...
The change is motivated by variety of standard ACLs that will be hard to manage with set of fixtures.
Remove logic that initializes wallet from remote devenv host.
This setup action should be handled outside tests.
Add ability to establish SSH connection using SSH key instead of password.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-07-14 10:02:28 +03:00
6e23e7d454
Simplify test checks and fixtures:
...
Remove default SSH key path.
Replace multiple fixtures for file generation with single function.
Rename references to keyword modules.
Update pytest test cases to be consistent with new keywords.
Remove gas balance checks from container operations.
Add logic to run initial gas transfer only if storage is not free.
Remove robot testsuites for s3 and http gateways.
S3 and http tests are covered and will be maintained in the future in pytest.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-07-08 17:45:32 +03:00
a.y.volkov
8acf738147
Remove dockerfile and removed docker run command from Makefile to keep testcases environment agnostic.
...
Add logic to retrieve mainnet wallet file from control node as WIF for this wallet is not available in config anymore.
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-07-08 17:45:32 +03:00
6b1e1ab28d
Add pytest tests.
...
Change AWS cli v1 to cli v2.
Improve allure attachments.
Add tests for S3 API.
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-07-08 17:45:32 +03:00