ChEktn/frostfs-testcases
1
0
Fork 0
forked from TrueCloudLab/frostfs-testcases
Code Pull requests Activity
432 commits 21 branches 8 tags 4 MiB
Commit graph

198 commits

Author SHA1 Message Date
Andrey Berezin
3e5a204d19 Refactor balance tests 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2022-11-16 19:14:58 +03:00
Vladimir Avdeev
2159982dbd Find critical pattern in system logs 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-11-15 11:44:43 +03:00
Yulia Kovshova
2b08a932ac [#312] Add new policy test 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-11-15 10:31:12 +03:00
Yulia Kovshova
a0da15e60b add new check for tags 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-11-14 15:41:42 +03:00
Andrey Berezin
21f1c3a922 Add static session tests for object 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2022-11-10 18:48:56 +03:00
Vladimir Avdeev
f9fa249cf2 Add new testmarks 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-11-10 10:11:02 +03:00
Vladimir Avdeev
bf2f638618 Bump neofs-testlib version 0.3.0 -> 0.4.0 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-11-07 10:45:53 +03:00
Vladimir Avdeev
14a4d014d1 Move requirements.txt to root repository folder 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-11-03 23:12:25 +03:00
Andrey Berezin
48b9cfbed5 Make node management tests to be last 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2022-11-03 16:24:15 +03:00
Vladimir Avdeev
5faef4df8b Add missed shell parameter in verify_list_storage_group() 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-11-03 12:08:35 +03:00
a.lipay
b8ab64e2c6 Add http benchmark tests 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-11-01 20:15:38 +03:00
Andrey Berezin
f80a9b7cbe Refactor Api tests and extend get_ranges_tests 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2022-11-01 19:12:56 +03:00
Vladimir Avdeev
bf71f3250d Switch storagegroup and session_token tests to testlib library 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-11-01 16:07:14 +03:00
Yulia Kovshova
c9e42a7a0a [#312] Add new Locking test 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-11-01 11:43:46 +03:00
Yulia Kovshova
2e8e105756 exclude multiupload from dev-env 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-28 17:32:15 +03:00
Vladimir Avdeev
9e2f8dfb00 Add missed shell parameter in wait_for_expected_object_copies() 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-28 12:28:07 +04:00
Vladimir Avdeev
ecd5cd1252 Add missed shell parameter in tick_epoch() 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-28 11:08:57 +03:00
Vladimir Avdeev
70a0f9f216 Remove neofs-keywords submodule 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-27 11:56:01 +03:00
a.lipay
bc1f873975 Fix k6 search 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-10-26 22:22:37 +03:00
anikeev-yadro
b3cf2ee0e3 Fix session token tests 
Delete some commands which not supported dynamic sessions

Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2022-10-26 17:11:01 +03:00
anikeev-yadro
f47a9d09ec Fix for object range content tests 
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2022-10-25 18:00:02 +03:00
Yulia Kovshova
f70dc9d648 Add tag 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-25 15:25:13 +03:00
a.lipay
a85f04a73b Add grpc benchmark tests 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-10-25 14:41:17 +03:00
anikeev-yadro
ec1dd45e0b Update pytest_tests/helpers/file_helper.py 
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
 2022-10-25 09:56:36 +03:00
anikeev-yadro
abe73fcc96 Update pytest_tests/helpers/file_helper.py 
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
 2022-10-25 09:56:36 +03:00
anikeev-yadro
77ebf95434 Update pytest_tests/helpers/file_helper.py 
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
 2022-10-25 09:56:36 +03:00
anikeev-yadro
0e86d55806 Add get arbitrary range from file 
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2022-10-25 09:56:36 +03:00
anikeev-yadro
8a48402f53 Fix failover tests 
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2022-10-24 14:58:05 +03:00
Yulia Kovshova
5cab1ecf19 Fix put object with --grant-full-control id=mycanonicaluserid 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-21 16:22:18 +03:00
a.lipay
3f41fbc14b Correct paths, add load mark to pytest.ini 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-10-21 08:58:33 +04:00
Vladimir Avdeev
b662418e42 Add shell parameter in eacl_full_placement_container_with_object() fixture 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-20 22:19:24 +03:00
a.lipay
c716c94b9a Add load mark 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-10-20 20:07:18 +03:00
a.lipay
93e5cb5f46 Add Load library, new params for common.py, new load tests, Adapt K6, remote_process for Hosting 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-10-19 23:59:42 +03:00
Vladimir Avdeev
805e014c2f Fix: Allow RANGEHASH by default for system wallets 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-19 18:12:12 +03:00
Vladimir Domnich
b38403699c Add shell parameter to head_object calls 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-19 11:39:46 +04:00
Vladimir Domnich
3de4d574d3 Fix code that constructs paths 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-18 16:32:53 +04:00
Vladimir Avdeev
7fcbdb6c34 Rename bearer_token to bearer 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-18 13:52:28 +03:00
Vladimir Domnich
7d54641e54 Add shell parameter to acl function calls 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-18 11:29:14 +04:00
Vladimir Domnich
59f7679b5d Fix config for neofs-cli in balance test 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-17 16:15:17 +04:00
Vladimir Domnich
114f0a1623 Switch to fixed version of testlib 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-17 16:15:17 +04:00
Yulia Kovshova
b64656f0b3 Don't check ACL in sync test 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-17 15:04:54 +03:00
Vladimir Domnich
8e8a5b6efd Pass shell where it was missed 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-17 14:04:53 +04:00
anastasia prasolova
4b3a5f60c4 Add check to version test S3 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-17 12:58:15 +03:00
Vladimir Domnich
48e53b3d86 Switch failover test to hosting from testlib 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-14 20:35:26 +04:00
Vladimir Domnich
92c034c10b Update environment check for failover tests 
With testlib we have a new concept of host. Depending on number of hosts we
can decide whether to run tests or not. This allows us to run failover tests
on devenv if we deploy multiple devenv hosts, also this allows us to add hardware
hosting without modifying code of the tests.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-14 20:35:26 +04:00
Vladimir Domnich
bfd02531ef Integrate with hosting from testlib 
Replace service_helper with hosting class from the testlib.
Instead of invoking commands on remote via ssh_helper, we now use
shell from the hosting.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-14 20:35:26 +04:00
a.lipay
88da942b03 Add tenacity to requirements for remote_process 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-10-14 13:03:08 +03:00
Yulia Kovshova
cf748bf785 Fix 'datetime.datetime' is not iterable 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-14 13:01:42 +03:00
a.lipay
7ab737b595 Parsing k6 results + dataclass for K6 results 
Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-10-14 12:15:53 +03:00
Vladimir Avdeev
e63db788c5 Use neofs-testlib 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-13 21:59:26 +03:00
Yulia Kovshova
6734cd70e6 [#312] Add new multipart upload test 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-13 10:20:44 +03:00
Vladimir Domnich
5eeb8b4058 [#350] Move file-related functions to file_helper 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-12 10:18:44 +04:00
Yulia Kovshova
ce41104d3a Fix regexp for error put object with lock mode 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-11 18:26:25 +03:00
Vladimir Domnich
0aeb998be9 [#350] Cleanup utility keywords 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-11 18:14:58 +04:00
Yulia Kovshova
f9d1a4dfae [#312] Add new test for s3 Bucket function 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-10 14:11:01 +03:00
Yulia Kovshova
bb62299945 [#312] Add new tagging tests for s3 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-10 08:58:53 +03:00
Yulia Kovshova
1d09fc73b6 Fix https://github.com/nspcc-dev/neofs-s3-gw/issues/628 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-07 20:33:30 +04:00
Vladimir Domnich
c29beb69a9 [#266] Upgrade test to S3 bucket removal 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-06 15:49:16 +03:00
Vladimir Domnich
e8cbd286cd [#344] Fix assert for http object not found error 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-06 12:33:19 +04:00
Vladimir Avdeev
455f2f4734 Fix test extended actions system 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-04 11:37:28 +03:00
Vladimir Domnich
2b635059c2 [#339] Fix code that checks complex object copies 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-04 11:51:29 +04:00
Vladimir Avdeev
2ebe3192e2 Change SberCloud api call (get id by ip) 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-10-04 10:07:48 +03:00
Vladimir Domnich
f1d3aa6098 [#334] Disable automatic retries in S3 clients 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-10-03 16:38:50 +04:00
Yulia Kovshova
987df42542 [#312] add new ACL test to s3 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-03 09:42:57 +03:00
Yulia Kovshova
c71d24ea76 Fix sbecloud nightly run 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-10-01 09:15:06 +03:00
Yulia Kovshova
92f7470757 [#312] add version test 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-09-30 16:03:27 +03:00
Vladimir Domnich
147cac0ebc [#314] Format all files with black and isort 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-09-30 13:45:25 +04:00
Vladimir Domnich
26032a67ec [#330] Switch to new command netmap snapshot 
1. Add netmap command to NeofsCli wrapper.
2. Update node_management steps to use netmap.snapshot method instead of
   deprecated "neofs-cli control netmap-snapshot" command.
3. Switch node's public key in netmap from base58-encoding to hex-encoding.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-09-30 13:22:52 +04:00
Vladimir Avdeev
2a175b5824 Add eACL test for system account 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-09-27 13:20:32 +03:00
Yulia Kovshova
c53e48d1f8 Fix skipping s3 test by python mistake 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-09-27 13:20:11 +03:00
Vladimir Domnich
d28d7c6e6d Skip balance tests when storage is free 
This is an alternative implementation of PR https://github.com/nspcc-dev/neofs-testcases/pull/304

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-09-27 13:27:31 +04:00
anikeev-yadro
fed50cb96d Set limit to 1000 in GET VM details query to sbercloud 
By default sbercloud API returns only first 25 VMs per query

Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2022-09-27 12:19:36 +03:00
Aleksey Lipay
38bb0c35a6 fix AttributeError in set_bucket_versioning 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-09-27 10:45:29 +03:00
Aleksey Lipay
30703bf701 Fix error response in test_expiration_epoch_in_http 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-09-27 10:43:40 +03:00
Vladimir Domnich
588292dfb5 [#314] Fix tools config 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-09-26 17:33:42 +04:00
Aleksey Lipay
2452cccba0 adding k6 + remote_process helper 
Why script file:
We have script file for debug after test is finished
We don't need too long strings for passing environment variables
We can easy get PID
https://serverfault.com/questions/420905/nohup-multiple-sequential-commands

Signed-off-by: a.lipay <a.lipay@yadro.com>
 2022-09-23 18:23:23 +03:00
Yulia Kovshova
ee2ed667c6 [#312] add new test for s3 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-09-23 15:54:57 +03:00
karmadim
68591a902d Add check for node is ready 
Signed-off-by: Dmitry Karmanov <d.karmanov@yadro.com>
 2022-09-22 16:30:45 +03:00
Yulia Kovshova
a8a00c1c53 [#297] remove robot.logger 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2022-09-22 15:33:42 +03:00
Yulia Kovshova
035175894d [#297] Replace @keyword decorator with allure.step 2022-09-21 14:02:09 +03:00
Vladimir Domnich
589197ba72 Add black formatter and isort into a precommit hook 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-09-21 12:18:17 +04:00
anikeev-yadro
9eb33465f9 Change sleeps from MAINNET_BLOCK_TIME to MORPH_BLOCK_TIME 
Our tests sleeps should based on MORPH_BLOCK_TIME

Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2022-09-19 17:26:29 +03:00
Elizaveta Chichindaeva
37f73af11e Test: balance accounting test -> pytest 
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-09-07 14:44:37 +03:00
Elizaveta Chichindaeva
38a177107e HOTFIX: FREE_STORAGE condition 
FREE_STORAGE may be false or true and it affects GAS transfer.

Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-09-07 13:47:51 +03:00
Vladimir Avdeev
926a7a5779 Add eACL tests using bearer token 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-09-07 12:11:49 +04:00
Elizaveta Chichindaeva
92cbc2e11b [226] Tests: test for session token for object 
A test for session token for object rewritten in pytest.

Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-09-05 14:36:01 +03:00
Elizaveta Chichindaeva
3f6ba19a8b Tests: Storagegroup tests into pytest 
Tests for Storagegroups rewritten in pytest

Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-09-05 12:12:26 +03:00
Vladimir Avdeev
f40111dc4a Implemented neofs-adm lib 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-08-31 23:52:02 +03:00
Vladimir Domnich
7e31610462 Change log collection fixture to put all logs into archive 
When collecting logs we dump all of the logs into a directory, because it is RAM-intensive
to keep entire set of logs in memory, especially in a large cluster.
And we attach logs to Allure not as individual files, but as single zip archive, because it
is more convenient to download, attach to bugs, etc.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-30 13:36:28 +04:00
Vladimir Domnich
94d6ec6b12 Add fixture to collect logs after test execution 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-30 13:36:28 +04:00
Vladimir Avdeev
6d040c6834 Add ACL and eACL PyTest tests 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-08-25 14:06:21 +03:00
Vladimir Domnich
590a5cfb0e Exclude content-length header from request signature 
Despite of SberCloud sample for python, content-length header is not accounted for
when calculating signature.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-22 18:52:04 +04:00
Vladimir Domnich
9454c5eb95 Implement access key authentication in SberCloud API 
Replaced insecture login/password authentication in SberCloud API with authentication
via access key. This is more secture and is the recommended approach for authentication
from an application.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-22 18:52:04 +04:00
Vladimir Avdeev
3294299612 Implement neofs-cli lib for container and object 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2022-08-19 09:47:19 +03:00
Vladimir Domnich
d935c2cafa Remove step for iptables installation 
Installation of iptables was implemented in environment preparation pipeline and tests
do not need to worry about it.
Removed conditions that were checking pytest mode vs robot mode, because we got rid of
robot tests in this branch of codebase.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-18 14:01:33 +04:00
Vladimir Domnich
0ca45d1ba8 Rename variable for GC waiting 
We need just an aggregate variable that allows to wait until GC pass occurs on
a storage node, rather than a variable for specific shard. Also, we need to account
for a time that GC session itself takes.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-18 14:01:33 +04:00
Vladimir Domnich
b270f39387 Fix node transition to online state 
Node hangs up if we attempt to transfer it to online state immediately after start.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-18 14:01:33 +04:00
Vladimir Domnich
a76614b40d Add asserts for error status codes in grpc responses 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-18 14:01:33 +04:00
Vladimir Domnich
b6b1644fd6 Refactor privileges for ssh commands 
Remove logic that checks for root login and prepends command with sudo, because
we should not use root login at all and all commands (that require higher permissions
should be prefixed with sudo anyways).
Add sudo prefix to privileged commands that require it.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-18 14:01:33 +04:00
Vladimir Domnich
f9ba463d2e Refactor container tests 
Use wellknown ACL constants.
Remove 0x prefix from ACL, because neofs CLI changed formatting.
Remove redundant comments.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-08-18 14:01:33 +04:00