Commit graph

456 commits

Author SHA1 Message Date
05b5f7d133 Mark replication test as failover and add fixture to return nodes 2023-07-31 12:27:12 +03:00
63c4ac5ac6 Add simple replication test
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2023-07-28 08:29:32 +00:00
49e1019a2c Fix method name
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-07-27 12:05:49 +03:00
Yaroslava Lukoyanova
0e1d34b2f7 Added http hostname as a header to all http calls 2023-07-25 14:08:26 +03:00
Yaroslava Lukoyanova
89a31a695b Skipped HTTP GW cases with PUT 'cause of feature deprecation 2023-07-24 06:56:29 +00:00
f4a267fe81 Changed fixture restore network
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-07-12 12:05:36 +03:00
dc13252ff2 Add logs
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-06-27 15:39:00 +00:00
Yaroslava Lukoyanova
d97d852940 Deprecated bearer-rules parameter 2023-06-26 17:23:29 +03:00
79a60c5e5b Temp disable curl upload for complex objects
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-06-23 17:50:18 +03:00
5acf19592a Fix s3_client fixture
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-06-22 10:30:09 +00:00
ead55f657f Delete object after put to container
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-06-19 07:43:48 +03:00
01f4c5217d Delete wait replication steps for tests
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-06-15 09:11:19 +03:00
Yaroslava Lukoyanova
c2cd9ba887 Added case for not ignoring unhealthy tree endpoints 2023-06-14 08:28:39 +00:00
6f77a6ab08 Fix test shutdown node
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-06-09 09:21:56 +03:00
Yaroslava Lukoyanova
dd7f91e66b Add case for loss of pilorama on one node 2023-06-05 10:39:36 +03:00
Yaroslava Lukoyanova
c071f54b56 Add test case for loss of one node 2023-06-01 14:24:48 +03:00
a0587438c4 Add write-cache loss test
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-05-31 18:31:35 +03:00
27cf9bb1bd Add metabase loss test 2023-05-30 16:45:23 +03:00
Yaroslava Lukoyanova
d0660d626b Fixture for restore stopped storage nodes in test_failover_storage 2023-05-29 17:50:02 +00:00
Yaroslava Lukoyanova
e36e18dc57 Fixed typo in test_s3_delete_versioning case assertion 2023-05-25 15:58:04 +00:00
Yaroslava Lukoyanova
8d50407439 Add pilorama loss test cases, marked as skipped 2023-05-23 17:42:52 +03:00
Yaroslava Lukoyanova
520f9fe5b5 Add test cases for S3 blobovnicza and fstree loss 2023-05-19 12:41:57 +00:00
2d174831ab Add wait block for tick epoch and add version testlib
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-05-19 15:30:29 +03:00
5be478e577 Test for invalid location constraint
Signed-off-by: Liza <e.chichindaeva@yadro.com>
2023-05-18 13:49:48 +00:00
856e5afa60 [#41] lifetime: Fix lifetime test
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-05-17 12:33:04 +03:00
8a3d617c19 Fix tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-05-15 20:20:27 +03:00
c77123f301 Move shared code to testlib
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-05-15 12:59:33 +03:00
Yaroslava Lukoyanova
b13f0ec33d Added new test cases for s3 gate, delete marker feature 2023-05-12 08:48:28 +00:00
cbe8847231 Node argument made optional for epoch ticks
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-05-10 11:53:47 +03:00
a6e1190f23 Add tests for node shutdown and object replication integrity
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-05-05 08:18:46 +00:00
bbf9ea7143 Use proper name for binary
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-05-03 16:23:05 +03:00
532d58abc7 Add check for Errors while deleting objects 2023-05-02 11:11:35 +03:00
e86ed765b1 Add test for putting object while one node is stopped
Signed-off-by: Liza <e.chichindaeva@yadro.com>
2023-04-20 17:40:30 +03:00
1e6d3e77f9 Divide test_expiration_epoch_in_http into several (parametrized)
Two tests now checks if an expired object can be got.
X-Attribute-System-Expiration-Epoch -> X-Attribute-System-Expiration-Epoch
python3.9 -> 3.10 in .pre-commit-config.yaml

Signed-off-by: Liza <e.chichindaeva@yadro.com>
2023-04-13 14:19:15 +03:00
520ac116df Update multipart upload abort test
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-04-06 21:47:08 +03:00
d355eccfd8 Add deletion 1001 objects test
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-04-05 19:02:42 +03:00
b995bfca41 Fix s3 tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-29 19:59:14 +03:00
4779d2be88 update headers names
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-27 19:49:41 +03:00
5684d11408 Fix dataloss test
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2023-03-24 13:54:08 +00:00
bb831697f7 [#25] testcases: Fix test_static_session_search
Lists should be compared sorted
Enable test after bugfix

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-03-21 16:19:01 +03:00
2b950f41cd Add test cycles feature
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-20 19:03:29 +03:00
eb464f422c Add tests with empty map
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2023-03-17 17:15:01 +03:00
c3947b0716 Remove payments and storagegroupe tests
Signed-off-by: Liza <e.chichindaeva@yadro.com>
2023-03-14 14:46:25 +00:00
c97855dcee Fix __FROSTFS__EXPIRATION*
Signed-off-by: Liza <e.chichindaeva@yadro.com>
2023-03-14 16:24:29 +03:00
c997e23194 Updates for testcases
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-14 12:21:40 +03:00
cff0e0f23e Update session token tests related to expiration rules
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-13 17:05:24 +03:00
06dc226ef8 Add timeout for cli commands
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-09 14:41:38 +03:00
ac7dae0d2d Add timeout for cli commands
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-09 14:13:51 +03:00
4755a2e167 import fix for some helpers and steps
Signed-off-by: Liza <e.chichindaeva@yadro.com>
2023-03-01 18:47:33 +03:00
Aleksei Chetaev
cb1b0c9bdd Fix issue with frostfs-authmate binnary name
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
2023-02-28 11:48:06 +01:00
Aleksei Chetaev
aa145357f3 Fixing path to DevEnv
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
2023-02-28 11:48:06 +01:00
Aleksei Chetaev
1fb08e36c3 Fixing comments changed by auto replace imports
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
2023-02-28 11:48:06 +01:00
Aleksei Chetaev
ee0c2527f7 Change python to 3.10
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
2023-02-28 11:48:06 +01:00
Aleksei Chetaev
52001dc23a Change all imports to imports from root and remove robot
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
2023-02-28 11:48:06 +01:00
Aleksei Chetaev
13bc98eecc Fixing imports after move utils ti frostfs-testlib
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
2023-02-27 11:44:19 +01:00
Aleksei Chetaev
d253e8f5fd Remove non used files from the repo 2023-02-27 11:44:19 +01:00
Aleksei Chetaev
7a742d57fc Move errors templates to testlib
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
2023-02-27 11:44:19 +01:00
19809c5641 Rename to frostfs
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2023-02-17 16:31:07 +03:00
Aleskei Chetaev
9395a8003f Add assert_s3_acl
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
2023-02-16 11:53:39 +03:00
850c0e77ec Remove wait_for_success for start/stop service methods
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2023-02-07 12:29:39 +03:00
fc6f9ac162 Update expected errors
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-01-24 13:26:50 +03:00
baf0b4dd0f Add waiting for epoch align for storage group lifetime test
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-01-16 15:45:22 +03:00
c6ebe1d67d align all nodes to be in the same epoch
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2023-01-13 19:08:08 +03:00
a942464de6 Fix epoch duration in http test
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2022-12-30 13:40:10 +03:00
690323e85d http test with bearer token
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2022-12-29 12:42:03 +03:00
ced72602ef Add too many open files to logs analyzer
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-29 11:28:24 +03:00
4099413577 #478 Update lock tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-28 11:27:19 +03:00
1abf544433 Add support data and internal ips
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-12-28 11:26:22 +03:00
4f9294918d add system http system header test
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2022-12-28 10:10:13 +03:00
6209a61258 Unskip static session token tests
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-12-27 11:28:29 +03:00
Мария Малыгина
ad2eafd230 [fix] s3 load
Signed-off-by: Мария Малыгина <m.malygina@MacBook-Pro-Maria.local>
2022-12-26 18:08:22 +03:00
2151f0e446 Add await to delete container
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-12-26 17:30:36 +03:00
422636f68b Updates for local dev env runs
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-23 12:18:37 +03:00
5c4f6b6a7d new http test
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2022-12-21 17:07:29 +03:00
a2a234f1b2 Update range tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-20 11:26:51 +03:00
4f5aedebfe Fix wildcard flag value
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-16 15:17:02 +03:00
c7f832e77a Fix allure attaches for failover test
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-16 11:51:48 +03:00
ee204528b8 fix lock_mode
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-12-15 16:44:18 +03:00
aa957639ec Fix policy test s3
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-12-14 14:07:24 +03:00
4003d0115c Fix s3 range tests
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-12-14 11:22:11 +03:00
f89d66817b Add drop locked objects tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-13 14:59:04 +03:00
2f04775fce Fix delete all objects in bucket
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-12-13 11:40:56 +03:00
3497f3b23a Add load_param file, delete old tests, new universal, parametrized test, add stop unused nodes function.
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-12-12 19:14:17 +03:00
15677e89eb Add load_param file, delete old tests, new universal, parametrized test, add stop unused nodes function.
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-12-12 19:14:17 +03:00
1bb640a0db Add load_param file, delete old tests, new universal, parametrized test, add stop unused nodes function.
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-12-12 19:14:17 +03:00
614031a53a Fix s3 object tests after remove obj size hardcode
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-12-09 14:45:30 +03:00
ddf6406e10 fix generate file in http test
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2022-12-09 14:35:43 +03:00
bceea1926a Fix after remove obj size hardcode
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-12-09 14:34:10 +03:00
00bf387f34 Update shards test
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-09 11:59:37 +03:00
6230d2244e create http folder, and adding a new test for http attributes
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2022-12-08 17:24:20 +03:00
3afdaa0e2a Small fixes for tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-08 13:27:50 +03:00
05924784ab Remove SIMPLE_OBJ_SIZE and COMPLEX_OBJ_SIZE from env
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-12-08 13:21:19 +03:00
76c5d40e63 Return to session log analyzer
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-07 15:12:46 +03:00
12b592713b Add control shards test
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-12-07 12:46:21 +03:00
6567aa72a9 Add bearer token tests for s3 wallet api calls
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-07 11:01:38 +03:00
522fc9dccd Delete node extra test
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-12-07 10:46:57 +03:00
bd05aae585 Refactor for cluster usage
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-06 12:34:28 +03:00
d9e881001e Add background load fixture
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-12-05 09:39:15 +03:00
9b0ac8579b Add static session token container tests
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-12-02 10:55:01 +03:00
455cafa08a add new test for 10 paths
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-12-02 10:02:14 +03:00
b2a17c26e7 Add bucket as fixture to s3_test
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-11-30 17:15:21 +03:00
30ea4ab54e Add grpc lock tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-25 16:45:49 +03:00
08274d4620 Enable tests for fixed functionality
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-23 12:34:36 +03:00
69efc2fcce Changed placement rules REP 2 IN X CBF 2 SELECT 2 FROM * AS X for http tests
Signed-off-by: acheyda <a.cheyda@yadro.com>
2022-11-22 16:06:23 +03:00
30600b8856 add password for s3
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-11-21 14:34:41 +03:00
4e6bbaca64 Fix too long logs dir for analyze logs
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-18 15:38:18 +03:00
6047ad2fb5 Add s3 tests
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-11-18 13:03:58 +03:00
bdbcee4e81 Add log analyze for each test
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-17 18:05:52 +03:00
3e5a204d19 Refactor balance tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-16 19:14:58 +03:00
2159982dbd Find critical pattern in system logs
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-11-15 11:44:43 +03:00
2b08a932ac [#312] Add new policy test
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-11-15 10:31:12 +03:00
a0da15e60b add new check for tags
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-11-14 15:41:42 +03:00
21f1c3a922 Add static session tests for object
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-10 18:48:56 +03:00
f9fa249cf2 Add new testmarks
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-11-10 10:11:02 +03:00
bf2f638618 Bump neofs-testlib version 0.3.0 -> 0.4.0
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-11-07 10:45:53 +03:00
14a4d014d1 Move requirements.txt to root repository folder
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-11-03 23:12:25 +03:00
48b9cfbed5 Make node management tests to be last
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-03 16:24:15 +03:00
5faef4df8b Add missed shell parameter in verify_list_storage_group()
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-11-03 12:08:35 +03:00
b8ab64e2c6 Add http benchmark tests
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-11-01 20:15:38 +03:00
f80a9b7cbe Refactor Api tests and extend get_ranges_tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-11-01 19:12:56 +03:00
bf71f3250d Switch storagegroup and session_token tests to testlib library
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-11-01 16:07:14 +03:00
c9e42a7a0a [#312] Add new Locking test
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-11-01 11:43:46 +03:00
2e8e105756 exclude multiupload from dev-env
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-28 17:32:15 +03:00
9e2f8dfb00 Add missed shell parameter in wait_for_expected_object_copies()
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-28 12:28:07 +04:00
ecd5cd1252 Add missed shell parameter in tick_epoch()
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-28 11:08:57 +03:00
70a0f9f216 Remove neofs-keywords submodule
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-27 11:56:01 +03:00
bc1f873975 Fix k6 search
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-26 22:22:37 +03:00
b3cf2ee0e3 Fix session token tests
Delete some commands which not supported dynamic sessions

Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-10-26 17:11:01 +03:00
f47a9d09ec Fix for object range content tests
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-10-25 18:00:02 +03:00
f70dc9d648 Add tag
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-25 15:25:13 +03:00
a85f04a73b Add grpc benchmark tests
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-25 14:41:17 +03:00
anikeev-yadro
ec1dd45e0b Update pytest_tests/helpers/file_helper.py
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
2022-10-25 09:56:36 +03:00
anikeev-yadro
abe73fcc96 Update pytest_tests/helpers/file_helper.py
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
2022-10-25 09:56:36 +03:00
anikeev-yadro
77ebf95434 Update pytest_tests/helpers/file_helper.py
Co-authored-by: Vladimir <108462321+vdomnich-yadro@users.noreply.github.com>
Signed-off-by: anikeev-yadro <110966367+anikeev-yadro@users.noreply.github.com>
2022-10-25 09:56:36 +03:00
0e86d55806 Add get arbitrary range from file
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-10-25 09:56:36 +03:00
8a48402f53 Fix failover tests
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-10-24 14:58:05 +03:00
5cab1ecf19 Fix put object with --grant-full-control id=mycanonicaluserid
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-21 16:22:18 +03:00
3f41fbc14b Correct paths, add load mark to pytest.ini
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-21 08:58:33 +04:00
b662418e42 Add shell parameter in eacl_full_placement_container_with_object() fixture
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-20 22:19:24 +03:00
c716c94b9a Add load mark
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-20 20:07:18 +03:00
93e5cb5f46 Add Load library, new params for common.py, new load tests, Adapt K6, remote_process for Hosting
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-19 23:59:42 +03:00
805e014c2f Fix: Allow RANGEHASH by default for system wallets
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-19 18:12:12 +03:00
b38403699c Add shell parameter to head_object calls
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-19 11:39:46 +04:00
3de4d574d3 Fix code that constructs paths
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-18 16:32:53 +04:00
7fcbdb6c34 Rename bearer_token to bearer
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-18 13:52:28 +03:00
7d54641e54 Add shell parameter to acl function calls
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-18 11:29:14 +04:00
59f7679b5d Fix config for neofs-cli in balance test
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-17 16:15:17 +04:00
114f0a1623 Switch to fixed version of testlib
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-17 16:15:17 +04:00
b64656f0b3 Don't check ACL in sync test
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-17 15:04:54 +03:00
8e8a5b6efd Pass shell where it was missed
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-17 14:04:53 +04:00
anastasia prasolova
4b3a5f60c4 Add check to version test S3
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-17 12:58:15 +03:00
48e53b3d86 Switch failover test to hosting from testlib
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-14 20:35:26 +04:00
92c034c10b Update environment check for failover tests
With testlib we have a new concept of host. Depending on number of hosts we
can decide whether to run tests or not. This allows us to run failover tests
on devenv if we deploy multiple devenv hosts, also this allows us to add hardware
hosting without modifying code of the tests.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-14 20:35:26 +04:00
bfd02531ef Integrate with hosting from testlib
Replace service_helper with hosting class from the testlib.
Instead of invoking commands on remote via ssh_helper, we now use
shell from the hosting.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-14 20:35:26 +04:00
88da942b03 Add tenacity to requirements for remote_process
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-14 13:03:08 +03:00
cf748bf785 Fix 'datetime.datetime' is not iterable
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-14 13:01:42 +03:00
7ab737b595 Parsing k6 results + dataclass for K6 results
Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-10-14 12:15:53 +03:00
e63db788c5 Use neofs-testlib
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-13 21:59:26 +03:00
6734cd70e6 [#312] Add new multipart upload test
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-13 10:20:44 +03:00
5eeb8b4058 [#350] Move file-related functions to file_helper
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-12 10:18:44 +04:00
ce41104d3a Fix regexp for error put object with lock mode
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-11 18:26:25 +03:00
0aeb998be9 [#350] Cleanup utility keywords
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-11 18:14:58 +04:00
f9d1a4dfae [#312] Add new test for s3 Bucket function
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-10 14:11:01 +03:00
bb62299945 [#312] Add new tagging tests for s3
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-10 08:58:53 +03:00
1d09fc73b6 Fix https://github.com/nspcc-dev/neofs-s3-gw/issues/628
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-07 20:33:30 +04:00
c29beb69a9 [#266] Upgrade test to S3 bucket removal
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-06 15:49:16 +03:00
e8cbd286cd [#344] Fix assert for http object not found error
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-06 12:33:19 +04:00
455f2f4734 Fix test extended actions system
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-04 11:37:28 +03:00
2b635059c2 [#339] Fix code that checks complex object copies
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-04 11:51:29 +04:00
2ebe3192e2 Change SberCloud api call (get id by ip)
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-10-04 10:07:48 +03:00
f1d3aa6098 [#334] Disable automatic retries in S3 clients
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-03 16:38:50 +04:00
987df42542 [#312] add new ACL test to s3
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-03 09:42:57 +03:00
c71d24ea76 Fix sbecloud nightly run
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-10-01 09:15:06 +03:00
92f7470757 [#312] add version test
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-09-30 16:03:27 +03:00
147cac0ebc [#314] Format all files with black and isort
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-09-30 13:45:25 +04:00
26032a67ec [#330] Switch to new command netmap snapshot
1. Add netmap command to NeofsCli wrapper.
2. Update node_management steps to use netmap.snapshot method instead of
   deprecated "neofs-cli control netmap-snapshot" command.
3. Switch node's public key in netmap from base58-encoding to hex-encoding.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-09-30 13:22:52 +04:00
2a175b5824 Add eACL test for system account
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-09-27 13:20:32 +03:00
c53e48d1f8 Fix skipping s3 test by python mistake
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-09-27 13:20:11 +03:00
d28d7c6e6d Skip balance tests when storage is free
This is an alternative implementation of PR https://github.com/nspcc-dev/neofs-testcases/pull/304

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-09-27 13:27:31 +04:00
fed50cb96d Set limit to 1000 in GET VM details query to sbercloud
By default sbercloud API returns only first 25 VMs per query

Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-09-27 12:19:36 +03:00
38bb0c35a6 fix AttributeError in set_bucket_versioning
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-09-27 10:45:29 +03:00
30703bf701 Fix error response in test_expiration_epoch_in_http
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-09-27 10:43:40 +03:00
588292dfb5 [#314] Fix tools config
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-09-26 17:33:42 +04:00
2452cccba0 adding k6 + remote_process helper
Why script file:
We have script file for debug after test is finished
We don't need too long strings for passing environment variables
We can easy get PID
https://serverfault.com/questions/420905/nohup-multiple-sequential-commands

Signed-off-by: a.lipay <a.lipay@yadro.com>
2022-09-23 18:23:23 +03:00
ee2ed667c6 [#312] add new test for s3
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-09-23 15:54:57 +03:00
karmadim
68591a902d Add check for node is ready
Signed-off-by: Dmitry Karmanov <d.karmanov@yadro.com>
2022-09-22 16:30:45 +03:00
a8a00c1c53 [#297] remove robot.logger
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
2022-09-22 15:33:42 +03:00
035175894d [#297] Replace @keyword decorator with allure.step 2022-09-21 14:02:09 +03:00
589197ba72 Add black formatter and isort into a precommit hook
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-09-21 12:18:17 +04:00
9eb33465f9 Change sleeps from MAINNET_BLOCK_TIME to MORPH_BLOCK_TIME
Our tests sleeps should based on MORPH_BLOCK_TIME

Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
2022-09-19 17:26:29 +03:00
Elizaveta Chichindaeva
37f73af11e Test: balance accounting test -> pytest
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
2022-09-07 14:44:37 +03:00
Elizaveta Chichindaeva
38a177107e HOTFIX: FREE_STORAGE condition
FREE_STORAGE may be false or true and it affects GAS transfer.

Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
2022-09-07 13:47:51 +03:00
926a7a5779 Add eACL tests using bearer token
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-09-07 12:11:49 +04:00
Elizaveta Chichindaeva
92cbc2e11b [226] Tests: test for session token for object
A test for session token for object rewritten in pytest.

Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
2022-09-05 14:36:01 +03:00
Elizaveta Chichindaeva
3f6ba19a8b Tests: Storagegroup tests into pytest
Tests for Storagegroups rewritten in pytest

Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
2022-09-05 12:12:26 +03:00
f40111dc4a Implemented neofs-adm lib
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-31 23:52:02 +03:00
7e31610462 Change log collection fixture to put all logs into archive
When collecting logs we dump all of the logs into a directory, because it is RAM-intensive
to keep entire set of logs in memory, especially in a large cluster.
And we attach logs to Allure not as individual files, but as single zip archive, because it
is more convenient to download, attach to bugs, etc.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-30 13:36:28 +04:00
94d6ec6b12 Add fixture to collect logs after test execution
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-30 13:36:28 +04:00
6d040c6834 Add ACL and eACL PyTest tests
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-25 14:06:21 +03:00
590a5cfb0e Exclude content-length header from request signature
Despite of SberCloud sample for python, content-length header is not accounted for
when calculating signature.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-22 18:52:04 +04:00
9454c5eb95 Implement access key authentication in SberCloud API
Replaced insecture login/password authentication in SberCloud API with authentication
via access key. This is more secture and is the recommended approach for authentication
from an application.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-22 18:52:04 +04:00
3294299612 Implement neofs-cli lib for container and object
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-19 09:47:19 +03:00
d935c2cafa Remove step for iptables installation
Installation of iptables was implemented in environment preparation pipeline and tests
do not need to worry about it.
Removed conditions that were checking pytest mode vs robot mode, because we got rid of
robot tests in this branch of codebase.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
0ca45d1ba8 Rename variable for GC waiting
We need just an aggregate variable that allows to wait until GC pass occurs on
a storage node, rather than a variable for specific shard. Also, we need to account
for a time that GC session itself takes.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
b270f39387 Fix node transition to online state
Node hangs up if we attempt to transfer it to online state immediately after start.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
a76614b40d Add asserts for error status codes in grpc responses
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
b6b1644fd6 Refactor privileges for ssh commands
Remove logic that checks for root login and prepends command with sudo, because
we should not use root login at all and all commands (that require higher permissions
should be prefixed with sudo anyways).
Add sudo prefix to privileged commands that require it.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
f9ba463d2e Refactor container tests
Use wellknown ACL constants.
Remove 0x prefix from ACL, because neofs CLI changed formatting.
Remove redundant comments.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-18 14:01:33 +04:00
Elizaveta Chichindaeva
186091640f Tests: fix in spelling
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
2022-08-17 16:20:18 +03:00
6110de9268 Refactor devenv service helper
Use docker API to operate with remote devenv, this makes code cleaner and more uniform
between local devenv and remote devenv.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
e88d64a263 Fix decorator for skipping binary version test
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
2b9b0d837d Skip test for binaries versions
It is currently blocked because internal components do not expose versions

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
b597937286 Fix container filtering by name in devenv
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
453dcb99fa Fix container wait logic in devenv
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
c131bb04ba Fix node cleanup step
The intention of the test was not to delete node entirely, but just to erase it's data.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
d6861f4f62 Refactor env properties
Encapculate reading/writing environment.properties in helper.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
a.y.volkov
9fea2efe83 Check binaries versions
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-08-15 18:49:05 +04:00
ce099c61a4 Move node deletion logic to service helper
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
91197335ba Add tests that start or stop services on remote vm
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-15 18:49:05 +04:00
a.y.volkov
f97bfed183 Add test for adding node to cluster
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-08-15 18:49:05 +04:00
b468a06f4e Fix hard reboot via sysrq-trigger
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-15 18:49:05 +04:00
448570afa0 Fix get_range usage in acl tests
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:31:22 +03:00
eff4b032a5 Refactor fixture that checks cloud environment
Now it relies on presence of sbercloud configuration rather than on free storage setting.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:31:22 +03:00
e1d7999313 Cleanup sbercloud config
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:31:22 +03:00
47c55f0060 Remove redundant variables
Small refactoring that includes:
 - Removed variables that are not used any more.
 - Cleanup in helper functions' names.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:31:17 +03:00
a.y.volkov
642af0a888 Add test for network failover
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-08-05 13:29:31 +03:00
5f53e80f93 Fixes in tests to enable them to run in a cloud environment
Few small fixes were made:
 - Fix path to binaries on storage node in cloud env.
 - Add logic to prepend ssh command with sudo.
 - Make re-encoding of homomorphic hash conditional.
 - Increase ssh timeout.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
892b8f227a Add helper function to wait for GC pass on storage nodes
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
05da181998 Add retries when checking presence of buckets in list
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
d8911f2490 Fix parsing of CLI output
Formatting has been changed in CLI tools in version v0.30 and it required us to
change logic in tests:
 - Fix authmate output parsing.
 - Fix format of container name in assert.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
cccfc41409 [#268]: Rename neofs-cli parameter to expire-at
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
6357554ed9 Fix logic that collects versions of binaries
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
a.y.volkov
3f12bd75f6 Add storage nodes health check before tests run
Signed-off-by: a.y.volkov <a.y.volkov@yadro.com>
2022-08-05 13:29:31 +03:00
d701e2cb62 Remove redundant environment variables
Along with that few tweaks were made:
 - Increase wait time as it seems to take more time for complex object.
 - Increase timeout for create_bucket as it fails periodically.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
ae9c9947b6 Fix logic that checks presense of node in netmap
We are now checking by node's public key as it is represented in netmap.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
18e87e3a13 Add delays to http gateway tests
There were 2 delays added:
 - Waiting for GC pass is driven by system design.
 - Waiting after HTTP upload is just termporary workaround.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
08081a8629 Fix cleanup of versioned s3 bucket
Add logic that deletes all objects versions from the bucket before attempting to
delete the bucket itself. This is required per AWS S3 specification.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
8afba7fca6 Fix assert that checks presence of node in netmap
We should be looking for node host rather than for node name that we assigned in tests code.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
568b4421ce Fix object lifetime tests
We should wait for GC pass on storage nodes, because object with expiration is garbage collected
only after epoch ticks.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
2c232c222c Fix node management tests
When we call storage node's control endpoint we need to override storage wallet path.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
eb5532c08e Extend allure logging for failover tests
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-05 13:29:31 +03:00
b6b95b86e8 Add markers for failover tests
This allows us to skip failover tests during regular run of integration tests.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
7026b93c37 Fix SberCloud failovers
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-05 13:29:31 +03:00
ab85389d59 Use neofs-adm to tick epoch
This is a more convenient way to tick epoch when we have multiple moprh blockchain nodes.
Approach that we use in devenv would require multi-signed transaction which is cumbersome.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
cbaecc60dc Fix usage of generate_file, prepare_wallet_and_deposit fixtures
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-05 13:29:31 +03:00
f60020f5aa Fix usage of temp_dir fixture
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
93a52b4a66 Add failover tests for storage nodes
The tests are aimed to work on cloud infrastructure (SberCloud VMs)

Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
2022-08-05 13:29:31 +03:00
014a1fee95 Enable configuration of wallets directories
Add new variables to common.py that allow:
 - Make paths to wallets configurable.
 - Make devenv services path configurable.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:31 +03:00
be39480ade Fix node management tests
Remote connection was created to the 1st storage node only. While in reality
we want to create connection to a specific node.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:30 +03:00
68cbb7deea Update variables for node management tests
New variables allow us:
1. To configure path of CLI binaries and config file on storage node.
2. Update variable names for storage node endpoints.

Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-08-05 13:29:30 +03:00