anurindm/frostfs-testlib
1
0
Fork 0
forked from TrueCloudLab/frostfs-testlib
Code Pull requests Activity
287 commits 5 branches 4 tags 3.1 MiB
Commit graph

229 commits

Author SHA1 Message Date
Andrey Berezin
be964e731f [#146] Prettify verifier messages for error rates 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-12-13 15:44:53 +00:00
Dmitriy Zayakin
f1264bd473 [#143] Change network utils 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-12-13 13:15:37 +00:00
mkadilov
54d26b226c [#140] Executive command changed 
Added exception of error 'Too many requests' in log analyzer

Signed-off-by: Mikhail Kadilov m.kadilov@yadro.com
 2023-12-11 14:20:06 +03:00
anurindm
247d2fbab7 Added logger config path attribute to NodeBase class 
Signed-off-by: Dmitry Anurin <d.anurin@yadro.com>
 2023-12-07 08:56:13 +00:00
Andrey Berezin
ae566b413b [#139] Use readers for init time calculation 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-12-06 15:51:48 +00:00
Andrey Berezin
81dfc723da [#137] Ability to control remote processes id and reports for load 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-12-04 15:00:26 +00:00
Dmitriy Zayakin
e65fc359fe [#134] Add method uptime service 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-12-04 07:07:31 +00:00
mkadilov
17c1a4f14b [#136] Added exclude_filter 
Added exclude_filter

Signed-off-by: Mikhail Kadilov <m.kadilov@yadro.com>
 2023-12-01 12:55:50 +00:00
Andrey Berezin
dc6b0e407f [#133] Change reporter usage 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-29 15:27:17 +03:00
Andrey Berezin
39a17f3634 [#132] Add steps logger and refactor reporter usage 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-28 09:29:07 +00:00
Yaroslava Lukoyanova
47414eb866 Support of AWS profiles 2023-11-28 06:52:35 +00:00
Andrey Berezin
c17f0f6173 [#130] Add service healthcheck and allow to skip version check for some binaries 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-24 19:46:35 +03:00
Dmitriy Zayakin
d1ba7eb661 Change local timeout 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-11-23 08:03:31 +03:00
Andrey Berezin
f072f88673 [#127] Change service registration 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-22 19:54:39 +03:00
Andrey Berezin
253bb3b1d8 [126] small healthcheck and stop start hosts rework 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-22 17:10:09 +03:00
Andrey Berezin
9ab4def44f Store k6 output and add socket info collection 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-20 17:39:15 +03:00
Dmitriy Zayakin
ed8f90dfc0 Change output time format to unix 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-11-20 15:53:30 +03:00
Dmitriy Zayakin
ed70dada96 Add support test maintenance 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-11-20 11:07:24 +00:00
mkadilov
22647c6d59 [#119] Renamed Github to Gitea in links 
Some links changed to git.frostfs from github

Signed-off-by: Mikhail Kadilov <m.kadilov@yadro.com>
 2023-11-15 13:08:58 +03:00
m.malygina
61a1b28652 s3local.js scenario 
Signed-off-by: m.malygina <m.malygina@yadro.com>
 2023-11-14 14:00:08 +03:00
Andrey Berezin
6519cfafc9 [#116] Updates for local scenario teardown 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-13 13:34:49 +03:00
Andrey Berezin
72bd467c53 [#114] Add yaml configuration controllers 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-11-10 19:46:18 +00:00
Dmitriy Zayakin
f8562da7e0 Add AWS retries 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-11-08 19:49:20 +03:00
Ekaterina Chernitsyna
c8227e80af update-remaining time 2023-11-03 08:19:03 +00:00
Dmitriy Zayakin
1f50166e78 Add method for work time 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-11-02 11:13:34 +03:00
Andrey Berezin
03c45d7592 [#110] Move chattr call after get_results call 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-31 18:17:21 +03:00
Andrey Berezin
e970fe2788 [#109] Update CSC with healthchecks 2023-10-31 14:17:54 +03:00
Andrey Berezin
8ee2985c89 [#108] Update user with couple retries 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-30 14:37:23 +03:00
Dmitriy Zayakin
137fd21561 Add local shell and small fix 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-10-27 11:50:45 +00:00
Andrey Berezin
f3c160f313 [#107] Add passwd change protection for local runner 2023-10-27 11:33:44 +00:00
m.malygina
3af4dfd977 multipart scenario 
Signed-off-by: m.malygina <m.malygina@yadro.com>
 2023-10-27 11:53:55 +03:00
Andrey Berezin
8a360683ae [#104] Add mask/unmask for services 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-26 17:31:33 +03:00
Andrey Berezin
f4111a1374 [#103] Add host_status method to Host 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-26 13:34:42 +03:00
Andrey Berezin
b1a3d740e9 [#102] Updates for failover 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-25 15:57:38 +03:00
Dmitriy Zayakin
0c3bb20af5 Add method to interfaces 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-10-24 12:41:44 +00:00
Andrey Berezin
e1f3444e92 [#100] Add new method for logs gathering 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-20 18:08:22 +03:00
Dmitriy Zayakin
cff5db5a67 Change func parsing netmap 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-10-18 08:29:34 +00:00
Andrey Berezin
1c3bbe26f7 [#98] Small dependency cleanup 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-17 17:45:23 +03:00
Dmitry Anurin
dd347dd8fb Added unit to logs getter 
Signed-off-by: Dmitry Anurin <d.anurin@yadro.com>
 2023-10-12 11:56:30 +00:00
Andrey Berezin
98f9c78f09 [#97] Probe fix for filedescriptor issue 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-11 18:21:40 +03:00
Andrey Berezin
2c2af7f8ed Keep only one ssh connection per host 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-10 17:47:46 +03:00
Dmitriy Zayakin
d039bcc221 Add IfUpDown utility helper 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-10-10 14:41:32 +00:00
Andrey Berezin
e919064bb9 [#92] Fix method name 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-05 16:42:28 +03:00
Andrey Berezin
98ccd4c382 [#91] Failover enhancements 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-10-03 15:18:29 +03:00
m.malygina
9feb8135e3 local scenario 
Signed-off-by: m.malygina <m.malygina@yadro.com>
 2023-09-28 09:21:25 +00:00
Andrey Berezin
64f004d5a5 Add read-from to verify settings 2023-09-27 10:38:28 +03:00
Andrey Berezin
eb37573df8 [#88] Add read from switch 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-09-25 16:26:45 +03:00
Andrey Berezin
602de43bff Use all nodes for s3 creds 2023-09-19 17:44:43 +00:00
Andrey Berezin
fc1f373477 Adding interval between ssh connection attempts 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-09-19 08:59:27 +00:00
Andrey Berezin
b039ee9940 Dev Env should not use sudo by default 2023-09-19 08:52:40 +00:00
Dmitriy Zayakin
be9b3f5855 Update argument func init s3 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-09-19 08:35:33 +00:00
anikeev-yadro
f7ef8cb881 Another increase default load time 
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2023-09-15 12:30:58 +03:00
Dmitriy Zayakin
ecf8f0841a Change NodeNetmapInfo class 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-09-11 10:36:54 +03:00
Andrey Berezin
19b8b96898 Use only name in ObjectSize repr and str 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-09-08 10:50:28 +00:00
Ekaterina Chernitsyna
f2d34dbf2e add latency report 2023-09-08 09:33:29 +00:00
Andrey Berezin
e14896400f Add post-init for load params 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-09-06 16:51:18 +03:00
Andrey Berezin
449c18bb1a Adding options to work with any service type 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-08-30 15:28:12 +03:00
anikeev-yadro
aa277fdd6a Increase default load time 
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2023-08-29 16:55:25 +03:00
m.malygina
7059596506 Support prepare locally flag 
Signed-off-by: m.malygina <m.malygina@yadro.com>
 2023-08-21 11:59:05 +00:00
Dmitriy Zayakin
7112bf9c88 Change NodeNetmapInfo class 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-08-17 12:54:05 +03:00
Dmitriy Zayakin
b1c21e0e5b Add Iptables helper 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-08-16 12:22:14 +00:00
Ekaterina Chernitsyna
02c079eda3 [OBJECT-3949] delete mainchain ready 2023-08-15 12:32:36 +00:00
Andrey Berezin
d28f3cdc28 Add UNDEFINED versionins status 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-08-04 14:19:49 +03:00
Andrey Berezin
e4878f4d1e Add readable enums 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-08-02 21:38:27 +03:00
Andrey Berezin
807235af95 Fix multiple services start (copy array for upstream functions) 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-31 14:08:12 +03:00
anikeev-yadro
716a780a13 Add epoch align after tick 
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2023-07-27 16:25:53 +00:00
m.malygina
d6e08c477b fix divizion by zero, when total operations is zero 2023-07-27 11:33:43 +00:00
Andrey Berezin
612e088763 Fix string representation for load params with empty fields 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-27 10:50:02 +03:00
Yaroslava Lukoyanova
b856e82008 Added http hostname as a header to all http calls 2023-07-26 08:33:45 +00:00
Andrey Berezin
2240be09d2 Add repr and str for most classes used in parametrize 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-24 19:34:21 +03:00
Andrey Berezin
38742badf2 Add unit tests for load_config.py 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-21 19:12:11 +03:00
Andrey Berezin
9c792c091e Add error_threshold parameter, add error check after load 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-21 15:37:32 +00:00
Dmitriy Zayakin
49ccd47e81 Add сopies_number argument 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-07-21 13:38:32 +00:00
Andrey Berezin
675183cd9a Fix empty and zero values parsing part 2 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-21 11:46:01 +03:00
Andrey Berezin
8dcfae5cb2 Fix empty and zero values parsing 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-20 11:00:34 +00:00
Vladimir Avdeev
15862e5901 Add optional parameter "copies_number" in "frostfs-cli object put" 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2023-07-20 03:41:21 +03:00
Andrey Berezin
4896abcec3 Adding code validation targets 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-18 20:38:37 +03:00
Andrey Berezin
62216293f8 Updates for s3 k6 2023-07-14 13:05:23 +00:00
d.anurin
59b4157991 Added sudo parameter for getting shell with elevated rights or not 2023-07-13 12:48:34 +00:00
sstovbyra
917dc6f6d8 add_wait_for_service_to_be_in_state 2023-07-12 09:52:26 +03:00
Yaroslava Lukoyanova
14c85e0a9e Added verify=False to requests calls to ignore self signed SSL certificate 2023-07-07 16:41:59 +03:00
Yaroslava Lukoyanova
3050ccc9fa Added -k parameter to curl to ignore self signed SSL certificate 2023-07-07 06:40:48 +00:00
Dmitriy Zayakin
f8409fa9f9 Change name metric Inner ring 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-07-05 09:21:24 +00:00
Andrey Berezin
a14b082a4d Make load things parallel 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-07-04 19:25:24 +03:00
Andrey Berezin
05ac392485 Remove deleted parameter 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-06-27 17:06:01 +03:00
Yaroslava Lukoyanova
ac28df2652 Removed --bearer_rules parameter from init s3 credentials due to changes in 1.3 2023-06-27 09:25:53 +00:00
Andrey Berezin
889e108be9 Update epoch align check 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-06-27 11:47:42 +03:00
Andrey Berezin
182bd6ab36 Add loader and sceanrio runner interfaces, add support for local scenario 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-06-26 13:47:54 +00:00
Dmitriy Zayakin
13ea25bff5 Change s3 auth func 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-06-21 13:02:16 +03:00
Dmitriy Zayakin
c0f63e3783 New methods S3 client 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-06-19 13:39:35 +03:00
Yaroslava Lukoyanova
98f5075715 Functions for stop/start s3 gateway in cluster_state_controller 2023-06-13 12:07:21 +03:00
Yaroslava Lukoyanova
f2f3d3c8e3 Add get_data_directory function 2023-06-06 06:54:27 +00:00
Dmitriy Zayakin
26a78c0eae New methods with nodes 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-06-05 14:12:42 +00:00
Andrey Berezin
e3c0f76896 Proper usage for shards_watcher 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-06-02 13:08:17 +03:00
Andrey Berezin
987e7f2a30 Revert "Update shards list command" 
This reverts commit 584ba5f0d1.
 2023-06-02 13:03:28 +03:00
Andrey Berezin
584ba5f0d1 Update shards list command 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-31 16:02:26 +03:00
Andrey Berezin
2bad0f1db6 Add metabase and write_cache operations 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-30 16:32:38 +03:00
Yaroslava Lukoyanova
a26f8e9c80 Added wait_for_node_to_be_ready to starting stopped storage nodes 2023-05-29 14:01:57 +00:00
Andrey Berezin
cc35b2e6da Changes required to run multiple loads during one test 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-25 23:09:07 +03:00
Andrey Berezin
123b5425a8 1. Increase wait time for k6 teardown after stop signal 2. Remove duplicated code 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-25 10:16:43 +00:00
Dmitriy Zayakin
32a8c5274a Fix time block 
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
 2023-05-25 10:16:30 +00:00
Andrey Berezin
6cdeb497c0 Various updates for failover and to cases 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-24 11:18:19 +03:00
sstovbyra
a34c34991f Update payment_neogo.py 2023-05-23 13:28:52 +00:00
Andrey Berezin
10468fa545 Use root to create dir and then transfer it to load user 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-19 12:42:18 +00:00
Yaroslava Lukoyanova
d9504697ba Add interfaces for deleting fstree, blobovnocza and pilorama.db 2023-05-19 11:44:34 +00:00
Andrey Berezin
d30d3d5cfd make dir on prepare step 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-18 14:30:25 +03:00
Vladimir Avdeev
7399cc9a8e Bump version 2.0.0 -> 2.0.1 
Signed-off-by: Vladimir Avdeev <v.avdeev@yadro.com>
 2023-05-18 08:15:55 +00:00
Vladimir Avdeev
70416d40c2 Add optional parameter "no wait for return" in panic_reboot_host 2023-05-18 09:55:12 +03:00
Andrey Berezin
c8e527e9ec Correct param name for skip in querry 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-15 17:07:17 +03:00
Andrey Berezin
863a1075cd Various fixes 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-15 14:23:40 +03:00
Andrey Berezin
997e768e92 Move shared code to testlib 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-05-14 13:43:59 +03:00
Andrey Berezin
d97a02d1d3 Add missing functions 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-03-20 16:56:14 +03:00
anikeev-yadro
e73585cf50 Add morph remove node command 
Signed-off-by: anikeev-yadro <a.anikeev@yadro.com>
 2023-03-15 18:58:52 +03:00
Andrey Berezin
f2ecce44bf Adding timeout for more cli actions 
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
 2023-03-09 11:29:48 +00:00
Aleksei Chetaev
8ed26cef7d Fix issue with generate random string 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-03-06 20:04:02 +01:00
Aleksei Chetaev
71b35d45c3 Fixing issues in imports after movin tests to pip install -e for testlib 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-28 13:49:01 +01:00
Aleksei Chetaev
4fd9d69701 Refactoring utils with adding several new ones 2023-02-27 11:44:04 +01:00
Aleksei Chetaev
5568cbd0bf Add new common erros templates 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-27 11:44:04 +01:00
Aleksei Chetaev
8223e99ec8 Bump version 1.2.0 -> 1.3.0 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-17 14:35:14 +01:00
Aleksei Chetaev
9c7c28e761 Add imports for the new modules 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-17 14:35:14 +01:00
Aleksei Chetaev
44e9a8480a Move errors patterns and check functions to testlib 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-17 14:35:14 +01:00
Aleksei Chetaev
e891f3804c Bump version 1.1.1 -> 1.2.0 2023-02-17 09:09:16 +01:00
Aleksei Chetaev
255c6b5eec Fix issue in imports with analytics module 2023-02-17 09:09:16 +01:00
Aleksei Chetaev
004c5fb00a Remove superfluous fields 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-16 19:22:16 +03:00
Aleksei Chetaev
9021c5c0df Add missed hints 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-16 19:22:16 +03:00
Aleksei Chetaev
9d21d1c143 Implement test analitics export into TMS systems 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-16 19:22:16 +03:00
Aleksei Chetaev
ad8fd930c8 Remove neoFS from comments and __doc__ 
Signed-off-by: Aleksei Chetaev <alex.chetaev@gmail.com>
 2023-02-16 18:09:37 +03:00
Yulia Kovshova
adb06aa158 Delete neofs_test_lib path 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2023-02-16 18:09:37 +03:00
Yulia Kovshova
6d3b6f0f2f Rename neofs to frostfs 
Signed-off-by: Yulia Kovshova <y.kovshova@yadro.com>
 2023-02-16 17:26:12 +03:00