Commit graph

229 commits

Author SHA1 Message Date
5b715877b3 [#214] Removed x10 wait in delete bucket function 2024-04-24 15:07:04 +03:00
c0e37c8138 [#210] Return response in complete_multipart_upload function 2024-04-23 23:51:42 +03:00
80c65b454e [#203] Remove hostnames cludges
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-04-22 12:31:35 +00:00
541a3e0636 [#208] Add await for search func
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2024-04-17 11:03:47 +03:00
70f0357960 [#207] Fix shards for disabled write_cache
Signed-off-by: a.berezin <a.berezin@yadro.com>
2024-04-15 16:50:54 +03:00
a85070e957 [#206] Change epoch in func set status node, to 2
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2024-04-15 12:35:33 +03:00
82a8f9bab3 [#205] Propagate SETUP_TIMEOUT option
Signed-off-by: a.berezin <a.berezin@yadro.com>
2024-04-11 11:46:04 +03:00
65ec50391e Interfaces for IAM in S3 client 2024-04-11 07:51:40 +00:00
863e74f161 [#204] Fix custom_registry for verify scenario
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-04-09 12:10:02 +03:00
e2a170d66e [#190] Introduce default EC placement policy
The default policy which is similar to REP 2, but uses EC instead.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-04 11:21:15 +00:00
338584069d [#190] Add PlacementPolicy dataclass
Allow to parametrize tests with placement policy.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-04 11:21:15 +00:00
9cfaf1a618 [#201] Add more time for node return
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-04-03 01:02:21 +03:00
076e444f84 [#198] Check only data disks for local safe-stopper
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-03-22 12:19:53 +03:00
653621fb7e [#197] Allow config_dir for local scenario 2024-03-20 18:59:22 +03:00
2dc5aa8a1e [#195] Update netmap parser and status check message
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-03-19 12:48:04 +00:00
11487e983d [#196] Removed profile name from Boto3 client 2024-03-18 20:12:40 +03:00
9c508c4f66 [#194] Fix shards watcher CLI usage
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-03-15 17:44:18 +03:00
f2bded64e4 [#189] Add setup step to check binaries versions
Signed-off-by: Liza <e.chichindaeva@yadro.com>
2024-03-15 16:09:02 +03:00
0e247c2ff2 [#193] Fix auth provider
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-03-14 16:39:20 +03:00
b323bcfd0a [#192] Fix param 2024-03-14 14:27:31 +03:00
25925c637b [#191] Credentials work overhaul
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-03-11 19:23:10 +03:00
09a7f66d1e [#188] Add CredentialsProvider
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-03-01 02:18:05 +03:00
22b41b227f [#186] Add total bytes to report
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-27 11:58:53 +03:00
f5a7ff5c90 [#185] Add prometheus load parameters 2024-02-21 18:37:48 +03:00
3fc3eaadf3 [#182] Refactoring old functions for FrostfsCli
Refactoring old functions for FrostfsCli

Signed-off-by: Mikhail Kadilov m.kadilov@yadro.com
2024-02-20 14:51:50 +00:00
273f0d13a5 [#184] Add streaming param
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-20 13:27:45 +03:00
55cebc042c [#183] Read all configuration files for service config
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-19 17:48:09 +03:00
751381cd60 Add GenericCli utility
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-14 16:16:59 +03:00
4f3814690e [TrueCloudLab/xk6-frostfs#125] Add acl option
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-05 18:53:33 +03:00
d79fd87ede [#174] Add flag to remove registry file
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-05 12:43:09 +03:00
8ba2cb8030 [#171] Components versions check
Components versions check

Signed-off-by: Mikhail Kadilov m.kadilov@yadro.com
2024-02-01 09:12:58 +00:00
6caa77dedf [#172] parallel get remote binaries versions 2024-01-31 16:42:30 +03:00
0d7a15877c [#169] Update metrics
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-01-26 15:29:02 +03:00
82f9df088a [#167] Strip components for new xk6 archive and update unit tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-01-26 13:35:42 +03:00
e04fac0770 [#164] Add local flag to preset in load
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-01-22 19:06:38 +03:00
328e43fe67 [#162] Refactor frostfs-cli functional
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2024-01-22 13:11:59 +00:00
c0a25ab699 Support of custom version parameter instead of --version for all bins 2024-01-18 10:41:36 +03:00
40fa2c24cc rename local_config_path 2024-01-12 20:25:39 +03:00
be36a10f1e [#157] fix for dev-env and unit-tests
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-01-12 16:42:19 +00:00
df8d99d83c [#156] load_time in the format of days, hours and minutes; new params
Signed-off-by: Liza <e.chichindaeva@yadro.com>
2024-01-12 16:45:18 +03:00
d6a2cf92a2 [#155] Change args to optionally
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2024-01-12 08:40:51 +00:00
a3bda0b34f [#154] Change func search container
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2024-01-11 13:42:02 +03:00
a4d1082ed5 Shards are attribute of StorageNode class 2023-12-22 16:07:20 +00:00
73c362c307 [#153] Fix stat calculation and add error threshold
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-12-22 11:33:50 +03:00
10a6efa333 [#151] Refactor load report
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-12-20 13:03:32 +00:00
663c144709 Search container by name using HTTP requests 2023-12-15 13:14:21 +00:00
8e739adea5 [#150] Increased the status waiting timeout
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-12-15 13:13:09 +03:00
3d63772f4a [#148] Add support for custom registry during read operations
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-12-14 14:03:19 +00:00
02f3ef6b40 [#147] Provide custom environment to ssh connection
Signed-off-by: Dmitry Anurin <d.anurin@yadro.com>
2023-12-14 12:53:51 +03:00
89522b607c update percent of filling 2023-12-13 15:57:13 +00:00
be964e731f [#146] Prettify verifier messages for error rates
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-12-13 15:44:53 +00:00
f1264bd473 [#143] Change network utils
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-12-13 13:15:37 +00:00
54d26b226c [#140] Executive command changed
Added exception of error 'Too many requests' in log analyzer

Signed-off-by: Mikhail Kadilov m.kadilov@yadro.com
2023-12-11 14:20:06 +03:00
247d2fbab7 Added logger config path attribute to NodeBase class
Signed-off-by: Dmitry Anurin <d.anurin@yadro.com>
2023-12-07 08:56:13 +00:00
ae566b413b [#139] Use readers for init time calculation
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-12-06 15:51:48 +00:00
81dfc723da [#137] Ability to control remote processes id and reports for load
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-12-04 15:00:26 +00:00
e65fc359fe [#134] Add method uptime service
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-12-04 07:07:31 +00:00
17c1a4f14b [#136] Added exclude_filter
Added exclude_filter

Signed-off-by: Mikhail Kadilov <m.kadilov@yadro.com>
2023-12-01 12:55:50 +00:00
dc6b0e407f [#133] Change reporter usage
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-29 15:27:17 +03:00
39a17f3634 [#132] Add steps logger and refactor reporter usage
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-28 09:29:07 +00:00
47414eb866 Support of AWS profiles 2023-11-28 06:52:35 +00:00
c17f0f6173 [#130] Add service healthcheck and allow to skip version check for some binaries
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-24 19:46:35 +03:00
d1ba7eb661 Change local timeout
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-11-23 08:03:31 +03:00
f072f88673 [#127] Change service registration
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-22 19:54:39 +03:00
253bb3b1d8 [126] small healthcheck and stop start hosts rework
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-22 17:10:09 +03:00
9ab4def44f Store k6 output and add socket info collection
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-20 17:39:15 +03:00
ed8f90dfc0 Change output time format to unix
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-11-20 15:53:30 +03:00
ed70dada96 Add support test maintenance
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-11-20 11:07:24 +00:00
22647c6d59 [#119] Renamed Github to Gitea in links
Some links changed to git.frostfs from github

Signed-off-by: Mikhail Kadilov <m.kadilov@yadro.com>
2023-11-15 13:08:58 +03:00
61a1b28652 s3local.js scenario
Signed-off-by: m.malygina <m.malygina@yadro.com>
2023-11-14 14:00:08 +03:00
6519cfafc9 [#116] Updates for local scenario teardown
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-13 13:34:49 +03:00
72bd467c53 [#114] Add yaml configuration controllers
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-11-10 19:46:18 +00:00
f8562da7e0 Add AWS retries
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-11-08 19:49:20 +03:00
c8227e80af update-remaining time 2023-11-03 08:19:03 +00:00
1f50166e78 Add method for work time
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-11-02 11:13:34 +03:00
03c45d7592 [#110] Move chattr call after get_results call
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-31 18:17:21 +03:00
e970fe2788 [#109] Update CSC with healthchecks 2023-10-31 14:17:54 +03:00
8ee2985c89 [#108] Update user with couple retries
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-30 14:37:23 +03:00
137fd21561 Add local shell and small fix
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-10-27 11:50:45 +00:00
f3c160f313 [#107] Add passwd change protection for local runner 2023-10-27 11:33:44 +00:00
3af4dfd977 multipart scenario
Signed-off-by: m.malygina <m.malygina@yadro.com>
2023-10-27 11:53:55 +03:00
8a360683ae [#104] Add mask/unmask for services
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-26 17:31:33 +03:00
f4111a1374 [#103] Add host_status method to Host
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-26 13:34:42 +03:00
b1a3d740e9 [#102] Updates for failover
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-25 15:57:38 +03:00
0c3bb20af5 Add method to interfaces
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-10-24 12:41:44 +00:00
e1f3444e92 [#100] Add new method for logs gathering
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-20 18:08:22 +03:00
cff5db5a67 Change func parsing netmap
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-10-18 08:29:34 +00:00
1c3bbe26f7 [#98] Small dependency cleanup
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-17 17:45:23 +03:00
dd347dd8fb Added unit to logs getter
Signed-off-by: Dmitry Anurin <d.anurin@yadro.com>
2023-10-12 11:56:30 +00:00
98f9c78f09 [#97] Probe fix for filedescriptor issue
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-11 18:21:40 +03:00
2c2af7f8ed Keep only one ssh connection per host
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-10 17:47:46 +03:00
d039bcc221 Add IfUpDown utility helper
Signed-off-by: Dmitriy Zayakin <d.zayakin@yadro.com>
2023-10-10 14:41:32 +00:00
e919064bb9 [#92] Fix method name
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-05 16:42:28 +03:00
98ccd4c382 [#91] Failover enhancements
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-03 15:18:29 +03:00
9feb8135e3 local scenario
Signed-off-by: m.malygina <m.malygina@yadro.com>
2023-09-28 09:21:25 +00:00
64f004d5a5 Add read-from to verify settings 2023-09-27 10:38:28 +03:00
eb37573df8 [#88] Add read from switch
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-09-25 16:26:45 +03:00
602de43bff Use all nodes for s3 creds 2023-09-19 17:44:43 +00:00
fc1f373477 Adding interval between ssh connection attempts
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-09-19 08:59:27 +00:00
b039ee9940 Dev Env should not use sudo by default 2023-09-19 08:52:40 +00:00