d8af19cc83
[ #114 ] datagen: Remove calcHash parameter in GenPayload()
...
Hash calculation is now done on-demand with a method call.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 19:29:16 +03:00
4544ec616b
[ #114 ] datagen: Allow to generate streaming payloads
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 19:29:16 +03:00
74121bb387
[ #114 ] datagen: Refactor payload generation
...
Return an interface which can be converted to `io.Reader` as well as
report payload size and hash.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 19:29:16 +03:00
14a5eac5b1
[ #117 ] scenarios: Refactor data generator construction
...
1. Make it easier to change new parameters.
2. Fix a bug where the generator was created even for read-only
scenarios.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 13:19:03 +03:00
278b234753
[ #117 ] scenarios: Provide all parameters to datagen.generator()
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 13:18:59 +03:00
0e06020118
[ #107 ] preset_grpc: Allow to create local containers
...
DCO action / DCO (pull_request) Successful in 1m2s
Tests and linters / Tests (1.21) (pull_request) Successful in 1m53s
Tests and linters / Tests (1.20) (pull_request) Successful in 2m2s
Tests and linters / Tests with -race (pull_request) Successful in 3m0s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-12-15 16:57:05 +03:00
bc47d66316
[ #106 ] xk6: Allow to set max total size in local scenarios
...
DCO action / DCO (pull_request) Successful in 1m8s
Tests and linters / Tests (1.21) (pull_request) Successful in 1m49s
Tests and linters / Tests (1.20) (pull_request) Successful in 2m1s
Tests and linters / Tests with -race (pull_request) Successful in 3m7s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-12-15 14:07:35 +03:00
3574361f2e
[ #104 ] s3local: Use default HTTP client instead of requests
...
DCO action / DCO (pull_request) Successful in 1m51s
Tests and linters / Tests (1.21) (pull_request) Successful in 2m55s
Tests and linters / Tests with -race (pull_request) Successful in 3m20s
Tests and linters / Tests (1.20) (pull_request) Successful in 3m33s
`requests` lib is not default, so it can be unavailable.
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-11-17 14:33:32 +03:00
48a95bc50b
remove http from s3 multipart upload load scenario, protocol would be set in endpoint parameter
...
DCO action / DCO (pull_request) Has been cancelled
Tests and linters / Tests (1.20) (pull_request) Has been cancelled
Tests and linters / Tests (1.21) (pull_request) Has been cancelled
Tests and linters / Tests with -race (pull_request) Has been cancelled
Signed-off-by: m.malygina <m.malygina@yadro.com>
2023-10-27 13:22:38 +03:00
26f5262b3d
[ #90 ] Support config folder together with config file
...
Tests and linters / Tests (1.20) (pull_request) Successful in 1m46s
Tests and linters / Tests with -race (pull_request) Successful in 2m9s
DCO action / DCO (pull_request) Successful in 3m26s
Tests and linters / Tests (1.21) (pull_request) Successful in 8m10s
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-10-25 16:48:29 +03:00
1311051f60
[ #99 ] Adding read age param to improve k6 runs stability
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-02 20:08:43 +03:00
7db7751334
[ #95 ] Allow to use wallet from config file for frostfs-cli
...
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-08-23 15:01:53 +03:00
bf884936a7
[ #91 ] Improve logging for preset
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-08-16 08:25:03 +00:00
5b1793f248
[ #30 ] report: log start and end time of load scenario
...
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
2023-07-26 14:54:59 +00:00
4ef3795e04
[ #84 ] preset: fix typo
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-07-21 06:55:40 +00:00
704c0f06bc
[ #25 ] selector: Remove next object timeout
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-20 15:01:57 +03:00
0dc0ba1704
[ #25 ] xk6: Read objects from registry for S3 tests
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-20 10:01:41 +03:00
3c26e7c917
[ #25 ] xk6: Read objects from registry for gRPC tests
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-20 10:01:34 +03:00
77d3dd8d6e
[ #80 ] Support parallel multipart
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2023-07-19 10:44:44 +03:00
6182d47b43
[ #81 ] remove schema from preset_s3 and k6 load s3 scenarios
2023-07-14 11:36:10 +00:00
ff6814e15d
[ #72 ] Add option --prepare-locally
...
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-07-07 13:16:54 +03:00
42f1881580
[ #79 ] object put: Add chunk size parameter
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-06 11:27:33 +03:00
8e99d08aa4
[ #12 ] Allow using multiple endpoints for presets
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-06-28 20:21:43 +03:00
ba04c682cb
[ #13 ] Allow to use english text in the payload
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-06-27 11:14:05 +00:00
62d7b78131
[ #73 ] preset: Allow to sleep before putting objects
...
For large networks block propagation may take some time.
If we do not wait enough, putting objects can fail for some containers.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-06-25 13:14:15 +03:00
6151005b4d
[ #67 ] Fail k6 if preset fails
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-05-24 08:39:37 +00:00
925fe3ec83
[ #66 ] scenarios: Exit if there is nothing to verify
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-23 16:02:12 +03:00
52ed0d6d88
[ #63 ] scenarios: Unify logs in verify script
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-23 16:02:03 +03:00
4c2678077b
[ #57 ] preset: Use temporary file for payload
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-22 09:06:10 +00:00
5a1191a1ab
[ #20 ] Add pprof extension with support for cpu and mem
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-05-18 15:08:33 +00:00
5c26b4bad4
[ #61 ] scenarios: Fix setObjectStatus parameters
...
We were providing new status instead of old and expected it to exist in
DB.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-18 09:43:41 +03:00
da01f4bc2a
[ #59 ] Revert scheme to http for s3 cli script
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-05-11 15:09:56 +03:00
5ab7cfed7c
[ #52 ] Add debug_logger flag to local scenarios
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-04-19 10:44:45 +03:00
8109df7de7
[ #51 ] Add constant arrival rate (car) scenarios for grpc and s3
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-04-14 11:05:20 +03:00
7bb16cdd94
[ #49 ] Import and use k6-utils library for uuidv4
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-04-13 16:31:54 +03:00
de6747fc0f
[ #14 ] Add s3 local loader
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-04-13 13:00:38 +00:00
6832771973
[ #47 ] Raise default STREAM_TIMEOUT to 60s
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-04-07 12:01:50 +03:00
ef6f5bdf48
[ #45 ] scenarios: Support ENV file in local.js
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-03-24 09:08:42 +00:00
7efb6315dc
[ #14 ]: Add local target support
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-03-23 11:58:11 +00:00
47b6d0fb8b
[ #37 ] scenarios: Make run_scenarios.md render properly
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-03-21 17:58:05 +03:00
ed58333aba
[ #11 ] Support reading env variables from file
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2023-03-15 09:13:34 +03:00
c5a250618c
[ #33 ] scenarios: Fix imports
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-03-13 12:31:17 +03:00
614bee3581
[ #19 ] Add json output for k6 scenarios
...
This is required for autotests to be able to parse summaries and do checks
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-01 15:12:23 +03:00
9212cefb0e
[ #9 ] scenarios: Unify error log entries
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-02-28 14:18:53 +03:00
4ea872d6c3
[ #9 ] logging: Make logger more functional
...
Previous iteration was bad, because `Logger` instance was shared and
endpoints in different VUs were overriding each other.
New interface is much better, it supports logger extension in any
context with arbitrary fields.
```
const l = logging.new().withFields({endpoint: "my endpoint"});
...
l.withField("cid", container).info("not found");
```
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-02-28 14:18:53 +03:00
e52a315752
[ #50 ] Use native.connect timeouts everywhere
...
Also, use defaults from the SDK itself, allow user to provide 0.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-02-03 17:12:26 +03:00
43fddcb28b
sys.exit with exit codes if no containers/objects during preset
...
correct statistics - total counts of request contains only successful requests.
add endpoint to grpc connection error message
added ability to change workers count during preset
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-30 17:30:50 +03:00
171327cdda
[ #2 ] Deep rebranding
...
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
2022-12-30 11:05:20 +03:00
88b2129b54
[ #50 ] Allow to set timeouts for native scenario
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
(cherry picked from commit 1337eed6df45492f1045541021e8b14a42c5a286)
2022-12-29 17:35:13 +03:00
d2541486ae
Add wallet params since -g flag is deprecated
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
(cherry picked from commit 3120b9bd7d85b8170a14c153c08b956a31aa8c70)
2022-12-29 17:35:13 +03:00
