Commit graph

97 commits

Author SHA1 Message Date
9b9db46a07 [#152] Allow to set mix of policies for containers and buckets
All checks were successful
DCO action / DCO (pull_request) Successful in 43s
Tests and linters / Tests (1.21) (pull_request) Successful in 3m10s
Tests and linters / Tests (1.22) (pull_request) Successful in 3m21s
Tests and linters / Tests with -race (pull_request) Successful in 3m34s
Tests and linters / Lint (pull_request) Successful in 2m56s
Signed-off-by: a.berezin <a.berezin@yadro.com>
2024-07-02 20:45:31 +03:00
e7d4dd404a [#150] scenarios: Use SelectorAwaiting for read and delete load in s3_dar.js, make delete_age optional
All checks were successful
DCO action / DCO (pull_request) Successful in 1m28s
Tests and linters / Tests (1.22) (pull_request) Successful in 3m14s
Tests and linters / Tests with -race (pull_request) Successful in 3m27s
Tests and linters / Tests (1.21) (pull_request) Successful in 3m40s
Tests and linters / Lint (pull_request) Successful in 4m29s
Signed-off-by: m.malygina <m.malygina@yadro.com>
2024-06-21 15:52:57 +03:00
0a9aeab47c [#150] In case we are running both read and delete load SelectorAwaiting
All checks were successful
DCO action / DCO (pull_request) Successful in 2m2s
Tests and linters / Tests (1.21) (pull_request) Successful in 4m31s
Tests and linters / Tests (1.22) (pull_request) Successful in 4m39s
Tests and linters / Tests with -race (pull_request) Successful in 4m43s
Tests and linters / Lint (pull_request) Successful in 5m33s
Signed-off-by: m.malygina <m.malygina@yadro.com>
2024-06-21 10:55:18 +03:00
e92ce668a8 [#145] scenarios: Format js files with clang
All checks were successful
DCO action / DCO (pull_request) Successful in 1m18s
Tests and linters / Tests (1.22) (pull_request) Successful in 3m10s
Tests and linters / Tests (1.21) (pull_request) Successful in 3m27s
Tests and linters / Tests with -race (pull_request) Successful in 3m28s
Tests and linters / Lint (pull_request) Successful in 4m29s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-06-14 11:26:01 +03:00
6d1e7eb49e [#145] native: Allow to specify max_obj_size
All checks were successful
DCO action / DCO (pull_request) Successful in 1m11s
Tests and linters / Tests (1.22) (pull_request) Successful in 3m12s
Tests and linters / Tests with -race (pull_request) Successful in 3m26s
Tests and linters / Tests (1.21) (pull_request) Successful in 3m39s
Tests and linters / Lint (pull_request) Successful in 4m13s
For locally prepared objects it is possible now to
specify cut size.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-06-14 10:57:30 +03:00
bdf4c192e1 [#143] Add new s3 scenario where delete only already read objects
Some checks reported warnings
DCO action / DCO (pull_request) Has been cancelled
Tests and linters / Lint (pull_request) Has been cancelled
Tests and linters / Tests (1.21) (pull_request) Has been cancelled
Tests and linters / Tests (1.22) (pull_request) Has been cancelled
Tests and linters / Tests with -race (pull_request) Has been cancelled
Signed-off-by: m.malygina <m.malygina@yadro.com>
2024-06-06 18:37:10 +03:00
7f139734b1 [#133] scenarios: Support one-shot deletion scenario
All checks were successful
DCO action / DCO (pull_request) Successful in 1m56s
Tests and linters / Tests (1.20) (pull_request) Successful in 3m50s
Tests and linters / Tests (1.21) (pull_request) Successful in 4m14s
Tests and linters / Lint (pull_request) Successful in 4m49s
Tests and linters / Tests with -race (pull_request) Successful in 4m40s
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-05 13:43:01 +03:00
86ed8add10 [#133] scenarios: Format with clang-format
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-05 13:43:01 +03:00
d1ec9e4bf0 [#108] preset: Allow to skip preset
All checks were successful
DCO action / DCO (pull_request) Successful in 37s
Tests and linters / Tests (1.21) (pull_request) Successful in 3m0s
Tests and linters / Tests (1.20) (pull_request) Successful in 3m16s
Tests and linters / Tests with -race (pull_request) Successful in 3m40s
Tests and linters / Lint (pull_request) Successful in 2m38s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-01 16:10:04 +03:00
93aaec4e0d [#131] scenarios: Format js files with clang formatter
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-03-20 11:40:49 +03:00
0c4e2665ba [#131] registry: Allow to create cycled/forward selectors
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-03-20 11:40:49 +03:00
2d26ac766f [#130] Update documentation
All checks were successful
DCO action / DCO (pull_request) Successful in 1m41s
Tests and linters / Tests (1.20) (pull_request) Successful in 2m10s
Tests and linters / Tests (1.21) (pull_request) Successful in 2m12s
Tests and linters / Lint (pull_request) Successful in 2m34s
Tests and linters / Tests with -race (pull_request) Successful in 3m5s
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-02-22 16:31:29 +03:00
adacef19bb [#125] Fix recursion issue
Some checks reported warnings
DCO action / DCO (pull_request) Has been cancelled
Tests and linters / Lint (pull_request) Has been cancelled
Tests and linters / Tests (1.20) (pull_request) Has been cancelled
Tests and linters / Tests (1.21) (pull_request) Has been cancelled
Tests and linters / Tests with -race (pull_request) Has been cancelled
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-15 16:40:18 +03:00
d1578a728f [#121] scenarios: Fix tags doc
All checks were successful
DCO action / DCO (pull_request) Successful in 3m49s
Tests and linters / Tests (1.21) (pull_request) Successful in 6m18s
Tests and linters / Tests with -race (pull_request) Successful in 6m56s
Tests and linters / Tests (1.20) (pull_request) Successful in 2m53s
Tests and linters / Lint (pull_request) Successful in 2m25s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-02-08 10:10:09 +03:00
5cfb958a18 [#121] scenarios: Add info about Grafana annotations
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-02-08 10:10:09 +03:00
47fc031028 [#125] Adding acl to container and bucket creation
Some checks reported warnings
DCO action / DCO (pull_request) Has been cancelled
Tests and linters / Lint (pull_request) Has been cancelled
Tests and linters / Tests (1.20) (pull_request) Has been cancelled
Tests and linters / Tests (1.21) (pull_request) Has been cancelled
Tests and linters / Tests with -race (pull_request) Has been cancelled
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2024-02-05 18:56:36 +03:00
965dcdcbe7 [#119] scenarios: Add Metrics export section to docs
All checks were successful
DCO action / DCO (pull_request) Successful in 52s
Tests and linters / Lint (pull_request) Successful in 2m14s
Tests and linters / Tests (1.21) (pull_request) Successful in 2m7s
Tests and linters / Tests with -race (pull_request) Successful in 9m56s
Tests and linters / Tests (1.20) (pull_request) Successful in 11m43s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-01-26 10:39:26 +03:00
604982de3e [#119] metrics: Allow to add custom tags
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-01-26 10:31:54 +03:00
4ff87f9bf6 [#122] preset_grpc: Allow specify --local without value
All checks were successful
DCO action / DCO (pull_request) Successful in 1m17s
Tests and linters / Lint (pull_request) Successful in 3m40s
Tests and linters / Tests (1.20) (pull_request) Successful in 3m45s
Tests and linters / Tests (1.21) (pull_request) Successful in 3m44s
Tests and linters / Tests with -race (pull_request) Successful in 4m7s
Now `--local` is flag, so it is possible to specify `--local`
instead of `--local True` or '--local False'.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-01-24 16:28:44 +03:00
d8af19cc83 [#114] datagen: Remove calcHash parameter in GenPayload()
Hash calculation is now done on-demand with a method call.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 19:29:16 +03:00
4544ec616b [#114] datagen: Allow to generate streaming payloads
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 19:29:16 +03:00
74121bb387 [#114] datagen: Refactor payload generation
Return an interface which can be converted to `io.Reader` as well as
report payload size and hash.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 19:29:16 +03:00
14a5eac5b1 [#117] scenarios: Refactor data generator construction
1. Make it easier to change new parameters.
2. Fix a bug where the generator was created even for read-only
   scenarios.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 13:19:03 +03:00
278b234753 [#117] scenarios: Provide all parameters to datagen.generator()
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-01-12 13:18:59 +03:00
0e06020118 [#107] preset_grpc: Allow to create local containers
All checks were successful
DCO action / DCO (pull_request) Successful in 1m2s
Tests and linters / Tests (1.21) (pull_request) Successful in 1m53s
Tests and linters / Tests (1.20) (pull_request) Successful in 2m2s
Tests and linters / Tests with -race (pull_request) Successful in 3m0s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-12-15 16:57:05 +03:00
bc47d66316 [#106] xk6: Allow to set max total size in local scenarios
All checks were successful
DCO action / DCO (pull_request) Successful in 1m8s
Tests and linters / Tests (1.21) (pull_request) Successful in 1m49s
Tests and linters / Tests (1.20) (pull_request) Successful in 2m1s
Tests and linters / Tests with -race (pull_request) Successful in 3m7s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-12-15 14:07:35 +03:00
3574361f2e [#104] s3local: Use default HTTP client instead of requests
All checks were successful
DCO action / DCO (pull_request) Successful in 1m51s
Tests and linters / Tests (1.21) (pull_request) Successful in 2m55s
Tests and linters / Tests with -race (pull_request) Successful in 3m20s
Tests and linters / Tests (1.20) (pull_request) Successful in 3m33s
`requests` lib is not default, so it can be unavailable.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-11-17 14:33:32 +03:00
48a95bc50b remove http from s3 multipart upload load scenario, protocol would be set in endpoint parameter
Some checks reported warnings
DCO action / DCO (pull_request) Has been cancelled
Tests and linters / Tests (1.20) (pull_request) Has been cancelled
Tests and linters / Tests (1.21) (pull_request) Has been cancelled
Tests and linters / Tests with -race (pull_request) Has been cancelled
Signed-off-by: m.malygina <m.malygina@yadro.com>
2023-10-27 13:22:38 +03:00
26f5262b3d [#90] Support config folder together with config file
All checks were successful
Tests and linters / Tests (1.20) (pull_request) Successful in 1m46s
Tests and linters / Tests with -race (pull_request) Successful in 2m9s
DCO action / DCO (pull_request) Successful in 3m26s
Tests and linters / Tests (1.21) (pull_request) Successful in 8m10s
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-10-25 16:48:29 +03:00
1311051f60 [#99] Adding read age param to improve k6 runs stability
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-10-02 20:08:43 +03:00
7db7751334 [#95] Allow to use wallet from config file for frostfs-cli
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-08-23 15:01:53 +03:00
bf884936a7 [#91] Improve logging for preset
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-08-16 08:25:03 +00:00
5b1793f248 [#30] report: log start and end time of load scenario
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
2023-07-26 14:54:59 +00:00
4ef3795e04 [#84] preset: fix typo
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-07-21 06:55:40 +00:00
704c0f06bc [#25] selector: Remove next object timeout
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-20 15:01:57 +03:00
0dc0ba1704 [#25] xk6: Read objects from registry for S3 tests
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-20 10:01:41 +03:00
3c26e7c917 [#25] xk6: Read objects from registry for gRPC tests
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-20 10:01:34 +03:00
77d3dd8d6e [#80] Support parallel multipart
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2023-07-19 10:44:44 +03:00
6182d47b43 [#81] remove schema from preset_s3 and k6 load s3 scenarios 2023-07-14 11:36:10 +00:00
ff6814e15d [#72] Add option --prepare-locally
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-07-07 13:16:54 +03:00
42f1881580 [#79] object put: Add chunk size parameter
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-06 11:27:33 +03:00
8e99d08aa4 [#12] Allow using multiple endpoints for presets
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-06-28 20:21:43 +03:00
ba04c682cb [#13] Allow to use english text in the payload
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-06-27 11:14:05 +00:00
62d7b78131 [#73] preset: Allow to sleep before putting objects
For large networks block propagation may take some time.
If we do not wait enough, putting objects can fail for some containers.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-06-25 13:14:15 +03:00
6151005b4d [#67] Fail k6 if preset fails
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-05-24 08:39:37 +00:00
925fe3ec83 [#66] scenarios: Exit if there is nothing to verify
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-23 16:02:12 +03:00
52ed0d6d88 [#63] scenarios: Unify logs in verify script
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-23 16:02:03 +03:00
4c2678077b [#57] preset: Use temporary file for payload
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-22 09:06:10 +00:00
5a1191a1ab [#20] Add pprof extension with support for cpu and mem
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-05-18 15:08:33 +00:00
5c26b4bad4 [#61] scenarios: Fix setObjectStatus parameters
We were providing new status instead of old and expected it to exist in
DB.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-18 09:43:41 +03:00