Andrey Berezin
6182d47b43
[ #81 ] remove schema from preset_s3 and k6 load s3 scenarios
2023-07-14 11:36:10 +00:00
Anton Nikiforov
ff6814e15d
[ #72 ] Add option `--prepare-locally`
...
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-07-07 13:16:54 +03:00
Dmitrii Stepanov
42f1881580
[ #79 ] object put: Add chunk size parameter
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-07-06 11:27:33 +03:00
Andrey Berezin
8e99d08aa4
[ #12 ] Allow using multiple endpoints for presets
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-06-28 20:21:43 +03:00
Evgenii Stratonikov
ba04c682cb
[ #13 ] Allow to use english text in the payload
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-06-27 11:14:05 +00:00
Evgenii Stratonikov
62d7b78131
[ #73 ] preset: Allow to sleep before putting objects
...
For large networks block propagation may take some time.
If we do not wait enough, putting objects can fail for some containers.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-06-25 13:14:15 +03:00
Andrey Berezin
6151005b4d
[ #67 ] Fail k6 if preset fails
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-05-24 08:39:37 +00:00
Evgenii Stratonikov
925fe3ec83
[ #66 ] scenarios: Exit if there is nothing to verify
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-23 16:02:12 +03:00
Evgenii Stratonikov
52ed0d6d88
[ #63 ] scenarios: Unify logs in verify script
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-23 16:02:03 +03:00
Evgenii Stratonikov
4c2678077b
[ #57 ] preset: Use temporary file for payload
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-22 09:06:10 +00:00
Alejandro Lopez
5a1191a1ab
[ #20 ] Add pprof extension with support for cpu and mem
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-05-18 15:08:33 +00:00
Evgenii Stratonikov
5c26b4bad4
[ #61 ] scenarios: Fix `setObjectStatus` parameters
...
We were providing new status instead of old and expected it to exist in
DB.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-05-18 09:43:41 +03:00
Alejandro Lopez
da01f4bc2a
[ #59 ] Revert scheme to http for s3 cli script
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-05-11 15:09:56 +03:00
Alejandro Lopez
5ab7cfed7c
[ #52 ] Add debug_logger flag to local scenarios
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-04-19 10:44:45 +03:00
Andrey Berezin
8109df7de7
[ #51 ] Add constant arrival rate (car) scenarios for grpc and s3
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-04-14 11:05:20 +03:00
Alejandro Lopez
7bb16cdd94
[ #49 ] Import and use k6-utils library for uuidv4
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-04-13 16:31:54 +03:00
Alejandro Lopez
de6747fc0f
[ #14 ] Add s3 local loader
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-04-13 13:00:38 +00:00
Andrey Berezin
6832771973
[ #47 ] Raise default STREAM_TIMEOUT to 60s
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-04-07 12:01:50 +03:00
Evgenii Stratonikov
ef6f5bdf48
[ #45 ] scenarios: Support ENV file in local.js
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-03-24 09:08:42 +00:00
Alejandro Lopez
7efb6315dc
[ #14 ]: Add local target support
...
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
2023-03-23 11:58:11 +00:00
Evgenii Stratonikov
47b6d0fb8b
[ #37 ] scenarios: Make run_scenarios.md render properly
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-03-21 17:58:05 +03:00
Denis Kirillov
ed58333aba
[ #11 ] Support reading env variables from file
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2023-03-15 09:13:34 +03:00
Evgenii Stratonikov
c5a250618c
[ #33 ] scenarios: Fix imports
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-03-13 12:31:17 +03:00
Andrey Berezin
614bee3581
[ #19 ] Add json output for k6 scenarios
...
This is required for autotests to be able to parse summaries and do checks
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2023-03-01 15:12:23 +03:00
Evgenii Stratonikov
9212cefb0e
[ #9 ] scenarios: Unify error log entries
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-02-28 14:18:53 +03:00
Evgenii Stratonikov
4ea872d6c3
[ #9 ] logging: Make logger more functional
...
Previous iteration was bad, because `Logger` instance was shared and
endpoints in different VUs were overriding each other.
New interface is much better, it supports logger extension in any
context with arbitrary fields.
```
const l = logging.new().withFields({endpoint: "my endpoint"});
...
l.withField("cid", container).info("not found");
```
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-02-28 14:18:53 +03:00
Evgenii Stratonikov
e52a315752
[ #50 ] Use `native.connect` timeouts everywhere
...
Also, use defaults from the SDK itself, allow user to provide 0.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-02-03 17:12:26 +03:00
Andrey Berezin
43fddcb28b
sys.exit with exit codes if no containers/objects during preset
...
correct statistics - total counts of request contains only successful requests.
add endpoint to grpc connection error message
added ability to change workers count during preset
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
2022-12-30 17:30:50 +03:00
Alexey Vanin
171327cdda
[ #2 ] Deep rebranding
...
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
2022-12-30 11:05:20 +03:00
Evgenii Stratonikov
88b2129b54
[ #50 ] Allow to set timeouts for native scenario
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
(cherry picked from commit 1337eed6df45492f1045541021e8b14a42c5a286)
2022-12-29 17:35:13 +03:00
Andrey Berezin
d2541486ae
Add wallet params since -g flag is deprecated
...
Signed-off-by: Andrey Berezin <a.berezin@yadro.com>
(cherry picked from commit 3120b9bd7d85b8170a14c153c08b956a31aa8c70)
2022-12-29 17:35:13 +03:00
a.chetaev
9501e300c1
Add documentation for new scripts
...
Signed-off-by: a.chetaev <alex.chetaev@gmail.com>
2022-11-18 17:36:29 +03:00
a.chetaev
22e97339c9
Add script to check policy complience
...
Signed-off-by: a.chetaev <alex.chetaev@gmail.com>
2022-11-18 17:36:29 +03:00
a.chetaev
ed25e553b2
[ #38 ] Move common function to helpers for preset
...
Signed-off-by: a.chetaev <alex.chetaev@gmail.com>
2022-11-18 11:44:06 +03:00
Vladislav Karakozov
97fbe9af82
[ #37 ] run_scenarios.md: K6 doc updates
...
Signed-off-by: Vladislav Karakozov <v.karakozov@yadro.com>
2022-11-18 11:42:47 +03:00
a.chetaev
9c08b45619
[ #34 ] Add script to check preset objects state
...
Signed-off-by: a.chetaev <alex.chetaev@gmail.com>
2022-11-15 19:38:24 +03:00
Evgenii Stratonikov
aa1cbb957c
[ #32 ] scenarios: Log object info on errors
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2022-11-11 10:26:27 +03:00
Evgenii Stratonikov
883c3c259a
[ #32 ] registry: Allow to customize cache size for DELETE
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2022-11-11 10:26:27 +03:00
Pavel Karpy
c43f73704e
[ #30 ] grpc: Cache object getters
...
Includes:
1. Logic simplification: no need to call `ObjSelector.Reset` from JS code,
everything could be done inside the Go code. Remove unused mutexes.
2. Do not handle object twice ever: Once handled, any error is expected to be
logged on the JS side and never be handled again. It solves "already removed"
error.
3. Object caching: no need to call bolt's `View` on every object removal: it
blocks other calls and slows down the execution. Read 100 objects (or less if
not available yet), cache them and send to buffered channel.
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
2022-11-03 13:11:50 +03:00
Pavel Karpy
dbfadc83d0
[ #30 ] preset: Print container progress
...
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
2022-11-03 13:11:50 +03:00
Pavel Karpy
70d4b1db9d
[ #30 ] grpc: Do not start deleters without registry
...
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
2022-11-03 13:11:50 +03:00
Pavel Karpy
0e34bf64bd
[ #30 ] presets: Pretty JSON files
...
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
2022-11-03 13:11:50 +03:00
Pavel Karpy
af840ed376
[ #30 ] preset: Create missing files
...
Also, stop if none of the container creation commands succeeded.
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
2022-11-03 13:11:50 +03:00
Pavel Karpy
0dda9f17fa
[ #30 ] preset: Stop execution if no new containers were created
...
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
2022-11-03 13:11:50 +03:00
Pavel Karpy
0088fbd7d6
[ #30 ] preset: PEP 8 refactor
...
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
2022-11-03 13:11:50 +03:00
Vladimir Domnich
eaff41c055
Fix misprint in docs
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-21 08:54:56 +03:00
Vladimir Domnich
258e448dbf
Fix grpc preset
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-17 14:45:35 +03:00
anatoly@nspcc.ru
ea604ee8ee
Use separate sleep intervals for VUs
...
To fine-tune read/write/delete load we need to have separate sleep
intervales for readers/writers/deleters.
The changes were originally authored by anatoly@nspcc.ru <anatoly@nspcc.ru>
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-17 14:30:24 +03:00
Vladimir Domnich
7875aa9c02
[ #23 ] Remove invalid variable from http scenario
...
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-13 15:43:53 +03:00
Vladimir Domnich
37e27f6791
[ #23 ] Implement deletion of objects
...
1. Added simple lock mechanism to reset obj selector. This prevents
most of concurrency issues when multiple VUs try to reset selector.
2. Added logic to delete objects to grpc and s3 scenarios.
3. Added registry support to http scenario.
4. Deletion logic was not implemented for http scenario, because
http gateway does not provide web-method to delete objects.
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
2022-10-03 17:34:20 +03:00