aarifullin/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
3979 commits 137 branches 26 tags 62 MiB
Commit graph

3979 commits

This branch
This branch
All branches
Author SHA1 Message Date
Airat Arifullin
6ce35c0a2d [#390] cli: Fix bearer token reading for tree subcommands 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 13:31:49 +03:00
Airat Arifullin
51674db43c [#390] cli: Make tree commands errors more verbose 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 12:44:38 +03:00
Airat Arifullin
8063fb220d [#390] cli: Support more tree service API calls in CLI 
* Support healthcheck API call
* Support move API call
* Support remove API call
* Support getSubtree API call
* Support getOpLog API call

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 12:43:48 +03:00
Dmitrii Stepanov
8d16d95376 [#484] morph: Add expired tx logging 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-03 08:03:25 +00:00
Alejandro Lopez
26acf5689e [#92] Ensure policer objects cannot be worked on concurrently 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-03 07:05:31 +00:00
Alejandro Lopez
3223402c90 [#92] Embed policer's objectsInWork mutex 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-03 07:05:31 +00:00
Alejandro Lopez
f9730f090d [#92] Refactor policer and add some unit tests 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-03 07:05:31 +00:00
Dmitrii Stepanov
0c5b025788 [#470] grpc: Increase message limits 
For send message limit set to 2GiB, but there are custom
GET/GET RANGE limiters.
For receive message limit set to 256 MiB, but actual chunk size
will be managed by client.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-30 16:32:15 +03:00
Airat Arifullin
f437ab8f15 [#197] object: Make Delete method return correct status 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-06-30 12:58:56 +00:00
Anton Nikiforov
d01c064674 [#455] Fix non-informative message when parse node attributes 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-28 15:02:29 +00:00
Evgenii Stratonikov
d0ab552a90 [#478] *: Fix funlen linter warnings 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 15:01:49 +00:00
Evgenii Stratonikov
33d9ebbe7f [#478] .golangci.yml: Increase timeout 
Make it enough for CI.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 15:01:49 +00:00
Evgenii Stratonikov
f91cfb36e6 [#478] .forgejo: Add build/test workflows 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 15:01:49 +00:00
Evgenii Stratonikov
8a4e250dae [#468] *: replace outdated TODO crypto-related links 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
4f413fe86e [#1] treesvc: Properly check for secure transport 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
cab51c8cbe [#1] metabase: Rename blindlyProcess() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
73a71a71b0 [#1] node: Use a proper validation of a substorage type 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
f4c71cea65 [#1] *: Replace outdated FIXME/TODO links 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
64e1383df6 [#1] Makefile: Remove image-storage-testnet target 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
13b53258b4 [#1] go.mod: Remove retract version 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
0c866f62c5 [#473] placement: Fix backwards compatibility for copies_number 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-27 11:13:16 +03:00
Dmitrii Stepanov
43d263c3d5 [#428] linter: Fix unkeyed assignment 
Thanks to gopls.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 13:29:39 +00:00
Dmitrii Stepanov
cac4ed93d6 [#428] engine: Add low_mem config parameter 
Concurrent initialization in case of the metabase resync leads to
high memory consumption and potential OOM.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 13:29:39 +00:00
Dmitrii Stepanov
71a63b8e9c [#439] node: Update SDK-Go version 
This fixed version: null header for complex object.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 07:56:32 +00:00
Evgenii Stratonikov
4bf345225c [#447] pilorama: Use named constant for the key size 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-26 07:42:05 +00:00
Evgenii Stratonikov
b4ce0b0412 [#447] pilorama: Do not undo log for create ops 
```
goos: linux
goarch: amd64
cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz
         │     old      │                 new                  │
         │    sec/op    │    sec/op     vs base                │
Create-8   36.48µ ± 11%   30.34µ ± 14%  -16.84% (p=0.000 n=10)

         │     old      │                 new                  │
         │     B/op     │     B/op      vs base                │
Create-8   43.01Ki ± 4%   37.78Ki ± 5%  -12.15% (p=0.000 n=10)

         │    old     │                new                 │
         │ allocs/op  │ allocs/op   vs base                │
Create-8   166.0 ± 3%   146.0 ± 3%  -12.05% (p=0.000 n=10)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-26 07:42:05 +00:00
Evgenii Stratonikov
dd3874eff1 [#447] pilorama: Add benchmark for create ops 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-26 07:42:05 +00:00
Dmitrii Stepanov
72fedff7ad [#426] cli: Add object nodes command 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 07:41:34 +00:00
Anton Nikiforov
ab489265b3 [#449] cli: Allow to exec tree get-by-path without bearer token 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Anton Nikiforov
71889234b7 [#449] tree: Allow reading requests signed by keys from allow list 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Evgenii Stratonikov
40eae22109 [#460] services/util: Remove CreateRequestStreamer 
There is no need in a wrapper with many from-`interface{}` conversions.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-21 17:08:04 +03:00
Evgenii Stratonikov
a64dc9ad70 [#460] services/util: Remove HandleServerStreamRequest 
There is no need in a wrapper with many from-`interface{}` conversions.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-21 17:08:01 +03:00
Evgenii Stratonikov
167a67f0b8 [#460] services/util: Remove HandleUnaryRequest 
There is no need in a wrapper with many from-`interface{}` conversions.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-21 17:07:56 +03:00
Evgenii Stratonikov
785d81a68a [#460] services/object: Reduce distibutedTarget memory footprint 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-21 17:07:50 +03:00
Dmitrii Stepanov
4d48377cec [#459] blobovniczatree: Fix get error 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 16:44:53 +03:00
Dmitrii Stepanov
03aa210145 [#373] metrics: Move labels to consts 
To unify label naming all lable keys and other consts are moved to
one file.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
b5d9f4a285 [#373] metrics: Add pilorama metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
e89fa110c7 [#373] metrics: Add metabase metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
af608da952 [#373] metrics: Add blobovnizca metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
56f320dd85 [#373] metrics: Add blobstor metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
16a142cd0c [#373] metrics: Add FSTree metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
d8ecc69d00 [#373] local storage: Pass parent ID 
This is required to add shard ID as metric label.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
d5aaec1107 [#373] pilorama: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
059e9e88a2 [#373] metabase: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
f54cc0b607 [#373] blobstor: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
8318d90ad0 [#373] blobovniczatree: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
3ae3c8dfdb [#373] fstree: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
a8526d45e9 [#373] blobovnizca: Add missed/fix tracing spans 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
028d4a8058 [#373] blobovnicza: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
01a0c97760 [#453] engine: Set Disabled mode to deleted shard 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-20 12:04:07 +03:00