achuprov/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Pull requests Activity
4058 commits 45 branches 27 tags 32 MiB
Commit graph

1438 commits

Author SHA1 Message Date
Evgenii Stratonikov
d3a52ec73a [#516] node: Send bootstrap request if attributes were updated 
Consider following situation:
1. Epoch tick.
2. Update node attributes in the config.
3. Restart node.

Because we already sent bootstrap query after (1) and we are still
online, new bootstrap query won't be sent. This leads to the node
attributes being updated after another epoch.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-08 07:40:26 +00:00
Alejandro Lopez
5bbfebba2d [#570] Fix writecache type constant copy-pasta bug 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-07 12:06:44 +03:00
Alejandro Lopez
1a0cb0f34a [#421] Try using badger for the write-cache 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-07 08:16:57 +00:00
Airat Arifullin
93c46cfdf0 [#550] cli: make get-op-log meta pretty formatted 
Close #550

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-02 10:27:15 +00:00
Airat Arifullin
1b7b54ba89 [#540] cli: refactor client parameters usage 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-02 09:44:51 +00:00
Anton Nikiforov
ec8a631d31 [#542] Update test for SizeInBytesSafe function 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-01 13:38:00 +00:00
Anton Nikiforov
9ca63ac8c3 [#542] Fix bug in SizeInBytesSafe function 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-01 13:38:00 +00:00
Dmitrii Stepanov
32c77f3a23 [#537] node: Add runtime.memory_limit config parameter 
This parameter allows to set soft memory limit for Go GC.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-25 17:27:09 +03:00
Evgenii Stratonikov
fef172c5b0 [#6] services/util: Simplify response.Service 
It has only 1 parameter, which is obligatory.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-21 18:29:57 +03:00
Alejandro Lopez
57e7fb5ccf [#521] cli: Add common aliases to policy playground commands 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-19 11:34:08 +00:00
Alejandro Lopez
24dffdac6f [#521] cli: Add netmap load command to policy playground 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-19 11:34:08 +00:00
Alejandro Lopez
a9d04ba86f [#244] Remove --local-dump from frostfs-adm config 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-18 13:51:25 +00:00
Alejandro Lopez
4680087711 [#527] Add support for select-filter expressions in policy playground 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-18 13:15:58 +00:00
Dmitrii Stepanov
f0355a453e [#463] policer: Remove capacity rebalance logic 
Current implementation has some quirks. For example,
using only half of object.put.pool_size_remote threads
tells replicator that is node is 50% loaded,
but in reality we could be putting lot's of big objects.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-18 10:52:12 +00:00
Dmitrii Stepanov
b2487e8cc5 [#516] node: Do not bootstrap if node is online candidate 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-18 10:51:02 +00:00
Dmitrii Stepanov
a0c7045f29 [#512] cli: Refactor UX for bearer create command 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-17 11:45:27 +03:00
Dmitrii Stepanov
d8e37a827f [#497] config: Add examples and unit tests 
Add examples and unit tests for tree.authorized_keys section.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-17 08:23:28 +00:00
Denis Kirillov
486287c2f7 [#524] cli: Add impersonate flag for bearer token creation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-07-17 08:20:50 +00:00
Dmitrii Stepanov
c83e7c875f [#294] searchsvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov
e8091101c7 [#294] searchsvc: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov
ec9b738465 [#294] putsvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov
800a685e84 [#294] putsvc: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov
1420b8b9ea [#294] deletesvc: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov
a476d8285a [#294] deletesvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov
70a1081988 [#294] aclsvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov
61541eaec2 [#294] aclsvc: Refactor checker constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Airat Arifullin
0754e6e654 [#390] cli: Fix bearer token reading for tree subcommands 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Airat Arifullin
676a3efa79 [#390] cli: Make tree commands errors and messages more verbose 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Airat Arifullin
c42db4e761 [#390] cli: Support more tree service API calls in CLI 
* Support healthcheck API call
* Support move API call
* Support remove API call
* Support getSubtree API call
* Support getOpLog API call

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Dmitrii Stepanov
7b76527759 [#486] node: Add PutSingle wrappers 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-10 15:49:21 +03:00
Dmitrii Stepanov
040a623d39 [#476] cli: Fix object nodes command 
Do not fail if client creation failed.
Use external addresses to create the client too.
Use public key as node ID.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-10 09:58:31 +03:00
Evgenii Stratonikov
e858479a74 [#498] policer: Explicitly Rewind() iterator after finish 
Previously, we can continue to return `EndOfListing` infinitely.
Reflect iterator reuse via Rewind() method.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-07 14:52:33 +00:00
Alexander Chuprov
033eaf77e1 [#496] node: Fix linter importas 
Standardize the alias of the
import frostfs-sdk-go/object as objectSDK.

Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-07-06 15:36:41 +03:00
Anton Nikiforov
b520a3049e [#483] cli: Fix object put cmd with flag --prepare-locally 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-04 18:58:26 +03:00
Anton Nikiforov
4c248d573e [#483] cli: Allow to split object on the client side 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-03 18:31:46 +03:00
Anton Nikiforov
90e9a85acc [#483] Update dependencies 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-03 15:44:59 +03:00
Alejandro Lopez
f9730f090d [#92] Refactor policer and add some unit tests 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-03 07:05:31 +00:00
Dmitrii Stepanov
0c5b025788 [#470] grpc: Increase message limits 
For send message limit set to 2GiB, but there are custom
GET/GET RANGE limiters.
For receive message limit set to 256 MiB, but actual chunk size
will be managed by client.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-30 16:32:15 +03:00
Evgenii Stratonikov
8a4e250dae [#468] *: replace outdated TODO crypto-related links 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
73a71a71b0 [#1] node: Use a proper validation of a substorage type 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov
f4c71cea65 [#1] *: Replace outdated FIXME/TODO links 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Dmitrii Stepanov
cac4ed93d6 [#428] engine: Add low_mem config parameter 
Concurrent initialization in case of the metabase resync leads to
high memory consumption and potential OOM.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 13:29:39 +00:00
Dmitrii Stepanov
72fedff7ad [#426] cli: Add object nodes command 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 07:41:34 +00:00
Anton Nikiforov
ab489265b3 [#449] cli: Allow to exec tree get-by-path without bearer token 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Anton Nikiforov
71889234b7 [#449] tree: Allow reading requests signed by keys from allow list 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Evgenii Stratonikov
167a67f0b8 [#460] services/util: Remove HandleUnaryRequest 
There is no need in a wrapper with many from-`interface{}` conversions.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-21 17:07:56 +03:00
Dmitrii Stepanov
b5d9f4a285 [#373] metrics: Add pilorama metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
e89fa110c7 [#373] metrics: Add metabase metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
af608da952 [#373] metrics: Add blobovnizca metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov
56f320dd85 [#373] metrics: Add blobstor metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00