TrueCloudLab
/
frostfs-node
18
1
Fork 21
Code Issues 89 Pull Requests 7 Actions Releases Activity
4,069 Commits
7 Branches
23 Tags
48 MiB
Commit Graph

1442 Commits (dbd816d6c64142fceba06db7c869e74bf4a682d4)

Author SHA1 Message Date
Airat Arifullin dbd816d6c6 [#591] cli: fix SDK PrmContainerDelete usage for DeleteContainerPrm
Build / Build Components (1.20) (pull_request) Failing after 4s Details
Tests and linters / Lint (pull_request) Failing after 4s Details
Tests and linters / Tests (1.20) (pull_request) Failing after 4s Details
Tests and linters / Tests with -race (pull_request) Failing after 3s Details
Tests and linters / Staticcheck (pull_request) Failing after 3s Details
Vulncheck / Vulncheck (pull_request) Failing after 3s Details
Build / Build Components (1.21) (pull_request) Successful in 10m38s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 17m28s Details 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-08-10 13:40:19 +03:00
Evgenii Stratonikov c3c0574e3c [#589] cli: Add `control shards evacuate` command 
It was accidentally removed in f7c0b50d70.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 09:06:06 +00:00
Alejandro Lopez 5b7e4a51b7 [#481] Update frostfs-sdk-go and error pointer receivers 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-09 10:26:53 +00:00
Alejandro Lopez ae322e9f73 [#576] Set SyncWrites for badger writecache by default
Build / Build Components (1.19) (pull_request) Failing after 3s Details
Build / Build Components (1.20) (pull_request) Failing after 2s Details
Tests and linters / Tests (1.19) (pull_request) Failing after 3s Details
Tests and linters / Tests with -race (pull_request) Failing after 3s Details
Tests and linters / Lint (pull_request) Failing after 12s Details
Tests and linters / Staticcheck (pull_request) Failing after 3s Details
Vulncheck / Vulncheck (pull_request) Successful in 5m46s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 11m37s Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-09 11:28:26 +03:00
Evgenii Stratonikov d3a52ec73a [#516] node: Send bootstrap request if attributes were updated 
Consider following situation:
1. Epoch tick.
2. Update node attributes in the config.
3. Restart node.

Because we already sent bootstrap query after (1) and we are still
online, new bootstrap query won't be sent. This leads to the node
attributes being updated after another epoch.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-08 07:40:26 +00:00
Alejandro Lopez 5bbfebba2d [#570] Fix writecache type constant copy-pasta bug
Build / Build Components (1.19) (pull_request) Failing after 3s Details
Build / Build Components (1.20) (pull_request) Failing after 3s Details
Tests and linters / Lint (pull_request) Failing after 4s Details
Tests and linters / Tests (1.19) (pull_request) Failing after 3s Details
Tests and linters / Tests (1.20) (pull_request) Failing after 3s Details
Tests and linters / Tests with -race (pull_request) Failing after 3s Details
Tests and linters / Staticcheck (pull_request) Failing after 3s Details
Vulncheck / Vulncheck (pull_request) Failing after 3s Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-07 12:06:44 +03:00
Alejandro Lopez 1a0cb0f34a [#421] Try using badger for the write-cache 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-07 08:16:57 +00:00
Airat Arifullin 93c46cfdf0 [#550] cli: make get-op-log meta pretty formatted 
Close #550

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-02 10:27:15 +00:00
Airat Arifullin 1b7b54ba89 [#540] cli: refactor client parameters usage 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-02 09:44:51 +00:00
Anton Nikiforov ec8a631d31 [#542] Update test for `SizeInBytesSafe` function 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-01 13:38:00 +00:00
Anton Nikiforov 9ca63ac8c3 [#542] Fix bug in `SizeInBytesSafe` function 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-01 13:38:00 +00:00
Dmitrii Stepanov 32c77f3a23 [#537] node: Add runtime.memory_limit config parameter
Build / Build Components (1.20) (pull_request) Successful in 4m6s Details
Build / Build Components (1.19) (pull_request) Successful in 4m18s Details
ci/woodpecker/pr/pre-commit Pipeline failed Details
Tests and linters / Lint (pull_request) Failing after 2m10s Details
Tests and linters / Tests with -race (pull_request) Has started running Details
Tests and linters / Tests (1.19) (pull_request) Successful in 3m58s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 3m44s Details
Vulncheck / Vulncheck (pull_request) Failing after 3m51s Details
Tests and linters / Staticcheck (pull_request) Successful in 8m3s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
This parameter allows to set soft memory limit for Go GC.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-25 17:27:09 +03:00
Evgenii Stratonikov fef172c5b0 [#6] services/util: Simplify `response.Service` 
It has only 1 parameter, which is obligatory.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-21 18:29:57 +03:00
Alejandro Lopez 57e7fb5ccf [#521] cli: Add common aliases to policy playground commands
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-19 11:34:08 +00:00
Alejandro Lopez 24dffdac6f [#521] cli: Add netmap load command to policy playground 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-19 11:34:08 +00:00
Alejandro Lopez a9d04ba86f [#244] Remove --local-dump from frostfs-adm config
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-18 13:51:25 +00:00
Alejandro Lopez 4680087711 [#527] Add support for select-filter expressions in policy playground
ci/woodpecker/push/pre-commit Pipeline failed Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-18 13:15:58 +00:00
Dmitrii Stepanov f0355a453e [#463] policer: Remove capacity rebalance logic
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Current implementation has some quirks. For example,
using only half of object.put.pool_size_remote threads
tells replicator that is node is 50% loaded,
but in reality we could be putting lot's of big objects.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-18 10:52:12 +00:00
Dmitrii Stepanov b2487e8cc5 [#516] node: Do not bootstrap if node is online candidate
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-18 10:51:02 +00:00
Dmitrii Stepanov a0c7045f29 [#512] cli: Refactor UX for bearer create command
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Build / Build Components (1.19) (pull_request) Successful in 3m56s Details
Tests and linters / Lint (pull_request) Successful in 3m9s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 5m27s Details
Build / Build Components (1.20) (pull_request) Successful in 9m25s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m57s Details
Tests and linters / Tests with -race (pull_request) Successful in 5m13s Details
Tests and linters / Staticcheck (pull_request) Successful in 10m30s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-17 11:45:27 +03:00
Dmitrii Stepanov d8e37a827f [#497] config: Add examples and unit tests
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Add examples and unit tests for tree.authorized_keys section.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-17 08:23:28 +00:00
Denis Kirillov 486287c2f7 [#524] cli: Add impersonate flag for bearer token creation
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-07-17 08:20:50 +00:00
Dmitrii Stepanov c83e7c875f [#294] searchsvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov e8091101c7 [#294] searchsvc: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov ec9b738465 [#294] putsvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov 800a685e84 [#294] putsvc: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov 1420b8b9ea [#294] deletesvc: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov a476d8285a [#294] deletesvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov 70a1081988 [#294] aclsvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov 61541eaec2 [#294] aclsvc: Refactor checker constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Airat Arifullin 0754e6e654 [#390] cli: Fix bearer token reading for tree subcommands
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Airat Arifullin 676a3efa79 [#390] cli: Make tree commands errors and messages more verbose 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Airat Arifullin c42db4e761 [#390] cli: Support more tree service API calls in CLI 
* Support healthcheck API call
* Support move API call
* Support remove API call
* Support getSubtree API call
* Support getOpLog API call

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Dmitrii Stepanov 7b76527759 [#486] node: Add PutSingle wrappers 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-10 15:49:21 +03:00
Dmitrii Stepanov 040a623d39 [#476] cli: Fix `object nodes` command
Build / Build Components (1.20) (pull_request) Successful in 3m56s Details
Build / Build Components (1.19) (pull_request) Successful in 4m18s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Lint (pull_request) Failing after 7m27s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 7m45s Details
Tests and linters / Tests with -race (pull_request) Successful in 7m40s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 14m7s Details
Tests and linters / Staticcheck (pull_request) Successful in 13m37s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Do not fail if client creation failed.
Use external addresses to create the client too.
Use public key as node ID.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-10 09:58:31 +03:00
Evgenii Stratonikov e858479a74 [#498] policer: Explicitly Rewind() iterator after finish 
Previously, we can continue to return `EndOfListing` infinitely.
Reflect iterator reuse via Rewind() method.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-07 14:52:33 +00:00
Alexander Chuprov 033eaf77e1 [#496] node: Fix linter importas
Build / Build Components (1.20) (pull_request) Successful in 3m52s Details
Build / Build Components (1.19) (pull_request) Successful in 4m1s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Tests with -race (pull_request) Successful in 5m36s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m55s Details
Tests and linters / Lint (pull_request) Successful in 14m40s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 15m29s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Standardize the alias of the
import frostfs-sdk-go/object as objectSDK.

Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-07-06 15:36:41 +03:00
Anton Nikiforov b520a3049e [#483] cli: Fix `object put` cmd with flag `--prepare-locally`
Build / Build Components (1.20) (pull_request) Successful in 3m31s Details
Build / Build Components (1.19) (pull_request) Successful in 3m46s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Tests with -race (pull_request) Successful in 5m2s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m28s Details
Tests and linters / Lint (pull_request) Successful in 9m28s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 13m46s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-04 18:58:26 +03:00
Anton Nikiforov 4c248d573e [#483] cli: Allow to split object on the client side
Build / Build Components (1.20) (pull_request) Successful in 3m50s Details
Build / Build Components (1.19) (pull_request) Successful in 4m2s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Lint (pull_request) Successful in 8m50s Details
Tests and linters / Tests with -race (pull_request) Successful in 5m16s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 6m10s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 13m36s Details
ci/woodpecker/push/pre-commit Pipeline failed Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-03 18:31:46 +03:00
Anton Nikiforov 90e9a85acc [#483] Update dependencies 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-03 15:44:59 +03:00
Alejandro Lopez f9730f090d [#92] Refactor policer and add some unit tests 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-03 07:05:31 +00:00
Dmitrii Stepanov 0c5b025788 [#470] grpc: Increase message limits
Build / Build Components (1.19) (pull_request) Successful in 3m27s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Build / Build Components (1.20) (pull_request) Successful in 3m25s Details
Tests and linters / Lint (pull_request) Successful in 2m15s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 2m51s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m54s Details
Tests and linters / Tests with -race (pull_request) Successful in 6m31s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
For send message limit set to 2GiB, but there are custom
GET/GET RANGE limiters.
For receive message limit set to 256 MiB, but actual chunk size
will be managed by client.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-30 16:32:15 +03:00
Evgenii Stratonikov 8a4e250dae [#468] *: replace outdated TODO crypto-related links
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov 73a71a71b0 [#1] node: Use a proper validation of a substorage type 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov f4c71cea65 [#1] *: Replace outdated FIXME/TODO links 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Dmitrii Stepanov cac4ed93d6 [#428] engine: Add low_mem config parameter 
Concurrent initialization in case of the metabase resync leads to
high memory consumption and potential OOM.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 13:29:39 +00:00
Dmitrii Stepanov 72fedff7ad [#426] cli: Add object nodes command
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 07:41:34 +00:00
Anton Nikiforov ab489265b3 [#449] cli: Allow to exec `tree get-by-path` without bearer token
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Anton Nikiforov 71889234b7 [#449] tree: Allow reading requests signed by keys from allow list 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Evgenii Stratonikov 167a67f0b8 [#460] services/util: Remove `HandleUnaryRequest` 
There is no need in a wrapper with many from-`interface{}` conversions.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-21 17:07:56 +03:00