dstepanov-yadro/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
5333 commits 282 branches 26 tags 24 MiB
Commit graph

1960 commits

Author SHA1 Message Date
Dmitrii Stepanov
92a67a6716
[#1636] qos: Add Limiter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:26 +03:00
Dmitrii Stepanov
98d6125029
[#1636] config: Add shard.limits config 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:25 +03:00
Aleksey Savchuk
c660271039
[#1658] node: Validate RPC limiter configuration 
Validate that configured limits match the methods registered earlier.

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 16:31:47 +03:00
Aleksey Savchuk
92ab58984b
[#1658] node: Simplify RPC limiter initialization 
- Move all initialization logic to one place
- Initialize the limiter after all RPC services are registered to be able
  to validate that configured limits match the methods registered earlier

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 16:24:33 +03:00
Aleksey Savchuk
dae0949f6e [#1639] node: Support active RPC limiting 
- Allow configuration of active RPC limits for method groups
- Apply RPC limiting for all services except the control service

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Aleksey Savchuk
dce269c62e [#1639] services/object: Remove limiting pools for Put operation 
Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Aleksey Savchuk
a97bded440 [#1639] config: Separate replicator.pool_size from other settings 
Separated `replicator.pool_size` and `object.put.remote_pool_size` settings.

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Alexander Chuprov
2ff032db90 [#1654] adm: Get 'gasInitialTotalSupply' from network 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-27 11:57:45 +00:00
Alexander Chuprov
37972a91c1 [#1654] adm: Make 'morph-init' idempotent 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-27 11:57:45 +00:00
Alexander Chuprov
b2adf1109e
[#1646] cli: Use Cmp() functions for ID-like structs 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-20 12:27:07 +03:00
Alexander Chuprov
304bee938b
[#1614] adm/nns: Add 'set-admin' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-11 12:00:51 +03:00
Alexander Chuprov
b2163ff44c
[#1614] adm: Allow use any wallets 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-11 12:00:25 +03:00
Alexander Chuprov
076952f4c7
[#1614] adm/frostfsid: Add 'delete-kv' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-10 15:28:29 +03:00
Alexander Chuprov
a7145ca9bf
[#1614] adm/frostfsid: Add 'set-kv' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-10 15:26:12 +03:00
Dmitrii Stepanov
0671c277db
[#1608] tree: Add IO tag for tree sync requests 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:06 +03:00
Dmitrii Stepanov
fd0c6c461d
[#1608] cli: Drop redundant interceptors 
There is no metrics or IO tags in cli.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:05 +03:00
Dmitrii Stepanov
acec938b2d
[#1608] qos: Add client grpc interceptors 
`qos` client interceptors replace internal IO tags `writecache`,
`policer` and `background` with `internal` IO tag for outcomming RPC.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:04 +03:00
Dmitrii Stepanov
dc6aea7b79
[#1608] control: Use IO tag critical 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:04 +03:00
Dmitrii Stepanov
12da2f8262
[#1608] object: Add IO tag adjustment layer 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:03 +03:00
Dmitrii Stepanov
f6b3f79e89
[#1608] qos: Add qos service to adjust incoming IO tags 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:03 +03:00
Dmitrii Stepanov
9729f31e5c
[#1608] grpc: Add QoS interceptors for server and clients 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:41:06 +03:00
Dmitrii Stepanov
155f9eecb0
[#1608] config: Add QoS section and config 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:41:06 +03:00
Alexander Chuprov
9b113c3156
[#1613] morph: Add tracing for morph queries to neo-go 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-05 16:38:20 +03:00
Dmitrii Stepanov
78bfd12229
[#1622] adm: Return non zero return code if metabase upgrade failed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-30 15:31:25 +03:00
Ekaterina Lebedeva
a788d44773 [#1570] cli: Use array type for attributes parameters 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-01-28 11:15:30 +03:00
Ekaterina Lebedeva
603015d029 [#1570] cli: Use array type for --range parameter to object hash 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-01-28 11:15:30 +03:00
Evgenii Stratonikov
c98357606b
[#1606] Use slices.Clone()/bytes.Clone() where possible 
gopatch:
```
@@
var from, to expression
@@
+import "bytes"
-to := make([]byte, len(from))
-copy(to, from)
+to := bytes.Clone(from)

@@
var from, to expression
@@
+import "bytes"
-to = make([]byte, len(from))
-copy(to, from)
+to = bytes.Clone(from)

@@
var from, to, typ expression
@@
+import "slices"
-to := make([]typ, len(from))
-copy(to, from)
+to := slices.Clone(from)

@@
var from, to, typ expression
@@
+import "slices"
-to = make([]typ, len(from))
-copy(to, from)
+to = slices.Clone(from)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-17 14:50:14 +03:00
Alexander Chuprov
80de5d70bf [#1593] node: Fix initialization of ape_chain cache 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-01-17 08:58:47 +00:00
Dmitrii Stepanov
eff95bd632
[#1598] engine: Drop unnecessary result structs 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-14 11:15:21 +03:00
Dmitrii Stepanov
fb928616cc
[#1598] golangci: Enable unparam linter 
To drop unnecessary parameters and return values.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-14 09:06:47 +03:00
Dmitrii Stepanov
4d5ae59a52
[#1598] golangci: Enable unconvert linters 
To drop unnecessary conversions.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-14 09:06:40 +03:00
Alexander Chuprov
09faca034c
[#1593] node: Fix initialization of frostfsid cache 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-01-10 15:01:36 +03:00
Evgenii Stratonikov
f7e75b13b0 [#1506] ape_manager: Await tx persist before returning response 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 12:04:21 +00:00
Evgenii Stratonikov
198aaebc94 [#1506] morph: Simplify WaitTxHalt() signature 
Avoid dependency on `morph/client` package because of `InvokeRes`.
Make signature resemble `WaitAny()` method of `waiter.Waiter` from neo-go.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 12:04:21 +00:00
Evgenii Stratonikov
dc410fca90 [#1590] adm: Accept many accounts in proxy-* commands 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 07:51:54 +00:00
Evgenii Stratonikov
cddcd73f04 [#1590] adm: Make --account flag required in proxy-* commands 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 07:51:54 +00:00
Ekaterina Lebedeva
c0221d76e6 [#1577] node/container: Fix typo 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-12-28 12:05:01 +03:00
Ekaterina Lebedeva
242f0095d0 [#1577] container: Reduce iterations through container list 
* Separated iteration through container ids from `ContainersOf()`
  so that it could be reused.
* When listing containers we used to iterate through the
  the whole list of containers twice: first when reading from
  a contract, then when sending them. Now we can send batches
  of containers when reading from the contract.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-12-27 15:30:26 +03:00
Evgenii Stratonikov
ea868e09f8
[#1582] adm: Use int64 type and the default value for --till flag 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-25 14:22:28 +03:00
Evgenii Stratonikov
31d3d299bf
[#1582] adm: Unify promps for reading a password 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-25 14:22:28 +03:00
Evgenii Stratonikov
b5b4f78b49
[#1582] adm: Allow using the default account in deposit-notary 
It has never worked, actually.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-25 14:22:28 +03:00
Evgenii Stratonikov
e64871c3fd
[#1578] adm: Allow to transfer GAS to multiple recepients 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
303cd35a01
[#1578] adm: Remove unnecessary comments in RefillGasCmd 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
bb9ba1bce2
[#1578] adm: Remove bool flag from refillGas() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
db03742d33
[#1578] adm: Reword help message for morph refill-gas 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
148d68933b [#1573] node: Simplify bootstrapWithState() 
After #1382 we have no need to use lambdas.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-20 08:17:05 +00:00
Evgenii Stratonikov
e44b84c18c
[#1569] cli: Remove unnecessary variable after refactoring 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-18 10:17:04 +03:00
Evgenii Stratonikov
bed49e6ace
[#1569] cli: Make --range flag required in object hash 
Previously, `object head` was used if no range was provided.
This is wrong on multiple levels:
1. We print an error if the checksum is missing in header,
   even though taking hash is possible.
2. We silently ignore --salt parameter.
3. `--range` is required for Object.RANGEHASH RPC, custom logic for one
   specific usecase has no value.

So we make it required and make CLI command follow more closely
the FrostFS API.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-18 10:17:04 +03:00
Ekaterina Lebedeva
df05057ed4 [#1452] container: Add ListStream method 
* Added new method for listing containers to container service.
  It opens stream and sends containers in batches.

* Added TransportSplitter wrapper around ExecutionService to
  split container ID list read from contract in parts that are
  smaller than grpc max message size. Batch size can be changed
  in node configuration file (as in example config file).

* Changed `container list` implementaion in cli: now ListStream
  is called by default. Old List is called only if ListStream
  is not implemented.

* Changed `internalclient.ListContainersPrm`.`Account` to
  `OwnerID` since `client.PrmContainerList`.`Account` was
  renamed to `OwnerID` in sdk.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-12-17 16:22:43 +03:00
Ekaterina Lebedeva
b6c8ebf493 [#1453] container: Replace sort.Slice with slices.SortFunc 
* Replaced `sort.Slice` with `slices.SortFunc` in
  `ListContainersRes.SortedIDList()` as it is a bit faster,
  according to 15102e6dfd.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-12-17 13:33:43 +03:00