dstepanov-yadro/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
5343 commits 282 branches 26 tags 24 MiB
Commit graph

1962 commits

Author SHA1 Message Date
Dmitrii Stepanov
401d96a89e
[#1636] config: Refactor newConfig and oldConfig 
`newConfig` is actually target config to set config values from source
(which is called `oldConfig`).

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:29 +03:00
Dmitrii Stepanov
e0dc3c3d0c
[#1636] shard: Add limiter usage 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:26 +03:00
Dmitrii Stepanov
92a67a6716
[#1636] qos: Add Limiter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:26 +03:00
Dmitrii Stepanov
98d6125029
[#1636] config: Add shard.limits config 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:25 +03:00
Aleksey Savchuk
c660271039
[#1658] node: Validate RPC limiter configuration 
Validate that configured limits match the methods registered earlier.

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 16:31:47 +03:00
Aleksey Savchuk
92ab58984b
[#1658] node: Simplify RPC limiter initialization 
- Move all initialization logic to one place
- Initialize the limiter after all RPC services are registered to be able
  to validate that configured limits match the methods registered earlier

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 16:24:33 +03:00
Aleksey Savchuk
dae0949f6e [#1639] node: Support active RPC limiting 
- Allow configuration of active RPC limits for method groups
- Apply RPC limiting for all services except the control service

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Aleksey Savchuk
dce269c62e [#1639] services/object: Remove limiting pools for Put operation 
Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Aleksey Savchuk
a97bded440 [#1639] config: Separate replicator.pool_size from other settings 
Separated `replicator.pool_size` and `object.put.remote_pool_size` settings.

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Alexander Chuprov
2ff032db90 [#1654] adm: Get 'gasInitialTotalSupply' from network 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-27 11:57:45 +00:00
Alexander Chuprov
37972a91c1 [#1654] adm: Make 'morph-init' idempotent 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-27 11:57:45 +00:00
Alexander Chuprov
b2adf1109e
[#1646] cli: Use Cmp() functions for ID-like structs 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-20 12:27:07 +03:00
Alexander Chuprov
304bee938b
[#1614] adm/nns: Add 'set-admin' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-11 12:00:51 +03:00
Alexander Chuprov
b2163ff44c
[#1614] adm: Allow use any wallets 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-11 12:00:25 +03:00
Alexander Chuprov
076952f4c7
[#1614] adm/frostfsid: Add 'delete-kv' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-10 15:28:29 +03:00
Alexander Chuprov
a7145ca9bf
[#1614] adm/frostfsid: Add 'set-kv' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-10 15:26:12 +03:00
Dmitrii Stepanov
0671c277db
[#1608] tree: Add IO tag for tree sync requests 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:06 +03:00
Dmitrii Stepanov
fd0c6c461d
[#1608] cli: Drop redundant interceptors 
There is no metrics or IO tags in cli.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:05 +03:00
Dmitrii Stepanov
acec938b2d
[#1608] qos: Add client grpc interceptors 
`qos` client interceptors replace internal IO tags `writecache`,
`policer` and `background` with `internal` IO tag for outcomming RPC.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:04 +03:00
Dmitrii Stepanov
dc6aea7b79
[#1608] control: Use IO tag critical 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:04 +03:00
Dmitrii Stepanov
12da2f8262
[#1608] object: Add IO tag adjustment layer 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:03 +03:00
Dmitrii Stepanov
f6b3f79e89
[#1608] qos: Add qos service to adjust incoming IO tags 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:03 +03:00
Dmitrii Stepanov
9729f31e5c
[#1608] grpc: Add QoS interceptors for server and clients 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:41:06 +03:00
Dmitrii Stepanov
155f9eecb0
[#1608] config: Add QoS section and config 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:41:06 +03:00
Alexander Chuprov
9b113c3156
[#1613] morph: Add tracing for morph queries to neo-go 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-05 16:38:20 +03:00
Dmitrii Stepanov
78bfd12229
[#1622] adm: Return non zero return code if metabase upgrade failed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-30 15:31:25 +03:00
Ekaterina Lebedeva
a788d44773 [#1570] cli: Use array type for attributes parameters 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-01-28 11:15:30 +03:00
Ekaterina Lebedeva
603015d029 [#1570] cli: Use array type for --range parameter to object hash 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-01-28 11:15:30 +03:00
Evgenii Stratonikov
c98357606b
[#1606] Use slices.Clone()/bytes.Clone() where possible 
gopatch:
```
@@
var from, to expression
@@
+import "bytes"
-to := make([]byte, len(from))
-copy(to, from)
+to := bytes.Clone(from)

@@
var from, to expression
@@
+import "bytes"
-to = make([]byte, len(from))
-copy(to, from)
+to = bytes.Clone(from)

@@
var from, to, typ expression
@@
+import "slices"
-to := make([]typ, len(from))
-copy(to, from)
+to := slices.Clone(from)

@@
var from, to, typ expression
@@
+import "slices"
-to = make([]typ, len(from))
-copy(to, from)
+to = slices.Clone(from)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-17 14:50:14 +03:00
Alexander Chuprov
80de5d70bf [#1593] node: Fix initialization of ape_chain cache 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-01-17 08:58:47 +00:00
Dmitrii Stepanov
eff95bd632
[#1598] engine: Drop unnecessary result structs 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-14 11:15:21 +03:00
Dmitrii Stepanov
fb928616cc
[#1598] golangci: Enable unparam linter 
To drop unnecessary parameters and return values.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-14 09:06:47 +03:00
Dmitrii Stepanov
4d5ae59a52
[#1598] golangci: Enable unconvert linters 
To drop unnecessary conversions.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-14 09:06:40 +03:00
Alexander Chuprov
09faca034c
[#1593] node: Fix initialization of frostfsid cache 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-01-10 15:01:36 +03:00
Evgenii Stratonikov
f7e75b13b0 [#1506] ape_manager: Await tx persist before returning response 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 12:04:21 +00:00
Evgenii Stratonikov
198aaebc94 [#1506] morph: Simplify WaitTxHalt() signature 
Avoid dependency on `morph/client` package because of `InvokeRes`.
Make signature resemble `WaitAny()` method of `waiter.Waiter` from neo-go.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 12:04:21 +00:00
Evgenii Stratonikov
dc410fca90 [#1590] adm: Accept many accounts in proxy-* commands 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 07:51:54 +00:00
Evgenii Stratonikov
cddcd73f04 [#1590] adm: Make --account flag required in proxy-* commands 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-09 07:51:54 +00:00
Ekaterina Lebedeva
c0221d76e6 [#1577] node/container: Fix typo 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-12-28 12:05:01 +03:00
Ekaterina Lebedeva
242f0095d0 [#1577] container: Reduce iterations through container list 
* Separated iteration through container ids from `ContainersOf()`
  so that it could be reused.
* When listing containers we used to iterate through the
  the whole list of containers twice: first when reading from
  a contract, then when sending them. Now we can send batches
  of containers when reading from the contract.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-12-27 15:30:26 +03:00
Evgenii Stratonikov
ea868e09f8
[#1582] adm: Use int64 type and the default value for --till flag 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-25 14:22:28 +03:00
Evgenii Stratonikov
31d3d299bf
[#1582] adm: Unify promps for reading a password 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-25 14:22:28 +03:00
Evgenii Stratonikov
b5b4f78b49
[#1582] adm: Allow using the default account in deposit-notary 
It has never worked, actually.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-25 14:22:28 +03:00
Evgenii Stratonikov
e64871c3fd
[#1578] adm: Allow to transfer GAS to multiple recepients 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
303cd35a01
[#1578] adm: Remove unnecessary comments in RefillGasCmd 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
bb9ba1bce2
[#1578] adm: Remove bool flag from refillGas() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
db03742d33
[#1578] adm: Reword help message for morph refill-gas 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-23 11:17:22 +03:00
Evgenii Stratonikov
148d68933b [#1573] node: Simplify bootstrapWithState() 
After #1382 we have no need to use lambdas.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-20 08:17:05 +00:00
Evgenii Stratonikov
e44b84c18c
[#1569] cli: Remove unnecessary variable after refactoring 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-18 10:17:04 +03:00
Evgenii Stratonikov
bed49e6ace
[#1569] cli: Make --range flag required in object hash 
Previously, `object head` was used if no range was provided.
This is wrong on multiple levels:
1. We print an error if the checksum is missing in header,
   even though taking hash is possible.
2. We silently ignore --salt parameter.
3. `--range` is required for Object.RANGEHASH RPC, custom logic for one
   specific usecase has no value.

So we make it required and make CLI command follow more closely
the FrostFS API.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-12-18 10:17:04 +03:00