realloc/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Releases Packages Activity
5401 commits 1 branch 26 tags 15 MiB
Commit graph

1982 commits

Author SHA1 Message Date
Evgenii Stratonikov
e7e91ef634 [#1689] adm: Remove storagecfg subcommand 
It is unused and unsupported for a long time.

Change-Id: I570567db4e8cb202e41286064406ad85cd0e7a39
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-03-21 15:05:02 +00:00
Aleksey Savchuk
4919b6a206
[#1689] node/config: Allow zero max_ops in RPC limits config 
The limiter allows zeros for limits, meaning "this operation is
disabled".  However, the config didn't allow zero due to the lack of
distinction between "no value" and "zero" - cast functions read both
`nil` and zero as zero.

Now, the config allows a zero limit. Added tests.

Managing such cases should be easier after #1610.

Change-Id: Ifc840732390b2feb975f230573b34bf479406e05
Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-03-21 17:00:40 +03:00
Dmitrii Stepanov
5385f9994f
[#1695] mod: Bump frostfs-observability version 
Change-Id: Id362b71f743ff70c8cd374030c9fa67e2566022f
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-03-21 13:28:02 +03:00
Anton Nikiforov
049a650b89 [#1619] logger: Simplify logger config reloading 
Change-Id: Ide892b250304b8cdb6c279f5f728c3b35f05df54
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2025-03-21 09:03:54 +00:00
Alexander Chuprov
fc743cc537
[#1684] cli: Correct description of control shards writecache seal 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-03-18 10:56:30 +03:00
Dmitrii Stepanov
fde2649e60 [#1678] adm: Fix frostfs-adm morph list-subjects & list-group-subjects 
`include-names` for `list-subjects` returns error `invalid response subject struct`
because `ListSubjects` returns only subject addresses (see frostfs-contract).

Replace `include-names` with `extended` as now all subject info printed.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-03-14 13:42:29 +00:00
Dmitrii Stepanov
07a660fbc4
[#1677] writecache: Add QoS limiter usage 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-03-14 16:23:33 +03:00
Alexander Chuprov
997759994a
[#1676] golangci: Enable gci linter 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-03-13 12:04:01 +03:00
Evgenii Stratonikov
ecb6b0793c [#1671] Use slices.ContainsFunc() where possible 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-03-13 08:12:20 +00:00
Evgenii Stratonikov
460e5cbccf [#1671] Use slices.Delete() where possible 
gopatch is missing for this one, because
https://github.com/uber-go/gopatch/issues/179

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-03-13 08:12:20 +00:00
Evgenii Stratonikov
40536d8a06 [#1671] Use fmt.Appendf where warranted 
Fix gopls warnings:
```
cmd/frostfs-adm/internal/modules/morph/config/config.go:68:20-64: Replace []byte(fmt.Sprintf...) with fmt.Appendf
````

gopatch:
```
@@
var f expression
@@
-[]byte(fmt.Sprintf(f, ...))
+fmt.Appendf(nil, f, ...)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-03-13 08:12:20 +00:00
Evgenii Stratonikov
d66bffb191 [#1671] Use max builtin where possible 
gopatcH:
```
@@
var d, a expression
@@
-if d < a {
-    d = a
-}
-return d
+return max(d, a)

@@
var d, a expression
@@
-if d <= a {
-    d = a
-}
-return d
+return max(d, a)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-03-13 08:12:20 +00:00
Dmitrii Stepanov
2005fdda09
[#1667] shard: Drop shard pool 
After adding an ops limiter, shard's `put` pool is redundant.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-03-11 13:59:51 +03:00
Dmitrii Stepanov
3727d60331 [#1653] qos: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-03-11 10:57:47 +00:00
Dmitrii Stepanov
d36afa31c7 [#1653] qos: Fix logging 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-03-11 10:57:47 +00:00
Ekaterina Lebedeva
df6d9da82a [#1635] cli: Add command to get object's shard info 
Added `frostfs-cli object locate` subcommand. It lists info
about shards storing an object.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-03-07 14:32:01 +03:00
Ekaterina Lebedeva
aab8addae0 [#1635] cli: Make object.readObjectAddress() public 
This method will be useful for upcoming control command.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-03-07 14:32:01 +03:00
Evgenii Stratonikov
6260d703ce
[#1665] treesvc: Disable service config query 
By default, gRPC fetches TXT report while resolving a domain.
0914bba6c5/internal/resolver/dns/dns_resolver.go (L336)

This leads to a hanging dial if DNS is unavailable, even though the host
may be specified in `/etc/hosts` (hello, localhost!).

SDK client for the main API uses these options by default.

Refs TrueCloudLab/frostfs-sdk-go#342

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-03-06 15:15:31 +03:00
Aleksey Savchuk
bf8914fedc [#1416] lens/explorer: Support metabase schema v3 
Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-03-05 07:20:05 +00:00
Evgenii Stratonikov
5ba0e2918e
[#1661] cli: Clarify --rpc-endpoint values 
`multiaddr` is not something an average user knows. Personally, I have
never used it in CLI. On the other hand, we need to connect with TLS quite often,
so it needs to be mentioned in help.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-03-04 10:19:49 +03:00
Dmitrii Stepanov
401d96a89e
[#1636] config: Refactor newConfig and oldConfig 
`newConfig` is actually target config to set config values from source
(which is called `oldConfig`).

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:29 +03:00
Dmitrii Stepanov
e0dc3c3d0c
[#1636] shard: Add limiter usage 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:26 +03:00
Dmitrii Stepanov
92a67a6716
[#1636] qos: Add Limiter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:26 +03:00
Dmitrii Stepanov
98d6125029
[#1636] config: Add shard.limits config 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-28 17:25:25 +03:00
Aleksey Savchuk
c660271039
[#1658] node: Validate RPC limiter configuration 
Validate that configured limits match the methods registered earlier.

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 16:31:47 +03:00
Aleksey Savchuk
92ab58984b
[#1658] node: Simplify RPC limiter initialization 
- Move all initialization logic to one place
- Initialize the limiter after all RPC services are registered to be able
  to validate that configured limits match the methods registered earlier

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 16:24:33 +03:00
Aleksey Savchuk
dae0949f6e [#1639] node: Support active RPC limiting 
- Allow configuration of active RPC limits for method groups
- Apply RPC limiting for all services except the control service

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Aleksey Savchuk
dce269c62e [#1639] services/object: Remove limiting pools for Put operation 
Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Aleksey Savchuk
a97bded440 [#1639] config: Separate replicator.pool_size from other settings 
Separated `replicator.pool_size` and `object.put.remote_pool_size` settings.

Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
 2025-02-28 11:08:09 +00:00
Alexander Chuprov
2ff032db90 [#1654] adm: Get 'gasInitialTotalSupply' from network 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-27 11:57:45 +00:00
Alexander Chuprov
37972a91c1 [#1654] adm: Make 'morph-init' idempotent 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-27 11:57:45 +00:00
Alexander Chuprov
b2adf1109e
[#1646] cli: Use Cmp() functions for ID-like structs 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-20 12:27:07 +03:00
Alexander Chuprov
304bee938b
[#1614] adm/nns: Add 'set-admin' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-11 12:00:51 +03:00
Alexander Chuprov
b2163ff44c
[#1614] adm: Allow use any wallets 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-11 12:00:25 +03:00
Alexander Chuprov
076952f4c7
[#1614] adm/frostfsid: Add 'delete-kv' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-10 15:28:29 +03:00
Alexander Chuprov
a7145ca9bf
[#1614] adm/frostfsid: Add 'set-kv' 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-10 15:26:12 +03:00
Dmitrii Stepanov
0671c277db
[#1608] tree: Add IO tag for tree sync requests 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:06 +03:00
Dmitrii Stepanov
fd0c6c461d
[#1608] cli: Drop redundant interceptors 
There is no metrics or IO tags in cli.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:05 +03:00
Dmitrii Stepanov
acec938b2d
[#1608] qos: Add client grpc interceptors 
`qos` client interceptors replace internal IO tags `writecache`,
`policer` and `background` with `internal` IO tag for outcomming RPC.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:04 +03:00
Dmitrii Stepanov
dc6aea7b79
[#1608] control: Use IO tag critical 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:04 +03:00
Dmitrii Stepanov
12da2f8262
[#1608] object: Add IO tag adjustment layer 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:03 +03:00
Dmitrii Stepanov
f6b3f79e89
[#1608] qos: Add qos service to adjust incoming IO tags 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:43:03 +03:00
Dmitrii Stepanov
9729f31e5c
[#1608] grpc: Add QoS interceptors for server and clients 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:41:06 +03:00
Dmitrii Stepanov
155f9eecb0
[#1608] config: Add QoS section and config 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-02-07 15:41:06 +03:00
Alexander Chuprov
9b113c3156
[#1613] morph: Add tracing for morph queries to neo-go 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-02-05 16:38:20 +03:00
Dmitrii Stepanov
78bfd12229
[#1622] adm: Return non zero return code if metabase upgrade failed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-01-30 15:31:25 +03:00
Ekaterina Lebedeva
a788d44773 [#1570] cli: Use array type for attributes parameters 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-01-28 11:15:30 +03:00
Ekaterina Lebedeva
603015d029 [#1570] cli: Use array type for --range parameter to object hash 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2025-01-28 11:15:30 +03:00
Evgenii Stratonikov
c98357606b
[#1606] Use slices.Clone()/bytes.Clone() where possible 
gopatch:
```
@@
var from, to expression
@@
+import "bytes"
-to := make([]byte, len(from))
-copy(to, from)
+to := bytes.Clone(from)

@@
var from, to expression
@@
+import "bytes"
-to = make([]byte, len(from))
-copy(to, from)
+to = bytes.Clone(from)

@@
var from, to, typ expression
@@
+import "slices"
-to := make([]typ, len(from))
-copy(to, from)
+to := slices.Clone(from)

@@
var from, to, typ expression
@@
+import "slices"
-to = make([]typ, len(from))
-copy(to, from)
+to = slices.Clone(from)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2025-01-17 14:50:14 +03:00
Alexander Chuprov
80de5d70bf [#1593] node: Fix initialization of ape_chain cache 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2025-01-17 08:58:47 +00:00