354 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	5b6cba04cb	[#1689] node: Drop node.relay config ... It is not used and not tested properly, so drop it. Change-Id: I7c90c7391ecb4be17459415d209811ba1a693f7a Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-04-23 12:43:52 +03:00
Alexander Chuprov	6567ceaf13	[#1702] tree: Support reloading 'tree.authorized_keys' on SIGHUP ... Allows updating the list of public keys authorized to invoke 'Tree service' operations without restarting the node. Change-Id: I01b6e05875b7ae3f3218062eb12bf9755e87f2a3 Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2025-04-18 10:41:46 +03:00
Anton Nikiforov	100eb8b654	[#1619] logger: Set tags for node components ... Change-Id: I55ffcce9d2a74fdd47621674739b07f2e20199e3 Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2025-04-16 13:07:51 +03:00
Ekaterina Lebedeva	a285d8924f	[#1693] node: Replace conditional panics with asserts ... Change-Id: I5024705fd1693d00cb9241235030a73984c2a7e1 Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2025-04-15 16:28:43 +00:00
Dmitrii Stepanov	0ee7467da5	[#1715] config: Add compression config section ... To group all `compression_*` parameters together. Change-Id: I11ad9600f731903753fef1adfbc0328ef75bbf87 Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-04-15 15:05:50 +00:00
Dmitrii Stepanov	98308d0cad	[#1715] blobstor: Allow to specify custom compression level ... Change-Id: I140c39b9dceaaeb58767061b131777af22242b19 Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-04-15 15:05:39 +00:00
Evgenii Stratonikov	2d1232ce6d	[#1689] network,core/netmap: Replace Iterate*() functions with iterators ... Change-Id: I4842a3160d74c56d99ea9465d4be2f0662080605 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-04-15 14:47:32 +00:00
Evgenii Stratonikov	bf06c4fb4b	[#1689] Remove deprecated NodeInfo.IterateNetworkEndpoints() ... Change-Id: Ic78f18aed11fab34ee3147ceea657296b89fe60c Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-04-15 14:47:22 +00:00
Anton Nikiforov	56d09a9957	[#1640] object: Add priority metric based on geo distance ... Change-Id: I3a7ea4fc4807392bf50e6ff1389c61367c953074 Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2025-04-15 13:35:28 +00:00
Dmitrii Stepanov	e80632884a	[#1700] config: Drop redundant check ... Target config created on level above, so limiter is always nil. Change-Id: I1896baae5b9ddeed339a7d2b022a9a886589d362 Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-04-14 14:35:15 +03:00
Dmitrii Stepanov	5aaa3df533	[#1700] config: Move config struct to qos package ... Change-Id: Ie642fff5cd1702cda00425628e11f3fd8c514798 Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-04-14 14:35:14 +03:00
Anton Nikiforov	dfe2f9956a	[#1619] logger: Filter entries by tags provided in config ... Change-Id: Ia2a79d6cb2a5eb263fb2e6db3f9cf9f2a7d57118 Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2025-04-11 17:27:27 +03:00
Alexander Chuprov	6f7b6b65f3	[#1689] linter: Fix staticcheck warning: 'embedded field can be simplified' ... Change-Id: I8f454f7d09973cdea096495c3949b88cdd01102e Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2025-04-08 09:32:24 +00:00
Anton Nikiforov	50dccff7c1	[#1633] morph/netmap: Merge node info in netmap with candidates list ... Applicable for both cases: when node uses local cache for netmap and when it disabled. Change-Id: I3050f537e20312a4b39e944aca763b77bd1e74c4 Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2025-04-03 16:29:54 +03:00
Dmitrii Stepanov	a5bae6c5af	[#1699] qos: Allow to prohibit operations for IO tag ... Change-Id: I2bee26885244e241d224860978b6de3526527e96 Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-04-01 10:08:03 +03:00
Dmitrii Stepanov	632bd8e38d	[#1696] qos: Fix internal tag adjust ... If request has no tag, but request's public key is netmap node's key or one of allowed internal tag keys from config, then request must use internal IO tag. Change-Id: Iff93b626941a81b088d8999b3f2947f9501dcdf8 Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-03-28 07:47:12 +00:00
Anton Nikiforov	3bbee1b554	[#1619] logger: Allow to set options for zap.Logger via logger.Prm ... Change-Id: I8eed951c25d1ecf18b0aea62c6825be65a450085 Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2025-03-27 15:41:37 +03:00
Airat Arifullin	ccdd6cb767	[#1052] object: Nuke out acl middleware ... * Remove `acl` package as it's no longer used; * Remove `RequestContext`; * Fix `cmd/frostfs-node`. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2025-03-23 06:39:32 +00:00
Airat Arifullin	73e35bc885	[#1052] object: Make ape middleware form request info ... * Move some helpers from `acl/v2` package to `ape`. Also move errors; * Introduce `Metadata`, `RequestInfo` types; * Introduce `RequestInfoExtractor` interface and its implementation. The extractor's purpose is to extract request info based on request metadata. It also validates session token; * Refactor ape service - each handler forms request info and pass necessary fields to checker. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2025-03-23 06:39:32 +00:00
Evgenii Stratonikov	30099194ba	[#1689] config: Remove testnet and mainnet configs ... They are invalid and unsupported. There is neither mainnet nor testnet currently. Change-Id: I520363e2de0c22a584238accc253248be3eefea5 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-03-21 15:07:02 +00:00
Aleksey Savchuk	4919b6a206	[#1689] node/config: Allow zero max_ops in RPC limits config ... The limiter allows zeros for limits, meaning "this operation is disabled". However, the config didn't allow zero due to the lack of distinction between "no value" and "zero" - cast functions read both `nil` and zero as zero. Now, the config allows a zero limit. Added tests. Managing such cases should be easier after #1610. Change-Id: Ifc840732390b2feb975f230573b34bf479406e05 Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2025-03-21 17:00:40 +03:00
Anton Nikiforov	049a650b89	[#1619] logger: Simplify logger config reloading ... Change-Id: Ide892b250304b8cdb6c279f5f728c3b35f05df54 Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2025-03-21 09:03:54 +00:00
Dmitrii Stepanov	07a660fbc4	[#1677] writecache: Add QoS limiter usage ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-03-14 16:23:33 +03:00
Evgenii Stratonikov	d66bffb191	[#1671] Use max builtin where possible ... gopatcH: ``` @@ var d, a expression @@ -if d < a { - d = a -} -return d +return max(d, a) @@ var d, a expression @@ -if d <= a { - d = a -} -return d +return max(d, a) ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-03-13 08:12:20 +00:00
Dmitrii Stepanov	2005fdda09	[#1667] shard: Drop shard pool ... After adding an ops limiter, shard's `put` pool is redundant. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-03-11 13:59:51 +03:00
Dmitrii Stepanov	3727d60331	[#1653] qos: Add metrics ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-03-11 10:57:47 +00:00
Dmitrii Stepanov	d36afa31c7	[#1653] qos: Fix logging ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-03-11 10:57:47 +00:00
Dmitrii Stepanov	401d96a89e	[#1636] config: Refactor newConfig and oldConfig ... `newConfig` is actually target config to set config values from source (which is called `oldConfig`). Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-28 17:25:29 +03:00
Dmitrii Stepanov	e0dc3c3d0c	[#1636] shard: Add limiter usage ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-28 17:25:26 +03:00
Dmitrii Stepanov	92a67a6716	[#1636] qos: Add Limiter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-28 17:25:26 +03:00
Dmitrii Stepanov	98d6125029	[#1636] config: Add shard.limits config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-28 17:25:25 +03:00
Aleksey Savchuk	c660271039	[#1658] node: Validate RPC limiter configuration ... Validate that configured limits match the methods registered earlier. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2025-02-28 16:31:47 +03:00
Aleksey Savchuk	92ab58984b	[#1658] node: Simplify RPC limiter initialization ... - Move all initialization logic to one place - Initialize the limiter after all RPC services are registered to be able to validate that configured limits match the methods registered earlier Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2025-02-28 16:24:33 +03:00
Aleksey Savchuk	dae0949f6e	[#1639] node: Support active RPC limiting ... - Allow configuration of active RPC limits for method groups - Apply RPC limiting for all services except the control service Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2025-02-28 11:08:09 +00:00
Aleksey Savchuk	dce269c62e	[#1639] services/object: Remove limiting pools for Put operation ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2025-02-28 11:08:09 +00:00
Aleksey Savchuk	a97bded440	[#1639] config: Separate replicator.pool_size from other settings ... Separated `replicator.pool_size` and `object.put.remote_pool_size` settings. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2025-02-28 11:08:09 +00:00
Dmitrii Stepanov	0671c277db	[#1608] tree: Add IO tag for tree sync requests ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-07 15:43:06 +03:00
Dmitrii Stepanov	acec938b2d	[#1608] qos: Add client grpc interceptors ... `qos` client interceptors replace internal IO tags `writecache`, `policer` and `background` with `internal` IO tag for outcomming RPC. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-07 15:43:04 +03:00
Dmitrii Stepanov	dc6aea7b79	[#1608] control: Use IO tag critical ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-07 15:43:04 +03:00
Dmitrii Stepanov	12da2f8262	[#1608] object: Add IO tag adjustment layer ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-07 15:43:03 +03:00
Dmitrii Stepanov	f6b3f79e89	[#1608] qos: Add qos service to adjust incoming IO tags ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-07 15:43:03 +03:00
Dmitrii Stepanov	9729f31e5c	[#1608] grpc: Add QoS interceptors for server and clients ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-07 15:41:06 +03:00
Dmitrii Stepanov	155f9eecb0	[#1608] config: Add QoS section and config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-02-07 15:41:06 +03:00
Alexander Chuprov	9b113c3156	[#1613] morph: Add tracing for morph queries to neo-go ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2025-02-05 16:38:20 +03:00
Evgenii Stratonikov	c98357606b	[#1606] Use slices.Clone()/bytes.Clone() where possible ... gopatch: ``` @@ var from, to expression @@ +import "bytes" -to := make([]byte, len(from)) -copy(to, from) +to := bytes.Clone(from) @@ var from, to expression @@ +import "bytes" -to = make([]byte, len(from)) -copy(to, from) +to = bytes.Clone(from) @@ var from, to, typ expression @@ +import "slices" -to := make([]typ, len(from)) -copy(to, from) +to := slices.Clone(from) @@ var from, to, typ expression @@ +import "slices" -to = make([]typ, len(from)) -copy(to, from) +to = slices.Clone(from) ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-01-17 14:50:14 +03:00
Alexander Chuprov	80de5d70bf	[#1593] node: Fix initialization of ape_chain cache ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2025-01-17 08:58:47 +00:00
Dmitrii Stepanov	eff95bd632	[#1598] engine: Drop unnecessary result structs ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-01-14 11:15:21 +03:00
Dmitrii Stepanov	fb928616cc	[#1598] golangci: Enable unparam linter ... To drop unnecessary parameters and return values. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-01-14 09:06:47 +03:00
Dmitrii Stepanov	4d5ae59a52	[#1598] golangci: Enable unconvert linters ... To drop unnecessary conversions. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-01-14 09:06:40 +03:00
Alexander Chuprov	09faca034c	[#1593] node: Fix initialization of frostfsid cache ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2025-01-10 15:01:36 +03:00