3417 commits

Author	SHA1	Message	Date
Airat Arifullin	7e542906ef	[#1539] go.mod: Bump frostfs-sdk-go version ... * Also fix placement unit-test in object manager Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-12-06 15:29:37 +03:00
Evgenii Stratonikov	d1bc4351c3	[#1545] morph/event: Simplify frostfs contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 14:00:23 +03:00
Evgenii Stratonikov	1c12f23b84	[#1541] morph/event: Simplify netmap contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 10:26:39 +00:00
Evgenii Stratonikov	a353d45742	[#1541] morph/event: Simplify container contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 10:26:39 +00:00
Evgenii Stratonikov	d5d5ce2074	[#1541] morph/event: Simplify balance contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 10:26:39 +00:00
Dmitrii Stepanov	7df3520d48	[#1540] getSvc: Drop redundant returns ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-05 12:39:49 +00:00
Dmitrii Stepanov	5fe78e51d1	[#1540] getSvc: Do not log context canceled errors during EC assemble ... Those errors are fired when it is enough chunks retrieved and error group cancels other requests. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-05 12:39:49 +00:00
Evgenii Stratonikov	84b4051b4d	[#1538] morph/container: Make opts struct similar to that of other contracts ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-04 15:30:58 +03:00
Evgenii Stratonikov	6a51086030	[#1538] morph/client: Remove TryNotary() option from side-chain contracts ... The notary is always enabled and this option does always work. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-04 15:30:58 +03:00
Evgenii Stratonikov	2d5d4093be	[#1537] morph: Use (user.ID).ScriptHash() where possible ... Pick up changes from TrueCloudLab/frostfs-sdk-go#198. gopatch: ``` @@ var user expression @@ -address.StringToUint160(user.EncodeToString()) +user.ScriptHash() ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-04 13:25:44 +03:00
Evgenii Stratonikov	e3487d5af5	[#1535] morph: Unify test invoke error messages ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-04 09:50:20 +00:00
Evgenii Stratonikov	e37dcdf88b	[#1535] morph/netmap: Unify error messages for config retrieval ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-04 09:50:20 +00:00
Evgenii Stratonikov	6c679d1535	[#1535] morph: Unify client creation error messages ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-04 09:50:20 +00:00
Aleksey Savchuk	281d65435e	[#1450] engine: Group object by shard before Inhume ... ``` goos: linux goarch: amd64 pkg: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/local_object_storage/engine cpu: 12th Gen Intel(R) Core(TM) i5-1235U │ old.txt │ new.txt │ │ sec/op │ sec/op vs base │ InhumeMultipart/objects=1-12 11.42m ± 1% 10.71m ± 0% -6.27% (p=0.000 n=10) InhumeMultipart/objects=10-12 113.5m ± 0% 100.9m ± 3% -11.08% (p=0.000 n=10) InhumeMultipart/objects=100-12 1135.4m ± 1% 681.3m ± 2% -40.00% (p=0.000 n=10) InhumeMultipart/objects=1000-12 11.358 ± 0% 1.089 ± 1% -90.41% (p=0.000 n=10) InhumeMultipart/objects=10000-12 113.251 ± 0% 1.645 ± 1% -98.55% (p=0.000 n=10) geomean 1.136 265.5m -76.63% ``` Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-04 10:09:00 +03:00
Aleksey Savchuk	b348b20289	[#1450] engine: Add benchmark for Inhume operation ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-04 10:08:34 +03:00
Aleksey Savchuk	748edd1999	[#1450] engine: Return shard-level error if object is expired on inhume ... Since we have errors defined on the shard-level, it looks strage that we check an error againt the shard-level error `ErrLockObjectRemoval`, but then return the metabase-level error. Let's return the same shard-level error instead. Since we have errors defined on the shard-level Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-04 10:06:57 +03:00
Aleksey Savchuk	432042c534	[#1527] engine: Add tests for handling expired objects on inhume and lock ... Currently, it's allowed to inhume or lock an expired object. Consider the following scenario: 1) An user inhumes or locks an object 2) The object expires 3) GC hasn't yet deleted the object 4) The node loses the associated tombstone or lock 5) Another node replicates tombstone or lock to the first node In this case, the second node succeeds, which is the desired behavior. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-03 12:29:45 +03:00
Aleksey Savchuk	9cabca9dfe	[#1527] engine/test: Move default metabase options to separate function ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-02 16:13:37 +03:00
Aleksey Savchuk	60feed3b5f	[#1527] engine/test: Allow to specify current epoch in epochState ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-02 15:37:25 +03:00
Anton Nikiforov	edfa3f4825	[#1528] node: Keep order for equal elements when sort priority metrics ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-12-02 13:58:19 +03:00
Aleksey Savchuk	e0ac3a583f	[#1523] metabase: Remove (*DB).IterateCoveredByTombstones ... Remove this method because it isn't used anywhere since 7799f8e4c. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-11-29 10:49:24 +00:00
Airat Arifullin	00c608c05e	[#1524] tree: Make check APE error get wrapped to api status ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-29 10:48:16 +00:00
Airat Arifullin	bba1892fa1	[#1524] ape: Make APE checker return error without status ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-29 10:48:16 +00:00
Evgenii Stratonikov	01acec708f	[#1525] pilorama: Use AppendUint* helpers from stdlib ... gopatch: ``` @@ var slice, e expression @@ +import "encoding/binary" -append(slice, byte(e), byte(e >> 8)) +binary.LittleEndian.AppendUint16(slice, e) ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-28 09:40:20 +03:00
Anton Nikiforov	f12f04199e	[#1516] traverser: Check for placement vector out of range ... Placement vector may contain fewer nodes count than it required by policy due to the outage of the one of the node. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-11-21 14:18:55 +03:00
Evgenii Stratonikov	49a4e727fd	[#1507] timer/test: Use const for constants ... Make it easy to see what the test is about. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 08:36:25 +00:00
Evgenii Stratonikov	2e974f734c	[#1507] timer/test: Improve test coverage ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 08:36:25 +00:00
Evgenii Stratonikov	3042490340	[#1507] timer: Remove unused OnDelta() method ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 08:36:25 +00:00
Airat Arifullin	ffe9906266	[#1501] cli: Move APE-chain parser methods to pkg/util ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	e2cb0640f1	[#1501] util: Move eACL-to-APE converter to pkg/util ... * `ConvertEACLToAPE` is useful method which couldn't be imported out of frostfs-node so far as it has been in `internal` * Since `ConvertEACLToAPE` and related structures and unit-tests are placed in `pkg/util` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Evgenii Stratonikov	d82f0d1926	[#1496] node/control: Await until SetNetmapStatus() persists ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	acd5babd86	[#1496] morph: Merge InvokeRes and WaitParams ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	b65874d1c3	[#1496] morph: Return InvokeRes from all invoke*() methods ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	69c63006da	[#1496] morph: Move tx waiter to morph package ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	d77a218f7c	[#1493] metabase: Merge Inhume() and DropGraves() for tombstones ... DropGraves() is only used to drop gravemarks after a tombstone removal. Thus, it makes sense to do Inhume() and DropGraves() in one transaction. It has less overhead and no unexpected problems in case of sudden power failure. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Evgenii Stratonikov	44df67492f	[#1493] metabase: Split inhumeTx() into 2 functions ... No functional changes. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Evgenii Stratonikov	1e6f132b4e	[#1493] metabase: Pass InhumePrm by value ... Unify with the other code, no functional changes. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Evgenii Stratonikov	6dc0dc6691	[#1493] shard: Take mode mutex in HandleExpiredTombstones() ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Aleksey Savchuk	7fc6101bec	[#1491] engine/test: Rework engine test utils ... - Remove `testNewShard` and `setInitializedShards` because they violated the default engine workflow. The correct workflow is: first use `New()`, followed by `Open()`, and then `Init()`. As a result, adding new logic to `(*StorageEngine).Init` caused several tests to fail with a panic when attempting to access uninitialized resources. Now, all engines created with the test utils must be initialized manually. The new helper method `prepare` can be used for that purpose. - Additionally, `setInitializedShards` hardcoded the shard worker pool size, which prevented it from being configured in tests and benchmarks. This has been fixed as well. - Ensure engine initialization is done wherever it was missing. - Refactor `setShardsNumOpts`, `setShardsNumAdditionalOpts`, and `setShardsNum`. Make them all depend on `setShardsNumOpts`. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-11-13 14:42:53 +03:00
Aleksey Savchuk	7ef36749d0	[#1491] engine/test: Move BenchmarkExists to exists_test.go ... Move `BenchmarkExists` from `engine_test.go` to `exists_test.go` for better organization and clarity. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-11-13 14:09:29 +03:00
Aleksey Savchuk	c6066d6ee4	[#1491] engine/test: Use more suitable testing utils here and there ... Use `setShardsNum` instead of `setInitializedShards` wherever possible. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-11-13 14:09:29 +03:00
Dmitrii Stepanov	612b34d570	[#1437] logger: Add caller skip to log original caller position ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:12 +03:00
Dmitrii Stepanov	7429553266	[#1437] node: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:10 +03:00
Dmitrii Stepanov	6921a89061	[#1437] ir: Fix contextcheck linters ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:10 +03:00
Dmitrii Stepanov	16598553d9	[#1437] shard: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:09 +03:00
Dmitrii Stepanov	c139892117	[#1437] ir: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:09 +03:00
Dmitrii Stepanov	62b5181618	[#1437] blobovnicza: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:08 +03:00
Dmitrii Stepanov	6db46257c0	[#1437] node: Use ctx for logging ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:07 +03:00
Dmitrii Stepanov	c16dae8b4d	[#1437] logger: Use context to log trace id ... Signed-off-by: Dmitrii Stepanov	2024-11-13 10:36:07 +03:00
Evgenii Stratonikov	fd004add00	[#1492] metabase: Fix import formatting ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-13 07:30:25 +00:00