3461 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	4d5ae59a52	[#1598] golangci: Enable unconvert linters ... To drop unnecessary conversions. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2025-01-14 09:06:40 +03:00
Airat Arifullin	a9f27e074b	[#1243] object: Look for X-Headers within origin before APE check ... * X-Headers can be found in `origin` field of `MetaHeader` if the request has been forwarded from non-container node. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2025-01-13 12:07:27 +00:00
Anton Nikiforov	6c51f48aab	[#1596] metrics: Create public aliases for internal engine metrics ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2025-01-13 10:05:01 +00:00
Evgenii Stratonikov	f7e75b13b0	[#1506] ape_manager: Await tx persist before returning response ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-01-09 12:04:21 +00:00
Evgenii Stratonikov	198aaebc94	[#1506] morph: Simplify WaitTxHalt() signature ... Avoid dependency on `morph/client` package because of `InvokeRes`. Make signature resemble `WaitAny()` method of `waiter.Waiter` from neo-go. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-01-09 12:04:21 +00:00
Evgenii Stratonikov	85af6bcd5c	[#1506] ape: Use contract reader in ListMorphRuleChains() ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-01-09 12:04:21 +00:00
Evgenii Stratonikov	8a658de0b2	[#1506] ape: Do not create cosigners slice on each contract invocation ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-01-09 12:04:21 +00:00
Evgenii Stratonikov	3900b92927	Revert "[#1492] metabase: Ensure Unmarshal() is called on a cloned slice" ... This reverts commit 8ed7a676d5. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2025-01-09 14:34:20 +03:00
Evgenii Stratonikov	d7fcc5ce30	[#1586] objsvc: Allow to send search response in multiple messages ... Previously, `ln` was only set once, so search has really worked for small number of objects. Fix panic: ``` panic: runtime error: slice bounds out of range [:43690] with capacity 21238 goroutine 6859775 [running]: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object.(*searchStreamMsgSizeCtrl).Send(0xc001eec8d0, 0xc005734000) git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/transport_splitter.go:173 +0x1f0 git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search/v2.(*streamWriter).WriteIDs(0xc000520320, {0xc00eb1a000, 0x4fd9c, 0x7fd6475a9a68?}) git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search/v2/streamer.go:28 +0x155 git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search.(*uniqueIDWriter).WriteIDs(0xc001386420, {0xc00eb1a000?, 0xc0013ea9c0?, 0x113eef3?}) git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search/util.go:62 +0x202 git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search.(*execCtx).writeIDList(0xc00011aa38?, {0xc00eb1a000?, 0xc001eec9f0?, 0xc0008f4380?}) git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search/exec.go:68 +0x91 git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search.(*execCtx).executeLocal(0xc0008f4380, {0x176c538, 0xc001eec9f0}) git.frostfs.info/TrueCloudLab/frostfs-node/pkg/services/object/search/local.go:18 +0x16b ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-28 12:29:22 +00:00
Ekaterina Lebedeva	c0221d76e6	[#1577] node/container: Fix typo ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-12-28 12:05:01 +03:00
Ekaterina Lebedeva	242f0095d0	[#1577] container: Reduce iterations through container list ... * Separated iteration through container ids from `ContainersOf()` so that it could be reused. * When listing containers we used to iterate through the the whole list of containers twice: first when reading from a contract, then when sending them. Now we can send batches of containers when reading from the contract. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-12-27 15:30:26 +03:00
Ekaterina Lebedeva	6fe34d266a	[#1577] morph: Fix typo ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-12-27 14:03:19 +03:00
Aleksey Savchuk	fa08bfa553	[#1583] metabase/test: Update TestLisObjectsWithCursor ... Update this test following recent changes to ensure that `(*DB).ListWithCursor` skips expired objects. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-26 14:39:50 +03:00
Aleksey Savchuk	0da998ef50	[#1583] metabase: Skip expired objects in ListWithCursor ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-26 14:39:49 +03:00
Airat Arifullin	e44782473a	[#1512] object: Fix writePart for EC-container ... * Immediatly return after `ObjectAlreadyRemoved` error. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-12-26 11:27:55 +00:00
Airat Arifullin	9cd1bcef06	[#1512] object: Make raw PutSingle check status within response ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-12-26 11:27:55 +00:00
Evgenii Stratonikov	ca0a33ea0f	[#465] objsvc: Set NETMAP_EPOCH xheader for auxiliary requests ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-26 09:17:58 +00:00
Evgenii Stratonikov	f6c5222952	[#1581] services/session: Use user.ID.EncodeToString() where possible ... gopatch: ``` @@ var id expression @@ -base58.Encode(id.WalletBytes()) +id.EncodeToString() ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-25 18:09:36 +00:00
Alexander Chuprov	51ee132ea3	[#1342] network/cache: Add node address to error multiClient ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-12-18 19:27:35 +03:00
Evgenii Stratonikov	226dd25dd0	[#1568] pilorama: Replace "containerID" with "container ID" in the error message ... It is "container ID" in every other place. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-18 15:52:26 +00:00
Evgenii Stratonikov	bd0197eaa8	[#1568] storage: Remove "could not/can't/failed to" from error messages ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-18 15:52:26 +00:00
Ekaterina Lebedeva	df05057ed4	[#1452] container: Add ListStream method ... * Added new method for listing containers to container service. It opens stream and sends containers in batches. * Added TransportSplitter wrapper around ExecutionService to split container ID list read from contract in parts that are smaller than grpc max message size. Batch size can be changed in node configuration file (as in example config file). * Changed `container list` implementaion in cli: now ListStream is called by default. Old List is called only if ListStream is not implemented. * Changed `internalclient.ListContainersPrm`.`Account` to `OwnerID` since `client.PrmContainerList`.`Account` was renamed to `OwnerID` in sdk. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-12-17 16:22:43 +03:00
Airat Arifullin	6e82661c35	[#1563] tree: Wrap only ChainRouterError erros with ObjectAccessDenied ... * Such wrapping helps to differentiate logical check errors and server internal errors. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-12-16 15:16:07 +03:00
Airat Arifullin	1a091ea7bb	[#1563] object: Wrap only ChainRouterError erros with ObjectAccessDenied ... * Such wrapping helps to differentiate logical check errors and server internal errors. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-12-16 15:15:25 +03:00
Airat Arifullin	7ac3542714	[#1563] ape: Introduce ChainRouterError error type ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-12-16 15:12:30 +03:00
Aleksey Savchuk	f0c43c8d80	[#1502] Use zap.Error for logging errors ... Use `zap.Error` instead of `zap.String` for logging errors: change all expressions like `zap.String("error", err.Error())` or `zap.String("err", err.Error())` to `zap.Error(err)`. Leave similar expressions with other messages unchanged, for example, `zap.String("last_error", lastErr.Error())` or `zap.String("reason", ctx.Err().Error())`. This change was made by applying the following patch: ```diff @@ var err expression @@ -zap.String("error", err.Error()) +zap.Error(err) @@ var err expression @@ -zap.String("err", err.Error()) +zap.Error(err) ``` Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-16 11:13:42 +03:00
Aleksey Savchuk	8ba9f31fca	[#1510] metabase/test: Fix BenchmarkListWithCursor ... - Fix misplaced `(*DB).Close` (broken after 47dcfa20f3) - Use `errors.Is` for error checking (broken after fcdbf5e509) Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-13 13:19:15 +03:00
Aleksey Savchuk	2af3409d39	[#1510] metabase/test: Fix BenchmarkGet ... Fix misplaced `(*DB).Close` (broken after 47dcfa20f3) Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-13 13:18:43 +03:00
Evgenii Stratonikov	d165ac042c	[#1558] morph/client: Reuse notary rpcclient wrapper ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-12 15:30:12 +03:00
Evgenii Stratonikov	7151c71d51	[#1558] morph/client: Remove "could not"/"can't"/"failed to" from error messages ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-12 15:30:12 +03:00
Evgenii Stratonikov	91d9dc2676	[#1558] morph/event: Remove "could not" from error messages ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-12 15:30:12 +03:00
Evgenii Stratonikov	7853dbc315	[#1557] morph/event: Remove embedded structs from scriptHashWithValue ... Also, make them public, because otherwise `unused` linter complains. ``` pkg/morph/event/utils.go:25:2 unused field `typ` is unused ``` This complain is wrong, though: we _use_ `typ` field because the whole struct is used as a map key. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-12 11:55:09 +00:00
Aleksey Savchuk	3821645085	[#1555] engine: Refactor (*StorageEngine).GetLocks ... Refactored after renaming the method to replace the confusing `locked` variable with `locks`. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-11 15:06:38 +03:00
Aleksey Savchuk	72470d6b48	[#1555] local_object_storage: Rename method GetLocked -> GetLocks ... Renamed to better reflect the method's purpose of returning locks for the specified object. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-12-11 15:06:37 +03:00
Evgenii Stratonikov	e9837bbcf9	[#1554] morph/event: Remove unused AlphabetUpdate event ... Refs TrueCloudLab/frostfs-contract#138. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-11 12:01:17 +00:00
Evgenii Stratonikov	b1614a284d	[#1546] morph/event: Export NotificationHandlerInfo fields ... Hiding them achieves nothing, as the struct has no methods and is not used concurrently. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-11 07:39:49 +00:00
Evgenii Stratonikov	d0ce835fbf	[#1546] morph/event: Merge notification parser and handlers ... They are decoupled, but it is an error to have a handler without a corresponding parser. Register them together on the code level and get rid of unreachable code. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-11 07:39:49 +00:00
Evgenii Stratonikov	dfa51048a8	[#1546] morph/event: Remove "is started" checks from event handler registrar ... This codepath hides possible bugs in code. All initialization function should run before init stage. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-11 07:39:49 +00:00
Evgenii Stratonikov	670305a721	[#1546] morph/event: Remove nil checks from event handler registrar ... This codepath hides possible bugs in code. We would rather panic then silently fail. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-11 07:39:49 +00:00
Dmitrii Stepanov	1f6cf57e30	[#1548] metabase: Check if EC parent is removed or expired ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-11 07:26:33 +00:00
Dmitrii Stepanov	386a12eea4	[#1548] engine: Rename parent -> ecParent ... Parent could mean split parent or EC parent. In this case it is EC parent only. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-11 07:26:33 +00:00
Dmitrii Stepanov	15139d80c9	[#1548] policer: Do not replicate EC chunk if object already removed ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-11 07:26:33 +00:00
Dmitrii Stepanov	41da27dad5	[#1549] engine: Drop Async flag from evacuation parameters ... Now it is only async evacuation. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-10 17:00:00 +03:00
Dmitrii Stepanov	ac0511d214	[#1549] controlSvc: Drop deprecated EvacuateShard rpc ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-10 16:59:52 +03:00
Airat Arifullin	7e542906ef	[#1539] go.mod: Bump frostfs-sdk-go version ... * Also fix placement unit-test in object manager Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-12-06 15:29:37 +03:00
Evgenii Stratonikov	d1bc4351c3	[#1545] morph/event: Simplify frostfs contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 14:00:23 +03:00
Evgenii Stratonikov	1c12f23b84	[#1541] morph/event: Simplify netmap contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 10:26:39 +00:00
Evgenii Stratonikov	a353d45742	[#1541] morph/event: Simplify container contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 10:26:39 +00:00
Evgenii Stratonikov	d5d5ce2074	[#1541] morph/event: Simplify balance contract event parsing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-12-06 10:26:39 +00:00
Dmitrii Stepanov	7df3520d48	[#1540] getSvc: Drop redundant returns ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-05 12:39:49 +00:00