1248 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	7edec9193c	[#1451] placement: Return copy of slice from container nodes cache ... Nodes from cache could be changed by traverser, if no objectID specified. So it is required to return copy of cache's slice. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	3cf6ea745d	[#1451] ec: Check all parts are saved ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	9a77527f46	[#1451] ape: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	5b1ba8e23d	[#1451] ape: Perform strict APE checks for EC parts ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	9902965ff4	[#1451] writer: Sign EC parts with node's private key ... As EC put request may be processed only by container node, so sign requests with current node private to not to perform APE checks. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	33ad753302	[#1473] policer: Add tracing span ... To filter HEAD requests from policer. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:15:11 +00:00
Evgenii Stratonikov	15102e6dfd	[#1471] Replace sort.Slice in some places ... `slices.SortFunc` doesn't use reflection and is a bit faster. I have done some micro-benchmarks for `[]NodeInfo`: ``` $ benchstat -col "/func" out goos: linux goarch: amd64 pkg: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/local_object_storage/pilorama cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz │ sort.Slice │ slices.SortFunc │ │ sec/op │ sec/op vs base │ Sort-8 2.130µ ± 2% 1.253µ ± 2% -41.20% (p=0.000 n=10) ``` Haven't included them, though, as they I don't see them being used a lot. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-06 08:07:32 +00:00
Evgenii Stratonikov	c2effcc61c	[#1465] Makefile: Update golangci-lint, fix warnings ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-31 06:39:59 +00:00
Evgenii Stratonikov	7ac0852364	[#1459] .golangci.yml: Add intrange linter, fix issues ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-30 15:18:22 +00:00
Aleksey Savchuk	d28a5d2d7a	[#1448] container/ape: Ignore an error when getting a role ... When getting a role in the APE checker for the container services, an error may be returned if network maps of the previous two epochs don't have enough nodes to fulfil a container placement policy. It's a logical error, so we should ignore it. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-30 12:51:57 +03:00
Airat Arifullin	87ac3c5279	[#1458] object: Make patch not set key before target construction ... * `SignRequestPrivateKey` field should be initialized either within `newUntrustedTarget` or within `newTrustedTarget`. Otherwise, all requests are signed by local node key that makes impossible to perform patch on non-container node. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 15:20:28 +00:00
Anton Nikiforov	81f4cdbb91	[#1439] object: Sort nodes by priority metrics to compute GET request ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-29 08:05:09 +00:00
Anton Nikiforov	3cd7d23f10	[#1439] node: Reduce usage of netmapAPI.NodeInfo ... Remove outdated code from `netmap` service. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-29 08:05:09 +00:00
Airat Arifullin	012af5cc38	[#1406] tree: Add unit-tests for ape check ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 08:04:23 +00:00
Airat Arifullin	eb5336d5ff	[#1406] tree: Use delete verb instead put for Remove ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 08:04:23 +00:00
Evgenii Stratonikov	bc8d79ddf9	[#1447] services/tree: Move relaying code to a separate function ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-24 10:01:03 +03:00
Aleksey Savchuk	65a4320c75	[#1441] services/tree: Use grpc.WaitForReady option when creating client ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 11:45:44 +00:00
Dmitrii Stepanov	e314f328c4	[#1422] tree: Use dialer source for tree service connections ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Evgenii Stratonikov	b42bcdc6fa	[#1433] services/object: Put object before auxiliary info ... Consider the following operations ordering: 1. Inhume(with tombstone A) --> add tombstone mark for an object 2. --> new epoch arives 3. --> GCMark is added for a tombstone A, because it is unavailable 4. Put(A) --> return error, because the object already has a GCMark It is possible, and I have successfully reproduced it with a test on the shard level. However, the error is related to the specific _ordering_ of operations with engine. And triggering race-conditions like this is only possible on a shard level currently, so no tests are written. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-17 14:43:13 +03:00
Alexander Chuprov	d83879d4b8	[#1431] node: Fix comment format ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Alexander Chuprov	f6582081a4	[#1431] obj_storage/metabase: Delete unused variable ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Vitaliy Potyarkin	714ff784fa	[#1431] objsvc: Use specific values in message about address mismatch ... This makes troubleshooting failed operations much easier Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>	2024-10-15 07:34:03 +00:00
Anton Nikiforov	acd6eb1815	[#1427] object: Fix Put for EC object when node unavailable ... There might be situation when context canceled earlier than traverser move to another part of the nodes. To avoid this, need to wait for the result from concurrent put at each traverser iteration. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-11 16:53:30 +03:00
Evgenii Stratonikov	1134760271	[#1425] services/tree: Remove eACL mentions from bearer token parsing errors ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-09 10:56:49 +03:00
Evgenii Stratonikov	02bb7159a5	[#1425] services/tree: Remove eACL processing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-09 10:56:48 +03:00
Evgenii Stratonikov	4190fba86d	[#1425] Remove SetEACL-related code ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-09 10:56:48 +03:00
Dmitrii Stepanov	4572fa4874	[#1412] searchSvc: Check container is indexed ... For non S3 containers it is expected to use attributes index for some attributes. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:50 +03:00
Dmitrii Stepanov	1b520f7973	[#1412] engine: Add IsIndexedContainer flag ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:49 +03:00
Airat Arifullin	9c5ddc4dfe	[#1407] tree: Set ContainerOwner in parameter for CheckAPE ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-02 07:21:02 +00:00
Anton Nikiforov	d0ed29b3c7	[#1350] node: Add ability to evacuate objects from REP 1 only ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-27 15:41:17 +03:00
Airat Arifullin	5f22ba6f38	[#1397] object: Correctly set namespace before APE check ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-09-27 11:43:29 +00:00
Dmitrii Stepanov	a5e1aa22c9	[#1394] putSvc: Fix relay ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 17:28:03 +03:00
Dmitrii Stepanov	4fbfffd44c	[#1388] putSvc: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	bdd57c8b6b	[#1388] sessionSvc: Add nolint annotations ... Used as map key. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	d1d6e3471c	[#1388] signSvc: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	580cd55180	[#1388] getSvc: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	e319bf403e	[#1388] apeSvc: Drop unused and make annotations ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Anton Nikiforov	34e6a309c6	[#1356] engine: Evacuate object from shards concurrently ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-24 12:50:19 +03:00
Dmitrii Stepanov	839dead226	[#1297] getSvc: Return AccessDenied instead of ObjectNotFound ... Do not replace the access denied error if it was received earlier. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-24 12:05:09 +03:00
Airat Arifullin	3bb65ba820	[#1392] object: Fix target initialization within put streamer ... * Remove `relay` field from put streamer as it's no longer used; * Fix initialization of `Relay` object writer parameter. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-09-24 09:04:13 +00:00
Dmitrii Stepanov	d4493a6d08	[#1390] getSvc: Fix Head EC1.1 ... If local EC chunk found, but remote node is off, then `HEAD --raw` request returns object not found. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-23 15:12:06 +03:00
Aleksey Savchuk	c34b8acedd	[#1312] Drop handling of system attributes with NeoFS prefix ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-09-20 11:37:18 +00:00
Airat Arifullin	61d5e140e0	[#1383] object: Add restrictions for Patch method ... * `Patch` can't be applied for non-regular type object (tombstones, locks etc.) * Complex object parts can't be patched. So, if an object has EC/Split header, it won't be patched. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-09-19 13:54:49 +03:00
Dmitrii Stepanov	e5c8f7ff9f	[#1382] controlSvc: Replace deprecated methods ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-18 14:29:24 +03:00
Dmitrii Stepanov	1e7f9909da	[#1382] policer: Replace deprecated methods ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-18 14:29:21 +03:00
Dmitrii Stepanov	89d0435b1d	[#1374] tree: Use NewClient to create grpc connection in cache ... Created grpc connection should be established, so perform Healthcheck request to check connection is ok. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-13 15:59:26 +03:00
Dmitrii Stepanov	54fe8383a4	[#1374] tree: Use NewClient to create grpc connection for sync ... Created connection will be used to sync trees, so it is ok to defer dial to the first RPC call. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-13 15:59:26 +03:00
Aleksey Savchuk	99be4c83a7	[#1368] *: Run gofumpt ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-09-12 10:00:28 +03:00
Airat Arifullin	a812932984	[#1362] ape: Move common APE check logic to separate package ... * Tree and object service have the same log for checking APE. So, this check should be moved to common package. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-09-10 12:40:34 +00:00
Dmitrii Stepanov	6b6eabe41c	[#1337] cli: Add control shards rebuild command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-06 13:57:27 +03:00