1260 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	16598553d9	[#1437] shard: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:09 +03:00
Dmitrii Stepanov	6db46257c0	[#1437] node: Use ctx for logging ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:07 +03:00
Dmitrii Stepanov	46fef276b4	[#1449] tree: Log tree sync with Info level ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 12:11:07 +00:00
Dmitrii Stepanov	9bd05e94c8	[#1449] tree: Add ApplyBatch method ... Concurrent Apply can lead to child node applies before parent, so undo/redo operations will perform. This leads to performance degradation in case of tree with many sublevels. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 12:11:07 +00:00
Evgenii Stratonikov	a692298533	[#1483] node: Remove eACL cache ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-12 12:10:51 +00:00
Evgenii Stratonikov	c82c753e9f	[#1480] objsvc: Remove useless stream wrappers ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-08 12:01:14 +00:00
Evgenii Stratonikov	f666898e5d	[#1480] objsvc: Remove EACL checks ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-08 12:01:14 +00:00
Evgenii Stratonikov	b1a31281e4	[#1480] ape: Remove SoftAPECheck flag ... Previous release was EACL-compatible. Starting from now all EACL should've been migrated to APE chains. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-08 12:01:14 +00:00
Airat Arifullin	764450d04a	[#1479] tree: Regenerate service protobufs ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-08 10:43:44 +03:00
Airat Arifullin	755cae3f19	[#1479] control: Regenerate protobufs for service ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-08 10:43:44 +03:00
Airat Arifullin	9b13a18aac	[#1479] go.mod: Bump frostfs-sdk-go version ... * Update version within go.mod; * Fix deprecated frostfs-api-go/v2 package and use frostfs-sdk-go/api instead. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-08 10:43:19 +03:00
Dmitrii Stepanov	ef64930fef	[#1477] ape: Fix EC chunk test ... Initially, this test was a check that only the container node can assemble an EC object. But the implementation of this test was wrong. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-07 16:00:20 +03:00
Dmitrii Stepanov	7edec9193c	[#1451] placement: Return copy of slice from container nodes cache ... Nodes from cache could be changed by traverser, if no objectID specified. So it is required to return copy of cache's slice. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	3cf6ea745d	[#1451] ec: Check all parts are saved ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	9a77527f46	[#1451] ape: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	5b1ba8e23d	[#1451] ape: Perform strict APE checks for EC parts ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	9902965ff4	[#1451] writer: Sign EC parts with node's private key ... As EC put request may be processed only by container node, so sign requests with current node private to not to perform APE checks. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	33ad753302	[#1473] policer: Add tracing span ... To filter HEAD requests from policer. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:15:11 +00:00
Evgenii Stratonikov	15102e6dfd	[#1471] Replace sort.Slice in some places ... `slices.SortFunc` doesn't use reflection and is a bit faster. I have done some micro-benchmarks for `[]NodeInfo`: ``` $ benchstat -col "/func" out goos: linux goarch: amd64 pkg: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/local_object_storage/pilorama cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz │ sort.Slice │ slices.SortFunc │ │ sec/op │ sec/op vs base │ Sort-8 2.130µ ± 2% 1.253µ ± 2% -41.20% (p=0.000 n=10) ``` Haven't included them, though, as they I don't see them being used a lot. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-06 08:07:32 +00:00
Evgenii Stratonikov	c2effcc61c	[#1465] Makefile: Update golangci-lint, fix warnings ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-31 06:39:59 +00:00
Evgenii Stratonikov	7ac0852364	[#1459] .golangci.yml: Add intrange linter, fix issues ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-30 15:18:22 +00:00
Aleksey Savchuk	d28a5d2d7a	[#1448] container/ape: Ignore an error when getting a role ... When getting a role in the APE checker for the container services, an error may be returned if network maps of the previous two epochs don't have enough nodes to fulfil a container placement policy. It's a logical error, so we should ignore it. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-30 12:51:57 +03:00
Airat Arifullin	87ac3c5279	[#1458] object: Make patch not set key before target construction ... * `SignRequestPrivateKey` field should be initialized either within `newUntrustedTarget` or within `newTrustedTarget`. Otherwise, all requests are signed by local node key that makes impossible to perform patch on non-container node. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 15:20:28 +00:00
Anton Nikiforov	81f4cdbb91	[#1439] object: Sort nodes by priority metrics to compute GET request ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-29 08:05:09 +00:00
Anton Nikiforov	3cd7d23f10	[#1439] node: Reduce usage of netmapAPI.NodeInfo ... Remove outdated code from `netmap` service. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-29 08:05:09 +00:00
Airat Arifullin	012af5cc38	[#1406] tree: Add unit-tests for ape check ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 08:04:23 +00:00
Airat Arifullin	eb5336d5ff	[#1406] tree: Use delete verb instead put for Remove ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 08:04:23 +00:00
Evgenii Stratonikov	bc8d79ddf9	[#1447] services/tree: Move relaying code to a separate function ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-24 10:01:03 +03:00
Aleksey Savchuk	65a4320c75	[#1441] services/tree: Use grpc.WaitForReady option when creating client ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 11:45:44 +00:00
Dmitrii Stepanov	e314f328c4	[#1422] tree: Use dialer source for tree service connections ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Evgenii Stratonikov	b42bcdc6fa	[#1433] services/object: Put object before auxiliary info ... Consider the following operations ordering: 1. Inhume(with tombstone A) --> add tombstone mark for an object 2. --> new epoch arives 3. --> GCMark is added for a tombstone A, because it is unavailable 4. Put(A) --> return error, because the object already has a GCMark It is possible, and I have successfully reproduced it with a test on the shard level. However, the error is related to the specific _ordering_ of operations with engine. And triggering race-conditions like this is only possible on a shard level currently, so no tests are written. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-17 14:43:13 +03:00
Alexander Chuprov	d83879d4b8	[#1431] node: Fix comment format ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Alexander Chuprov	f6582081a4	[#1431] obj_storage/metabase: Delete unused variable ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Vitaliy Potyarkin	714ff784fa	[#1431] objsvc: Use specific values in message about address mismatch ... This makes troubleshooting failed operations much easier Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>	2024-10-15 07:34:03 +00:00
Anton Nikiforov	acd6eb1815	[#1427] object: Fix Put for EC object when node unavailable ... There might be situation when context canceled earlier than traverser move to another part of the nodes. To avoid this, need to wait for the result from concurrent put at each traverser iteration. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-11 16:53:30 +03:00
Evgenii Stratonikov	1134760271	[#1425] services/tree: Remove eACL mentions from bearer token parsing errors ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-09 10:56:49 +03:00
Evgenii Stratonikov	02bb7159a5	[#1425] services/tree: Remove eACL processing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-09 10:56:48 +03:00
Evgenii Stratonikov	4190fba86d	[#1425] Remove SetEACL-related code ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-09 10:56:48 +03:00
Dmitrii Stepanov	4572fa4874	[#1412] searchSvc: Check container is indexed ... For non S3 containers it is expected to use attributes index for some attributes. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:50 +03:00
Dmitrii Stepanov	1b520f7973	[#1412] engine: Add IsIndexedContainer flag ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-08 11:41:49 +03:00
Airat Arifullin	9c5ddc4dfe	[#1407] tree: Set ContainerOwner in parameter for CheckAPE ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-02 07:21:02 +00:00
Anton Nikiforov	d0ed29b3c7	[#1350] node: Add ability to evacuate objects from REP 1 only ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-27 15:41:17 +03:00
Airat Arifullin	5f22ba6f38	[#1397] object: Correctly set namespace before APE check ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-09-27 11:43:29 +00:00
Dmitrii Stepanov	a5e1aa22c9	[#1394] putSvc: Fix relay ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 17:28:03 +03:00
Dmitrii Stepanov	4fbfffd44c	[#1388] putSvc: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	bdd57c8b6b	[#1388] sessionSvc: Add nolint annotations ... Used as map key. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	d1d6e3471c	[#1388] signSvc: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	580cd55180	[#1388] getSvc: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Dmitrii Stepanov	e319bf403e	[#1388] apeSvc: Drop unused and make annotations ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Anton Nikiforov	34e6a309c6	[#1356] engine: Evacuate object from shards concurrently ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-24 12:50:19 +03:00