5189 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Dmitrii Stepanov	ef64930fef	[#1477] ape: Fix EC chunk test ... Initially, this test was a check that only the container node can assemble an EC object. But the implementation of this test was wrong. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-07 16:00:20 +03:00
Evgenii Stratonikov	c8fb154151	[#1475] Remove container estimation code ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-06 15:32:33 +03:00
Dmitrii Stepanov	7edec9193c	[#1451] placement: Return copy of slice from container nodes cache ... Nodes from cache could be changed by traverser, if no objectID specified. So it is required to return copy of cache's slice. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	3cf6ea745d	[#1451] ec: Check all parts are saved ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	9a77527f46	[#1451] ape: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	5b1ba8e23d	[#1451] ape: Perform strict APE checks for EC parts ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	9902965ff4	[#1451] writer: Sign EC parts with node's private key ... As EC put request may be processed only by container node, so sign requests with current node private to not to perform APE checks. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:18:10 +00:00
Dmitrii Stepanov	33ad753302	[#1473] policer: Add tracing span ... To filter HEAD requests from policer. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-06 08:15:11 +00:00
Evgenii Stratonikov	15102e6dfd	[#1471] Replace sort.Slice in some places ... `slices.SortFunc` doesn't use reflection and is a bit faster. I have done some micro-benchmarks for `[]NodeInfo`: ``` $ benchstat -col "/func" out goos: linux goarch: amd64 pkg: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/local_object_storage/pilorama cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz │ sort.Slice │ slices.SortFunc │ │ sec/op │ sec/op vs base │ Sort-8 2.130µ ± 2% 1.253µ ± 2% -41.20% (p=0.000 n=10) ``` Haven't included them, though, as they I don't see them being used a lot. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-06 08:07:32 +00:00
Evgenii Stratonikov	17ec84151b	[#532] cli: Respect XDG base directory spec ... XDG base directory specification defines where various files should be looked by an application. Hopefully, this makes `frostfs-cli` more predictable and pleasant to work with. Luckily for us, golang already has everything we need in the stdlib. This commit also gets rid of `github.com/mitchellh/go-homedir` dependency. Close #532 Refs #1455 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-05 16:27:18 +03:00
Dmitrii Stepanov	6c45a17af6	[#1467] node: Break notary deposit wait after VUB ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-01 16:42:02 +03:00
Dmitrii Stepanov	d19ab43500	[#1462] node: Add off-cpu profiler ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-31 11:32:13 +03:00
Evgenii Stratonikov	5bcf81d1cc	[#1466] Remove woodpecker CI ... We use forgejo actions now. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-31 10:07:33 +03:00
Evgenii Stratonikov	c2effcc61c	[#1465] Makefile: Update golangci-lint, fix warnings ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-31 06:39:59 +00:00
Dmitrii Stepanov	2285cfc36f	[#1464] frostfsid: Cache subject not found error ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-30 18:27:33 +03:00
Dmitrii Stepanov	e74d05c03f	[#1464] frostfsid: Add cache metrics ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-30 18:27:32 +03:00
Evgenii Stratonikov	48862e0e63	[#1459] .golanci.yml: Add tenv linter, fix issues ... Refs #1309 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-30 15:18:22 +00:00
Evgenii Stratonikov	89892d9754	[#1459] cli: Simplify slice append ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-30 15:18:22 +00:00
Evgenii Stratonikov	7ac0852364	[#1459] .golangci.yml: Add intrange linter, fix issues ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-30 15:18:22 +00:00
Aleksey Savchuk	d28a5d2d7a	[#1448] container/ape: Ignore an error when getting a role ... When getting a role in the APE checker for the container services, an error may be returned if network maps of the previous two epochs don't have enough nodes to fulfil a container placement policy. It's a logical error, so we should ignore it. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-30 12:51:57 +03:00
Airat Arifullin	87ac3c5279	[#1458] object: Make patch not set key before target construction ... * `SignRequestPrivateKey` field should be initialized either within `newUntrustedTarget` or within `newTrustedTarget`. Otherwise, all requests are signed by local node key that makes impossible to perform patch on non-container node. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 15:20:28 +00:00
Dmitrii Stepanov	d5ee6d3039	[#1456] morph: Use DialerSource interface instead of internal struct ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-29 17:34:14 +03:00
Evgenii Stratonikov	433aab12bb	[#1455] cli: Handle missing home directory ... go-homedir library incorrectly handles some of the errors that could occur. It is archived, so no PR, but let's fix it on our side. The scenario in case: executing command in an empty environment. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-29 16:37:55 +03:00
Anton Nikiforov	81f4cdbb91	[#1439] object: Sort nodes by priority metrics to compute GET request ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-29 08:05:09 +00:00
Anton Nikiforov	3cd7d23f10	[#1439] node: Reduce usage of netmapAPI.NodeInfo ... Remove outdated code from `netmap` service. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-29 08:05:09 +00:00
Airat Arifullin	012af5cc38	[#1406] tree: Add unit-tests for ape check ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 08:04:23 +00:00
Airat Arifullin	eb5336d5ff	[#1406] tree: Use delete verb instead put for Remove ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-10-29 08:04:23 +00:00
Evgenii Stratonikov	bc8d79ddf9	[#1447] services/tree: Move relaying code to a separate function ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-24 10:01:03 +03:00
Aleksey Savchuk	29708b78d7	[#1442] cli/tree: Enchance error message if rpc-endpoint isn't defined ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 13:05:17 +00:00
Aleksey Savchuk	b9284604d9	[#1442] cli/tree: Allow to specify rpc-endpoint with config file ... We have several ways to specify the `rpc-endpoint`: with a flag, with a single config file or multiple files. Before, the `rpc-endpoint` flag was marked as required. Because `cobra` checked the required flag presence first, it prevented specifying `rpc-endpoint` with a config file. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 13:05:17 +00:00
Aleksey Savchuk	65a4320c75	[#1441] services/tree: Use grpc.WaitForReady option when creating client ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 11:45:44 +00:00
Aleksey Savchuk	9a260c2e64	[#1441] network/cache: Use grpc.WaitForReady option when creating client ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 11:45:44 +00:00
Aleksey Savchuk	6f798b9c4b	[#1441] cli: Use grpc.WaitForReady while initializing SDK client ... Before, when the target RPC server was unavailable, requests made by CLI didn't wait for a timeout specified by the `--timeout` option if the timeout was more than 20 seconds. It's because of the gRPC default backoff strategy. Adding this option fixes that behavior. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 11:45:44 +00:00
Dmitrii Stepanov	e515dd4582	[#1444] config: Fix data race on morph component init ... It could be called for every shard on metabase resync concurrently and it is possible to get state with initialized client but not initialized contract hashes. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-23 10:41:36 +03:00
Anton Nikiforov	8b6ec57c61	[#1440] sdnotify: Fix status for RELOADING ... Before: ``` RELOADING=1 MONOTONIC_USEC=17951246687 STATUS=RELOADING=1 MONOTONIC_USEC=17951246687 ``` After: ``` RELOADING=1 MONOTONIC_USEC=17951246687 STATUS=RELOADING ``` Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-21 14:25:08 +03:00
Evgenii Stratonikov	ed13387c0e	[#1438] .docker: Use go1.23 for builders ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-18 15:20:37 +03:00
Evgenii Stratonikov	5afea62ec0	[#1438] debian: Remove package scripts ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-18 15:20:37 +03:00
Dmitrii Stepanov	c0a2f20eee	[#1422] multinet: Add metrics ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	2d064d0bd8	[#1422] morph: Resolve funlen linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	ef38420623	[#1422] ir: Add dialer source ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	f7caef355b	[#1422] node: Use dialer source for morph ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	fbdfd503e4	[#1422] morph: Add dialer source support ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	67798bb50e	[#1422] mod: Bump neoneo-go version ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	5b653aa65f	[#1422] morph: Drop single client as not used ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	e314f328c4	[#1422] tree: Use dialer source for tree service connections ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	6c96cc2af6	[#1422] node: Use dialer source for SDK cache ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	74db735265	[#1422] node: Add dialer source to config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Dmitrii Stepanov	3304afa9d1	[#1422] config: Add multinet config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Evgenii Stratonikov	b42bcdc6fa	[#1433] services/object: Put object before auxiliary info ... Consider the following operations ordering: 1. Inhume(with tombstone A) --> add tombstone mark for an object 2. --> new epoch arives 3. --> GCMark is added for a tombstone A, because it is unavailable 4. Put(A) --> return error, because the object already has a GCMark It is possible, and I have successfully reproduced it with a test on the shard level. However, the error is related to the specific _ordering_ of operations with engine. And triggering race-conditions like this is only possible on a shard level currently, so no tests are written. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-17 14:43:13 +03:00
Evgenii Stratonikov	b0c5def2d9	[#1433] shard/test: Use WithDisabledGC() option where possible ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-17 14:38:07 +03:00