224 commits

Author	SHA1	Message	Date
Ekaterina Lebedeva	df05057ed4	[#1452] container: Add ListStream method ... * Added new method for listing containers to container service. It opens stream and sends containers in batches. * Added TransportSplitter wrapper around ExecutionService to split container ID list read from contract in parts that are smaller than grpc max message size. Batch size can be changed in node configuration file (as in example config file). * Changed `container list` implementaion in cli: now ListStream is called by default. Old List is called only if ListStream is not implemented. * Changed `internalclient.ListContainersPrm`.`Account` to `OwnerID` since `client.PrmContainerList`.`Account` was renamed to `OwnerID` in sdk. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-12-17 16:22:43 +03:00
Ekaterina Lebedeva	b6c8ebf493	[#1453] container: Replace sort.Slice with slices.SortFunc ... * Replaced `sort.Slice` with `slices.SortFunc` in `ListContainersRes.SortedIDList()` as it is a bit faster, according to 15102e6dfd. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-12-17 13:33:43 +03:00
Dmitrii Stepanov	ac0511d214	[#1549] controlSvc: Drop deprecated EvacuateShard rpc ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-12-10 16:59:52 +03:00
Anton Nikiforov	635a292ae4	[#1528] cli: Keep order for required nodes in the result of object nodes ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-12-02 13:58:24 +03:00
Airat Arifullin	4ab4ed6f96	[#1501] cli: Refactor bearer subcommand ... * Use `cmd/internal/common/ape` parser commands within `generate-ape-override` subcommand * Use flag names from `cmd/internal/common/ape` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	3b1364e4cf	[#1501] cli: Refactor ape-manager subcommands ... * Refactor ape-manager subcommands * Use `cmd/internal/common/ape` parser commands within ape-manager subcommands * Use flag names from `cmd/internal/common/ape` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	daff77b273	[#1501] cli: Refactor local override managing subcommands ... * Refactor local override managing subcommands * Use `cmd/internal/common/ape` parser commands within local override subcommands * Use flag names from `cmd/internal/common/ape` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	ffe9906266	[#1501] cli: Move APE-chain parser methods to pkg/util ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	ae31ef3602	[#1501] cli: Move PrintHumanReadableAPEChain to a common package ... * Both `frostfs-cli` and `frostfs-adm` APE-related subcommands use `PrintHumanReadableAPEChain` to print a parsed APE-chain. So, it's more correct to have it in a common package over `frostfs-cli` and `frostfs-adm` folders. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	e2cb0640f1	[#1501] util: Move eACL-to-APE converter to pkg/util ... * `ConvertEACLToAPE` is useful method which couldn't be imported out of frostfs-node so far as it has been in `internal` * Since `ConvertEACLToAPE` and related structures and unit-tests are placed in `pkg/util` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Evgenii Stratonikov	16830033f8	[#1483] cli: Remove --basic-acl flag ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-12 12:10:51 +00:00
Evgenii Stratonikov	1cf51a8079	[#1483] cli/docs: Remove set-eacl mention ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-12 12:10:51 +00:00
Alexander Chuprov	80f8a8fd3a	[#1396] cli/playground: Refactor ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-11-12 11:09:27 +03:00
Alexander Chuprov	2f3bc6eb84	[#1396] cli/playground: Improve terminal control key handling ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-11-12 11:07:48 +03:00
Airat Arifullin	9b13a18aac	[#1479] go.mod: Bump frostfs-sdk-go version ... * Update version within go.mod; * Fix deprecated frostfs-api-go/v2 package and use frostfs-sdk-go/api instead. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-08 10:43:19 +03:00
Evgenii Stratonikov	15102e6dfd	[#1471] Replace sort.Slice in some places ... `slices.SortFunc` doesn't use reflection and is a bit faster. I have done some micro-benchmarks for `[]NodeInfo`: ``` $ benchstat -col "/func" out goos: linux goarch: amd64 pkg: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/local_object_storage/pilorama cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz │ sort.Slice │ slices.SortFunc │ │ sec/op │ sec/op vs base │ Sort-8 2.130µ ± 2% 1.253µ ± 2% -41.20% (p=0.000 n=10) ``` Haven't included them, though, as they I don't see them being used a lot. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-06 08:07:32 +00:00
Evgenii Stratonikov	17ec84151b	[#532] cli: Respect XDG base directory spec ... XDG base directory specification defines where various files should be looked by an application. Hopefully, this makes `frostfs-cli` more predictable and pleasant to work with. Luckily for us, golang already has everything we need in the stdlib. This commit also gets rid of `github.com/mitchellh/go-homedir` dependency. Close #532 Refs #1455 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-05 16:27:18 +03:00
Evgenii Stratonikov	c2effcc61c	[#1465] Makefile: Update golangci-lint, fix warnings ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-31 06:39:59 +00:00
Evgenii Stratonikov	89892d9754	[#1459] cli: Simplify slice append ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-30 15:18:22 +00:00
Evgenii Stratonikov	433aab12bb	[#1455] cli: Handle missing home directory ... go-homedir library incorrectly handles some of the errors that could occur. It is archived, so no PR, but let's fix it on our side. The scenario in case: executing command in an empty environment. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-10-29 16:37:55 +03:00
Aleksey Savchuk	29708b78d7	[#1442] cli/tree: Enchance error message if rpc-endpoint isn't defined ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 13:05:17 +00:00
Aleksey Savchuk	b9284604d9	[#1442] cli/tree: Allow to specify rpc-endpoint with config file ... We have several ways to specify the `rpc-endpoint`: with a flag, with a single config file or multiple files. Before, the `rpc-endpoint` flag was marked as required. Because `cobra` checked the required flag presence first, it prevented specifying `rpc-endpoint` with a config file. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 13:05:17 +00:00
Aleksey Savchuk	6f798b9c4b	[#1441] cli: Use grpc.WaitForReady while initializing SDK client ... Before, when the target RPC server was unavailable, requests made by CLI didn't wait for a timeout specified by the `--timeout` option if the timeout was more than 20 seconds. It's because of the gRPC default backoff strategy. Adding this option fixes that behavior. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-10-23 11:45:44 +00:00
Alexander Chuprov	63466d71b2	[#1431] engine: Delete unused constants ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-15 08:53:59 +00:00
Anton Nikiforov	d0ed29b3c7	[#1350] node: Add ability to evacuate objects from REP 1 only ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-27 15:41:17 +03:00
Dmitrii Stepanov	2bd560e528	[#1388] cli: Drop unused flag/parameter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-25 08:55:38 +00:00
Anton Nikiforov	34e6a309c6	[#1356] engine: Evacuate object from shards concurrently ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-24 12:50:19 +03:00
Aleksey Savchuk	c34b8acedd	[#1312] Drop handling of system attributes with NeoFS prefix ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-09-20 11:37:18 +00:00
Dmitrii Stepanov	3441fff05d	[#1382] cli: Replace deprecated methods ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-18 14:35:48 +03:00
Dmitrii Stepanov	944160427b	[#1374] cli: Drop deprecated grpc connection method ... For `frostfs-cli` it is ok to use grpc-client without blocking, as `frostfs-cli` will perform RPC call anyway. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-13 15:59:26 +03:00
Aleksey Savchuk	66e17f4b8e	[#1368] cli/container: Use dedicated method to list user attributes ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-09-12 10:01:27 +03:00
Ekaterina Lebedeva	dea6f031f9	[#1331] cli/tree: Add order flag to tree get-subtree ... Added `--ordered` flag to sort output by ascending FileName. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-09-11 11:30:28 +00:00
Dmitrii Stepanov	a61201a987	[#1337] config: Move rebuild_worker_count to shard section ... This makes it simple to limit performance degradation for every shard because of rebuild. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-06 13:57:27 +03:00
Dmitrii Stepanov	6b6eabe41c	[#1337] cli: Add control shards rebuild command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-06 13:57:27 +03:00
Anton Nikiforov	108e4e07be	[#1349] node: Evacuate objects without setting mode to MAINTENANCE ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-09-05 16:08:27 +03:00
Aleksey Savchuk	a4fb7f085b	[#1348] go.mod: Update api-go and sdk-go ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-09-04 10:47:26 +03:00
Ekaterina Lebedeva	a685fcdc96	[#1317] go.mod: Use range over int ... Since Go 1.22 a "for" statement with a "range" clause is able to iterate through integer values from zero to an upper limit. gopatch script: @@ var i, e expression @@ -for i := 0; i <= e - 1; i++ { +for i := range e { ... } @@ var i, e expression @@ -for i := 0; i <= e; i++ { +for i := range e + 1 { ... } @@ var i, e expression @@ -for i := 0; i < e; i++ { +for i := range e { ... } Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-09-03 13:00:54 +03:00
Evgenii Stratonikov	98fe24cdb7	[#1343] go.mod: Update api-go ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-30 08:45:24 +00:00
Evgenii Stratonikov	03976c6ed5	[#1341] .golangci.yml: Replace exportloopref with copyloopvar ... exportloopref is deprecated. gopatch: ``` @@ var index, value identifier var slice expression @@ for index, value := range slice { ... -value := value ... } @@ var index, value identifier var slice expression @@ for index, value := range slice { ... -index := index ... } @@ var value identifier var channel expression @@ for value := range channel { ... -value := value ... } ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-28 15:44:41 +00:00
Dmitrii Stepanov	a059a7dcf0	[#1329] cli: Skip linking objects in complex object processing ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-23 13:51:20 +03:00
Aleksey Savchuk	dfe825b81b	[#1309] test: Clean up config after tests ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-08-22 08:49:10 +00:00
Evgenii Stratonikov	7bca428db0	[#1322] Use new protobuf marshaler ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-22 07:17:41 +00:00
Airat Arifullin	41104f2383	[#1307] cli: Make cli process object.patch ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-08-16 14:13:09 +00:00
Airat Arifullin	5ed317e24c	[#1307] cli: Introduce object patch command ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-08-16 14:13:09 +00:00
Dmitrii Stepanov	93d63e1632	[#1284] writecache: Allow to seal writecache async ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 13:23:35 +03:00
Dmitrii Stepanov	36efccd862	[#1298] writecache: Add shrink flag for Seal command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-08 16:32:29 +03:00
Dmitrii Stepanov	5c01bd5be8	[#1298] writecache: Add restore-mode flag for Seal command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-07 11:20:14 +03:00
Dmitrii Stepanov	c49982d22a	[#1282] cli: Allow to external addresses first for object nodes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-01 09:16:19 +03:00
Evgenii Stratonikov	8377372a40	[#1276] go.mod: Update api-go ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-26 16:44:19 +03:00
George Bartolomey	1032075a21	[#1259] cli: Remove locode subcommand ... Removed `frostfs-cli util locode` subcommand. Alternative command could be found in `git.frostfs.info/TrueCloudLab/frostfs-locode-db`. Signed-off-by: George Bartolomey <george@bh4.ru>	2024-07-23 14:59:14 +03:00