5151 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Evgenii Stratonikov	39e3339df6	adm: Allow to use --local-dump everywhere --rpc-endpoint is present ... Currently, we allow using `--local-dump` in `morph init` command. We also have this flag in other commands, but no `--protocol` which is also needed. And in new command we do not have the ability to use local dump at all. This commit makes it possible to work either with an RPC or with local-dump in every command. Refs #1035. Refs TrueCloudLab/frostfs-dev-env#42. Writing gopatch this time was really satisfying, btw: ``` @@ var flags expression @@ -flags.StringP(commonflags.EndpointFlag, ...) +commonflags.InitRPC(flags) @@ var flags expression @@ -_ = viper.BindPFlag(commonflags.EndpointFlag, flags.Lookup(...)) +commonflags.BindRPC(flags) ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 14:31:47 +03:00
Evgenii Stratonikov	00d16dbfd1	m ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 14:24:02 +03:00
Evgenii Stratonikov	70f77a53d9	adm: Move ProtoConfigPath from constants to commonflags package ... Refs #932 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 14:16:34 +03:00
Evgenii Stratonikov	6ae8667fb4	[#1509] .forgejo: Run actions on push to master ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 11:42:12 +03:00
Evgenii Stratonikov	49a4e727fd	[#1507] timer/test: Use const for constants ... Make it easy to see what the test is about. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 08:36:25 +00:00
Evgenii Stratonikov	2e974f734c	[#1507] timer/test: Improve test coverage ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 08:36:25 +00:00
Evgenii Stratonikov	3042490340	[#1507] timer: Remove unused OnDelta() method ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-20 08:36:25 +00:00
Airat Arifullin	a339b52a60	[#1501] adm: Refactor APE-chains managing subcommands ... * Use `cmd/internal/common/ape` parser commands within `ape` subcommands * Use flag names from `cmd/internal/common/ape Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	4ab4ed6f96	[#1501] cli: Refactor bearer subcommand ... * Use `cmd/internal/common/ape` parser commands within `generate-ape-override` subcommand * Use flag names from `cmd/internal/common/ape` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	3b1364e4cf	[#1501] cli: Refactor ape-manager subcommands ... * Refactor ape-manager subcommands * Use `cmd/internal/common/ape` parser commands within ape-manager subcommands * Use flag names from `cmd/internal/common/ape` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	daff77b273	[#1501] cli: Refactor local override managing subcommands ... * Refactor local override managing subcommands * Use `cmd/internal/common/ape` parser commands within local override subcommands * Use flag names from `cmd/internal/common/ape` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	7a7ee71a4d	[#1501] cmd: Introduce common APE-chain parser commands ... * Introduce common parsing commands to use them in `frostfs-cli` and `frostfs-adm` APE-related subcommands * Introduce common flags for these parsing commands Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	ffe9906266	[#1501] cli: Move APE-chain parser methods to pkg/util ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	ae31ef3602	[#1501] cli: Move PrintHumanReadableAPEChain to a common package ... * Both `frostfs-cli` and `frostfs-adm` APE-related subcommands use `PrintHumanReadableAPEChain` to print a parsed APE-chain. So, it's more correct to have it in a common package over `frostfs-cli` and `frostfs-adm` folders. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Airat Arifullin	e2cb0640f1	[#1501] util: Move eACL-to-APE converter to pkg/util ... * `ConvertEACLToAPE` is useful method which couldn't be imported out of frostfs-node so far as it has been in `internal` * Since `ConvertEACLToAPE` and related structures and unit-tests are placed in `pkg/util` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-11-20 07:58:32 +00:00
Evgenii Stratonikov	9f4ce600ac	[#1505] adm: Allow to manage additional keys in frostfsid ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-19 16:25:16 +03:00
Evgenii Stratonikov	d82f0d1926	[#1496] node/control: Await until SetNetmapStatus() persists ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	acd5babd86	[#1496] morph: Merge InvokeRes and WaitParams ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	b65874d1c3	[#1496] morph: Return InvokeRes from all invoke*() methods ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	69c63006da	[#1496] morph: Move tx waiter to morph package ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-15 16:36:07 +03:00
Evgenii Stratonikov	d77a218f7c	[#1493] metabase: Merge Inhume() and DropGraves() for tombstones ... DropGraves() is only used to drop gravemarks after a tombstone removal. Thus, it makes sense to do Inhume() and DropGraves() in one transaction. It has less overhead and no unexpected problems in case of sudden power failure. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Evgenii Stratonikov	44df67492f	[#1493] metabase: Split inhumeTx() into 2 functions ... No functional changes. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Evgenii Stratonikov	1e6f132b4e	[#1493] metabase: Pass InhumePrm by value ... Unify with the other code, no functional changes. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Evgenii Stratonikov	6dc0dc6691	[#1493] shard: Take mode mutex in HandleExpiredTombstones() ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-14 06:47:04 +00:00
Alexander Chuprov	f7cb6b4d87	[#1482] Makefile: Update golangci-lint ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-11-13 15:01:41 +00:00
Aleksey Savchuk	7fc6101bec	[#1491] engine/test: Rework engine test utils ... - Remove `testNewShard` and `setInitializedShards` because they violated the default engine workflow. The correct workflow is: first use `New()`, followed by `Open()`, and then `Init()`. As a result, adding new logic to `(*StorageEngine).Init` caused several tests to fail with a panic when attempting to access uninitialized resources. Now, all engines created with the test utils must be initialized manually. The new helper method `prepare` can be used for that purpose. - Additionally, `setInitializedShards` hardcoded the shard worker pool size, which prevented it from being configured in tests and benchmarks. This has been fixed as well. - Ensure engine initialization is done wherever it was missing. - Refactor `setShardsNumOpts`, `setShardsNumAdditionalOpts`, and `setShardsNum`. Make them all depend on `setShardsNumOpts`. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-11-13 14:42:53 +03:00
Aleksey Savchuk	7ef36749d0	[#1491] engine/test: Move BenchmarkExists to exists_test.go ... Move `BenchmarkExists` from `engine_test.go` to `exists_test.go` for better organization and clarity. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-11-13 14:09:29 +03:00
Aleksey Savchuk	c6066d6ee4	[#1491] engine/test: Use more suitable testing utils here and there ... Use `setShardsNum` instead of `setInitializedShards` wherever possible. Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-11-13 14:09:29 +03:00
Dmitrii Stepanov	612b34d570	[#1437] logger: Add caller skip to log original caller position ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:12 +03:00
Dmitrii Stepanov	7429553266	[#1437] node: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:10 +03:00
Dmitrii Stepanov	6921a89061	[#1437] ir: Fix contextcheck linters ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:10 +03:00
Dmitrii Stepanov	16598553d9	[#1437] shard: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:09 +03:00
Dmitrii Stepanov	c139892117	[#1437] ir: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:09 +03:00
Dmitrii Stepanov	62b5181618	[#1437] blobovnicza: Fix contextcheck linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:08 +03:00
Dmitrii Stepanov	6db46257c0	[#1437] node: Use ctx for logging ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-13 10:36:07 +03:00
Dmitrii Stepanov	c16dae8b4d	[#1437] logger: Use context to log trace id ... Signed-off-by: Dmitrii Stepanov	2024-11-13 10:36:07 +03:00
Evgenii Stratonikov	fd004add00	[#1492] metabase: Fix import formatting ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-13 07:30:25 +00:00
Evgenii Stratonikov	8ed7a676d5	[#1492] metabase: Ensure Unmarshal() is called on a cloned slice ... The slice returned from bucket.Get() is only valid during the tx lifetime. Cloning it is not necessary everywhere, but better safe than sorry. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-13 07:30:25 +00:00
Evgenii Stratonikov	b451de94c8	[#1492] metabase: Fix typo in objData ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-13 07:30:25 +00:00
Dmitrii Stepanov	f1556e3c42	[#1488] Makefile: Drop all containers created on env-up ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 17:24:44 +03:00
Dmitrii Stepanov	e122ff6013	[#1488] dev: Add Jaeger image and enable tracing on debug ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 17:24:44 +03:00
Dmitrii Stepanov	e2658c7519	[#1488] tracing: KV attributes for spans from config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 17:24:43 +03:00
Dmitrii Stepanov	c00f4bab18	[#1488] go.mod: Bump observability version ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 17:24:43 +03:00
Dmitrii Stepanov	46fef276b4	[#1449] tree: Log tree sync with Info level ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 12:11:07 +00:00
Dmitrii Stepanov	9bd05e94c8	[#1449] tree: Add ApplyBatch method ... Concurrent Apply can lead to child node applies before parent, so undo/redo operations will perform. This leads to performance degradation in case of tree with many sublevels. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 12:11:07 +00:00
Evgenii Stratonikov	16830033f8	[#1483] cli: Remove --basic-acl flag ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-12 12:10:51 +00:00
Evgenii Stratonikov	1cf51a8079	[#1483] cli/docs: Remove set-eacl mention ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-12 12:10:51 +00:00
Evgenii Stratonikov	3324c26fd8	[#1483] morph: Remove container.GetEACL() ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-12 12:10:51 +00:00
Evgenii Stratonikov	a692298533	[#1483] node: Remove eACL cache ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-11-12 12:10:51 +00:00
Anton Nikiforov	be2753de00	[#1490] docs: Update description for object.get.priority ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-11-12 13:35:13 +03:00