1807 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	36efccd862	[#1298] writecache: Add shrink flag for Seal command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-08 16:32:29 +03:00
Dmitrii Stepanov	5c01bd5be8	[#1298] writecache: Add restore-mode flag for Seal command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-07 11:20:14 +03:00
Dmitrii Stepanov	c49982d22a	[#1282] cli: Allow to external addresses first for object nodes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-01 09:16:19 +03:00
Airat Arifullin	85a77b7c21	[#1279] adm: Interpret "root" name as empty for namespace target type ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-29 12:57:40 +00:00
Evgenii Stratonikov	8377372a40	[#1276] go.mod: Update api-go ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-26 16:44:19 +03:00
George Bartolomey	1032075a21	[#1259] cli: Remove locode subcommand ... Removed `frostfs-cli util locode` subcommand. Alternative command could be found in `git.frostfs.info/TrueCloudLab/frostfs-locode-db`. Signed-off-by: George Bartolomey <george@bh4.ru>	2024-07-23 14:59:14 +03:00
Evgenii Stratonikov	3940bc17c1	[#1251] pilorama: Allow traversing multiple branches in parallel ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-17 11:25:07 +03:00
Alexander Chuprov	08953a2f94	[#1239] adm/morph: Fix transfer GAS to alphabet nodes ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-07-11 18:28:32 +03:00
Alexander Chuprov	36956db123	[#1159] adm/frostfsid: Remove wallet requirement for list-* ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-07-11 14:04:37 +00:00
Alexander Chuprov	784e8ef857	[#1209] cli: Add --quiet flag to healthcheck command ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-07-09 12:40:32 +00:00
Dmitrii Stepanov	ca974b8b4c	[#1233] cli: Drop debugee from object nodes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-09 07:54:29 +00:00
Airat Arifullin	6ef38c07bd	[#1235] cli: Fix parse action ... * Parsed `object.*` lexeme should also include `MethodRangeObject` constant. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-08 18:35:44 +03:00
Airat Arifullin	0c2b6f3dac	[#1216] ape: Make services use bearer chains fed router ... * Refactor object and tree service - they should instantiate chain router cheking the bearer token. If there are no bearer token rules, then defaul chain router is used. * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-05 18:26:48 +00:00
Dmitrii Stepanov	78b1d9b18d	[#1226] blobovniczatree: Drop leaf width limitation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-04 12:22:06 +03:00
Dmitrii Stepanov	40c9ddb6ba	[#1226] blobovniczatree: Drop init in advance option ... To make blobovniczatree unlimited. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-04 12:22:06 +03:00
Evgenii Stratonikov	91bed3b0ba	[#1219] Remove Container.SetEACL method ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-02 13:05:40 +00:00
Alexander Chuprov	74842e7f43	[#1210] adm: Fix error handling when contract not found ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-07-02 13:03:40 +00:00
Ekaterina Lebedeva	56eeb630b6	[#1217] Fix grammar mistakes and misspelling ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-07-01 19:14:25 +03:00
Anton Nikiforov	36eab4059c	[#218] adm: Refactor helper in part of reading alphabet wallets ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-07-01 06:56:02 +00:00
Anton Nikiforov	72ab373b71	[#218] adm: Update doc for morph generate-alphabet ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-07-01 06:56:02 +00:00
Dmitrii Stepanov	10497e9136	[#1213] cli: Do not allow to lock EC chunks ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-01 06:49:35 +00:00
Anton Nikiforov	81070ada01	[#1091] cli: Check NotFound properly for control list-targets ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-06-27 13:18:36 +00:00
Dmitrii Stepanov	4f7d76c9ef	[#1206] audit: Drop not required events ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-27 10:54:31 +00:00
Ekaterina Lebedeva	a0e5fc733e	[#1145] node/ir: Handle double SIGHUP correctly ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-06-25 12:07:14 +03:00
Dmitrii Stepanov	df894fbac7	[#451] frostfs-node: Add cache metrics ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-25 08:52:37 +00:00
Dmitrii Stepanov	81ea91de52	[#451] metrics: Move to internal ... `metrics` don't look like something others want to import. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-25 08:52:37 +00:00
Dmitrii Stepanov	46732b61d7	[#60] cli: Add await flag to control set-status ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-20 16:28:42 +03:00
Dmitrii Stepanov	a83eeddb1d	[#60] control: Add GetNetmapStatus method ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-20 16:28:42 +03:00
Airat Arifullin	68eb68f59a	[#1189] cli: Make util subcommand convert eACL to APE chains ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-20 11:29:02 +00:00
Airat Arifullin	11e880de7f	[#1186] cli: Make owner field optional for bearer token ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-19 17:23:57 +00:00
Dmitrii Stepanov	fd28461def	[#1184] ir: Add grpc middleware for control service ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-19 16:05:53 +03:00
Dmitrii Stepanov	ecd1ed7a5e	[#1184] node: Add audit middleware for grpc services ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-19 16:05:53 +03:00
Dmitrii Stepanov	7b8937ec35	[#1184] config: Add audit.enabled parameter for node ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-19 16:05:53 +03:00
Airat Arifullin	b9d6c9d10c	[#1177] cli: Fix resource name parsing ... * If `root` name is given explicitly, then it should be translated to `//` but not `/root/`. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-14 13:09:08 +03:00
Evgenii Stratonikov	dbd3b238f7	[#1170] node: Support morph mTLS ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-14 09:30:46 +03:00
Evgenii Stratonikov	a0e49fa5a5	[#1170] adm: Support morph mTLS ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-14 09:27:06 +03:00
Alexander Chuprov	41e670c9ba	[#1167] adm/morph: Move literal to const ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-06-11 15:15:21 +00:00
Alexander Chuprov	d4f425f86a	[#1167] adm/morph: Fix set-config parameter validation ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-06-11 15:15:21 +00:00
Dmitrii Stepanov	069c1559cc	[#1164] cli: Improve object nodes performance ... Do complex EC object parts flatten concurrently. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-11 08:45:44 +03:00
Anton Nikiforov	a0c588263b	[#1157] cli: Support adding APE overrides to Bearer token ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-07 12:11:11 +00:00
Airat Arifullin	239323eeef	[#1157] tree: Make tree service use Bearer token's APE overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-07 12:11:11 +00:00
Airat Arifullin	04a3f891fd	[#1157] object: Make APE checker use Bearer-token's APE overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-07 12:11:11 +00:00
Evgenii Stratonikov	a849236b68	[#1161] node: Remove notification functionality ... It is unused and will be reworked in future. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-07 12:10:51 +00:00
Anton Nikiforov	67b3002743	[#951] adm: Check for error when reading contracts from archive ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-06-07 12:09:16 +00:00
Alexander Chuprov	643480d6fa	[#1146] adm: Make --group-name flag required ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-06-03 13:54:59 +03:00
Airat Arifullin	0b367007fc	[#1152] go.mod: Update api-go and sdk versions ... * Resolve conflicts for apemanager since api-go contains ape and apemanager packages and SDK only ape package. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-31 15:39:09 +03:00
Anton Nikiforov	6130650bb6	[#1147] node: Implement Lock\Delete requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-30 08:13:04 +00:00
Anton Nikiforov	88b8ddd902	[#1147] cli: Fix output when print EC info with flags json & proto ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-30 08:13:04 +00:00
Anton Nikiforov	50923ed81c	[#1147] Fix gofumpt issue ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-30 08:13:04 +00:00
Alex Vanin	4a34d0d40e	[#1149] go.mod: Bump neo-go up to v0.106.0 ... Required to work with neo-go v0.106.0 node with default hardfork configuration. Without neo-go client version bump, it throws error. failed to get network magic: unexpected hardfork: Cockatrice Signed-off-by: Alex Vanin <a.vanin@yadro.com>	2024-05-30 08:11:58 +00:00
Ekaterina Lebedeva	cc3f762cf2	[#12] cli: clarify -g usage in container list ... Add usage replacement for `container list -g` and verbose warning when using `-g` without `--owner`. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-05-28 15:18:30 +03:00
Airat Arifullin	2b02f52cd9	[#1105] cli: Add apemanager commands ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-27 09:34:21 +00:00
Airat Arifullin	542d3adcb2	[#1105] apemanager: Implement apemanager service ... * Introduce grpc server for apemanager service and its implementation in `pkg/services/apemanager`. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-27 09:34:21 +00:00
Airat Arifullin	2697d4d1fe	[#1143] node: Fix frostfsid cache ... * Fix `subjectFromSubjectExtended` converter. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-20 18:49:52 +03:00
Dmitrii Stepanov	436c9f5558	[#1129] policer: Restore EC object ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-17 14:36:18 +03:00
Dmitrii Stepanov	cbe9757490	[#1129] policer: Pull required EC chunks ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:49 +03:00
Dmitrii Stepanov	d45d086acd	[#1129] policer: Add EC chunk replication ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:48 +03:00
Evgenii Stratonikov	af57d5a6a1	[#1138] adm/test: Use --size=1 for negative tests ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-16 10:40:59 +00:00
Evgenii Stratonikov	2f04ce2f79	[#1138] adm: Parallelize generate-alphabet command ... This is the longest test in our suite, try to help CI a bit. Before: ``` $ go test -run=TestGenerateAlphabet -count=10 . ok git.frostfs.info/TrueCloudLab/frostfs-node/cmd/frostfs-adm/internal/modules/morph/generate 45.400s ``` After: ``` $ go test -run=TestGenerateAlphabet -count=10 . ok git.frostfs.info/TrueCloudLab/frostfs-node/cmd/frostfs-adm/internal/modules/morph/generate 33.267s ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-16 10:40:59 +00:00
Alexander Chuprov	b078fe5ba1	[#1092] control: Move SignMessage to separate package ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-05-16 12:14:01 +03:00
Evgenii Stratonikov	b4cfc80579	[#1133] node: Improve tests for shards.default config section ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-15 09:48:21 +03:00
Airat Arifullin	952d13cd2b	[#1124] cli: Improve APE rule parsing ... * Make APE rule parser to read condition's kind in unambiguous using lexemes `ResourceCondition`, `RequestCondition` instead confusing `Object.Request`, `Object.Resource`. * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-14 12:23:26 +03:00
aarifullin	20baf6e112	[#1108] ape: Update policy-engine version for listing by iteration ... * Update go.mod with a new version of policy-engine pacakge. * Adapt SwitchRPCGuardedActor to ContractStorage interface. * Fix `frostfs-adm` util. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-14 12:17:56 +03:00
Anoke	74135776c7	[#1067] adm: Fix panic on negative value ... Signed-off-by: Anoke <rustamgta1011@gmail.com>	2024-05-13 16:44:04 +00:00
Dmitrii Stepanov	0144117cc9	[#1125] objectSvc: Add EC header APE check ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 16:25:55 +03:00
Dmitrii Stepanov	368218f0cc	[#1120] cli: Edit object nodes output ... Print detailed information only. Allow to output to JSON. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:58 +03:00
Dmitrii Stepanov	a45b548a6f	[#1120] cli: Add explain to object nodes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:58 +03:00
Dmitrii Stepanov	654384990c	[#1120] cli: Fix object nodes for linking objects ... Do not use linking objects to get placement for complex object. Linking objects should be stored on all container nodes, also they are not required. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:57 +03:00
Dmitrii Stepanov	5c730de96e	[#1120] cli: Add EC support to object nodes command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:57 +03:00
Alexander Chuprov	854200a874	[#1115] node: Remove unused const ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-05-07 19:11:21 +03:00
Airat Arifullin	9cc51f86b7	[#1117] node: Introduce cache for frostfsid contract client ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-07 10:01:21 +00:00
Ekaterina Lebedeva	e07869a8cf	[#1100] Remove unused fields ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-05-06 10:14:36 +03:00
Evgenii Stratonikov	52bebe9452	[#1110] node: Use single handler for new epoch event ... Bootstrap logic depends on the netmap status, which in turn depends on the node info. Updating them in a single thread makes things more predictable. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Evgenii Stratonikov	4b514f5ba0	[#1110] node: Log maintenance stop only if it was enabled ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Evgenii Stratonikov	c8e2ca2ab4	[#1110] node: Rename handleLocalNodeInfo() ... It is used in "handler" only once, what we really do is set the variable. And we have another "local" node info in `cfgNodeInfo`, this one is not really local (node info), more like (local node) info, so use setContractNodeInfo to distinguish it from the local view on the node info. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Evgenii Stratonikov	3b9d12b11c	[#1110] node: Fix comment about nodeInfo type ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Anton Nikiforov	411a8d0245	[#1004] blobovnicza: Use TTL for blobovnicza tree cache ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-26 19:54:29 +03:00
Anton Nikiforov	112a7c690f	[#1103] node: Implement Get\Head requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-24 18:15:53 +03:00
Airat Arifullin	10ee865e98	[#1096] tree: Make verifyClient fill ape request with user claim tags ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-16 15:12:46 +03:00
Airat Arifullin	c21d72ac23	[#1096] object: Make ape middleware fill request with user claim tags ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-16 15:12:44 +03:00
Evgenii Stratonikov	97e54066d0	[#1095] adm: Support user/group target for APE ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-16 11:03:50 +00:00
Evgenii Stratonikov	46bc6a7930	[#1095] cli: Support user/group target for local overrides ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-16 11:03:50 +00:00
aarifullin	6a46c6d229	[#1090] tree: Make workaround for APE checks ... * Make `verifyClient` method perform APE check if a container was created with zero-filled basic ACL. * Object verbs are used in APE, until tree verbs are introduced. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-15 07:45:45 +00:00
Evgenii Stratonikov	669103a33e	Reapply "[#972] Use slices.Sort* when useful" ... This reverts commit 3359349acb. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Evgenii Stratonikov	2ca5dfc2f6	Reapply "[#972] Adopt slices.BinarySearch()" ... This reverts commit 4bfc6d29b9. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Evgenii Stratonikov	3dc81cb4fc	Reapply "[#972] Use min/max builtins" ... This reverts commit dad56d2e98. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Dmitrii Stepanov	57466594fb	[#1024] shard: Resync metabase concurrently ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-10 10:21:10 +03:00
Dmitrii Stepanov	bdf4990904	[#1064] cli: Add EC header output to object head ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-09 07:08:53 +00:00
Alexander Chuprov	92569b9bbf	[#1065] cli: Add support EC parameters ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-04-08 12:27:51 +03:00
Alexander Chuprov	17f7adb640	[#1065] adm: Add support EC parameters ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-04-08 12:27:30 +03:00
Alexander Chuprov	0290f86579	[#1065] adm: refactor dump-config ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-04-08 12:06:23 +03:00
Anton Nikiforov	9aa533e59a	[#1072] node, ir: Add new config option kludge_compatibility_mode ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-04 11:05:25 +03:00
aarifullin	531542ce60	[#1063] cli: Validate container creation for EC policy ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-03 10:33:51 +00:00
aarifullin	4738508ce2	[#1063] go.mod: Update SDK version ... * Update frostfs-sdk and frostfs-api-go versions. * Refactor depreacted method ReplicaNumberByIndex. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-03 10:33:51 +00:00
Airat Arifullin	4080b99310	[#1061] node: Set TTL for morph rule cache from morph config ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-02 12:40:56 +03:00
Dmitrii Stepanov	5d58b44bc8	[#1044] node: Drop unused methods from APE implementation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-18 18:44:10 +03:00
Dmitrii Stepanov	6bf77cabd4	[#1044] ape: Add morph chain cache ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-18 18:44:10 +03:00
Anton Nikiforov	7278201753	[#1030] adm: Add command morph ape list-targets ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-15 13:48:43 +03:00
Anton Nikiforov	bf70d77844	[#976] adm: Allow to remove all chains by target ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-13 15:33:26 +03:00
Anton Nikiforov	11fde3cde4	[#976] cli: Allow to remove all chains by target ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-13 15:33:26 +03:00