1883 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	df894fbac7	[#451] frostfs-node: Add cache metrics ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-25 08:52:37 +00:00
Dmitrii Stepanov	81ea91de52	[#451] metrics: Move to internal ... `metrics` don't look like something others want to import. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-25 08:52:37 +00:00
Dmitrii Stepanov	46732b61d7	[#60] cli: Add await flag to control set-status ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-20 16:28:42 +03:00
Dmitrii Stepanov	a83eeddb1d	[#60] control: Add GetNetmapStatus method ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-20 16:28:42 +03:00
Airat Arifullin	68eb68f59a	[#1189] cli: Make util subcommand convert eACL to APE chains ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-20 11:29:02 +00:00
Airat Arifullin	11e880de7f	[#1186] cli: Make owner field optional for bearer token ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-19 17:23:57 +00:00
Dmitrii Stepanov	fd28461def	[#1184] ir: Add grpc middleware for control service ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-19 16:05:53 +03:00
Dmitrii Stepanov	ecd1ed7a5e	[#1184] node: Add audit middleware for grpc services ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-19 16:05:53 +03:00
Dmitrii Stepanov	7b8937ec35	[#1184] config: Add audit.enabled parameter for node ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-19 16:05:53 +03:00
Airat Arifullin	b9d6c9d10c	[#1177] cli: Fix resource name parsing ... * If `root` name is given explicitly, then it should be translated to `//` but not `/root/`. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-14 13:09:08 +03:00
Evgenii Stratonikov	dbd3b238f7	[#1170] node: Support morph mTLS ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-14 09:30:46 +03:00
Evgenii Stratonikov	a0e49fa5a5	[#1170] adm: Support morph mTLS ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-14 09:27:06 +03:00
Alexander Chuprov	41e670c9ba	[#1167] adm/morph: Move literal to const ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-06-11 15:15:21 +00:00
Alexander Chuprov	d4f425f86a	[#1167] adm/morph: Fix set-config parameter validation ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-06-11 15:15:21 +00:00
Dmitrii Stepanov	069c1559cc	[#1164] cli: Improve object nodes performance ... Do complex EC object parts flatten concurrently. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-11 08:45:44 +03:00
Anton Nikiforov	a0c588263b	[#1157] cli: Support adding APE overrides to Bearer token ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-07 12:11:11 +00:00
Airat Arifullin	239323eeef	[#1157] tree: Make tree service use Bearer token's APE overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-07 12:11:11 +00:00
Airat Arifullin	04a3f891fd	[#1157] object: Make APE checker use Bearer-token's APE overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-07 12:11:11 +00:00
Evgenii Stratonikov	a849236b68	[#1161] node: Remove notification functionality ... It is unused and will be reworked in future. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-07 12:10:51 +00:00
Anton Nikiforov	67b3002743	[#951] adm: Check for error when reading contracts from archive ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-06-07 12:09:16 +00:00
Alexander Chuprov	643480d6fa	[#1146] adm: Make --group-name flag required ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-06-03 13:54:59 +03:00
Airat Arifullin	0b367007fc	[#1152] go.mod: Update api-go and sdk versions ... * Resolve conflicts for apemanager since api-go contains ape and apemanager packages and SDK only ape package. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-31 15:39:09 +03:00
Anton Nikiforov	6130650bb6	[#1147] node: Implement Lock\Delete requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-30 08:13:04 +00:00
Anton Nikiforov	88b8ddd902	[#1147] cli: Fix output when print EC info with flags json & proto ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-30 08:13:04 +00:00
Anton Nikiforov	50923ed81c	[#1147] Fix gofumpt issue ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-30 08:13:04 +00:00
Alex Vanin	4a34d0d40e	[#1149] go.mod: Bump neo-go up to v0.106.0 ... Required to work with neo-go v0.106.0 node with default hardfork configuration. Without neo-go client version bump, it throws error. failed to get network magic: unexpected hardfork: Cockatrice Signed-off-by: Alex Vanin <a.vanin@yadro.com>	2024-05-30 08:11:58 +00:00
Ekaterina Lebedeva	cc3f762cf2	[#12] cli: clarify -g usage in container list ... Add usage replacement for `container list -g` and verbose warning when using `-g` without `--owner`. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-05-28 15:18:30 +03:00
Airat Arifullin	2b02f52cd9	[#1105] cli: Add apemanager commands ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-27 09:34:21 +00:00
Airat Arifullin	542d3adcb2	[#1105] apemanager: Implement apemanager service ... * Introduce grpc server for apemanager service and its implementation in `pkg/services/apemanager`. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-27 09:34:21 +00:00
Airat Arifullin	2697d4d1fe	[#1143] node: Fix frostfsid cache ... * Fix `subjectFromSubjectExtended` converter. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-20 18:49:52 +03:00
Dmitrii Stepanov	436c9f5558	[#1129] policer: Restore EC object ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-17 14:36:18 +03:00
Dmitrii Stepanov	cbe9757490	[#1129] policer: Pull required EC chunks ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:49 +03:00
Dmitrii Stepanov	d45d086acd	[#1129] policer: Add EC chunk replication ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:48 +03:00
Evgenii Stratonikov	af57d5a6a1	[#1138] adm/test: Use --size=1 for negative tests ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-16 10:40:59 +00:00
Evgenii Stratonikov	2f04ce2f79	[#1138] adm: Parallelize generate-alphabet command ... This is the longest test in our suite, try to help CI a bit. Before: ``` $ go test -run=TestGenerateAlphabet -count=10 . ok git.frostfs.info/TrueCloudLab/frostfs-node/cmd/frostfs-adm/internal/modules/morph/generate 45.400s ``` After: ``` $ go test -run=TestGenerateAlphabet -count=10 . ok git.frostfs.info/TrueCloudLab/frostfs-node/cmd/frostfs-adm/internal/modules/morph/generate 33.267s ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-16 10:40:59 +00:00
Alexander Chuprov	b078fe5ba1	[#1092] control: Move SignMessage to separate package ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-05-16 12:14:01 +03:00
Evgenii Stratonikov	b4cfc80579	[#1133] node: Improve tests for shards.default config section ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-15 09:48:21 +03:00
Airat Arifullin	952d13cd2b	[#1124] cli: Improve APE rule parsing ... * Make APE rule parser to read condition's kind in unambiguous using lexemes `ResourceCondition`, `RequestCondition` instead confusing `Object.Request`, `Object.Resource`. * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-14 12:23:26 +03:00
aarifullin	20baf6e112	[#1108] ape: Update policy-engine version for listing by iteration ... * Update go.mod with a new version of policy-engine pacakge. * Adapt SwitchRPCGuardedActor to ContractStorage interface. * Fix `frostfs-adm` util. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-14 12:17:56 +03:00
Anoke	74135776c7	[#1067] adm: Fix panic on negative value ... Signed-off-by: Anoke <rustamgta1011@gmail.com>	2024-05-13 16:44:04 +00:00
Dmitrii Stepanov	0144117cc9	[#1125] objectSvc: Add EC header APE check ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 16:25:55 +03:00
Dmitrii Stepanov	368218f0cc	[#1120] cli: Edit object nodes output ... Print detailed information only. Allow to output to JSON. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:58 +03:00
Dmitrii Stepanov	a45b548a6f	[#1120] cli: Add explain to object nodes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:58 +03:00
Dmitrii Stepanov	654384990c	[#1120] cli: Fix object nodes for linking objects ... Do not use linking objects to get placement for complex object. Linking objects should be stored on all container nodes, also they are not required. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:57 +03:00
Dmitrii Stepanov	5c730de96e	[#1120] cli: Add EC support to object nodes command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:57 +03:00
Alexander Chuprov	854200a874	[#1115] node: Remove unused const ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-05-07 19:11:21 +03:00
Airat Arifullin	9cc51f86b7	[#1117] node: Introduce cache for frostfsid contract client ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-07 10:01:21 +00:00
Ekaterina Lebedeva	e07869a8cf	[#1100] Remove unused fields ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-05-06 10:14:36 +03:00
Evgenii Stratonikov	52bebe9452	[#1110] node: Use single handler for new epoch event ... Bootstrap logic depends on the netmap status, which in turn depends on the node info. Updating them in a single thread makes things more predictable. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Evgenii Stratonikov	4b514f5ba0	[#1110] node: Log maintenance stop only if it was enabled ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Evgenii Stratonikov	c8e2ca2ab4	[#1110] node: Rename handleLocalNodeInfo() ... It is used in "handler" only once, what we really do is set the variable. And we have another "local" node info in `cfgNodeInfo`, this one is not really local (node info), more like (local node) info, so use setContractNodeInfo to distinguish it from the local view on the node info. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Evgenii Stratonikov	3b9d12b11c	[#1110] node: Fix comment about nodeInfo type ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-27 15:17:45 +03:00
Anton Nikiforov	411a8d0245	[#1004] blobovnicza: Use TTL for blobovnicza tree cache ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-26 19:54:29 +03:00
Anton Nikiforov	112a7c690f	[#1103] node: Implement Get\Head requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-24 18:15:53 +03:00
Airat Arifullin	10ee865e98	[#1096] tree: Make verifyClient fill ape request with user claim tags ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-16 15:12:46 +03:00
Airat Arifullin	c21d72ac23	[#1096] object: Make ape middleware fill request with user claim tags ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-16 15:12:44 +03:00
Evgenii Stratonikov	97e54066d0	[#1095] adm: Support user/group target for APE ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-16 11:03:50 +00:00
Evgenii Stratonikov	46bc6a7930	[#1095] cli: Support user/group target for local overrides ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-16 11:03:50 +00:00
aarifullin	6a46c6d229	[#1090] tree: Make workaround for APE checks ... * Make `verifyClient` method perform APE check if a container was created with zero-filled basic ACL. * Object verbs are used in APE, until tree verbs are introduced. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-15 07:45:45 +00:00
Evgenii Stratonikov	669103a33e	Reapply "[#972] Use slices.Sort* when useful" ... This reverts commit 3359349acb. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Evgenii Stratonikov	2ca5dfc2f6	Reapply "[#972] Adopt slices.BinarySearch()" ... This reverts commit 4bfc6d29b9. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Evgenii Stratonikov	3dc81cb4fc	Reapply "[#972] Use min/max builtins" ... This reverts commit dad56d2e98. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Dmitrii Stepanov	57466594fb	[#1024] shard: Resync metabase concurrently ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-10 10:21:10 +03:00
Dmitrii Stepanov	bdf4990904	[#1064] cli: Add EC header output to object head ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-09 07:08:53 +00:00
Alexander Chuprov	92569b9bbf	[#1065] cli: Add support EC parameters ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-04-08 12:27:51 +03:00
Alexander Chuprov	17f7adb640	[#1065] adm: Add support EC parameters ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-04-08 12:27:30 +03:00
Alexander Chuprov	0290f86579	[#1065] adm: refactor dump-config ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-04-08 12:06:23 +03:00
Anton Nikiforov	9aa533e59a	[#1072] node, ir: Add new config option kludge_compatibility_mode ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-04 11:05:25 +03:00
aarifullin	531542ce60	[#1063] cli: Validate container creation for EC policy ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-03 10:33:51 +00:00
aarifullin	4738508ce2	[#1063] go.mod: Update SDK version ... * Update frostfs-sdk and frostfs-api-go versions. * Refactor depreacted method ReplicaNumberByIndex. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-03 10:33:51 +00:00
Airat Arifullin	4080b99310	[#1061] node: Set TTL for morph rule cache from morph config ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-02 12:40:56 +03:00
Dmitrii Stepanov	5d58b44bc8	[#1044] node: Drop unused methods from APE implementation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-18 18:44:10 +03:00
Dmitrii Stepanov	6bf77cabd4	[#1044] ape: Add morph chain cache ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-18 18:44:10 +03:00
Anton Nikiforov	7278201753	[#1030] adm: Add command morph ape list-targets ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-15 13:48:43 +03:00
Anton Nikiforov	bf70d77844	[#976] adm: Allow to remove all chains by target ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-13 15:33:26 +03:00
Anton Nikiforov	11fde3cde4	[#976] cli: Allow to remove all chains by target ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-13 15:33:26 +03:00
Dmitrii Stepanov	17f5463389	[#1043] cli: Add reset evacuation status command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-13 10:29:45 +00:00
aarifullin	d1d53d2bb6	[#963] node: Add logging for waitNotaryDeposit ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-13 11:59:51 +03:00
aarifullin	7a4b6057ce	Revert "[#963] node: Go on initialization even deposit notary is hung" ... This reverts commit b4cb54e7ed. Signed-off-by: aarifullin <a.arifullin@yadro.com>	2024-03-13 11:53:59 +03:00
Airat Arifullin	b4cb54e7ed	[#963] node: Go on initialization even deposit notary is hung ... * Make makeAndWaitNotaryDeposit run asynchronously as worker during application boot-up. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-12 10:18:07 +00:00
Dmitrii Stepanov	d433b49265	[#973] node: Resolve perfsprint linter ... `fmt.Errorf can be replaced with errors.New` and `fmt.Sprintf can be replaced with string addition` Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-11 17:55:50 +03:00
Dmitrii Stepanov	66a26b7775	[#973] node: Resolve revive: unused-parameter linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-11 17:11:49 +03:00
Alexander Chuprov	e5d18e7a85	[#1023] adm: Make --namespace flag required ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-03-05 16:03:39 +03:00
Airat Arifullin	b84cf91f73	[#1009] adm: Make workaround for get-admin and list-rule-chains ... * Inroduce workaround to create actor for contract storage interface without passing a real alphabet wallet. This is made by creating a dummy account. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-05 12:34:53 +00:00
Dmitrii Stepanov	702351a5d1	[#983] blobstor: Allow to specify wait before drop time ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-05 09:23:57 +03:00
Anton Nikiforov	ae5bb87e70	Revert "[#866] Use TTL for blobovnicza tree cache" ... This reverts commit d9cbb16bd3. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-01 19:29:33 +03:00
Dmitrii Stepanov	d6534fd755	[#1016] frostfs-node: Fix gopls issues ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-01 12:13:43 +03:00
Airat Arifullin	6f25c790aa	[#1012] cli: Fix messages for list commands ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-01 07:16:57 +00:00
Airat Arifullin	93bf9acbc2	[#898] control: Remove removed flag from RemoveChainLocalOverrideResponse ... * Remove removed flag in service.proto for RemoveChainLocalOverrideResponse. * Regenerate control API. * Return error only if RemoveOverride returns non-NotFound code. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-28 19:07:07 +00:00
Anton Nikiforov	bc9dbb26ec	[#932] adm: Add custom Actor to sign tx by all committee accounts ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-28 18:57:16 +00:00
Anton Nikiforov	61c58e2f92	[#932] adm: Add commands to manipulate with NNS contract ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-28 18:57:16 +00:00
Anton Nikiforov	9801d08438	[#932] adm: Move defaults for NNS to package constants ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-28 18:57:16 +00:00
Evgenii Stratonikov	abea258b65	[#1000] adm: Use default batch size for TraverseIterator() ... Nothing is broken now, but will easily become if we change nnsMaxTokens, thus this change. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-23 06:24:40 +00:00
Airat Arifullin	47d9ce71be	[#986] cli: Allow add-rule command to parse new actions ... * Introduce Object.* and Container.* actions that span all methods for services. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-20 07:42:29 +00:00
Airat Arifullin	0f064b7962	[#989] util: Introduce any and all statements for ape rule parsing ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-20 07:42:29 +00:00
Airat Arifullin	613e11c4d2	[#989] adm: Read and parse chains from file ... * Slightly fix the approach to read encoded chain from file in frostfs-adm. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-20 07:42:29 +00:00
Airat Arifullin	9611710e19	[#989] cli: Read and parse chains from file ... * Introduce path flag to make add-rule command read and parse chain from file. File is binary/JSON-encoded chain. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-20 07:42:29 +00:00
Evgenii Stratonikov	dad56d2e98	Revert "[#972] Use min/max builtins" ... This reverts commit 89784b2e0a. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 15:36:01 +00:00
Evgenii Stratonikov	4bfc6d29b9	Revert "[#972] Adopt slices.BinarySearch()" ... This reverts commit d2f13a29de. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 15:36:01 +00:00
Evgenii Stratonikov	3359349acb	Revert "[#972] Use slices.Sort* when useful" ... This reverts commit b871d7a5e8. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 15:36:01 +00:00
Evgenii Stratonikov	9e55836da5	[#994] cli: Output pilorama path in shards list ... Do it for JSON too, not only for human output. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 15:19:47 +00:00
Evgenii Stratonikov	b871d7a5e8	[#972] Use slices.Sort* when useful ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 13:13:09 +00:00
Evgenii Stratonikov	d2f13a29de	[#972] Adopt slices.BinarySearch() ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 13:13:09 +00:00
Evgenii Stratonikov	89784b2e0a	[#972] Use min/max builtins ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 13:13:09 +00:00
Anton Nikiforov	5cbf57081f	[#980] adm: Introduce flag chain-name for APE managing commands ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-14 09:41:56 +03:00
Anton Nikiforov	35370283ba	[#948] adm: Move TestNextPollInterval to package helper ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 10:08:49 +03:00
Anton Nikiforov	802192cfef	[#932] adm: Rename util to helper ... To avoid conflicts with `util` packages in other imports. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	e2cee4cf09	[#932] adm: Move const to package constants ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	814c411f4a	[#932] adm: Move flags to package commonflags ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	7b0e3f5010	[#932] adm: Remove unnecessary import alias usage ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	63c34ea707	[#932] adm: Move command init to package initialize ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	86b2515744	[#932] adm: Move generate.go to package generate ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	b8cf0a6b88	[#932] adm: Move deploy to package contract ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	76343f19e5	[#932] adm: Move update-contracts to package contract ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	e2557b2f0b	[#932] adm: Move dump-hashes to package contract ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	9b65f1595a	[#932] adm: Move force-new-epoch to package netmap ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	ce42547980	[#932] adm: Move remove-nodes to package node ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	9690bd02aa	[#932] adm: Move netmap-candidates to package netmap ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	36fd6c663c	[#932] adm: Move dump/restore/list-containers to package container ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	be15eab82a	[#932] adm: Move dump/set-config to package config ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	f7a8f51c66	[#932] adm: Move command deposit-notary to package notary ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	beb9d80e34	[#932] adm: Move command dump-balances to package balance ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	8148c9dc19	[#932] adm: Move command morph proxy to package proxy ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	218bd72f9a	[#932] adm: Move command frostfsid to package frostfsid ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	a92188e5f9	[#932] adm: Reduce methods visibility in util package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	f6ff3de0ae	[#932] adm: Move set-/dump-policy to policy package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	77694a2f3b	[#932] adm: Move InitializeContext to util package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	b68f7be0b6	[#932] adm: Prepare to move InitializeContext to util package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	bee3741f4e	[#932] adm: Move cmd morph ape to ape package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	ba00fc4971	[#932] adm: Move contract name constants to util package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	fdeb99c52f	[#932] adm: Move DomainOf to util package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	34fcab3498	[#932] adm: Move alphabet-wallets flag to util package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	7954c7f8af	[#932] adm: Move NNS methods to util package ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Anton Nikiforov	cda3a3d834	[#932] adm: Refactor command morph ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-13 09:59:27 +03:00
Dmitrii Stepanov	3a41858a0f	[#975] ir: Add default logger destination ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-12 13:30:32 +03:00
Dmitrii Stepanov	962e5a9c19	[#736] logger: Add journald support ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-12 06:17:22 +00:00
Anton Nikiforov	d19ade23c8	[#959] node: Set mode to shard's components when open it ... Avoid opening database for `metabase` and `cache` in `Degraded` mode. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-09 14:04:01 +00:00
Dmitrii Stepanov	db67c21d55	[#947] engine: Evacuate trees to remote nodes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-09 11:33:15 +03:00
Dmitrii Stepanov	e4064c4394	[#947] cli: Print tree evacuation stat ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-09 11:20:39 +03:00
Dmitrii Stepanov	b3f3505ada	[#947] cli: Allow to specify evacuation scope ... It may be required to evacuate only objects or only tree or all, so now it spossible to specify. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-09 11:20:38 +03:00
Olga Konstantinova	80b581d499	[#466] adm: Allow to download contracts from Gitea ... Signed-off-by: Olga Konstantinova <kola43843@gmail.com>	2024-02-08 21:07:49 +00:00
Evgenii Stratonikov	805862f4b7	[#956] node: Allow to reload goroutine pool sizes ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 15:49:43 +00:00
Evgenii Stratonikov	426cf58b98	[#956] node: Remove pool sizes from config struct ... They are available through the pool methods and unused outside of the function that sets them. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 15:49:43 +00:00
Evgenii Stratonikov	cbfeb72466	[#956] policer: Remove WithMaxCapacity option ... We already provide the pool and this argument is used only for preallocation. No functional changes. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 15:49:43 +00:00
Evgenii Stratonikov	053a195ac2	[#968] adm: Allow concurrent epoch ticks ... Previous fix was incomplete, there are two possible places for this error to occur. Refs #592 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 08:10:24 +00:00
Evgenii Stratonikov	a6c9a337cd	[#965] morph: Get rid of container.List invocations ... ContainersOf() is better in almost every aspect, besides creating a session when the containers number is between 1024 and 2048 (prefetch script does limited unwrapping). Making List() private helps to ensure it is no longer used and can be safely removed in future. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-07 08:56:27 +00:00
Airat Arifullin	b1a1b2107d	[#909] cli: Make add-rule and list-rules recieve namespace param ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-07 06:54:41 +00:00
Dmitrii Stepanov	9ba48c582d	[#917] engine: Allow to detach shards ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-06 14:49:47 +03:00
Anton Nikiforov	befbaf9d56	[#922] cli: Add new command control list-targets ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-02 12:09:51 +00:00
Airat Arifullin	5be2af881a	[#934] container: Make container APE middleware read namespaces ... * Those methods that can access already existing containers and thus can get container properties should read namespace from Zone property. If Zone is not set, take a namespace for root. * Otherwise, define namespaces by owner ID via frostfs-id contract. * Improve unit-tests, consider more cases. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-01 17:38:24 +00:00
Airat Arifullin	96c86c4637	[#934] adm: Make frostfsid commands read alphabet wallets ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-01 17:38:24 +00:00
Anton Nikiforov	483a67b170	[#937] ape: Validate chain resource name ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-31 11:34:35 +03:00
Anton Nikiforov	e3573de6db	[#930] gc: Stop internal activity by context ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-31 08:30:34 +00:00
Anton Nikiforov	417f8fc2c2	[#876] cli: Add doc for commands control *-rule ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-25 20:26:13 +03:00
Anton Nikiforov	51d1d935ef	[#876] cli: Add support for container in local rules ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-25 20:26:13 +03:00
Airat Arifullin	1fe7736d92	[#925] morph: Introduce switch rpc guarded rpc actor ... * Introduce switch rpc guarded rpc actor in morph client to prevent using invalidated rpc actor when RPC switch happens. * Initialize NewContractStorage with SwitchRPCGuardedActor. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-25 13:24:13 +00:00
Evgenii Stratonikov	d13e37f70b	[#768] adm: Do not change frostfsid admin on update ... Behave similarly to the netmap contract. Close #768 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-01-25 10:54:42 +00:00
Evgenii Stratonikov	d2d850786d	[#923] adm: Move netconfig merge to a separate function ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-01-25 10:54:42 +00:00
Evgenii Stratonikov	61a3afbf9b	[#768] adm: Rephrase error text for NNS fetch ... Error could come from the network, we must not assume everything. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-01-25 10:54:42 +00:00
Evgenii Stratonikov	c00eb7ccee	[#768] adm: Return error from getContractDeployData() ... Make code more idiomatic and unify in style with other error reporting. Retain panics for code errors. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-01-25 10:54:42 +00:00
Denis Kirillov	e42262a863	[#908] adm/frostfsid: Add parameter validations ... Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>	2024-01-19 11:04:03 +00:00
Denis Kirillov	136acdba21	[#908] adm/frostfsid: Use client for write operations ... Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>	2024-01-19 11:04:03 +00:00
Denis Kirillov	6ebd61298e	[#908] adm/frostfsid: Support subject/group management ... Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>	2024-01-19 11:04:03 +00:00
Denis Kirillov	0e3d144695	[#908] adm: Support frostfsid basic operations ... Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>	2024-01-19 11:04:03 +00:00
Airat Arifullin	c8baf76fae	[#872] object: Introduce APE middlewar for object service ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-12 18:41:35 +03:00
Dmitrii Stepanov	52ffa9f164	[#891] getSvc: Refactor Get service V2 creation ... Use arguments for mandatory fields. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-12 13:35:38 +03:00
Dmitrii Stepanov	394f086fe2	[#891] getSvc: Fix get range hash implementation ... Get range can perform GET request, so this request must be done from container node to not to get access denied error. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-12 13:35:38 +03:00
Evgenii Stratonikov	a601391719	[#902] adm: Do not create session when dumping hashes ... Unless the total number of domains is too big, there is no need to consume resources in neo-go. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-01-12 10:25:56 +00:00
Denis Kirillov	4a4c790ec1	[#885] cli: Support hex chain id in control API ... Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>	2024-01-11 07:24:22 +00:00
Denis Kirillov	c19396d203	[#885] control: Make chain id bytes in grpc ... Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>	2024-01-11 07:24:22 +00:00
Alexander Chuprov	79bebe4a68	[#884] cli: Fix error message for undefined endpoint ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-01-10 10:02:16 +00:00
Dmitrii Stepanov	d75e7e9a21	[#864] engine: Drop container size metric if container deleted ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-10 10:44:54 +03:00
Dmitrii Stepanov	581887148a	[#569] cli: Add control shards writecache seal command ... It does the same as `control shards flush-writecache --seal`, but has better name. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-29 16:05:37 +03:00
Dmitrii Stepanov	0cb0fc1735	[#569] writecache: Allow to seal writecache after flush ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-29 16:05:37 +03:00
Dmitrii Stepanov	764f70634d	[#881] containerSvc: Add APE validation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-27 11:05:34 +03:00
Dmitrii Stepanov	8180a0664f	[#887] node: Drop badger writecache implementation ... Badger implementation isn't tested and works not well, but requires human resources to maintain. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-22 13:00:54 +03:00
Anton Nikiforov	5b672fb392	[#876] adm: Add morph ape get/set-admin commands ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-12-21 18:21:37 +03:00
Dmitrii Stepanov	825f65f79e	[#873] node: Start metrics and pprof as soon as possible ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-21 15:09:51 +00:00
Alex Vanin	b1eab1de54	[#883] adm: Add domainOf function to resolve NNS domain ... Signed-off-by: Alex Vanin <a.vanin@yadro.com>	2023-12-21 15:04:00 +03:00
Alex Vanin	ac0821a1a5	[#883] adm: Support proxy accounts ... Signed-off-by: Alex Vanin <a.vanin@yadro.com>	2023-12-21 13:53:34 +03:00
Alex Vanin	419b07e8b8	[#883] adm: Use proxy contract as admin for frostfsid and policy contracts ... Signed-off-by: Alex Vanin <a.vanin@yadro.com>	2023-12-21 12:30:37 +03:00
Anton Nikiforov	32f4e72e6a	[#834] adm: Add commands to invoke methods of policy contract ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-12-20 15:44:12 +03:00
Anton Nikiforov	7ade11922e	[#834] adm: Refactor morph module ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-12-20 15:22:17 +03:00
Dmitrii Stepanov	d69d318cb0	[#878] node: Drain internal error's channel ... This fixes shutdown panic: 1. Some morph connection gets error and passes it to internalErr channel. 2. Storage node starts to shutdow and closes internalErr channel. 3. Other morph connection gets error and tries to pass it to internalErr channel. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-19 16:38:03 +00:00
Anton Nikiforov	d9cbb16bd3	[#866] Use TTL for blobovnicza tree cache ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-12-19 16:36:28 +00:00
Ekaterina Lebedeva	be8f499b91	[#717] Fix mixing CID and container ID ... All container ID outputs that may be used in scripts were replaced with CID. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-19 12:36:29 +03:00
Airat Arifullin	7d7cf05575	[#851] ape: Initialize and use policy contract interface ... * Replace inmemory policy contract mock by initialized policy contract interface. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-18 11:06:35 +00:00
Dmitrii Stepanov	61da7dca24	[#835] node: Fix appCfg concurrent access ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-14 16:38:59 +03:00
Dmitrii Stepanov	f4877e7b42	[#835] grpc: Try to reconnect if endpoint listen failed ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-14 16:38:59 +03:00
Airat Arifullin	4a64b07703	[#869] cli: Pass only CID in requests for control API ... * Fix add-rule, list-rules, remove-rule, get-rule commands: do not convert container ID to native-schema resource format and pass it to control API. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-14 11:01:20 +00:00
Ekaterina Lebedeva	ef07c1a3c9	[#552] Add sysd notifications to storage service ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 17:51:41 +03:00
Ekaterina Lebedeva	eca7ac9f0d	[#552] Add sdnotify package ... To avoid using third-party dependencies. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 17:49:26 +03:00
Ekaterina Lebedeva	9b2dce5763	[#552] Add status notification to systemd ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 15:02:39 +03:00
Ekaterina Lebedeva	05f8f49289	[#552] gofumpt changes ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 15:02:25 +03:00
Dmitrii Stepanov	11add38e87	[#857] golangci: Add protogetter linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-12 16:27:02 +03:00
Dmitrii Stepanov	d2746a7d67	[#857] Makefile: Update linter version ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-12 16:27:02 +03:00
aarifullin	0f45e3d344	[#804] ape: Implement boltdb storage for local overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-07 19:08:41 +03:00
aarifullin	39060382a1	[#842] control: Recieve target in gRPC methods for APE managing ... * Introduce Target type and pass it to all gRPC methods for APE chain managing instead CID. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-07 14:21:55 +00:00
Dmitrii Stepanov	db49ad16cc	[#826] blobovniczatree: Do not create DB's on init ... Blobovniczas will be created on write requests. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	8bbfb2df43	[#661] blobovniczatree: Pass object size limit from config ... If actual small object size value lower than default object size limit, then unnecessary buckets created. If actual small object size value greated than default object size limit, then error happens. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00