1221 commits

Author	SHA1	Message	Date
Airat Arifullin	8fd678e269	[#1141] go.mod: Update frostfs-sdk-go and frostfs-api-go/v2 ... * Also fix unit-test. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-20 13:22:48 +03:00
Dmitrii Stepanov	436c9f5558	[#1129] policer: Restore EC object ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-17 14:36:18 +03:00
Dmitrii Stepanov	44f2e8f27f	[#1129] putSvc: Allow to put single unprepared object to EC container ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:49 +03:00
Dmitrii Stepanov	1cd8562db8	[#1129] policer: Refactor shortage ... Drop override inside method. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:49 +03:00
Dmitrii Stepanov	4ab6c404f7	[#1129] policer: Drop unused ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:49 +03:00
Dmitrii Stepanov	cbe9757490	[#1129] policer: Pull required EC chunks ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:49 +03:00
Dmitrii Stepanov	d45d086acd	[#1129] policer: Add EC chunk replication ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-16 16:28:48 +03:00
Alexander Chuprov	b078fe5ba1	[#1092] control: Move SignMessage to separate package ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-05-16 12:14:01 +03:00
Evgenii Stratonikov	b3eaa8a9bc	[#1083] objsvc/v2: Check response status in RANGE_HASH forwarder ... Fixes #1083 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-15 12:04:21 +03:00
Evgenii Stratonikov	0924b62a95	[#1083] objsvc/v2: Unify response verification after forwarding ... 1. Use the same routine for HEAD/GET_RANGE methods. 2. Make error message similar. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-15 12:04:06 +03:00
Evgenii Stratonikov	300654b045	[#1083] objsvc/v2: Properly check response status after forwarding ... Previously we had cryptic error: ``` debug get/remote.go:38 remote call failed {"component": "Object.Get service", "request": "HEAD", "address": "9sTxoVrhJ7WBtXQfK2NJ7zDV5yCF7BPLKK1XTxYPdGsP/BbHV4KZZ8y2BPqAT5kyjdHRLkfbtY2xf5uYoMVqxACn1", "raw": false, "local": false, "with session": false, "with bearer": false, "error": "unexpected header type <nil>"} ``` Now we have and expected error: ``` debug get/remote.go:38 remote call failed {"component": "Object.Get service", "request": "HEAD", "address": "D2rqaMG4D2VHdv3HKky8UYSYmwQFH2v9oXXqtyRZPTMy/BbHV4KZZ8y2BPqAT5kyjdHRLkfbtY2xf5uYoMVqxACn1", "raw": false, "local": false, "with session": false, "with bearer": false, "error": "status: code = 2049 message = object not found"} ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-15 12:04:06 +03:00
Airat Arifullin	952d13cd2b	[#1124] cli: Improve APE rule parsing ... * Make APE rule parser to read condition's kind in unambiguous using lexemes `ResourceCondition`, `RequestCondition` instead confusing `Object.Request`, `Object.Resource`. * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-14 12:23:26 +03:00
Dmitrii Stepanov	0144117cc9	[#1125] objectSvc: Add EC header APE check ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 16:25:55 +03:00
Dmitrii Stepanov	ada1b9f737	[#1120] objectSvc: Fix EC put placement ... Use parent object ID to compute placement. Fix too many copies saving. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-05-08 15:23:57 +03:00
Anton Nikiforov	fe2c1c926f	[#1112] node: Fix race warning for GetObjectAndWritePayload ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-07 14:47:21 +03:00
Anton Nikiforov	3e782527b8	[#1112] node: Add test for Range request for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-07 14:47:21 +03:00
Anton Nikiforov	21a490da8f	[#1112] Fix issue from gofumpt ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-07 14:47:21 +03:00
Evgenii Stratonikov	93c0ccad4f	[#1077] objectsvc: Fix possible panic in GetRange() ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-07 14:47:21 +03:00
Anton Nikiforov	00b2b77b26	[#1112] node: Implement Range\RangeHash requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-05-07 14:47:21 +03:00
aarifullin	b60a51b862	[#1117] ape: Introduce FormFrostfsIDRequestProperties method ... * `FormFrostfsIDRequestProperties` gets user claim tags and group id and sets them as ape request properties. * Make tree, container and object service use the method. * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-07 10:01:21 +00:00
aarifullin	6c76c9b457	[#1117] core: Introduce SubjectProvider interface for FrostfsID ... * Make tree, object and container services use SubjectProvider interface. * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-07 10:01:21 +00:00
Ekaterina Lebedeva	e07869a8cf	[#1100] Remove unused fields ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-05-06 10:14:36 +03:00
Evgenii Stratonikov	71789676d5	[#1114] aclsvc: Add tests for request ownership ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-02 11:57:39 +03:00
Anton Nikiforov	112a7c690f	[#1103] node: Implement Get\Head requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-24 18:15:53 +03:00
Anton Nikiforov	700e891b85	[#1103] Fix end of file and trim trailing whitespace ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-24 16:31:04 +03:00
Airat Arifullin	10ee865e98	[#1096] tree: Make verifyClient fill ape request with user claim tags ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-16 15:12:46 +03:00
Airat Arifullin	c21d72ac23	[#1096] object: Make ape middleware fill request with user claim tags ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-16 15:12:44 +03:00
Airat Arifullin	6772976657	[#1096] container: Make ape middleware fill request with user claim tags ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-16 15:10:20 +03:00
Evgenii Stratonikov	3ea1d7b729	[#1089] control: Add USER and GROUP targets for local override storage ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-16 11:03:50 +00:00
Evgenii Stratonikov	0094186299	[#1089] control: Format proto files with clang-format ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-16 11:03:50 +00:00
Evgenii Stratonikov	91e79c98ba	[#1089] ape: Provide request actor as an additional target ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-16 11:03:50 +00:00
aarifullin	6a46c6d229	[#1090] tree: Make workaround for APE checks ... * Make `verifyClient` method perform APE check if a container was created with zero-filled basic ACL. * Object verbs are used in APE, until tree verbs are introduced. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-15 07:45:45 +00:00
aarifullin	f4dcb418f2	[#1090] ape: Move ape request and resource implementations to common package ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-15 07:45:45 +00:00
Evgenii Stratonikov	669103a33e	Reapply "[#972] Use slices.Sort* when useful" ... This reverts commit 3359349acb. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Evgenii Stratonikov	3dc81cb4fc	Reapply "[#972] Use min/max builtins" ... This reverts commit dad56d2e98. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-10 12:09:34 +00:00
Dmitrii Stepanov	e74bdaa5d5	[#1080] ape: Use value for APE request ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-09 18:42:03 +03:00
Dmitrii Stepanov	338d8cbebd	[#1080] ape: Do not read object headers before Head/Get ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-09 15:27:40 +03:00
Anton Nikiforov	2b88361849	[#1062] object: Fix buffer allocation for PayloadRange ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-09 11:59:07 +03:00
Dmitrii Stepanov	f5b67c6735	[#1064] policer: Disable EC processing ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-09 07:08:53 +00:00
Dmitrii Stepanov	1c5e0f90aa	[#1064] putsvc: Add EC put ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-09 07:08:53 +00:00
Dmitrii Stepanov	39da643354	[#1064] putsvc: Refactor distributed target ... Extract object builder. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-09 07:08:53 +00:00
Anton Nikiforov	d614f04a0a	[#1072] Fix gofumpt issues ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-03 22:21:14 +03:00
aarifullin	4738508ce2	[#1063] go.mod: Update SDK version ... * Update frostfs-sdk and frostfs-api-go versions. * Refactor depreacted method ReplicaNumberByIndex. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-03 10:33:51 +00:00
Evgenii Stratonikov	ff4c23f59a	[#1070] services/tree: Fix fast listing depth processing ... For unsorted `GetSubTree()` we return a single node for depth=1. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-02 14:41:31 +00:00
Evgenii Stratonikov	e12fcc041d	[#1059] services/tree: Fast sorted listing ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-01 12:37:34 +00:00
aarifullin	6959e617c4	[#1047] object: Set container owner ID property to ape request ... * Introduce ContainerOwner field in RequestContext. * Set ContainerOwner in aclv2 middleware. * Set PropertyKeyContainerOwnerID for object ape request. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-18 15:39:50 +00:00
aarifullin	d7be70e93f	[#1040] object: Wrap CheckAPE errors to status errors ... * All methods should wrap CheckAPE error, if it occurs, to status error. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-14 07:34:03 +00:00
Anton Nikiforov	5ee5f1df42	[#976] control: Introduce new method RemoveChainLocalOverridesByTarget ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-13 15:33:19 +03:00
Dmitrii Stepanov	17f5463389	[#1043] cli: Add reset evacuation status command ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-13 10:29:45 +00:00
Dmitrii Stepanov	31e2396a5f	[#1043] control: Add ResetEvacuationStatus implementation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-13 10:29:45 +00:00
Dmitrii Stepanov	926cdeb072	[#1043] services: Regenerate proto ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-13 10:29:45 +00:00
Airat Arifullin	5c252c9193	[#1039] object: Skip APE check for certain request roles ... * Skip APE check if a role is Container. * Skip APE check if a role is IR and methods are get-like. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-12 16:15:20 +03:00
Dmitrii Stepanov	d433b49265	[#973] node: Resolve perfsprint linter ... `fmt.Errorf can be replaced with errors.New` and `fmt.Sprintf can be replaced with string addition` Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-11 17:55:50 +03:00
Dmitrii Stepanov	66a26b7775	[#973] node: Resolve revive: unused-parameter linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-11 17:11:49 +03:00
Dmitrii Stepanov	d6534fd755	[#1016] frostfs-node: Fix gopls issues ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-01 12:13:43 +03:00
Airat Arifullin	93bf9acbc2	[#898] control: Remove removed flag from RemoveChainLocalOverrideResponse ... * Remove removed flag in service.proto for RemoveChainLocalOverrideResponse. * Regenerate control API. * Return error only if RemoveOverride returns non-NotFound code. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-28 19:07:07 +00:00
Airat Arifullin	75a1a95c2c	[#986] tree: Skip ACL checks if basicACL mask is unset ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-28 19:05:57 +00:00
Airat Arifullin	b1d171c261	[#986] container: Interpret APE NoRuleFound as request deny ... * If APE check returns NoRuleFound, then it is taken for request deny. * Add more unit-test for ape container middleware. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-28 19:05:57 +00:00
Airat Arifullin	7cc368e188	[#986] object: Introduce soft ape checks ... * Soft APE check means that APE should allow request even it gets status NoRuleFound for a request. Otherwise, it is interpreted as Deny. * Soft APE check is performed if basic ACL mask is not set. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-28 19:05:57 +00:00
Evgenii Stratonikov	dad56d2e98	Revert "[#972] Use min/max builtins" ... This reverts commit 89784b2e0a. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 15:36:01 +00:00
Evgenii Stratonikov	3359349acb	Revert "[#972] Use slices.Sort* when useful" ... This reverts commit b871d7a5e8. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 15:36:01 +00:00
Evgenii Stratonikov	b871d7a5e8	[#972] Use slices.Sort* when useful ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 13:13:09 +00:00
Evgenii Stratonikov	89784b2e0a	[#972] Use min/max builtins ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-19 13:13:09 +00:00
Dmitrii Stepanov	2680192ba0	[#988] objectSvc: Fix SetMarshalData for PutSingle ... After api-go update it is required to pass marshal data to `SetMarshalData`. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-15 17:21:08 +03:00
Dmitrii Stepanov	db67c21d55	[#947] engine: Evacuate trees to remote nodes ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-09 11:33:15 +03:00
Dmitrii Stepanov	15d853ea22	[#947] controlSvc: Return tree evacuation stat ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-09 11:20:39 +03:00
Dmitrii Stepanov	b3f3505ada	[#947] cli: Allow to specify evacuation scope ... It may be required to evacuate only objects or only tree or all, so now it spossible to specify. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-09 11:20:38 +03:00
Dmitrii Stepanov	a6eb66bf9c	[#947] evacuate: Refactor evacuate parameters ... Drop methods to make it easier to extend. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-09 11:20:38 +03:00
Evgenii Stratonikov	edbe06e07e	[#956] policer/test: Reuse testPool helper ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 15:49:43 +00:00
Evgenii Stratonikov	cbfeb72466	[#956] policer: Remove WithMaxCapacity option ... We already provide the pool and this argument is used only for preallocation. No functional changes. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 15:49:43 +00:00
Evgenii Stratonikov	c3fa902780	[#969] policer: Restrict the number of remembered errors ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 10:10:41 +03:00
Evgenii Stratonikov	6010dfdf3d	[#969] policer: Make error skip thread-safe ... Introduces in afd2ba9a66. Refs #914 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 10:10:41 +03:00
Evgenii Stratonikov	a6c9a337cd	[#965] morph: Get rid of container.List invocations ... ContainersOf() is better in almost every aspect, besides creating a session when the containers number is between 1024 and 2048 (prefetch script does limited unwrapping). Making List() private helps to ensure it is no longer used and can be safely removed in future. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-07 08:56:27 +00:00
Dmitrii Stepanov	9ba48c582d	[#917] engine: Allow to detach shards ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-06 14:49:47 +03:00
Dmitrii Stepanov	4358d3c423	[#917] controlSvc: Add DetachShards handler ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-06 14:47:52 +03:00
Ekaterina Lebedeva	afd2ba9a66	[#110] Add check for repeated error log in policer ... processObject() returns 3 types of errors: container not found errors, could not get container error and placement vector building error. Every error will occur for all objects in container simultaneously, so we can log each error once and safely ignore the rest. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-02-06 00:56:41 +03:00
Evgenii Stratonikov	602ee11123	[#934] containersvc: Marhal public key in short format for APE ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-02 17:51:38 +00:00
Anton Nikiforov	9916598dfb	[#922] control: Extend api with ListOverrideDefinedTargets ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-02 12:09:51 +00:00
Anton Nikiforov	95e15f499f	[#922] Update files generated by protoc ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-02 12:09:51 +00:00
Anton Nikiforov	2cb04379a4	[#922] go.mod: Update APE ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-02 12:09:51 +00:00
Airat Arifullin	a5446bc17d	[#952] object: Pass namespace within context in ACL service ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-02 14:48:11 +03:00
Anton Nikiforov	6534252c22	[#799] policer: Refactor method processNodes ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-02-01 17:49:22 +00:00
Airat Arifullin	5be2af881a	[#934] container: Make container APE middleware read namespaces ... * Those methods that can access already existing containers and thus can get container properties should read namespace from Zone property. If Zone is not set, take a namespace for root. * Otherwise, define namespaces by owner ID via frostfs-id contract. * Improve unit-tests, consider more cases. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-01 17:38:24 +00:00
Airat Arifullin	4352bd0e8e	[#934] ape: Transform empty namespace within chainbase ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-01 17:38:24 +00:00
Anton Nikiforov	483a67b170	[#937] ape: Validate chain resource name ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-31 11:34:35 +03:00
Anton Nikiforov	c441296592	[#930] policer: Release task pool when context cancelled ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-31 08:30:34 +00:00
Evgenii Stratonikov	6e2cc32768	[#681] objsvc: Validate session token owner for local sessions ... Previously, the check was in place only when session token was missing. Format validator checks are applied only to fully-prepared object, so this lead to the following situation: 1. Object is put locally with malformed token, because there are no checks. 2. Object cannot be replicated, because the token is malformed. This is now fixed and token check is done before any payload receival. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-01-26 08:52:29 +00:00
Anton Nikiforov	b6fc3321c5	[#876] Fix linters ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-25 20:26:13 +03:00
Airat Arifullin	f2f3294fc3	[#919] ape: Improve error messages in ape service ... * Wrap all APE middleware errors in apeErr that makes errors more explicit with status AccessDenied. * Use denyingRuleErr for denying status from chain router. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-23 08:11:24 +00:00
Airat Arifullin	be33070550	[#910] control: Take empty namespace for 'root' ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-19 06:22:10 +00:00
Airat Arifullin	96b020626f	[#915] ape: Fix method name in getStreamBasicChecker ... * Replace incorrect MethodGetContainer by MethodGetObject constant. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-16 23:52:37 +03:00
Airat Arifullin	c8baf76fae	[#872] object: Introduce APE middlewar for object service ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-12 18:41:35 +03:00
Dmitrii Stepanov	52ffa9f164	[#891] getSvc: Refactor Get service V2 creation ... Use arguments for mandatory fields. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-12 13:35:38 +03:00
Dmitrii Stepanov	394f086fe2	[#891] getSvc: Fix get range hash implementation ... Get range can perform GET request, so this request must be done from container node to not to get access denied error. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-12 13:35:38 +03:00
Dmitrii Stepanov	f1b2b8bffa	[#895] test: Fix NewLogger arguments list ... `debug` is always true. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-11 12:32:09 +00:00
Airat Arifullin	a8e52ef7aa	[#898] control: Fix codes for returning APE errors ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-11 12:31:31 +00:00
Denis Kirillov	c19396d203	[#885] control: Make chain id bytes in grpc ... Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>	2024-01-11 07:24:22 +00:00
Dmitrii Stepanov	5c0a736a25	[#899] containerSvc: Fix invalid session token type ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-10 18:37:54 +03:00
Dmitrii Stepanov	581887148a	[#569] cli: Add control shards writecache seal command ... It does the same as `control shards flush-writecache --seal`, but has better name. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-29 16:05:37 +03:00
Dmitrii Stepanov	0cb0fc1735	[#569] writecache: Allow to seal writecache after flush ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-29 16:05:37 +03:00
Dmitrii Stepanov	b118734909	[#890] getsvc: Log node PK ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-29 14:24:13 +03:00
Dmitrii Stepanov	764f70634d	[#881] containerSvc: Add APE validation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-27 11:05:34 +03:00
Anton Nikiforov	eab981bf1a	[#876] Fix linter error ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-12-21 18:21:37 +03:00
Airat Arifullin	bdd43f6211	[#869] object: Pass just CID to chain router ... * Do not convert CID from request to native-schema resource format - this step is unneccessary for APE. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-14 11:01:20 +00:00
Dmitrii Stepanov	11add38e87	[#857] golangci: Add protogetter linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-12 16:27:02 +03:00
Dmitrii Stepanov	681b2c5fd4	[#825] policer: Do not drop required linking objects ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-12 11:04:03 +00:00
aarifullin	0f45e3d344	[#804] ape: Implement boltdb storage for local overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-07 19:08:41 +03:00
aarifullin	e361e017f3	[#842] control: Pass target instead resource name ... * Update policy-engine package version in go.mod, go.sum. * Refactor CheckIfRequestPermitted: pass container target instead container ID. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-07 14:21:55 +00:00
aarifullin	39060382a1	[#842] control: Recieve target in gRPC methods for APE managing ... * Introduce Target type and pass it to all gRPC methods for APE chain managing instead CID. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-07 14:21:55 +00:00
Dmitrii Stepanov	26e4f7005c	[#741] treesvc: Refactor tree sync ... Fix linter issues. Add error logging. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-30 12:45:02 +00:00
Dmitrii Stepanov	b21be1abdd	[#741] treesvc: Do not update sync height if some node is unavailable ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-30 12:45:02 +00:00
Dmitrii Stepanov	b215817e14	[#741] treesvc: Remove unused height variables ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-30 12:45:02 +00:00
Dmitrii Stepanov	c516c7c5f4	[#821] node: Pass user.ID by value ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-23 10:21:07 +03:00
aarifullin	4d5be5ccb5	[#811] ape: Update policy-engine module version and rebase ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-16 11:31:37 +03:00
Dmitrii Stepanov	8088063195	[#787] netmap: Refactor NewEpoch method ... Split for user and control methods. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-13 17:22:31 +03:00
Dmitrii Stepanov	2393d13e4d	[#787] morph: Return VUB for IR service calls ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-13 17:13:03 +03:00
Dmitrii Stepanov	bdfa523487	[#787] proto: Add VUB field for IR service ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-13 17:13:03 +03:00
Dmitrii Stepanov	0f75e48138	[#796] policer: Fix tombstone objects replication ... Tombstone objects must be replicated to all container nodes. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-09 13:39:33 +03:00
Dmitrii Stepanov	7cdae4f660	[#792] proto: Regenerate with fixed version ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-09 10:09:13 +00:00
Dmitrii Stepanov	9133b4389e	[#788] objectsvc: Fix formatting (gofumpt) ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-09 10:27:32 +03:00
aarifullin	3534d6d05b	[#794] objectsvc: Return accidentally removed acl checks for Head ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-08 17:13:58 +03:00
Airat Arifullin	66848d3288	[#770] cli: Add methods to work with APE rules via control svc ... * Add methods to frostfs-cli * Implement rpc in control service Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-08 13:34:03 +00:00
Airat Arifullin	8e11ef46b8	[#770] object: Introduce ape chain checker for object svc ... * Introduce Request type converted from RequestInfo type to implement policy-engine's Request interface * Implement basic ape checker to check if a request is permitted to be performed * Make put handlers use APE checker instead EACL Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-08 13:34:03 +00:00
Airat Arifullin	5ec73fe8a0	[#770] node: Introduce ape chain source ... * Provide methods to access rule chains with access policy engine (APE) chain source * Initialize apeChainSource within object service initialization * Share apeChainSource with control service * Implement dummy apeChainSource instance based on in-memory implementation Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-08 13:34:03 +00:00
Airat Arifullin	3a2c319b87	[#770] control: Generate gRPC methods to manipulate APE chains ... * Define new types and gRPC methods to manipulate APE chains in control service. * Stub gRPC handlers for the generated methods. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-08 13:34:03 +00:00
Dmitrii Stepanov	226e84d782	[#684] node: Add skipped objects count to evacuation result ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-07 12:17:11 +00:00
Dmitrii Stepanov	523fb3ca51	[#684] proto: Add skipped count to evacuation status response ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-07 12:17:11 +00:00
aarifullin	74c91eeef5	[#777] client: Refactor PrmContainerList, PrmObjectSearch usage ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-06 06:50:11 +00:00
Dmitrii Stepanov	20d6132f31	[#531] signSvc: Add SetMarshaledData method call ... To reduce memory allocations add `SetMarshaledData` method call to return already marshalled data in next `StableMarshal` calls. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-02 17:34:33 +03:00
Dmitrii Stepanov	05b508f79a	[#772] proto: Fix file ending ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-10-31 17:03:04 +03:00
Dmitrii Stepanov	79088baa06	[#772] node: Apply gofumpt ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-10-31 17:03:03 +03:00
Anton Nikiforov	b0cf100427	[#49] node: React on SIGHUP only when node in READY state ... Add more info in logs when node is going to shut down, but initialization process still in progress. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-10-24 15:55:29 +00:00
aarifullin	58b6224dd8	[#747] client: Refactor PrmObjectPutInit usage ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-10-20 11:55:40 +00:00
aarifullin	12b7cf2533	[#747] client: Refactor PrmObjectPutSingle usage ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-10-20 11:55:40 +00:00
Dmitrii Stepanov	189dbb01be	[#733] frostfs-cli: Add control ir remove-container ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-10-19 16:22:18 +03:00
Evgenii Stratonikov	aca11d7474	[#735] policer: Allow to provide metrics from the outside ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-10-11 15:14:13 +03:00
Ekaterina Lebedeva	5e229dc248	[#701] metrics: add metric to evaluate policer performance ... Add processed objects counter in policerMetrics, add policer field to NodeMetrics Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-10-09 19:02:08 +00:00
Evgenii Stratonikov	4caa934eea	[#729] containersvc: Remove load announcement ... IR code was removed in 8879c6ea. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-10-09 19:01:13 +00:00
Alexander Chuprov	c1e4130020	[#146] node: Add trace_id to logs ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2023-09-27 11:05:27 +03:00
Anton Nikiforov	aeeb8193d2	[#676] node: Fix header source creation when checking eacl ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-09-06 17:06:54 +03:00
Anton Nikiforov	88d50e4c77	[#656] policer: Add "bad" testcase ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-09-06 08:04:59 +00:00
Airat Arifullin	806cc13d9f	[#658] client: Refactor PrmObjectGet/Head/Range usage ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-08-30 17:13:23 +00:00
Anton Nikiforov	fe5aa06a75	[#665] node: Bind length of copies number to number of replicas ... Allow to use one digit in copies number array for backward compatibility. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-08-30 17:11:55 +00:00
Dmitrii Stepanov	55b82e744b	[#529] objectcore: Use common sender classifier ... Use common sender classifier for ACL service and format validator. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-29 10:33:06 +03:00
Dmitrii Stepanov	ae81d6660a	[#529] objectcore: Fix object content validation ... There are old objects where the owner of the object may not match the one who issued the token. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-29 10:33:06 +03:00
Airat Arifullin	4ea0df77d0	[#574] policer: Check if the container was really removed ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-08-28 14:21:38 +00:00
Airat Arifullin	554ff2c06b	[#574] core: Extend Source interface with DeletionInfo method ... * Introduce common method EverExisted * Define DeletionInfo for struct that must implement Source * Refactor tree srv Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-08-28 14:21:38 +00:00
Evgenii Stratonikov	f8ba60aa0c	[#648] objsvc/delete: Handle errors in Go style ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-25 09:45:35 +00:00
Evgenii Stratonikov	d2084ece41	[#648] objsvc/delete: Remove redundant logs ... We never propagate delete requests to the container node, because tombstone broadcast is done via PUT. No need to pollute logs. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-25 09:45:35 +00:00
Evgenii Stratonikov	40b556fc19	[#647] objsvc/search: Improve testing coverage ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-25 10:40:01 +03:00