achuprov
/
frostfs-node
forked from TrueCloudLab/frostfs-node
1
0
Fork 0
Code Pull Requests Activity
4,723 Commits
30 Branches
27 Tags
30 MiB
Commit Graph

4723 Commits (feat/change_mode_shard_components)

Author SHA1 Message Date
Airat Arifullin 952d13cd2b [#1124] cli: Improve APE rule parsing 
* Make APE rule parser to read condition's kind in unambiguous using lexemes
`ResourceCondition`, `RequestCondition` instead confusing `Object.Request`, `Object.Resource`.
* Fix unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-14 12:23:26 +03:00
Airat Arifullin 20baf6e112 [#1108] ape: Update policy-engine version for listing by iteration 
* Update go.mod with a new version of policy-engine pacakge.
* Adapt SwitchRPCGuardedActor to ContractStorage interface.
* Fix `frostfs-adm` util.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-14 12:17:56 +03:00
Rustam Akberov 74135776c7 [#1067] adm: Fix panic on negative value 
Signed-off-by: Anoke <rustamgta1011@gmail.com>
 2024-05-13 16:44:04 +00:00
Dmitrii Stepanov 0144117cc9 [#1125] objectSvc: Add EC header APE check 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-08 16:25:55 +03:00
Dmitrii Stepanov 368218f0cc [#1120] cli: Edit `object nodes` output 
Print detailed information only.
Allow to output to JSON.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-08 15:23:58 +03:00
Dmitrii Stepanov a45b548a6f [#1120] cli: Add explain to `object nodes` 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-08 15:23:58 +03:00
Dmitrii Stepanov 654384990c [#1120] cli: Fix `object nodes` for linking objects 
Do not use linking objects to get placement for complex object.
Linking objects should be stored on all container nodes, also they are not required.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-08 15:23:57 +03:00
Dmitrii Stepanov ada1b9f737 [#1120] objectSvc: Fix EC put placement 
Use parent object ID to compute placement.
Fix too many copies saving.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-08 15:23:57 +03:00
Dmitrii Stepanov 5c730de96e [#1120] cli: Add EC support to `object nodes` command 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-08 15:23:57 +03:00
Alexander Chuprov 854200a874 [#1115] node: Remove unused const 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-05-07 19:11:21 +03:00
Anton Nikiforov fe2c1c926f [#1112] node: Fix race warning for `GetObjectAndWritePayload` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-05-07 14:47:21 +03:00
Anton Nikiforov 3e782527b8 [#1112] node: Add test for `Range` request for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-05-07 14:47:21 +03:00
Anton Nikiforov 21a490da8f [#1112] Fix issue from `gofumpt` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-05-07 14:47:21 +03:00
Evgenii Stratonikov 93c0ccad4f [#1077] objectsvc: Fix possible panic in GetRange() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-07 14:47:21 +03:00
Anton Nikiforov 00b2b77b26 [#1112] node: Implement `Range\RangeHash` requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-05-07 14:47:21 +03:00
Evgenii Stratonikov a23d53b2d4 [#1118] .forgejo: Add pre-commit action 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-07 11:36:11 +00:00
Evgenii Stratonikov fc7b07f314 [#1118] docs: Fix pre-commit warnings 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-07 11:36:11 +00:00
Airat Arifullin 9cc51f86b7 [#1117] node: Introduce cache for frostfsid contract client 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-07 10:01:21 +00:00
Airat Arifullin b60a51b862 [#1117] ape: Introduce `FormFrostfsIDRequestProperties` method 
* `FormFrostfsIDRequestProperties` gets user claim tags and group id and sets them
  as ape request properties.
* Make tree, container and object service use the method.
* Fix unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-07 10:01:21 +00:00
Airat Arifullin 6c76c9b457 [#1117] core: Introduce SubjectProvider interface for FrostfsID 
* Make tree, object and container services use SubjectProvider interface.
* Fix unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-07 10:01:21 +00:00
Airat Arifullin 45f4e6939d [#1117] morph: Make frostfsid client provide GetSubjectExtended method 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-07 10:01:21 +00:00
Ekaterina Lebedeva e07869a8cf [#1100] Remove unused fields 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-05-06 10:14:36 +03:00
Alexander Chuprov ec2873caa7 [#1116] node: Fix writecache metrics 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-05-02 20:03:33 +03:00
Evgenii Stratonikov 71789676d5 [#1114] aclsvc: Add tests for request ownership 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-02 11:57:39 +03:00
Alexander Chuprov c9efaa5819 [#966] node: Add path of the write_cache to metric labels 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-05-02 06:46:46 +00:00
Alexander Chuprov 4730ecfdb8 [#966] node: Refactor WriteCacheMetrics interface 
Grouping common fields of methods will enhance the readability of the interface.

Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-05-02 06:46:46 +00:00
Evgenii Stratonikov 52bebe9452 [#1110] node: Use single handler for new epoch event 
Bootstrap logic depends on the netmap status, which in turn depends on
the node info. Updating them in a single thread makes things more
predictable.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-27 15:17:45 +03:00
Evgenii Stratonikov 4b514f5ba0 [#1110] node: Log maintenance stop only if it was enabled 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-27 15:17:45 +03:00
Evgenii Stratonikov c8e2ca2ab4 [#1110] node: Rename handleLocalNodeInfo() 
It is used in "handler" only once, what we really do is set the
variable. And we have another "local" node info in `cfgNodeInfo`, this
one is not really local (node info), more like (local node) info, so use
setContractNodeInfo to distinguish it from the local view on the node
info.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-27 15:17:45 +03:00
Evgenii Stratonikov 3b9d12b11c [#1110] node: Fix comment about nodeInfo type 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-27 15:17:45 +03:00
Anton Nikiforov 411a8d0245 [#1004] blobovnicza: Use TTL for blobovnicza tree cache 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-26 19:54:29 +03:00
Anton Nikiforov 112a7c690f [#1103] node: Implement `Get\Head` requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-24 18:15:53 +03:00
Anton Nikiforov 167c52a1a9 [#1103] node: Reduce amount of lines for method `StorageEngine.head` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-24 16:31:04 +03:00
Anton Nikiforov 700e891b85 [#1103] Fix end of file and trim trailing whitespace 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-24 16:31:04 +03:00
Anton Nikiforov 1f02ac2566 [#1103] pre-commit: Exclude `*.svg` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-24 16:31:04 +03:00
Evgenii Stratonikov 7bc3003803 [#1104] docs: Add bearer token description to auth doc 
This is about authentication only and eACL is deprecated, so only
mention `allow_impersonate` flag.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-23 14:14:17 +03:00
Evgenii Stratonikov 6d4583f5de [#1097] docs: Describe authentication mechanisms 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-16 15:56:06 +00:00
Airat Arifullin 10ee865e98 [#1096] tree: Make `verifyClient` fill ape request with user claim tags 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-04-16 15:12:46 +03:00
Airat Arifullin c21d72ac23 [#1096] object: Make ape middleware fill request with user claim tags 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-04-16 15:12:44 +03:00
Airat Arifullin 6772976657 [#1096] container: Make ape middleware fill request with user claim tags 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-04-16 15:10:20 +03:00
Evgenii Stratonikov 97e54066d0 [#1095] adm: Support user/group target for APE 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-16 11:03:50 +00:00
Evgenii Stratonikov 46bc6a7930 [#1095] cli: Support user/group target for local overrides 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-16 11:03:50 +00:00
Evgenii Stratonikov 3ea1d7b729 [#1089] control: Add USER and GROUP targets for local override storage 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-16 11:03:50 +00:00
Evgenii Stratonikov 0094186299 [#1089] control: Format proto files with clang-format 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-16 11:03:50 +00:00
Evgenii Stratonikov 91e79c98ba [#1089] ape: Provide request actor as an additional target 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-16 11:03:50 +00:00
Evgenii Stratonikov e5e0542482 [#1085] log: Move storage log message to constants package 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-15 07:57:00 +00:00
Evgenii Stratonikov 5be36924e3 [#41] log: Log storage operations in only in Debug 
They are mostly useless unless we need to _debug_ a specific issue.
The amount of logs we produce is too big.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-15 07:57:00 +00:00
Airat Arifullin 6a46c6d229 [#1090] tree: Make workaround for APE checks 
* Make `verifyClient` method perform APE check if a container
  was created with zero-filled basic ACL.
* Object verbs are used in APE, until tree verbs are introduced.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-04-15 07:45:45 +00:00
Airat Arifullin f4dcb418f2 [#1090] ape: Move ape request and resource implementations to common package 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-04-15 07:45:45 +00:00
Airat Arifullin 661faa639e [#1090] go.mod: Update policy-engine version 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-04-15 07:45:45 +00:00