aarifullin
/
frostfs-node
forked from TrueCloudLab/frostfs-node
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,391 Commits
111 Branches
26 Tags
62 MiB
Commit Graph

4391 Commits (feature/ape_errors)

Author SHA1 Message Date
Alexander Chuprov 7f6852bbd2 [#639] node: Refactor TTL cache 
Migrate from internal to external TTL implementation

Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-11-30 12:54:51 +00:00
Dmitrii Stepanov 26e4f7005c [#741] treesvc: Refactor tree sync 
Fix linter issues.
Add error logging.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-30 12:45:02 +00:00
Dmitrii Stepanov b21be1abdd [#741] treesvc: Do not update sync height if some node is unavailable 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-30 12:45:02 +00:00
Dmitrii Stepanov b215817e14 [#741] treesvc: Remove unused height variables 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-30 12:45:02 +00:00
Airat Arifullin 306f12e6c5 [#828] adm: Fix policy contract deploy 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-29 06:23:56 +00:00
Evgenii Stratonikov 5521737f0b [#808] cli: Use EnableTraverseRunHooks in cobra 
Adopt EnableTraverseRunHooks to get rid of tracing boilerplate in
multiple commands. Now adding `--trace` flag is sufficient for a command
to support tracing. Finally, it looks how it _should_.

Refs TrueCloudLab/frostfs-node#406

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-27 09:58:19 +00:00
Evgenii Stratonikov e81a58b8da [#808] cli: Use MarkFlagsOneRequired after cobra update 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-27 09:58:19 +00:00
Evgenii Stratonikov 5048236441 [#808] go.mod: Update dependencies 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-27 09:58:19 +00:00
Dmitrii Stepanov c516c7c5f4 [#821] node: Pass user.ID by value 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-23 10:21:07 +03:00
Dmitrii Stepanov c99157f0b2 [#821] go.mod: Update SDK-Go version 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-23 10:21:06 +03:00
Dmitrii Stepanov 07390ad4e3 [#715] node: Unify config parameter names 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-22 17:13:50 +03:00
Dmitrii Stepanov 8d18fa159e [#667] writecache: Fix flush test 
Allow to disable background flusher for testing purposes.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-17 17:45:43 +03:00
Airat Arifullin 02454df14a [#809] client: Refactor PrmInit, PrmDial usage 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-17 13:37:03 +00:00
Dmitrii Stepanov 76ff26039c [#96] node: Drop neo-go's `slices` package 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-17 13:24:04 +03:00
Airat Arifullin 47286ebf32 [#805] pilorama: Fix TreeDrop 
* If treeID is empty then deleting buckets for cursor may get
  invalidated. So, buckets should be gathered before deleting.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-17 10:21:35 +00:00
Dmitrii Stepanov 5cfb758e4e [#806] morph: Remove container list cache 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-17 10:40:08 +03:00
Dmitrii Stepanov 29fe8c41f3 [#655] storage: Drop `ErrorHandler` 
The only one usage was for logging.
Now logging performed by storage anyway.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-16 17:27:38 +03:00
Dmitrii Stepanov 137e987a4e [#655] storage: Drop `LazyHandler` 
LazyHandler is implemented and used incorrectly.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-16 17:27:38 +03:00
Airat Arifullin 4d5be5ccb5 [#811] ape: Update policy-engine module version and rebase 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-16 11:31:37 +03:00
Dmitrii Stepanov fd9128d051 [#800] node: eACL -> APE converter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-15 11:55:55 +03:00
Alexander Chuprov 364f835b7e [#740] logs: Add Loki 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-11-14 19:01:05 +00:00
Evgenii Stratonikov c1ec6e33b4 [#793] adm: Always use committee as FrostFS ID owner 
Committee should be able to authorize everything, there are no other
usecases for the frostfs-adm currently. Also, it somewhat eases
configuration, because committee hash depends on the protocol
configuration.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-14 19:00:32 +00:00
Evgenii Stratonikov f871f5cc6c [#793] adm: Support new FrostFS ID contract 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-14 19:00:32 +00:00
Evgenii Stratonikov b62008daca [#506] node: Invalidate `list` cache after container add/removal 
`update` already has problems mentioned in its doc-comment and the code
itself is not straightforward. Invalidating cache altogether seems like
a better option because we don't construct cache output ourselves (thus, no
"impossible" results).

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-14 19:00:11 +00:00
Evgenii Stratonikov f13f5d3b0f [#506] node: Use DeletionInfo() method to get deleted container owner 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-14 19:00:11 +00:00
Evgenii Stratonikov a952a406a2 [#506] container: Use uint64 for epoch type 
It is `uint64` in netmap source interfaces and other code.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-14 19:00:11 +00:00
Evgenii Stratonikov f04806ccd3 [#506] container: Use user.ID in DeletionInfo response 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-14 19:00:11 +00:00
Dmitrii Stepanov 8088063195 [#787] netmap: Refactor `NewEpoch` method 
Split for user and control methods.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-13 17:22:31 +03:00
Dmitrii Stepanov c8a62ffedd [#787] morph: Calculate VUB and nonce when hash is nil 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-13 17:13:03 +03:00
Dmitrii Stepanov 2393d13e4d [#787] morph: Return VUB for IR service calls 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-13 17:13:03 +03:00
Dmitrii Stepanov 518f3baf41 [#787] morph: Return VUB from `Invoke` method 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-13 17:13:03 +03:00
Dmitrii Stepanov 5466e88444 [#787] cli: Add `vub` for `control ir` commands 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-13 17:13:03 +03:00
Dmitrii Stepanov bdfa523487 [#787] proto: Add VUB field for IR service 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-13 17:13:03 +03:00
Dmitrii Stepanov 78cfb6aea8 [#796] cli: Fix object nodes command 
Tombstone objects must be present on all container nodes.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-09 13:41:36 +03:00
Dmitrii Stepanov 0f75e48138 [#796] policer: Fix tombstone objects replication 
Tombstone objects must be replicated to all container nodes.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-09 13:39:33 +03:00
Dmitrii Stepanov 7cdae4f660 [#792] proto: Regenerate with fixed version 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-09 10:09:13 +00:00
Dmitrii Stepanov 1bca8f118f [#792] makefile: Fix protoc and staticcheck versions 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-09 10:09:13 +00:00
Dmitrii Stepanov 9133b4389e [#788] objectsvc: Fix formatting (gofumpt) 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-09 10:27:32 +03:00
Dmitrii Stepanov 1b22801eed [#788] engine: Fix flaky tests 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-09 10:25:46 +03:00
Airat Arifullin 3534d6d05b [#794] objectsvc: Return accidentally removed acl checks for Head 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 17:13:58 +03:00
Evgenii Stratonikov 3ed3e2715b [#xx] adm: Drop notaryDisabled deploy parameter 
Refs TrueCloudLab/frostfs-contract#50

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-08 13:38:04 +00:00
Airat Arifullin 66848d3288 [#770] cli: Add methods to work with APE rules via control svc 
* Add methods to frostfs-cli
* Implement rpc in control service

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Airat Arifullin 8e11ef46b8 [#770] object: Introduce ape chain checker for object svc 
* Introduce Request type converted from RequestInfo type
  to implement policy-engine's Request interface
* Implement basic ape checker to check if a request is
  permitted to be performed
* Make put handlers use APE checker instead EACL

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Airat Arifullin 5ec73fe8a0 [#770] node: Introduce ape chain source 
* Provide methods to access rule chains with access
  policy engine (APE) chain source
* Initialize apeChainSource within object service
  initialization
* Share apeChainSource with control service
* Implement dummy apeChainSource instance based on
  in-memory implementation

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Airat Arifullin 3a2c319b87 [#770] control: Generate gRPC methods to manipulate APE chains 
* Define new types and gRPC methods to manipulate APE chains
  in control service.
* Stub gRPC handlers for the generated methods.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Dmitrii Stepanov 70ab1ebd54 [#763] metrics: Add container_objects_total metric 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-08 12:30:57 +03:00
Dmitrii Stepanov 9c98fa6152 [#763] metabase: Add container objects counter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-08 12:30:57 +03:00
Dmitrii Stepanov 226e84d782 [#684] node: Add skipped objects count to evacuation result 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-07 12:17:11 +00:00
Dmitrii Stepanov 1e21733ea5 [#684] cli: Add skipped count to evacuation status output 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-07 12:17:11 +00:00
Dmitrii Stepanov 523fb3ca51 [#684] proto: Add skipped count to evacuation status response 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-07 12:17:11 +00:00