Commit Graph

4737 Commits (b9fcaad21f03da4bf1562700c76b6e61e5cdc47e)

Author SHA1 Message Date
Anton Nikiforov b9fcaad21f [#1168] shard: Set `Disabled` as default `mode` for components
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-06-11 15:13:38 +00:00
Dmitrii Stepanov 069c1559cc [#1164] cli: Improve `object nodes` performance
DCO action / DCO (pull_request) Successful in 5m12s Details
Vulncheck / Vulncheck (pull_request) Successful in 5m35s Details
Build / Build Components (1.21) (pull_request) Successful in 6m3s Details
Build / Build Components (1.22) (pull_request) Successful in 5m59s Details
Tests and linters / gopls check (pull_request) Successful in 7m39s Details
Tests and linters / Staticcheck (pull_request) Successful in 8m28s Details
Tests and linters / Lint (pull_request) Successful in 8m48s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 10m50s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 12m12s Details
Tests and linters / Tests with -race (pull_request) Successful in 12m13s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 12m38s Details
Do complex EC object parts flatten concurrently.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-06-11 08:45:44 +03:00
Dmitrii Stepanov 6cf512e574 [#1166] blobovniczatree: Handle blobovnicza's NoSpaceLeft error
DCO action / DCO (pull_request) Successful in 10m57s Details
Vulncheck / Vulncheck (pull_request) Successful in 11m50s Details
Build / Build Components (1.21) (pull_request) Successful in 14m43s Details
Build / Build Components (1.22) (pull_request) Successful in 16m38s Details
Tests and linters / gopls check (pull_request) Successful in 18m17s Details
Tests and linters / Staticcheck (pull_request) Successful in 23m58s Details
Tests and linters / Lint (pull_request) Successful in 25m50s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 27m13s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 3m5s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 4m3s Details
Tests and linters / Tests with -race (pull_request) Successful in 4m23s Details
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-06-07 17:15:43 +03:00
Dmitrii Stepanov e7d479f4c2 [#1166] blobovnicza: Return NoSpaceLeft error instead of syscall.ENOSPC
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-06-07 17:15:43 +03:00
Anton Nikiforov a0c588263b [#1157] cli: Support adding APE overrides to Bearer token
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-06-07 12:11:11 +00:00
Airat Arifullin 239323eeef [#1157] tree: Make tree service use Bearer token's APE overrides
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-06-07 12:11:11 +00:00
Airat Arifullin 04a3f891fd [#1157] object: Make APE checker use Bearer-token's APE overrides
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-06-07 12:11:11 +00:00
Anton Nikiforov 4edff5eea6 [#1157] ape: Introduce single-run chain router
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-06-07 12:11:11 +00:00
Anton Nikiforov a90310335d [#1156] ape: Return `not found` when removing local overrides
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-06-07 12:10:57 +00:00
Evgenii Stratonikov a849236b68 [#1161] node: Remove notification functionality
It is unused and will be reworked in future.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-06-07 12:10:51 +00:00
Anton Nikiforov 67b3002743 [#951] adm: Check for error when reading contracts from archive
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-06-07 12:09:16 +00:00
Evgenii Stratonikov 3f1961157e [#1163] metabase: Handle multiple splitInfos for EC
DCO action / DCO (pull_request) Successful in 3m5s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 4m41s Details
Vulncheck / Vulncheck (pull_request) Successful in 4m10s Details
Build / Build Components (1.21) (pull_request) Successful in 5m49s Details
Build / Build Components (1.22) (pull_request) Successful in 5m46s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m37s Details
Tests and linters / Lint (pull_request) Successful in 7m12s Details
Tests and linters / gopls check (pull_request) Successful in 7m16s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 10m11s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 10m20s Details
Tests and linters / Tests with -race (pull_request) Successful in 10m21s Details
For REP updating split info is handled explicitly by a high-level PUT logic.
For EC it is trickier, because the address of an object we put is only
distantly related to a split info.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-06-06 16:26:29 +03:00
Evgenii Stratonikov 2e074d3846 [#1163] metabase: Properly save EC parent split ID
Search by SplitID should return all parts of a complex object.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-06-05 12:40:16 +03:00
Alexander Chuprov 8fcd0f8f8d [#1121] docs: Change mode of shard components
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-06-05 05:55:24 +00:00
Alexander Chuprov 806236da78 [#1121] node: Change mode of shard components
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-06-05 05:55:24 +00:00
Alexander Chuprov 6f2187a420 [#1121] node: Refactor mods of shard
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-06-05 05:55:24 +00:00
Dmitrii Stepanov cc2449beaf [#1158] metabase: Fix EC storage schema
Vulncheck / Vulncheck (pull_request) Successful in 3m5s Details
Build / Build Components (1.21) (pull_request) Successful in 4m0s Details
Build / Build Components (1.22) (pull_request) Successful in 3m56s Details
Tests and linters / Staticcheck (pull_request) Successful in 4m54s Details
Tests and linters / gopls check (pull_request) Successful in 4m55s Details
Tests and linters / Lint (pull_request) Successful in 5m54s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 6m29s Details
DCO action / DCO (pull_request) Successful in 3m34s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 7m28s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 7m50s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m25s Details
Do not store EC info twice.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-06-04 17:24:40 +03:00
Alexander Chuprov 643480d6fa [#1146] adm: Make --group-name flag required
Vulncheck / Vulncheck (pull_request) Successful in 3m34s Details
DCO action / DCO (pull_request) Successful in 3m50s Details
Build / Build Components (1.21) (pull_request) Successful in 4m31s Details
Build / Build Components (1.22) (pull_request) Successful in 4m29s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m7s Details
Tests and linters / gopls check (pull_request) Successful in 5m29s Details
Tests and linters / Lint (pull_request) Successful in 6m25s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 8m15s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m57s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 10m10s Details
Tests and linters / Tests with -race (pull_request) Successful in 10m6s Details
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-06-03 13:54:59 +03:00
Evgenii Stratonikov f2d2908745 Release v0.40.0
Build / Build Components (1.21) (pull_request) Successful in 1m44s Details
DCO action / DCO (pull_request) Successful in 2m18s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m35s Details
Build / Build Components (1.22) (pull_request) Successful in 4m35s Details
Tests and linters / Staticcheck (pull_request) Successful in 4m31s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 5m0s Details
Tests and linters / Lint (pull_request) Successful in 6m13s Details
Tests and linters / gopls check (pull_request) Successful in 6m4s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m18s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m18s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 9m35s Details
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-05-31 21:58:09 +03:00
Airat Arifullin 5aacb8fc86 [#1144] metabase: Save parent attributes for ec-chunks
Vulncheck / Vulncheck (pull_request) Successful in 4m15s Details
DCO action / DCO (pull_request) Successful in 4m4s Details
Build / Build Components (1.22) (pull_request) Successful in 5m17s Details
Build / Build Components (1.21) (pull_request) Successful in 5m22s Details
Tests and linters / Lint (pull_request) Successful in 7m6s Details
Tests and linters / Staticcheck (pull_request) Successful in 7m25s Details
Tests and linters / gopls check (pull_request) Successful in 7m19s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 9m39s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 10m36s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 10m50s Details
Tests and linters / Tests with -race (pull_request) Successful in 10m51s Details
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-31 19:55:32 +03:00
Airat Arifullin f8e33f8e3a [#1144] metabase: Proprely choose root OID for EC-splitted objects
* If EC-parent is a part of Split itself, then save to root bucket
  its parent;
* If EC-parent is not a part of Split itself, then save to root bucket
  OID of this EC-parent.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-31 19:53:32 +03:00
Airat Arifullin f0edebea18 [#1144] metabase: Support ec parent filter for `Search`
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-31 19:53:32 +03:00
Airat Arifullin 0b367007fc [#1152] go.mod: Update api-go and sdk versions
DCO action / DCO (pull_request) Successful in 5m23s Details
Build / Build Components (1.22) (pull_request) Successful in 7m33s Details
Build / Build Components (1.21) (pull_request) Successful in 7m43s Details
Tests and linters / Lint (pull_request) Successful in 8m51s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 14m33s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 15m48s Details
Vulncheck / Vulncheck (pull_request) Successful in 15m12s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 16m38s Details
Tests and linters / gopls check (pull_request) Successful in 19m24s Details
Tests and linters / Staticcheck (pull_request) Successful in 21m29s Details
Tests and linters / Tests with -race (pull_request) Successful in 23m16s Details
* Resolve conflicts for apemanager since api-go
  contains ape and apemanager packages and SDK only
  ape package.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-31 15:39:09 +03:00
Anton Nikiforov 92e19feb57 [#1147] node: Use public fields for `shard.ExistsPrm`
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov c1af13b47e [#1147] node: Fix issue from `gopls`
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov 9f80d6d9a2 [#1147] Makefile: Fix `gopls-run` target
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov 6130650bb6 [#1147] node: Implement `Lock\Delete` requests for EC object
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov 88b8ddd902 [#1147] cli: Fix output when print EC info with flags `json` & `proto`
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov a82c8cc5b8 [#1147] gc: Execute callback for expired tombstones when they exists
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov d355274cd0 [#1147] object: Use methods on pointer for `searchsvc.execCtx`
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov 3555c73225 [#1147] object: Use methods on pointer for `deletesvc.execCtx`
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov e43e7bec3a [#1147] log: Remove redundant `address` field from log
Filled when logger created for `request` object from package `getsvc`.

Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov 50923ed81c [#1147] Fix gofumpt issue
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Alexey Vanin 4a34d0d40e [#1149] go.mod: Bump neo-go up to v0.106.0
Required to work with neo-go v0.106.0 node
with default hardfork configuration. Without
neo-go client version bump, it throws error.

  failed to get network magic: unexpected hardfork: Cockatrice

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
2024-05-30 08:11:58 +00:00
Ekaterina Lebedeva cc3f762cf2 [#12] cli: clarify `-g` usage in `container list`
DCO action / DCO (pull_request) Successful in 7m44s Details
Vulncheck / Vulncheck (pull_request) Successful in 9m38s Details
Build / Build Components (1.21) (pull_request) Successful in 10m2s Details
Build / Build Components (1.22) (pull_request) Successful in 10m0s Details
Tests and linters / Staticcheck (pull_request) Successful in 12m36s Details
Tests and linters / Lint (pull_request) Successful in 13m13s Details
Tests and linters / gopls check (pull_request) Successful in 15m17s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 16m16s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 16m36s Details
Tests and linters / Tests with -race (pull_request) Successful in 16m36s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 17m25s Details
Add usage replacement for `container list -g` and verbose
warning when using `-g` without `--owner`.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
2024-05-28 15:18:30 +03:00
Airat Arifullin 3627b44e92 [#1142] tree: Fill APE-request with source IP property
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-27 10:17:17 +00:00
Airat Arifullin 482c5129ac [#1142] object: Fill APE-request with source IP property
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-27 10:17:17 +00:00
Airat Arifullin 43625e7536 [#1142] container: Fill APE-request property with source IP
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-27 10:17:17 +00:00
Airat Arifullin 2b02f52cd9 [#1105] cli: Add apemanager commands
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-27 09:34:21 +00:00
Airat Arifullin 542d3adcb2 [#1105] apemanager: Implement apemanager service
* Introduce grpc server for apemanager service and
  its implementation in `pkg/services/apemanager`.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-27 09:34:21 +00:00
Airat Arifullin 51ade979e8 [#1105] ape: Introduce contract storage with proxy contract verification
* `ProxyVerificationContractStorage` uses Proxy contract as a cosigner.
* `ProxyVerificationContractStorage` recreates a contract storage for each handler
  invocation because of an issue: rpc-actor from morph client may be expired. This
  way won't create a bottlenecks because it is expected that this contract storage
  implementation will be used not so often.
* Make morph client return `RPCActor` (that is websocket client in fact).
* Make `SwitchRPCGuardedActor` return `RPCActor` as it will be used for
  `ProxyVerificationContractStorage`.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-27 09:34:21 +00:00
Airat Arifullin 2697d4d1fe [#1143] node: Fix frostfsid cache
DCO action / DCO (pull_request) Successful in 3m16s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m2s Details
Build / Build Components (1.21) (pull_request) Successful in 5m35s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m8s Details
Tests and linters / gopls check (pull_request) Successful in 5m22s Details
Tests and linters / Lint (pull_request) Successful in 6m31s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 9m6s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m26s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m31s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 9m58s Details
Build / Build Components (1.22) (pull_request) Successful in 2m55s Details
* Fix `subjectFromSubjectExtended` converter.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-20 18:49:52 +03:00
Airat Arifullin 40b04c00ef [#1141] metabase: Fix `IsUserObject` method
DCO action / DCO (pull_request) Successful in 6m57s Details
Build / Build Components (1.22) (pull_request) Successful in 10m4s Details
Build / Build Components (1.21) (pull_request) Successful in 10m12s Details
Vulncheck / Vulncheck (pull_request) Successful in 10m4s Details
Tests and linters / gopls check (pull_request) Successful in 13m13s Details
Tests and linters / Staticcheck (pull_request) Successful in 13m45s Details
Tests and linters / Lint (pull_request) Successful in 14m21s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 16m3s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 16m26s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 16m27s Details
Tests and linters / Tests with -race (pull_request) Successful in 16m29s Details
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-20 13:24:15 +03:00
Airat Arifullin 89a80e9a0f [#1141] metabase: Fix `putUniqueIndexItem`
* `GetECHeader` is not correct way to determine if an object's got
  EC-header: `ECHeader` must be used for that.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-20 13:24:08 +03:00
Airat Arifullin 8fd678e269 [#1141] go.mod: Update frostfs-sdk-go and frostfs-api-go/v2
* Also fix unit-test.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-20 13:22:48 +03:00
Dmitrii Stepanov 436c9f5558 [#1129] policer: Restore EC object
Vulncheck / Vulncheck (pull_request) Successful in 1m43s Details
DCO action / DCO (pull_request) Successful in 2m53s Details
Build / Build Components (1.21) (pull_request) Successful in 4m6s Details
Build / Build Components (1.22) (pull_request) Successful in 4m31s Details
Tests and linters / gopls check (pull_request) Successful in 4m57s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m14s Details
Tests and linters / Lint (pull_request) Successful in 6m42s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 9m19s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 10m15s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 10m36s Details
Tests and linters / Tests with -race (pull_request) Successful in 10m36s Details
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-17 14:36:18 +03:00
Dmitrii Stepanov 44f2e8f27f [#1129] putSvc: Allow to put single unprepared object to EC container
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-16 16:28:49 +03:00
Dmitrii Stepanov 0e42126ddc [#1129] object: Fix check owner for EC part
Do not validate EC part owner if request from container node.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-16 16:28:49 +03:00
Dmitrii Stepanov 1cd8562db8 [#1129] policer: Refactor shortage
Drop override inside method.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-16 16:28:49 +03:00
Dmitrii Stepanov 4ab6c404f7 [#1129] policer: Drop unused
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-16 16:28:49 +03:00