Commit Graph

163 Commits (v0.41.0)

Author SHA1 Message Date
Dmitrii Stepanov 069c1559cc [#1164] cli: Improve `object nodes` performance
DCO action / DCO (pull_request) Successful in 5m12s Details
Vulncheck / Vulncheck (pull_request) Successful in 5m35s Details
Build / Build Components (1.21) (pull_request) Successful in 6m3s Details
Build / Build Components (1.22) (pull_request) Successful in 5m59s Details
Tests and linters / gopls check (pull_request) Successful in 7m39s Details
Tests and linters / Staticcheck (pull_request) Successful in 8m28s Details
Tests and linters / Lint (pull_request) Successful in 8m48s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 10m50s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 12m12s Details
Tests and linters / Tests with -race (pull_request) Successful in 12m13s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 12m38s Details
Do complex EC object parts flatten concurrently.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-06-11 08:45:44 +03:00
Anton Nikiforov a0c588263b [#1157] cli: Support adding APE overrides to Bearer token
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-06-07 12:11:11 +00:00
Airat Arifullin 0b367007fc [#1152] go.mod: Update api-go and sdk versions
DCO action / DCO (pull_request) Successful in 5m23s Details
Build / Build Components (1.22) (pull_request) Successful in 7m33s Details
Build / Build Components (1.21) (pull_request) Successful in 7m43s Details
Tests and linters / Lint (pull_request) Successful in 8m51s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 14m33s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 15m48s Details
Vulncheck / Vulncheck (pull_request) Successful in 15m12s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 16m38s Details
Tests and linters / gopls check (pull_request) Successful in 19m24s Details
Tests and linters / Staticcheck (pull_request) Successful in 21m29s Details
Tests and linters / Tests with -race (pull_request) Successful in 23m16s Details
* Resolve conflicts for apemanager since api-go
  contains ape and apemanager packages and SDK only
  ape package.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-31 15:39:09 +03:00
Anton Nikiforov 6130650bb6 [#1147] node: Implement `Lock\Delete` requests for EC object
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov 88b8ddd902 [#1147] cli: Fix output when print EC info with flags `json` & `proto`
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Anton Nikiforov 50923ed81c [#1147] Fix gofumpt issue
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-05-30 08:13:04 +00:00
Ekaterina Lebedeva cc3f762cf2 [#12] cli: clarify `-g` usage in `container list`
DCO action / DCO (pull_request) Successful in 7m44s Details
Vulncheck / Vulncheck (pull_request) Successful in 9m38s Details
Build / Build Components (1.21) (pull_request) Successful in 10m2s Details
Build / Build Components (1.22) (pull_request) Successful in 10m0s Details
Tests and linters / Staticcheck (pull_request) Successful in 12m36s Details
Tests and linters / Lint (pull_request) Successful in 13m13s Details
Tests and linters / gopls check (pull_request) Successful in 15m17s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 16m16s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 16m36s Details
Tests and linters / Tests with -race (pull_request) Successful in 16m36s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 17m25s Details
Add usage replacement for `container list -g` and verbose
warning when using `-g` without `--owner`.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
2024-05-28 15:18:30 +03:00
Airat Arifullin 2b02f52cd9 [#1105] cli: Add apemanager commands
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-27 09:34:21 +00:00
Alexander Chuprov b078fe5ba1 [#1092] control: Move SignMessage to separate package
DCO action / DCO (pull_request) Successful in 6m11s Details
Build / Build Components (1.22) (pull_request) Successful in 7m50s Details
Build / Build Components (1.21) (pull_request) Successful in 8m3s Details
Tests and linters / Lint (pull_request) Successful in 9m45s Details
Tests and linters / gopls check (pull_request) Successful in 12m40s Details
Vulncheck / Vulncheck (pull_request) Successful in 12m35s Details
Tests and linters / Staticcheck (pull_request) Successful in 15m34s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 19m38s Details
Tests and linters / Tests with -race (pull_request) Successful in 21m40s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 3m21s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 3m36s Details
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-05-16 12:14:01 +03:00
Airat Arifullin 952d13cd2b [#1124] cli: Improve APE rule parsing
Vulncheck / Vulncheck (pull_request) Successful in 1m25s Details
DCO action / DCO (pull_request) Successful in 1m59s Details
Build / Build Components (1.21) (pull_request) Successful in 2m27s Details
Build / Build Components (1.22) (pull_request) Successful in 4m25s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 4m57s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m38s Details
Tests and linters / gopls check (pull_request) Successful in 5m57s Details
Tests and linters / Lint (pull_request) Successful in 6m26s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 9m5s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m11s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m4s Details
* Make APE rule parser to read condition's kind in unambiguous using lexemes
`ResourceCondition`, `RequestCondition` instead confusing `Object.Request`, `Object.Resource`.
* Fix unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-05-14 12:23:26 +03:00
Dmitrii Stepanov 368218f0cc [#1120] cli: Edit `object nodes` output
Vulncheck / Vulncheck (pull_request) Failing after 1m35s Details
DCO action / DCO (pull_request) Successful in 2m32s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 3m58s Details
Build / Build Components (1.22) (pull_request) Successful in 4m38s Details
Build / Build Components (1.21) (pull_request) Successful in 4m44s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m26s Details
Tests and linters / gopls check (pull_request) Successful in 5m26s Details
Tests and linters / Lint (pull_request) Successful in 6m44s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 10m41s Details
Tests and linters / Tests with -race (pull_request) Successful in 10m41s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 10m54s Details
Print detailed information only.
Allow to output to JSON.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-08 15:23:58 +03:00
Dmitrii Stepanov a45b548a6f [#1120] cli: Add explain to `object nodes`
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-08 15:23:58 +03:00
Dmitrii Stepanov 654384990c [#1120] cli: Fix `object nodes` for linking objects
Do not use linking objects to get placement for complex object.
Linking objects should be stored on all container nodes, also they are not required.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-08 15:23:57 +03:00
Dmitrii Stepanov 5c730de96e [#1120] cli: Add EC support to `object nodes` command
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-05-08 15:23:57 +03:00
Alexander Chuprov 854200a874 [#1115] node: Remove unused const
Vulncheck / Vulncheck (pull_request) Successful in 1m49s Details
DCO action / DCO (pull_request) Successful in 2m9s Details
Build / Build Components (1.21) (pull_request) Successful in 3m41s Details
Build / Build Components (1.22) (pull_request) Successful in 3m53s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m10s Details
Tests and linters / gopls check (pull_request) Successful in 5m17s Details
Tests and linters / Lint (pull_request) Successful in 6m8s Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 9m52s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 11m26s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 11m43s Details
Tests and linters / Tests with -race (pull_request) Successful in 11m46s Details
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-05-07 19:11:21 +03:00
Ekaterina Lebedeva e07869a8cf [#1100] Remove unused fields
DCO action / DCO (pull_request) Successful in 2m47s Details
Build / Build Components (1.21) (pull_request) Successful in 3m21s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m33s Details
Build / Build Components (1.22) (pull_request) Successful in 5m25s Details
Tests and linters / gopls check (pull_request) Successful in 5m13s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m13s Details
Tests and linters / Lint (pull_request) Successful in 7m2s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 10m2s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m55s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 10m11s Details
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
2024-05-06 10:14:36 +03:00
Anton Nikiforov 112a7c690f [#1103] node: Implement `Get\Head` requests for EC object
DCO action / DCO (pull_request) Successful in 1m44s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m3s Details
Build / Build Components (1.21) (pull_request) Successful in 4m0s Details
Build / Build Components (1.22) (pull_request) Successful in 3m57s Details
Tests and linters / Staticcheck (pull_request) Successful in 4m46s Details
Tests and linters / gopls check (pull_request) Successful in 4m48s Details
Tests and linters / Lint (pull_request) Successful in 5m45s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 8m57s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m10s Details
Tests and linters / Tests (1.22) (pull_request) Successful in 9m20s Details
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-04-24 18:15:53 +03:00
Evgenii Stratonikov 46bc6a7930 [#1095] cli: Support user/group target for local overrides
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-16 11:03:50 +00:00
Evgenii Stratonikov 669103a33e Reapply "[#972] Use slices.Sort* when useful"
This reverts commit 3359349acb.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Dmitrii Stepanov bdf4990904 [#1064] cli: Add EC header output to object head
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 07:08:53 +00:00
Alexander Chuprov 92569b9bbf [#1065] cli: Add support EC parameters
DCO action / DCO (pull_request) Successful in 20m19s Details
Vulncheck / Vulncheck (pull_request) Successful in 23m37s Details
Build / Build Components (1.20) (pull_request) Successful in 25m19s Details
Build / Build Components (1.21) (pull_request) Successful in 25m42s Details
Tests and linters / gopls check (pull_request) Successful in 28m36s Details
Tests and linters / Staticcheck (pull_request) Successful in 30m21s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 6m41s Details
Tests and linters / Lint (pull_request) Successful in 8m48s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 4m29s Details
Tests and linters / Tests with -race (pull_request) Successful in 4m46s Details
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-04-08 12:27:51 +03:00
Airat Arifullin 531542ce60 [#1063] cli: Validate container creation for EC policy
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-03 10:33:51 +00:00
Airat Arifullin 4738508ce2 [#1063] go.mod: Update SDK version
* Update frostfs-sdk and frostfs-api-go versions.
* Refactor depreacted method ReplicaNumberByIndex.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-03 10:33:51 +00:00
Anton Nikiforov 11fde3cde4 [#976] cli: Allow to remove all chains by target
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-03-13 15:33:26 +03:00
Dmitrii Stepanov 17f5463389 [#1043] cli: Add reset evacuation status command
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-03-13 10:29:45 +00:00
Dmitrii Stepanov d433b49265 [#973] node: Resolve perfsprint linter
DCO action / DCO (pull_request) Successful in 2m40s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m41s Details
Build / Build Components (1.20) (pull_request) Successful in 4m27s Details
Build / Build Components (1.21) (pull_request) Successful in 5m6s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m16s Details
Tests and linters / gopls check (pull_request) Successful in 6m23s Details
Tests and linters / Lint (pull_request) Successful in 6m48s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 9m4s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m9s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m23s Details
`fmt.Errorf can be replaced with errors.New` and `fmt.Sprintf can be replaced with string addition`

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-03-11 17:55:50 +03:00
Dmitrii Stepanov 66a26b7775 [#973] node: Resolve revive: unused-parameter linter
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-03-11 17:11:49 +03:00
Airat Arifullin 6f25c790aa [#1012] cli: Fix messages for list commands
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-03-01 07:16:57 +00:00
Airat Arifullin 93bf9acbc2 [#898] control: Remove removed flag from RemoveChainLocalOverrideResponse
* Remove removed flag in service.proto for RemoveChainLocalOverrideResponse.
* Regenerate control API.
* Return error only if RemoveOverride returns non-NotFound code.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-02-28 19:07:07 +00:00
Airat Arifullin 47d9ce71be [#986] cli: Allow add-rule command to parse new actions
* Introduce Object.* and Container.* actions that
  span all methods for services.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-02-20 07:42:29 +00:00
Airat Arifullin 0f064b7962 [#989] util: Introduce any and all statements for ape rule parsing
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-02-20 07:42:29 +00:00
Airat Arifullin 9611710e19 [#989] cli: Read and parse chains from file
* Introduce path flag to make add-rule command read and parse
  chain from file. File is binary/JSON-encoded chain.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-02-20 07:42:29 +00:00
Evgenii Stratonikov 3359349acb Revert "[#972] Use slices.Sort* when useful"
This reverts commit b871d7a5e8.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-02-19 15:36:01 +00:00
Evgenii Stratonikov 9e55836da5 [#994] cli: Output pilorama path in `shards list`
Do it for JSON too, not only for human output.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-02-19 15:19:47 +00:00
Evgenii Stratonikov b871d7a5e8 [#972] Use slices.Sort* when useful
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-02-19 13:13:09 +00:00
Dmitrii Stepanov e4064c4394 [#947] cli: Print tree evacuation stat
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-02-09 11:20:39 +03:00
Dmitrii Stepanov b3f3505ada [#947] cli: Allow to specify evacuation scope
It may be required to evacuate only objects or only tree or all, so
now it spossible to specify.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-02-09 11:20:38 +03:00
Airat Arifullin b1a1b2107d [#909] cli: Make add-rule and list-rules recieve namespace param
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-02-07 06:54:41 +00:00
Dmitrii Stepanov 9ba48c582d [#917] engine: Allow to detach shards
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-02-06 14:49:47 +03:00
Anton Nikiforov befbaf9d56 [#922] cli: Add new command `control list-targets`
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-02-02 12:09:51 +00:00
Anton Nikiforov 417f8fc2c2 [#876] cli: Add doc for commands `control *-rule`
DCO action / DCO (pull_request) Successful in 7m54s Details
Tests and linters / Lint (pull_request) Successful in 9m7s Details
Vulncheck / Vulncheck (pull_request) Successful in 8m51s Details
Build / Build Components (1.20) (pull_request) Successful in 11m57s Details
Build / Build Components (1.21) (pull_request) Successful in 11m52s Details
Tests and linters / Staticcheck (pull_request) Successful in 14m15s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 14m46s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 15m9s Details
Tests and linters / Tests with -race (pull_request) Successful in 15m17s Details
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-01-25 20:26:13 +03:00
Anton Nikiforov 51d1d935ef [#876] cli: Add support for `container` in local rules
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-01-25 20:26:13 +03:00
Denis Kirillov 4a4c790ec1 [#885] cli: Support hex chain id in control API
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-01-11 07:24:22 +00:00
Denis Kirillov c19396d203 [#885] control: Make chain id bytes in grpc
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-01-11 07:24:22 +00:00
Alexander Chuprov 79bebe4a68 [#884] cli: Fix error message for undefined endpoint
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-01-10 10:02:16 +00:00
Dmitrii Stepanov 581887148a [#569] cli: Add `control shards writecache seal` command
DCO action / DCO (pull_request) Successful in 2m46s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m3s Details
Build / Build Components (1.21) (pull_request) Successful in 3m53s Details
Build / Build Components (1.20) (pull_request) Successful in 4m0s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m31s Details
Tests and linters / Lint (pull_request) Successful in 6m17s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 12m47s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 13m14s Details
Tests and linters / Tests with -race (pull_request) Successful in 13m12s Details
It does the same as `control shards flush-writecache --seal`, but
has better name.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-12-29 16:05:37 +03:00
Dmitrii Stepanov 0cb0fc1735 [#569] writecache: Allow to seal writecache after flush
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2023-12-29 16:05:37 +03:00
Anton Nikiforov 32f4e72e6a [#834] adm: Add commands to invoke methods of `policy` contract
DCO action / DCO (pull_request) Successful in 2m49s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m31s Details
Build / Build Components (1.20) (pull_request) Successful in 4m15s Details
Build / Build Components (1.21) (pull_request) Successful in 4m13s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m0s Details
Tests and linters / Lint (pull_request) Successful in 6m50s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 11m42s Details
Tests and linters / Tests with -race (pull_request) Successful in 11m43s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 11m53s Details
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2023-12-20 15:44:12 +03:00
Ekaterina Lebedeva be8f499b91 [#717] Fix mixing CID and container ID
Vulncheck / Vulncheck (pull_request) Successful in 1m13s Details
DCO action / DCO (pull_request) Successful in 2m43s Details
Tests and linters / Staticcheck (pull_request) Successful in 4m11s Details
Tests and linters / Lint (pull_request) Successful in 5m20s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 8m13s Details
Build / Build Components (1.21) (pull_request) Successful in 4m22s Details
Build / Build Components (1.20) (pull_request) Successful in 4m35s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 8m39s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m2s Details
All container ID outputs that may be used in scripts
were replaced with CID.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
2023-12-19 12:36:29 +03:00
Airat Arifullin 4a64b07703 [#869] cli: Pass only CID in requests for control API
* Fix add-rule, list-rules, remove-rule, get-rule commands:
  do not convert container ID to native-schema resource format
  and pass it to control API.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2023-12-14 11:01:20 +00:00