Commit graph

4870 commits

Author SHA1 Message Date
2ca4d4ca6b [#9999] shard: Fix reload test
Some checks failed
DCO action / DCO (pull_request) Successful in 1m21s
Tests and linters / Staticcheck (pull_request) Failing after 1m47s
Build / Build Components (1.21) (pull_request) Successful in 1m58s
Build / Build Components (1.22) (pull_request) Successful in 2m0s
Tests and linters / Lint (pull_request) Successful in 3m39s
Tests and linters / gopls check (pull_request) Failing after 3m52s
Pre-commit hooks / Pre-commit (pull_request) Successful in 4m29s
Tests and linters / Tests (1.22) (pull_request) Failing after 7m58s
Tests and linters / Tests (1.21) (pull_request) Failing after 7m59s
Tests and linters / Tests with -race (pull_request) Failing after 8m14s
Vulncheck / Vulncheck (pull_request) Failing after 12m2s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:48 +03:00
3e00dc304c [#9999] metabase: Fix EC delete tests
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
13234a6e4f [#9999] shard: Resolve linters
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
343662773f [#9999] metabase: Fix SetMode after db engine change to pebble
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
f5344b481b [#9999] node: Fix config after db engine change
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
fc695b312a [#9999] lens: Fix metabase engine to pebble
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
9bd273d2f9 [#9999] engine: Fix methods after db engine change
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
88a8738259 [#9999] shard: Fix metabase usage after db engine change
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
743819134c [#9999] metabase: Fix unit test after db engine change
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
d0a5d96089 [#9999] metabase: Fix db engine to pebble in db.go and control.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
c229b08f46 [#9999] metabase: Fix db engine to pebble in version.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
3db4112366 [#9999] metabase: Fix db engine to pebble in shard_id.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
c73bf08b72 [#9999] metabase: Fix db engine to pebble in select.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
e5b9ad6465 [#9999] metabase: Fix db engine to pebble in put.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
8bfa2fe106 [#9999] metabase: Fix db engine to pebble in storage_id.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
4bac5644f1 [#9999] metabase: Fix db engine to pebble in lock.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
b12c1f1b23 [#9999] metabase: Fix db engine to pebble in list.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:47 +03:00
06b0ad5b89 [#9999] metabase: Fix db engine to pebble in iterators.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
691af2b2eb [#9999] metabase: Fix db engine to pebble in inhume.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
6bb7330a46 [#9999] metabase: Fix db engine to pebble in graveyard.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
b1d0b71be7 [#9999] metabase: Fix db engine to pebble in get.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
1ff0f37267 [#9999] metabase: Fix db engine to pebble in expired.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
956a64e06b [#9999] metabase: Fix db engine to pebble in delete.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
eae6b4f7e8 [#9999] metabase: Fix db engine to pebble in counter.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
b2bd6650ba [#9999] metabase: Fix db engine to pebble in containers.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
5b33d84180 [#9999] metabase: Fix db engine to pebble in children.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
b8599d9826 [#9999] metabase: Fix db engine to pebble in exists.go
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
1aaf3346ae [#9999] metabase: Change DB engine to pebble
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-30 12:14:46 +03:00
7e04083c27 [#1278] containerSvc: Validate FrostFSID subject exitence on Put
All checks were successful
DCO action / DCO (pull_request) Successful in 1m52s
Vulncheck / Vulncheck (pull_request) Successful in 2m18s
Build / Build Components (1.21) (pull_request) Successful in 2m52s
Tests and linters / Lint (pull_request) Successful in 2m56s
Build / Build Components (1.22) (pull_request) Successful in 2m32s
Tests and linters / Staticcheck (pull_request) Successful in 3m2s
Tests and linters / gopls check (pull_request) Successful in 3m25s
Tests and linters / Tests (1.22) (pull_request) Successful in 5m16s
Pre-commit hooks / Pre-commit (pull_request) Successful in 5m3s
Tests and linters / Tests (1.21) (pull_request) Successful in 8m5s
Tests and linters / Tests with -race (pull_request) Successful in 8m53s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-29 16:01:37 +03:00
a12c39667d [#1278] ir: Do not allow to create container without FrostFSID record
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-29 16:01:37 +03:00
85a77b7c21 [#1279] adm: Interpret "root" name as empty for namespace target type
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-07-29 12:57:40 +00:00
8377372a40 [#1276] go.mod: Update api-go
All checks were successful
Tests and linters / Staticcheck (pull_request) Successful in 2m54s
Build / Build Components (1.22) (pull_request) Successful in 3m28s
Build / Build Components (1.21) (pull_request) Successful in 3m16s
Tests and linters / Lint (pull_request) Successful in 4m14s
Tests and linters / Tests with -race (pull_request) Successful in 8m2s
Tests and linters / Tests (1.21) (pull_request) Successful in 8m41s
Tests and linters / Tests (1.22) (pull_request) Successful in 8m54s
Tests and linters / gopls check (pull_request) Successful in 2m53s
DCO action / DCO (pull_request) Successful in 46s
Vulncheck / Vulncheck (pull_request) Successful in 1m4s
Pre-commit hooks / Pre-commit (pull_request) Successful in 1m47s
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-07-26 16:44:19 +03:00
dd459d399f [#1274] go.mod: Update neo-go version that fixes ws-client
All checks were successful
DCO action / DCO (pull_request) Successful in 1m1s
Vulncheck / Vulncheck (pull_request) Successful in 1m27s
Pre-commit hooks / Pre-commit (pull_request) Successful in 3m8s
Tests and linters / gopls check (pull_request) Successful in 3m12s
Build / Build Components (1.21) (pull_request) Successful in 3m27s
Build / Build Components (1.22) (pull_request) Successful in 3m43s
Tests and linters / Tests (1.22) (pull_request) Successful in 3m39s
Tests and linters / Staticcheck (pull_request) Successful in 3m38s
Tests and linters / Lint (pull_request) Successful in 4m29s
Tests and linters / Tests (1.21) (pull_request) Successful in 9m2s
Tests and linters / Tests with -race (pull_request) Successful in 9m10s
* Update go.mod;
* This neo-go package version contains fix for the wsclient that
  allows to morph event listener refresh the invalidated websocket
  connection to neo-go.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-07-26 14:21:19 +03:00
7fd7961dfa [#1271] getSvc: Fix local EC chunk get
All checks were successful
Build / Build Components (1.21) (pull_request) Successful in 4m22s
Tests and linters / Staticcheck (pull_request) Successful in 4m56s
Tests and linters / gopls check (pull_request) Successful in 5m59s
Tests and linters / Tests (1.21) (pull_request) Successful in 8m20s
DCO action / DCO (pull_request) Successful in 35s
Build / Build Components (1.22) (pull_request) Successful in 1m15s
Vulncheck / Vulncheck (pull_request) Successful in 59s
Tests and linters / Lint (pull_request) Successful in 2m24s
Pre-commit hooks / Pre-commit (pull_request) Successful in 3m1s
Tests and linters / Tests (1.22) (pull_request) Successful in 6m59s
Tests and linters / Tests with -race (pull_request) Successful in 7m32s
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-24 08:52:16 +03:00
8398a8b4b3 [#1271] getSvc: Fix head --raw assemble for EC
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-24 08:52:08 +03:00
9c2c76ca32
[#1259] Move pkg/util/locode to frostfs-locode-db
All checks were successful
Vulncheck / Vulncheck (pull_request) Successful in 4m47s
DCO action / DCO (pull_request) Successful in 4m40s
Build / Build Components (1.21) (pull_request) Successful in 7m27s
Tests and linters / Staticcheck (pull_request) Successful in 8m22s
Tests and linters / gopls check (pull_request) Successful in 10m56s
Build / Build Components (1.22) (pull_request) Successful in 11m48s
Tests and linters / Tests (1.22) (pull_request) Successful in 16m11s
Tests and linters / Lint (pull_request) Successful in 16m27s
Pre-commit hooks / Pre-commit (pull_request) Successful in 19m12s
Tests and linters / Tests (1.21) (pull_request) Successful in 20m31s
Tests and linters / Tests with -race (pull_request) Successful in 8m56s
Removed pkg/util/locode package, added
git.frostfs.info/TrueCloudLab/frostfs-locode-db/pkg/locode dependency.

Signed-off-by: George Bartolomey <george@bh4.ru>
2024-07-23 14:59:14 +03:00
1032075a21
[#1259] cli: Remove locode subcommand
Removed `frostfs-cli util locode` subcommand.
Alternative command could be found in
`git.frostfs.info/TrueCloudLab/frostfs-locode-db`.

Signed-off-by: George Bartolomey <george@bh4.ru>
2024-07-23 14:59:14 +03:00
94f07b4778 [#1245] docker: Fix warnings
All checks were successful
Build / Build Components (1.21) (pull_request) Successful in 2m14s
DCO action / DCO (pull_request) Successful in 2m42s
Build / Build Components (1.22) (pull_request) Successful in 3m49s
Vulncheck / Vulncheck (pull_request) Successful in 3m53s
Tests and linters / Staticcheck (pull_request) Successful in 5m2s
Tests and linters / gopls check (pull_request) Successful in 5m9s
Tests and linters / Lint (pull_request) Successful in 6m9s
Pre-commit hooks / Pre-commit (pull_request) Successful in 8m56s
Tests and linters / Tests (1.21) (pull_request) Successful in 9m35s
Tests and linters / Tests (1.22) (pull_request) Successful in 9m47s
Tests and linters / Tests with -race (pull_request) Successful in 9m58s
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
2024-07-23 12:36:11 +03:00
7ddba70030 [#1264] go.mod: Update dependencies
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-07-23 08:42:29 +00:00
658e3cb92f [#1264] go.mod: Update bbolt to v1.3.10
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-07-23 08:42:29 +00:00
9ee1bd3669
[#1265] *: Run gofumpt
All checks were successful
DCO action / DCO (pull_request) Successful in 7m50s
Vulncheck / Vulncheck (pull_request) Successful in 11m12s
Build / Build Components (1.22) (pull_request) Successful in 15m55s
Build / Build Components (1.21) (pull_request) Successful in 16m2s
Pre-commit hooks / Pre-commit (pull_request) Successful in 20m47s
Tests and linters / Staticcheck (pull_request) Successful in 4m8s
Tests and linters / gopls check (pull_request) Successful in 4m16s
Tests and linters / Lint (pull_request) Successful in 5m35s
Tests and linters / Tests with -race (pull_request) Successful in 7m58s
Tests and linters / Tests (1.22) (pull_request) Successful in 8m12s
Tests and linters / Tests (1.21) (pull_request) Successful in 2m59s
Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>
2024-07-23 10:36:32 +03:00
ca4d6df1cc Release v0.42.0
All checks were successful
Vulncheck / Vulncheck (pull_request) Successful in 3m16s
Tests and linters / Staticcheck (pull_request) Successful in 3m55s
DCO action / DCO (pull_request) Successful in 3m33s
Build / Build Components (1.22) (pull_request) Successful in 4m19s
Build / Build Components (1.21) (pull_request) Successful in 4m25s
Tests and linters / gopls check (pull_request) Successful in 4m45s
Tests and linters / Lint (pull_request) Successful in 7m30s
Pre-commit hooks / Pre-commit (pull_request) Successful in 9m36s
Tests and linters / Tests (1.21) (pull_request) Successful in 11m23s
Tests and linters / Tests with -race (pull_request) Successful in 11m15s
Tests and linters / Tests (1.22) (pull_request) Successful in 11m26s
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-07-23 09:14:36 +03:00
18182e578e [#1261] shard: Fix delete objects from FSTree
All checks were successful
DCO action / DCO (pull_request) Successful in 6m56s
Vulncheck / Vulncheck (pull_request) Successful in 7m38s
Build / Build Components (1.22) (pull_request) Successful in 9m57s
Build / Build Components (1.21) (pull_request) Successful in 10m38s
Tests and linters / gopls check (pull_request) Successful in 10m43s
Tests and linters / Staticcheck (pull_request) Successful in 11m1s
Tests and linters / Lint (pull_request) Successful in 13m35s
Pre-commit hooks / Pre-commit (pull_request) Successful in 14m53s
Tests and linters / Tests (1.21) (pull_request) Successful in 15m55s
Tests and linters / Tests with -race (pull_request) Successful in 15m49s
Tests and linters / Tests (1.22) (pull_request) Successful in 16m10s
Replace nil storageID with empty like by shard.Get.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-22 14:38:09 +03:00
3119f2fbc3 [#1257] metabase: Delete EC gc marks and split info
All checks were successful
DCO action / DCO (pull_request) Successful in 2m12s
Vulncheck / Vulncheck (pull_request) Successful in 4m9s
Pre-commit hooks / Pre-commit (pull_request) Successful in 5m37s
Tests and linters / gopls check (pull_request) Successful in 6m7s
Build / Build Components (1.21) (pull_request) Successful in 6m2s
Build / Build Components (1.22) (pull_request) Successful in 5m55s
Tests and linters / Staticcheck (pull_request) Successful in 6m55s
Tests and linters / Lint (pull_request) Successful in 9m2s
Tests and linters / Tests (1.21) (pull_request) Successful in 11m56s
Tests and linters / Tests with -race (pull_request) Successful in 11m47s
Tests and linters / Tests (1.22) (pull_request) Successful in 11m55s
EC parent and split gc marks should be deleted after last EC chunk delete.
Also should delete split info for EC parent and split parent.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-19 17:14:14 +03:00
e377a92d97 [#1258] audit: Fix panic in LogRequest method
All checks were successful
DCO action / DCO (pull_request) Successful in 11m49s
Vulncheck / Vulncheck (pull_request) Successful in 12m48s
Build / Build Components (1.22) (pull_request) Successful in 14m58s
Build / Build Components (1.21) (pull_request) Successful in 15m34s
Tests and linters / gopls check (pull_request) Successful in 16m12s
Tests and linters / Lint (pull_request) Successful in 16m41s
Tests and linters / Staticcheck (pull_request) Successful in 16m35s
Tests and linters / Tests (1.21) (pull_request) Successful in 21m57s
Tests and linters / Tests (1.22) (pull_request) Successful in 21m55s
Tests and linters / Tests with -race (pull_request) Successful in 22m30s
Pre-commit hooks / Pre-commit (pull_request) Successful in 32m31s
* Make `LogRequest` process `req=nil` to avoid panic.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-07-19 11:27:33 +03:00
eadcea8df0 [#1249] object: Remove all APE pre-checks in handlers
* Methods `Head`, `Get`, `GetRangeHash` should no longer use APE pre-checks
  as that leads only to incorrect rule chain processing for requests:
  1. Immediate return with `NoRuleFound` may be unexpected as some `Allow`
     rule is actually defined but can't be matched yet as it gets no object
     attributes;
  2. Immdediate return with `Allow` may be incorrect as some `Deny` rule
     is actually defined but can't bet matched yet as it gets no object
     attirbutes;
  3. Pre-check breaks compatibility for converted EACL-tables.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-07-18 13:52:43 +00:00
5e5ee545b6 [#1254] policer: Fix svacer warning
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-18 11:30:39 +00:00
27caa8a72f [#1256] metabase: Put split parent object ID for EC chunks
All checks were successful
DCO action / DCO (pull_request) Successful in 6m13s
Vulncheck / Vulncheck (pull_request) Successful in 6m44s
Tests and linters / gopls check (pull_request) Successful in 9m52s
Build / Build Components (1.22) (pull_request) Successful in 10m1s
Build / Build Components (1.21) (pull_request) Successful in 10m33s
Tests and linters / Staticcheck (pull_request) Successful in 11m5s
Pre-commit hooks / Pre-commit (pull_request) Successful in 14m47s
Tests and linters / Lint (pull_request) Successful in 16m21s
Tests and linters / Tests (1.22) (pull_request) Successful in 16m22s
Tests and linters / Tests with -race (pull_request) Successful in 16m32s
Tests and linters / Tests (1.21) (pull_request) Successful in 16m47s
It is required to save split parent ID too, not only split ID.
Otherwise inhume operation works incorrect: shard with last part may be skipped
and parent object will be available.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-17 18:08:07 +03:00
e83d39e33f [#1253] deleteSvc: Use copy of common parameters
All checks were successful
DCO action / DCO (pull_request) Successful in 3m29s
Vulncheck / Vulncheck (pull_request) Successful in 3m31s
Build / Build Components (1.21) (pull_request) Successful in 4m56s
Build / Build Components (1.22) (pull_request) Successful in 4m57s
Tests and linters / Staticcheck (pull_request) Successful in 5m14s
Tests and linters / gopls check (pull_request) Successful in 5m11s
Tests and linters / Lint (pull_request) Successful in 6m23s
Tests and linters / Tests (1.22) (pull_request) Successful in 12m42s
Tests and linters / Tests (1.21) (pull_request) Successful in 12m54s
Tests and linters / Tests with -race (pull_request) Successful in 16m31s
Pre-commit hooks / Pre-commit (pull_request) Successful in 21m57s
getSvc may change the values of some fields, so Head will affect Delete
or Put. In this case, the change is necessary so that the session token
is stored in the tombstone object (EC assemble calls `ForgetTokens`).

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-17 14:24:27 +03:00
fc383ea6ae [#1253] getSvc: Fix EC objects get
Now EC objects assembling is performed concurrently.
Also fixed issue with an error in case of getting
EC object via non-container node.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-07-17 14:24:27 +03:00