Airat Arifullin
6772976657
[ #1096 ] container: Make ape middleware fill request with user claim tags
...
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-16 15:10:20 +03:00
Evgenii Stratonikov
97e54066d0
[ #1095 ] adm: Support user/group target for APE
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-16 11:03:50 +00:00
Evgenii Stratonikov
46bc6a7930
[ #1095 ] cli: Support user/group target for local overrides
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-16 11:03:50 +00:00
Evgenii Stratonikov
3ea1d7b729
[ #1089 ] control: Add USER and GROUP targets for local override storage
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-16 11:03:50 +00:00
Evgenii Stratonikov
0094186299
[ #1089 ] control: Format proto files with clang-format
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-16 11:03:50 +00:00
Evgenii Stratonikov
91e79c98ba
[ #1089 ] ape: Provide request actor as an additional target
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-16 11:03:50 +00:00
Evgenii Stratonikov
e5e0542482
[ #1085 ] log: Move storage log message to constants package
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-15 07:57:00 +00:00
Evgenii Stratonikov
5be36924e3
[ #41 ] log: Log storage operations in only in Debug
...
They are mostly useless unless we need to _debug_ a specific issue.
The amount of logs we produce is too big.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-15 07:57:00 +00:00
Airat Arifullin
6a46c6d229
[ #1090 ] tree: Make workaround for APE checks
...
* Make `verifyClient` method perform APE check if a container
was created with zero-filled basic ACL.
* Object verbs are used in APE, until tree verbs are introduced.
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-15 07:45:45 +00:00
Airat Arifullin
f4dcb418f2
[ #1090 ] ape: Move ape request and resource implementations to common package
...
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-15 07:45:45 +00:00
Airat Arifullin
661faa639e
[ #1090 ] go.mod: Update policy-engine version
...
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-15 07:45:45 +00:00
Anton Nikiforov
cdae227f82
[ #1083 ] go.mod: Bump grpc version
...
DCO action / DCO (pull_request) Successful in 5m52s
Details
Vulncheck / Vulncheck (pull_request) Successful in 6m19s
Details
Build / Build Components (1.22) (pull_request) Successful in 7m43s
Details
Build / Build Components (1.21) (pull_request) Successful in 7m49s
Details
Tests and linters / Staticcheck (pull_request) Successful in 8m2s
Details
Tests and linters / Lint (pull_request) Successful in 8m47s
Details
Tests and linters / gopls check (pull_request) Successful in 8m29s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 13m20s
Details
Tests and linters / Tests (1.22) (pull_request) Successful in 13m26s
Details
Tests and linters / Tests with -race (pull_request) Successful in 13m32s
Details
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-04-10 16:07:57 +03:00
Dmitrii Stepanov
40781b3a20
[ #1086 ] engine: Change mode in case of errors async
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-10 12:29:43 +00:00
Evgenii Stratonikov
5ef5734c4e
Reapply "[ #972 ] Drop x/exp/slices dependency"
...
This reverts commit 946f2ec2bf
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Evgenii Stratonikov
669103a33e
Reapply "[ #972 ] Use slices.Sort* when useful"
...
This reverts commit 3359349acb
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Evgenii Stratonikov
2c4b50a71e
Reapply "[ #972 ] Use require.ElementsMatch() where possible"
...
This reverts commit 7627d08914
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Evgenii Stratonikov
2ca5dfc2f6
Reapply "[ #972 ] Adopt slices.BinarySearch()"
...
This reverts commit 4bfc6d29b9
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Evgenii Stratonikov
3dc81cb4fc
Reapply "[ #972 ] Use min/max builtins"
...
This reverts commit dad56d2e98
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Evgenii Stratonikov
d864945961
Reapply "[ #972 ] pilorama: Remove removeDuplicatesInPlace()"
...
This reverts commit 9f68305c2e
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Evgenii Stratonikov
43fdb1da45
Reapply "[ #972 ] go.mod: Bump go version to go1.21"
...
This reverts commit 9adcb253be
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-10 12:09:34 +00:00
Dmitrii Stepanov
1b17258c04
[ #1029 ] metabase: Add refill metrics
...
DCO action / DCO (pull_request) Successful in 1m22s
Details
Vulncheck / Vulncheck (pull_request) Successful in 3m11s
Details
Build / Build Components (1.21) (pull_request) Successful in 3m56s
Details
Build / Build Components (1.20) (pull_request) Successful in 3m59s
Details
Tests and linters / Staticcheck (pull_request) Successful in 5m31s
Details
Tests and linters / gopls check (pull_request) Successful in 5m26s
Details
Tests and linters / Lint (pull_request) Successful in 6m13s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 8m54s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m13s
Details
Tests and linters / Tests with -race (pull_request) Successful in 9m30s
Details
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-10 13:05:44 +03:00
Dmitrii Stepanov
e3d9dd6ee8
[ #1024 ] blobovnicza: Copy data on iterate
...
DB value is only valid while the tx is alive.
But handler may to run something in other goroutine.
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-10 10:21:11 +03:00
Dmitrii Stepanov
57466594fb
[ #1024 ] shard: Resync metabase concurrently
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-10 10:21:10 +03:00
Dmitrii Stepanov
1005bf4f56
[ #1024 ] shard: Add refill metabase benchmark
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-10 10:21:10 +03:00
Dmitrii Stepanov
76398c06b0
[ #1080 ] metabase: Add StorageID metric
...
DCO action / DCO (pull_request) Successful in 1m19s
Details
Build / Build Components (1.21) (pull_request) Successful in 4m6s
Details
Vulncheck / Vulncheck (pull_request) Successful in 4m35s
Details
Build / Build Components (1.20) (pull_request) Successful in 7m32s
Details
Tests and linters / gopls check (pull_request) Successful in 7m43s
Details
Tests and linters / Lint (pull_request) Successful in 9m51s
Details
Tests and linters / Staticcheck (pull_request) Successful in 9m53s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 12m48s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 13m11s
Details
Tests and linters / Tests with -race (pull_request) Successful in 14m4s
Details
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-10 10:00:08 +03:00
Dmitrii Stepanov
7b1adfed3e
[ #1080 ] metabase: Open bucket for container counter once
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-10 10:00:08 +03:00
Dmitrii Stepanov
e74bdaa5d5
[ #1080 ] ape: Use value for APE request
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 18:42:03 +03:00
Dmitrii Stepanov
338d8cbebd
[ #1080 ] ape: Do not read object headers before Head/Get
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 15:27:40 +03:00
Dmitrii Stepanov
5b8200de88
[ #984 ] blobovnicza: Do not fail rebuild on big objects
...
If blobovnicza contains objects larger than object size parameter
value, then rebuild fails with an error, because there is no such
bucket in database. This commit forces to create bucket on rebuild.
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 11:51:18 +00:00
Anton Nikiforov
2b88361849
[ #1062 ] object: Fix buffer allocation for `PayloadRange`
...
DCO action / DCO (pull_request) Successful in 5m34s
Details
Vulncheck / Vulncheck (pull_request) Successful in 5m14s
Details
Build / Build Components (1.20) (pull_request) Successful in 8m56s
Details
Build / Build Components (1.21) (pull_request) Successful in 8m56s
Details
Tests and linters / gopls check (pull_request) Successful in 9m3s
Details
Tests and linters / Staticcheck (pull_request) Successful in 9m39s
Details
Tests and linters / Lint (pull_request) Successful in 10m9s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 13m43s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 14m4s
Details
Tests and linters / Tests with -race (pull_request) Successful in 14m40s
Details
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-04-09 11:59:07 +03:00
Dmitrii Stepanov
f5b67c6735
[ #1064 ] policer: Disable EC processing
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 07:08:53 +00:00
Dmitrii Stepanov
bdf4990904
[ #1064 ] cli: Add EC header output to object head
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 07:08:53 +00:00
Dmitrii Stepanov
8668cbf147
[ #1064 ] dev: Add `IR + 4 storage nodes` configuration
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 07:08:53 +00:00
Dmitrii Stepanov
1c5e0f90aa
[ #1064 ] putsvc: Add EC put
...
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 07:08:53 +00:00
Dmitrii Stepanov
39da643354
[ #1064 ] putsvc: Refactor distributed target
...
Extract object builder.
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
2024-04-09 07:08:53 +00:00
Alexander Chuprov
92569b9bbf
[ #1065 ] cli: Add support EC parameters
...
DCO action / DCO (pull_request) Successful in 20m19s
Details
Vulncheck / Vulncheck (pull_request) Successful in 23m37s
Details
Build / Build Components (1.20) (pull_request) Successful in 25m19s
Details
Build / Build Components (1.21) (pull_request) Successful in 25m42s
Details
Tests and linters / gopls check (pull_request) Successful in 28m36s
Details
Tests and linters / Staticcheck (pull_request) Successful in 30m21s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 6m41s
Details
Tests and linters / Lint (pull_request) Successful in 8m48s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 4m29s
Details
Tests and linters / Tests with -race (pull_request) Successful in 4m46s
Details
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-04-08 12:27:51 +03:00
Alexander Chuprov
17f7adb640
[ #1065 ] adm: Add support EC parameters
...
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-04-08 12:27:30 +03:00
Alexander Chuprov
0290f86579
[ #1065 ] adm: refactor dump-config
...
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
2024-04-08 12:06:23 +03:00
Anton Nikiforov
ffb1a6f81a
[ #1072 ] Fix issue from `govulncheck`
...
Vulncheck / Vulncheck (pull_request) Successful in 1m21s
Details
DCO action / DCO (pull_request) Successful in 2m6s
Details
Build / Build Components (1.21) (pull_request) Successful in 4m17s
Details
Build / Build Components (1.20) (pull_request) Successful in 4m52s
Details
Tests and linters / Staticcheck (pull_request) Successful in 6m37s
Details
Tests and linters / Lint (pull_request) Successful in 7m13s
Details
Tests and linters / gopls check (pull_request) Successful in 7m2s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 9m8s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 10m22s
Details
Tests and linters / Tests with -race (pull_request) Successful in 10m20s
Details
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-04-05 18:20:07 +03:00
Anton Nikiforov
9aa533e59a
[ #1072 ] node, ir: Add new config option `kludge_compatibility_mode`
...
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-04-04 11:05:25 +03:00
Anton Nikiforov
d614f04a0a
[ #1072 ] Fix gofumpt issues
...
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
2024-04-03 22:21:14 +03:00
Airat Arifullin
531542ce60
[ #1063 ] cli: Validate container creation for EC policy
...
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-03 10:33:51 +00:00
Airat Arifullin
4738508ce2
[ #1063 ] go.mod: Update SDK version
...
* Update frostfs-sdk and frostfs-api-go versions.
* Refactor depreacted method ReplicaNumberByIndex.
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-03 10:33:51 +00:00
Evgenii Stratonikov
ff4c23f59a
[ #1070 ] services/tree: Fix fast listing depth processing
...
For unsorted `GetSubTree()` we return a single node for depth=1.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-02 14:41:31 +00:00
Evgenii Stratonikov
17af91619a
[ #1070 ] pilorama: Fix cycling behaviour for sorted listing
...
In case there are no items left, return empty slice.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-02 14:41:31 +00:00
Airat Arifullin
4080b99310
[ #1061 ] node: Set TTL for morph rule cache from morph config
...
DCO action / DCO (pull_request) Successful in 1m43s
Details
Build / Build Components (1.21) (pull_request) Successful in 4m3s
Details
Vulncheck / Vulncheck (pull_request) Successful in 4m1s
Details
Build / Build Components (1.20) (pull_request) Successful in 5m28s
Details
Tests and linters / Staticcheck (pull_request) Successful in 6m16s
Details
Tests and linters / Lint (pull_request) Successful in 7m0s
Details
Tests and linters / gopls check (pull_request) Successful in 6m47s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 7m55s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 8m43s
Details
Tests and linters / Tests with -race (pull_request) Successful in 9m6s
Details
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
2024-04-02 12:40:56 +03:00
Ekaterina Lebedeva
d5194ab2a6
[ #949 ] metabase: fix shard.UpdateID()
...
Vulncheck / Vulncheck (pull_request) Successful in 1m20s
Details
DCO action / DCO (pull_request) Successful in 1m59s
Details
Build / Build Components (1.21) (pull_request) Successful in 3m25s
Details
Build / Build Components (1.20) (pull_request) Successful in 4m46s
Details
Tests and linters / Staticcheck (pull_request) Successful in 6m5s
Details
Tests and linters / gopls check (pull_request) Successful in 6m17s
Details
Tests and linters / Lint (pull_request) Successful in 7m7s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 8m38s
Details
Tests and linters / Tests with -race (pull_request) Successful in 8m51s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 8m56s
Details
metabase.Open() now reports metabase mode metric. shard.UpdateID()
needs to read shard ID from metabase => needs to open metabase.
It caused reporting 'shard undefined' metrics. To avoid reporting
wrong metrics metabase.GetShardID() was added which also opens
metabase and does not report metrics.
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
2024-04-01 17:27:34 +03:00
Ekaterina Lebedeva
81a0346a96
[ #949 ] metabase: fix metabase mode metric
...
It used to always show CLOSED regardless of actual mode.
Now metric represents actual metabase mode of operations.
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
2024-04-01 17:27:34 +03:00
Evgenii Stratonikov
e12fcc041d
[ #1059 ] services/tree: Fast sorted listing
...
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-01 12:37:34 +00:00
Evgenii Stratonikov
f23e38c285
Revert "[ #446 ] engine: Move to read-only on blobstor errors"
...
DCO action / DCO (pull_request) Successful in 2m14s
Details
Build / Build Components (1.20) (pull_request) Successful in 4m7s
Details
Vulncheck / Vulncheck (pull_request) Successful in 3m30s
Details
Build / Build Components (1.21) (pull_request) Successful in 4m15s
Details
Tests and linters / Staticcheck (pull_request) Successful in 5m41s
Details
Tests and linters / Lint (pull_request) Successful in 6m6s
Details
Tests and linters / gopls check (pull_request) Successful in 6m42s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 7m47s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 8m21s
Details
Tests and linters / Tests with -race (pull_request) Successful in 8m20s
Details
This reverts commit 69df0d21c2
.
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2024-04-01 12:48:30 +03:00