TrueCloudLab
/
frostfs-node
19
1
Fork 21
Code Issues 86 Pull Requests 6 Actions Releases Activity
4,248 Commits
7 Branches
21 Tags
47 MiB
Commit Graph

4248 Commits (5ec73fe8a0b6c3c2ab31b093a43c6fdfa7423773)

Author SHA1 Message Date
Airat Arifullin 5ec73fe8a0 [#770] node: Introduce ape chain source 
* Provide methods to access rule chains with access
  policy engine (APE) chain source
* Initialize apeChainSource within object service
  initialization
* Share apeChainSource with control service
* Implement dummy apeChainSource instance based on
  in-memory implementation

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Airat Arifullin 3a2c319b87 [#770] control: Generate gRPC methods to manipulate APE chains 
* Define new types and gRPC methods to manipulate APE chains
  in control service.
* Stub gRPC handlers for the generated methods.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Dmitrii Stepanov 70ab1ebd54 [#763] metrics: Add container_objects_total metric
DCO action / DCO (pull_request) Successful in 3m54s Details
Build / Build Components (1.20) (pull_request) Successful in 4m58s Details
Build / Build Components (1.21) (pull_request) Successful in 5m16s Details
Vulncheck / Vulncheck (pull_request) Successful in 9m54s Details
Tests and linters / Lint (pull_request) Successful in 10m57s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 12m40s Details
Tests and linters / Staticcheck (pull_request) Successful in 12m34s Details
Tests and linters / Tests with -race (pull_request) Successful in 12m48s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 13m19s Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-08 12:30:57 +03:00
Dmitrii Stepanov 9c98fa6152 [#763] metabase: Add container objects counter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-08 12:30:57 +03:00
Dmitrii Stepanov 226e84d782 [#684] node: Add skipped objects count to evacuation result 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-07 12:17:11 +00:00
Dmitrii Stepanov 1e21733ea5 [#684] cli: Add skipped count to evacuation status output 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-07 12:17:11 +00:00
Dmitrii Stepanov 523fb3ca51 [#684] proto: Add skipped count to evacuation status response 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-07 12:17:11 +00:00
Airat Arifullin 74c91eeef5 [#777] client: Refactor PrmContainerList, PrmObjectSearch usage 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-06 06:50:11 +00:00
Alexander Chuprov cae50ecb21 [#716] adm: Add dump policy 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-11-06 06:43:56 +00:00
Dmitrii Stepanov 20d6132f31 [#531] signSvc: Add SetMarshaledData method call
Vulncheck / Vulncheck (pull_request) Successful in 1m25s Details
DCO action / DCO (pull_request) Successful in 1m36s Details
Build / Build Components (1.21) (pull_request) Successful in 2m40s Details
Build / Build Components (1.20) (pull_request) Successful in 3m2s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 5m41s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m32s Details
Tests and linters / Lint (pull_request) Successful in 5m59s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 6m3s Details
Tests and linters / Tests with -race (pull_request) Successful in 6m6s Details 
To reduce memory allocations add `SetMarshaledData` method call
to return already marshalled data in next `StableMarshal` calls.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-02 17:34:33 +03:00
Dmitrii Stepanov 7b1eda5107 [#531] go.mod: Update api-go version 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-02 17:32:41 +03:00
Evgenii Stratonikov 7c8591f83b [#779] go.mod: Update frostfs-contract
DCO action / DCO (pull_request) Successful in 2m5s Details
Vulncheck / Vulncheck (pull_request) Successful in 4m26s Details
Build / Build Components (1.20) (pull_request) Successful in 5m59s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m8s Details
Tests and linters / Lint (pull_request) Successful in 6m49s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 7m45s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 8m18s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m56s Details
Build / Build Components (1.21) (pull_request) Successful in 1m41s Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-02 09:23:41 +00:00
Evgenii Stratonikov 1ab567870a [#779] adm: Support deploying policy contract 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-02 09:23:41 +00:00
Dmitrii Stepanov 0b0e5dab24 [#756] adm: Add polling interval increase
Build / Build Components (1.20) (pull_request) Successful in 3m37s Details
DCO action / DCO (pull_request) Successful in 5m49s Details
Vulncheck / Vulncheck (pull_request) Successful in 5m44s Details
Build / Build Components (1.21) (pull_request) Successful in 6m53s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 7m40s Details
Tests and linters / Staticcheck (pull_request) Successful in 7m39s Details
Tests and linters / Tests with -race (pull_request) Successful in 7m53s Details
Tests and linters / Lint (pull_request) Successful in 8m16s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m55s Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-01 14:24:28 +03:00
Dmitrii Stepanov c7a7229484 [#764] metrics: Fix epoch metric 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-01 10:57:31 +00:00
Anton Nikiforov a26483fc30 [#749] morph: Fix panic when closing morph client 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-11-01 10:48:10 +00:00
Dmitrii Stepanov c80b46fad3 [#754] blobstor: Estimate compressability
DCO action / DCO (pull_request) Successful in 1m59s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m31s Details
Build / Build Components (1.20) (pull_request) Successful in 4m37s Details
Build / Build Components (1.21) (pull_request) Successful in 4m33s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 4m54s Details
Tests and linters / Staticcheck (pull_request) Successful in 4m49s Details
Tests and linters / Tests with -race (pull_request) Successful in 5m9s Details
Tests and linters / Lint (pull_request) Successful in 6m4s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 6m9s Details 
Now it is possible to enable compressability estimation.
If data is likely uncompressable, it should reduce CPU time and memory.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-01 11:24:32 +03:00
Dmitrii Stepanov 05b508f79a [#772] proto: Fix file ending
DCO action / DCO (pull_request) Successful in 3m47s Details
Vulncheck / Vulncheck (pull_request) Successful in 4m47s Details
Build / Build Components (1.21) (pull_request) Successful in 6m5s Details
Build / Build Components (1.20) (pull_request) Successful in 6m13s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 13m9s Details
Tests and linters / Staticcheck (pull_request) Successful in 13m17s Details
Tests and linters / Lint (pull_request) Successful in 13m49s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 14m12s Details
Tests and linters / Tests with -race (pull_request) Successful in 4m30s Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 17:03:04 +03:00
Dmitrii Stepanov 8a82335b5c [#772] pre-commit: Add gofumpt check 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 17:03:04 +03:00
Dmitrii Stepanov 990f9f2d2b [#772] makefile: Replace gofmt with gofumpt 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 17:03:04 +03:00
Dmitrii Stepanov 79088baa06 [#772] node: Apply gofumpt 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 17:03:03 +03:00
Evgenii Stratonikov 00aa6d9749 [#633] shard/test: Fix TestCounters() 
Introduced in 362f24953a, forgotten to be changed because test
generator didn't provide payload size.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-31 12:53:28 +00:00
Evgenii Stratonikov b8f79f4227 [#633] shard/test: Fix race conditions in TestCounters() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-31 12:53:28 +00:00
Evgenii Stratonikov 261d281154 [#762] go.mod: Update sdk-go 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-31 11:22:29 +00:00
Dmitrii Stepanov 869518be0a [#728] writecache: Fix Badger writecache race.
Build / Build Components (1.21) (pull_request) Successful in 1m47s Details
DCO action / DCO (pull_request) Successful in 2m1s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m5s Details
Build / Build Components (1.20) (pull_request) Successful in 3m58s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m43s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m49s Details
Tests and linters / Lint (pull_request) Successful in 6m20s Details
Tests and linters / Tests with -race (pull_request) Successful in 6m8s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 3m6s Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-30 18:36:41 +03:00
Dmitrii Stepanov d4b6ebe7e7 [#725] writecache: Fix metric values
DCO action / DCO (pull_request) Successful in 1m33s Details
Build / Build Components (1.21) (pull_request) Successful in 3m11s Details
Build / Build Components (1.20) (pull_request) Successful in 3m22s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m34s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 6m0s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 6m1s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m4s Details
Tests and linters / Tests with -race (pull_request) Successful in 3m58s Details
Tests and linters / Lint (pull_request) Successful in 11m43s Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-27 12:22:29 +03:00
Anton Nikiforov 121f5c4dd8 [#757] ir: Do not exclude node in maintenance mode from netmap
Build / Build Components (1.20) (pull_request) Successful in 6m20s Details
DCO action / DCO (pull_request) Successful in 6m45s Details
Vulncheck / Vulncheck (pull_request) Successful in 6m20s Details
Build / Build Components (1.21) (pull_request) Successful in 8m34s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 9m21s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m17s Details
Tests and linters / Staticcheck (pull_request) Successful in 9m15s Details
Tests and linters / Lint (pull_request) Successful in 9m42s Details
Tests and linters / Tests with -race (pull_request) Successful in 11m34s Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-10-26 10:50:32 +03:00
Evgenii Stratonikov 9f7c2d8810 [#752] innerring: Simplify keyPosition()
DCO action / DCO (pull_request) Successful in 3m0s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m10s Details
Build / Build Components (1.20) (pull_request) Successful in 4m3s Details
Build / Build Components (1.21) (pull_request) Successful in 4m8s Details
Tests and linters / Staticcheck (pull_request) Successful in 5m13s Details
Tests and linters / Lint (pull_request) Successful in 5m44s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 7m0s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 7m7s Details
Tests and linters / Tests with -race (pull_request) Successful in 7m50s Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 16:06:44 +03:00
Evgenii Stratonikov cddc58ace2 [#752] innerring: Optimize keyPosition() 
```
goos: linux
goarch: amd64
pkg: git.frostfs.info/TrueCloudLab/frostfs-node/pkg/innerring
cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz
              │      old       │                 new                 │
              │     sec/op     │   sec/op     vs base                │
KeyPosition-8   2771.50n ± 10%   40.32n ± 4%  -98.55% (p=0.000 n=10)

              │     old      │                  new                  │
              │     B/op     │     B/op      vs base                 │
KeyPosition-8   1.531Ki ± 0%   0.000Ki ± 0%  -100.00% (p=0.000 n=10)

              │    old     │                new                 │
              │ allocs/op  │ allocs/op  vs base                 │
KeyPosition-8   21.00 ± 0%   0.00 ± 0%  -100.00% (p=0.000 n=10)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 16:06:44 +03:00
Evgenii Stratonikov 0a9830564f [#752] morph: Adopt neo-go RPC statuses 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 16:06:44 +03:00
Evgenii Stratonikov 6950312967 [#752] morph: Drop loop copy kludges 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 16:06:44 +03:00
Evgenii Stratonikov 4f62fded01 [#752] go.mod: Update dependencies 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 16:06:44 +03:00
Evgenii Stratonikov 2dbf5c612a [#752] go.mod: Update neo-go to v0.103.0 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 16:06:44 +03:00
Evgenii Stratonikov 4239f1e817 [#750] adm: Drop deprecated rpcclient.TransferTarget 
We do not use `nep17` wrapper, because transfers of different tokens are
possible in a single transaction.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov 7f35f2fb1d [#750] adm: Drop deprecated CreateTxFromScript() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov b0d303f3ed [#750] adm: Drop unused methods from Client 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov a788c24e6d [#750] adm: Drop deprecated AddNetworkFee() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov 4368243bed [#750] adm: Drop deprecated NEP17BalanceOf() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov 00a0045d9a [#750] adm: Drop deprecated GetContract*() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov 7f8ccc105b [#750] adm: Drop deprecated GetNetwork() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov efb37b0e65 [#750] adm: Fix invalid tests 
Introduced in a9d04ba86f.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Evgenii Stratonikov fe1acf9e9a [#750] morph: Remove deprecated channel use 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-25 07:57:05 +00:00
Anton Nikiforov 559ad58ab1 [#642] writecache: Remove usage of close channel in bbolt 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-10-24 15:57:50 +00:00
Anton Nikiforov c0b86f2d93 [#642] writecache: Remove usage of close channel in badger 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-10-24 15:57:50 +00:00
Anton Nikiforov b0cf100427 [#49] node: React on SIGHUP only when node in READY state 
Add more info in logs when node is going to shut down,
but initialization process still in progress.

Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-10-24 15:55:29 +00:00
Airat Arifullin 58b6224dd8 [#747] client: Refactor PrmObjectPutInit usage 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-10-20 11:55:40 +00:00
Airat Arifullin 12b7cf2533 [#747] client: Refactor PrmObjectPutSingle usage 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-10-20 11:55:40 +00:00
Dmitrii Stepanov dc4d27201b [#733] morph: Fix delete container signature check
DCO action / DCO (pull_request) Successful in 3m26s Details
Vulncheck / Vulncheck (pull_request) Successful in 4m22s Details
Build / Build Components (1.21) (pull_request) Successful in 5m30s Details
Build / Build Components (1.20) (pull_request) Successful in 6m4s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m52s Details
Tests and linters / Tests with -race (pull_request) Failing after 7m16s Details
Tests and linters / Lint (pull_request) Successful in 9m46s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 9m44s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m41s Details 
Committed invalid condition, it was just for debug.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-19 18:07:37 +03:00
Dmitrii Stepanov 189dbb01be [#733] frostfs-cli: Add `control ir remove-container`
DCO action / DCO (pull_request) Successful in 3m51s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m49s Details
Build / Build Components (1.21) (pull_request) Successful in 4m34s Details
Build / Build Components (1.20) (pull_request) Successful in 6m21s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 9m1s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 9m12s Details
Tests and linters / Staticcheck (pull_request) Successful in 6m40s Details
Tests and linters / Tests with -race (pull_request) Successful in 9m21s Details
Tests and linters / Lint (pull_request) Successful in 9m39s Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-19 16:22:18 +03:00
Dmitrii Stepanov f2437f7ae9 [#734] shard: Fix Delete method
DCO action / DCO (pull_request) Successful in 1m36s Details
Build / Build Components (1.20) (pull_request) Successful in 3m46s Details
Vulncheck / Vulncheck (pull_request) Successful in 3m16s Details
Tests and linters / Staticcheck (pull_request) Successful in 4m42s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 6m27s Details
Tests and linters / Tests (1.21) (pull_request) Successful in 6m35s Details
Tests and linters / Tests with -race (pull_request) Successful in 6m33s Details
Build / Build Components (1.21) (pull_request) Successful in 13m7s Details
Tests and linters / Lint (pull_request) Successful in 19m14s Details 
Due to the flushing data from the writecache to the storage
and simultaneous deletion, a partial deletion situation is possible.
So as a solution, deletion is allowed only when the object is in storage,
because object will be deleted from writecache by flush goroutine.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-16 17:00:18 +03:00