TrueCloudLab
/
frostfs-node
19
1
Fork 21
Code Issues 86 Pull Requests 7 Actions Releases Activity
4,597 Commits
7 Branches
21 Tags
47 MiB
Commit Graph

1665 Commits (v0.38.3)

Author SHA1 Message Date
Dmitrii Stepanov a476d8285a [#294] deletesvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov 70a1081988 [#294] aclsvcv2: Refactor service constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Dmitrii Stepanov 61541eaec2 [#294] aclsvc: Refactor checker constructor 
Pass required deps as args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-12 07:42:10 +00:00
Airat Arifullin 0754e6e654 [#390] cli: Fix bearer token reading for tree subcommands
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Airat Arifullin 676a3efa79 [#390] cli: Make tree commands errors and messages more verbose 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Airat Arifullin c42db4e761 [#390] cli: Support more tree service API calls in CLI 
* Support healthcheck API call
* Support move API call
* Support remove API call
* Support getSubtree API call
* Support getOpLog API call

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-11 14:11:30 +00:00
Dmitrii Stepanov 7b76527759 [#486] node: Add PutSingle wrappers 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-10 15:49:21 +03:00
Dmitrii Stepanov 040a623d39 [#476] cli: Fix `object nodes` command
Build / Build Components (1.20) (pull_request) Successful in 3m56s Details
Build / Build Components (1.19) (pull_request) Successful in 4m18s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Lint (pull_request) Failing after 7m27s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 7m45s Details
Tests and linters / Tests with -race (pull_request) Successful in 7m40s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 14m7s Details
Tests and linters / Staticcheck (pull_request) Successful in 13m37s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Do not fail if client creation failed.
Use external addresses to create the client too.
Use public key as node ID.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-10 09:58:31 +03:00
Evgenii Stratonikov e858479a74 [#498] policer: Explicitly Rewind() iterator after finish 
Previously, we can continue to return `EndOfListing` infinitely.
Reflect iterator reuse via Rewind() method.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-07 14:52:33 +00:00
Alexander Chuprov 033eaf77e1 [#496] node: Fix linter importas
Build / Build Components (1.20) (pull_request) Successful in 3m52s Details
Build / Build Components (1.19) (pull_request) Successful in 4m1s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Tests with -race (pull_request) Successful in 5m36s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m55s Details
Tests and linters / Lint (pull_request) Successful in 14m40s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 15m29s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Standardize the alias of the
import frostfs-sdk-go/object as objectSDK.

Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-07-06 15:36:41 +03:00
Anton Nikiforov b520a3049e [#483] cli: Fix `object put` cmd with flag `--prepare-locally`
Build / Build Components (1.20) (pull_request) Successful in 3m31s Details
Build / Build Components (1.19) (pull_request) Successful in 3m46s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Tests with -race (pull_request) Successful in 5m2s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m28s Details
Tests and linters / Lint (pull_request) Successful in 9m28s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 13m46s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-04 18:58:26 +03:00
Anton Nikiforov 4c248d573e [#483] cli: Allow to split object on the client side
Build / Build Components (1.20) (pull_request) Successful in 3m50s Details
Build / Build Components (1.19) (pull_request) Successful in 4m2s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Tests and linters / Lint (pull_request) Successful in 8m50s Details
Tests and linters / Tests with -race (pull_request) Successful in 5m16s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 6m10s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 13m36s Details
ci/woodpecker/push/pre-commit Pipeline failed Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-03 18:31:46 +03:00
Anton Nikiforov 90e9a85acc [#483] Update dependencies 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-07-03 15:44:59 +03:00
Alejandro Lopez f9730f090d [#92] Refactor policer and add some unit tests 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-03 07:05:31 +00:00
Dmitrii Stepanov 0c5b025788 [#470] grpc: Increase message limits
Build / Build Components (1.19) (pull_request) Successful in 3m27s Details
ci/woodpecker/pr/pre-commit Pipeline was successful Details
Build / Build Components (1.20) (pull_request) Successful in 3m25s Details
Tests and linters / Lint (pull_request) Successful in 2m15s Details
Tests and linters / Tests (1.19) (pull_request) Successful in 2m51s Details
Tests and linters / Tests (1.20) (pull_request) Successful in 5m54s Details
Tests and linters / Tests with -race (pull_request) Successful in 6m31s Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
For send message limit set to 2GiB, but there are custom
GET/GET RANGE limiters.
For receive message limit set to 256 MiB, but actual chunk size
will be managed by client.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-30 16:32:15 +03:00
Evgenii Stratonikov 8a4e250dae [#468] *: replace outdated TODO crypto-related links
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov 73a71a71b0 [#1] node: Use a proper validation of a substorage type 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Evgenii Stratonikov f4c71cea65 [#1] *: Replace outdated FIXME/TODO links 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Dmitrii Stepanov cac4ed93d6 [#428] engine: Add low_mem config parameter 
Concurrent initialization in case of the metabase resync leads to
high memory consumption and potential OOM.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 13:29:39 +00:00
Dmitrii Stepanov 72fedff7ad [#426] cli: Add object nodes command
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-26 07:41:34 +00:00
Anton Nikiforov ab489265b3 [#449] cli: Allow to exec `tree get-by-path` without bearer token
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Anton Nikiforov 71889234b7 [#449] tree: Allow reading requests signed by keys from allow list 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-23 14:44:19 +03:00
Evgenii Stratonikov 167a67f0b8 [#460] services/util: Remove `HandleUnaryRequest` 
There is no need in a wrapper with many from-`interface{}` conversions.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-21 17:07:56 +03:00
Dmitrii Stepanov b5d9f4a285 [#373] metrics: Add pilorama metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov e89fa110c7 [#373] metrics: Add metabase metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov af608da952 [#373] metrics: Add blobovnizca metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov 56f320dd85 [#373] metrics: Add blobstor metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov 16a142cd0c [#373] metrics: Add FSTree metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov 059e9e88a2 [#373] metabase: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-21 15:13:26 +03:00
Dmitrii Stepanov 26b305f82b [#424] morph: Fix cache metrics
ci/woodpecker/pr/pre-commit Pipeline was successful Details 
Use separate morph cache metrics for node and IR

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-14 18:26:19 +03:00
Dmitrii Stepanov c348ae35b0 [#424] metrics: Drop embedded metrics 
It was not obvious where metrics are used.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-14 14:53:32 +03:00
Alejandro Lopez 344d6b2ae1 [#xx] Fix invalid log metric namespace identifier
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-06-13 15:36:34 +03:00
Alejandro Lopez 4887f489a1 [#17] Add morph client metrics
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-06-13 14:06:04 +03:00
Dmitrii Stepanov 4f83ab0fb4 [#409] node: Do not sent initial bootstrap under maintenance
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-13 10:02:36 +00:00
Dmitrii Stepanov e68384d4e3 [#409] node: Fetch last bootstrap info on startup 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-13 10:02:36 +00:00
Dmitrii Stepanov 898f0686b1 [#409] node: Log maintenance state on startup 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-13 10:02:36 +00:00
Alejandro Lopez 0c40d98f7a [#375] Add log metrics
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-06-13 09:52:45 +00:00
Dmitrii Stepanov 508e2064eb [#438] cli: Drop tracing debug print
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-09 14:12:25 +03:00
Airat Arifullin 189a367ef2 [#390] frostfs-cli: Pass bearer token to Tree srv
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
* Add --bearer flag for "tree" subcommand

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-06-07 11:08:34 +03:00
Evgenii Stratonikov a770b89fd8 [#422] adm: Fix ValidatorCount problems after neo-go update
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-02 14:48:51 +03:00
Evgenii Stratonikov f8c1e0639d [#422] cli: Provide context to NetmapSnapshot() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-02 14:48:47 +03:00
Evgenii Stratonikov f1f56ef871 [#406] cli: Add --trace flag
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-02 11:44:04 +00:00
Evgenii Stratonikov 96c9843591 [#406] cmd/common: Execute PersistentPostRun() on errors 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-02 11:44:04 +00:00
Evgenii Stratonikov 9562123c49 [#406] cli: Pass context to internal client 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-02 11:44:04 +00:00
Alejandro Lopez 2dd3fc8b7e [#xx] cli: Add policy-playground command
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-06-02 09:23:40 +00:00
Dmitrii Stepanov dcdfb6ed41 [#412] node: Use observability interceptors 
Use metrics and tracing interceptors.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-01 13:23:11 +00:00
Dmitrii Stepanov c09144ecf1 [#412] node: Replace metrics package 
Use observability module.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-01 13:23:11 +00:00
Dmitrii Stepanov 74578052f9 [#412] node: Replace tracing package 
Use observability module.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-01 13:23:11 +00:00
Alejandro Lopez faca861451 [#411] Remove unnecessary pointers for sync objects
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-31 10:19:14 +00:00
Dmitrii Stepanov f64322576a [#402] cli: Add estimated evacuation time left 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-31 10:18:44 +00:00
Anton Nikiforov 8dcd06c587 [#394] node: Use `Context` in `Blobovniczas.Iterate()`
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-31 10:09:18 +00:00
Airat Arifullin a3e30062df [#325] node: Introduce unsafe_disable param to disable policer
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-05-31 10:09:05 +00:00
Alejandro Lopez bc34fee6a7 [#370] Add tree service metrics
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-26 13:39:12 +00:00
Dmitrii Stepanov 5983617069 [#393] shard: Create tombstone source when reload
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-26 12:14:02 +00:00
Dmitrii Stepanov 9119199f6e [#397] cli: Fix evacuation method names
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-26 11:28:30 +03:00
Dmitrii Stepanov 81718afb39 [#338] ir: Drop named named put fee 
Named put fee value used only when notary disabled.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-24 08:44:47 +00:00
Dmitrii Stepanov 03ab0ca30f [#338] adm: Drop notaryless code 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-24 08:44:47 +00:00
Evgenii Stratonikov 4b768fd115 [#381] *: Move to sync/atomic 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-23 08:18:01 +03:00
Alejandro Lopez e3ad3c2965 [#283] cli: Move control healthcheck command under control ir
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-22 08:13:52 +00:00
Dmitrii Stepanov f7c0b50d70 [#329] cli: Add async evacuate commands 
Add start, stop evacuate and evacuate status commands.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-19 08:43:52 +00:00
Anton Nikiforov aabcd8d3e4 [#362] node: Cancel ctx in the same routine as for signal watcher
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-18 09:28:10 +03:00
Alejandro Lopez df9e099fa7 [#352] Add explicit max number of alphabet nodes
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-17 15:01:26 +00:00
Anton Nikiforov 6f47c75e43 [#125] ir: Set extra wallets on SIGHUP
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-16 12:47:43 +00:00
Anton Nikiforov 8da6530f41 [#351] cli: Support copies number parameter in `object put`
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-16 08:22:56 +00:00
Alejandro Lopez 079b28fa0f [#341] Register candidates in separate transactions
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-15 12:46:12 +00:00
Evgenii Stratonikov d4d921dcaf [#346] adm: fix race in wallet generation
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-15 11:50:20 +03:00
Evgenii Stratonikov 429a87e83b [#39] ir: Use defer for wg.Done()
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Not important, but `exitOnErr` can alter control flow, let's be
explicit.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 17:49:47 +03:00
Pavel Karpy f604d6bbdc [#39] ir: Add optional profilers 
Includes `block` and `mutex` profiles configuration.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 17:49:47 +03:00
Evgenii Stratonikov f989bc52be [#39] ir: Do not store config keys in `httpComponent` 
Pprof will have specific options, it seems wrong to have them in a
generic struct.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 17:49:46 +03:00
Evgenii Stratonikov 61776033c2 [#39] ir: Do not reload services if they are disabled 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 15:49:04 +03:00
Pavel Karpy 14c35d776e [#39] node: Add optional profilers 
Include settings for block and mutex profilers.
They are disabled by default, as in Go runtime itself.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 15:49:04 +03:00
Alejandro Lopez a6ee7a3087 [#324] Add replicator metrics
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-12 11:00:17 +00:00
Evgenii Stratonikov c8c5f14e2e [#321] adm/test: Check wallet correctness in parallel 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov fe4082799a [#321] adm: Create multisig accounts in parallel 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Anton Nikiforov 800eb5e983 [#125] ir: Reconfigure pprof and metrics on SIGHUP
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-11 12:38:34 +03:00
Alejandro Lopez 90799497d3 [#114] Add remove-node IR control command
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-10 14:31:44 +00:00
Dmitrii Stepanov d02950ad63 [#330] morph: Fix linter issue
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Revive became smarter after go 1.20.4 upgrade.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-05 18:02:38 +03:00
Alejandro Lopez d1661ae7dc [#308] Remove downloadContractsFromGithub from the frostfs-adm
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-04 14:08:42 +03:00
Dmitrii Stepanov 30e1b62b67 [#277] getsvc: Fix service deps 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-28 14:03:12 +00:00
Evgenii Stratonikov 3bac5a485d [#248] config: Remove audit-related parameters
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-28 17:00:43 +03:00
Evgenii Stratonikov 8b2aae73c6 [#248] cli: Remove storagegroup commands 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-28 17:00:43 +03:00
Alejandro Lopez ff25521204 [#270] Add IR epoch tick control call
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-04-28 07:57:00 +00:00
Evgenii Stratonikov dfe4ada838 [#285] lint: Resolve revive/if-return 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-26 17:35:08 +03:00
Evgenii Stratonikov f07e2d4812 [#285] lint: Fix revive/unused-parameter 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-26 17:35:04 +03:00
Anton Nikiforov 14f83b8aa9 [#125] ir: Change log level on SIGHUP
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:54:19 +03:00
Anton Nikiforov 563780057d [#125] ir: Use `internal/common/config` for reading config 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:53:51 +03:00
Anton Nikiforov ef222e2487 [#125] cmd: Refactor `internal/common/viper` 
Add `opts.WithViper`, set opts struct as private.

Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:53:51 +03:00
Anton Nikiforov e61aec4a7d [#125] node: Remove unused config.Prm 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:53:51 +03:00
Anton Nikiforov eb7be82e87 [#125] node: Avoid panic when reading config 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:53:51 +03:00
Anton Nikiforov d390f093e0 [#125] node: Move viper creation to `internal/common/config` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:53:51 +03:00
Anton Nikiforov b2123bfd1a [#125] node: Add new option `WithEnvPrefix` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:53:51 +03:00
Anton Nikiforov ee01275d25 [#125] node: Remove redundant `env` from `config/internal` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-26 13:53:51 +03:00
Dmitrii Stepanov 04be9415d9 [#231] node: Fix race condition in TTL cache
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Use key locker to lock by key.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-25 09:54:12 +03:00
Dmitrii Stepanov ddbc9e255f [#231] node: Invalidate container cache on PutSuccess event 
For example: frostfs-cli creates container and makes polling
GetContainer requests. These requests go through container cache,
so not found error stores in container cache.
So container cache can contain not found error when PutSuccess event received.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-25 09:42:02 +03:00
Evgenii Stratonikov 015d62425b [#164] metrics: Fill local registry explicitly 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-24 09:01:13 +00:00
Pavel Karpy 59822f7fb4 [#1248] node: Do not update cache twice
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Do not request morph values on morph cache misses concurrently.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-04-21 09:45:53 +00:00
Dmitrii Stepanov 3d43b0f7f9 [#265] node: Fix after SDK & API-Go version up
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-18 12:09:19 +03:00
Dmitrii Stepanov a358255c1b [#265] node: Drop unused 
Resolve unused linter.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-18 12:09:16 +03:00
Dmitrii Stepanov f07d4158f5 [#249] node: Drop subnet from IR and morph 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-17 09:46:02 +03:00
Dmitrii Stepanov d757d881d0 [#249] node: Drop subnet from config 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-17 09:46:02 +03:00
Dmitrii Stepanov 05c870f39a [#249] cli: Drop subnet support 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-17 09:46:02 +03:00
Dmitrii Stepanov 160147b05d [#249] adm: Drop subnet support 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-17 09:46:02 +03:00
Evgenii Stratonikov 8466894fdf [#250] control: remove `DumpShard` and `RestoreShard` RPC
ci/woodpecker/push/pre-commit Pipeline was successful Details 
We have `Evacuate` with a cleaner interface.
Also, remove them from CLI and engine.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-14 12:28:49 +00:00
Pavel Karpy beabed788c [#247] network_config: Drop reputation 
Drop the code that was expected to work with global reputation network
parameters.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-04-14 14:53:22 +03:00
Pavel Karpy 960e3c219e [#247] config, doc: Drop reputation references 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-04-14 14:44:14 +03:00
Pavel Karpy 560f73ab7e [#247] node, ir: Drop reputation related code 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-04-14 14:44:14 +03:00
Dmitrii Stepanov d62c6e4ce6 [#242] node: Add tracing spans 
Add tracing spans for PUT requests.
Add tracing spans for DELETE requests.
Add tracing spans for SELECT requests.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-14 10:25:53 +00:00
Anton Nikiforov 995db117d0 [#238] node: Read cfg from dir even if cfg file not set
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-14 10:19:10 +00:00
Anton Nikiforov 299b6a6938 [#100] adm: Use netmap constants from pkg
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-14 05:12:50 +00:00
Anton Nikiforov 0c6aeaaf18 [#100] adm: Take net settings into account during netmap contract update 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-04-14 05:12:50 +00:00
Evgenii Stratonikov 0e31c12e63 [#240] logs: Move log messages to constants 
Drop duplicate entities.
Format entities.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-14 05:06:09 +00:00
Evgenii Stratonikov d686ab49e8 [#202] adm: Remove deprecated RPC client methods 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-13 13:15:30 +00:00
Evgenii Stratonikov 2f1beddfd3 [#202] adm: Remove deprecated warnings in tests 
`VerifyBlocks` is now `SkipBlockVerification` and is false by default.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-13 13:15:30 +00:00
Airat Arifullin 01c0c90a86 [#113] cli: add "name" option for "get container" command
ci/woodpecker/push/pre-commit Pipeline was successful Details 
* Make get container command filter out the container by attribute name

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-04-12 18:25:37 +00:00
Dmitrii Stepanov 0920d848d0 [#135] get-object: Add tracing spans 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-12 06:52:00 +00:00
Dmitrii Stepanov 5af9f58469 [#135] tracing: Add tracing to node gRPC endpoints 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-12 06:52:00 +00:00
Dmitrii Stepanov 2c07f831c7 [#223] node: Refactor cache usage
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Drop excess type args.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-10 14:16:34 +03:00
Evgenii Stratonikov b689027d57 [#191] cli: Add `control shards doctor` command
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-07 17:25:50 +00:00
Dmitrii Stepanov 7ebbfa3358 [#212] reputationsvc: Resolve linters and rename 
Resolved containedctx linters.
Renamed context structs and interfaces to more understandble names.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-07 15:35:57 +00:00
Dmitrii Stepanov e815b19101 [#219] morph: Resolve containedctx linter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-07 15:43:20 +03:00
Dmitrii Stepanov e21c5bea21 [#203] cli: Fix error message 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-06 16:33:36 +03:00
Dmitrii Stepanov 68a2f36636 [#203] morph: Mark depracated methods 
Skip staticcheck for depracated methods. Will be fixed soon.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-06 16:33:36 +03:00
Dmitrii Stepanov 9e2df4b7c7 [#203] node: Fix double imports 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-06 16:33:36 +03:00
Dmitrii Stepanov 206458c841 [#217] containersvc: Resolve containedctx linter
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-05 14:38:00 +00:00
Dmitrii Stepanov 279261ace3 [#217] containersvc: Refactor route passing 
Resolve containedctx for routeCtx.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-05 14:38:00 +00:00
Dmitrii Stepanov 23575e1ac0 [#210] policier: Resolve contextcheck linter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-05 14:55:52 +03:00
Evgenii Stratonikov 49cc23e03c [#175] adm: pipeline container iteration
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Do not accumulate everything in memory.
Also, CLI should be responsive.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-04 07:26:23 +00:00
Evgenii Stratonikov e85e5382e4 [#175] adm: list containers using `containersOf` 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-04 07:26:23 +00:00
Evgenii Stratonikov 0948a280fa [#195] morph: use blocking unlimited pool for notifications
ci/woodpecker/push/pre-commit Pipeline failed Details 
With non-blocking pool restricted by 10 in capacity, the probability of
dropping events is unexpectedly big. Notifications are an essential part of the FrostFS,
we should not drop anything, especially new epochs.
```
Mar 31 07:07:03 vedi neofs-ir[19164]: 2023-03-31T07:07:03.901Z        debug        subscriber/subscriber.go:154        new notification event from sidechain        {"name": "NewEpoch"}
Mar 31 07:07:03 vedi neofs-ir[19164]: 2023-03-31T07:07:03.901Z        warn        event/listener.go:248        listener worker pool drained        {"chain": "morph", "capacity": 10}
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-03 15:58:16 +00:00
Dmitrii Stepanov 27bdddc48f [#199] putsvc: Refactor put object 
Resolve containedctx linter for streamer and remote target

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-03 15:58:11 +00:00
Dmitrii Stepanov ed28ce24cd [#168] node: Refactor reputation service
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Resolve funlen linter for initReputationService function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov 1f929fdd57 [#168] node: Refactor netmap service init 
Resolve funlen linter for initNetmapService function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov dd572825c7 [#168] node: Refactor object service init 
Resolve funlen linter for initObjectService function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov 56161d39b4 [#168] node: Refactor container services 
Resolve containedctx for remoteLoadAnnounceWriter struct

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov 28dc9e2190 [#168] node: Refactor container service init 
Resolve funlen linter for initContainerService function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov dcd39f8fdd [#168] node: Refactor shard opts initialization 
Resolve funlen linter for shardOpts method

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov c94372e6f9 [#168] node: Refactor config initialization 
Resolve funlen linter for initCfg function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov 3bbb516528 [#168] node: Refactor node config read 
Resolve funlen linter for readConfig method

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Dmitrii Stepanov a7c79c773a [#168] node: Refactor node config 
Resolve containedctx linter for cfg

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-31 09:32:59 +03:00
Alejandro Lopez 341fe1688f [#139] test: Add test storage implementation
ci/woodpecker/push/pre-commit Pipeline was successful Details 
This aims to reduce the usage of chmod hackery to induce or simulate
OS-related failures.

Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-03-29 14:28:49 +00:00
Pavel Karpy ba58a77f8c [#184] node, ir: Do not wait for already made notary deposits 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-03-29 10:34:54 +00:00
Airat Arifullin 221203beeb [#180] node: Refactor panics in unit test
ci/woodpecker/push/pre-commit Pipeline was successful Details 
* Replace panics in unit tests by require.NoError and t.Fatalf

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-03-29 12:39:07 +03:00
Evgenii Stratonikov 382ecae96a [#172] Use ContainersOf() for container list fetching
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Previously we were limited by ~2048 containers because of
neo-go VM limits.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-03-27 14:32:55 +00:00
Dmitrii Stepanov 5bf1ec348f [#161] adm: Refactor storage-config command
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Resolve funlen linter for storageConfig function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov 93cb9e3a94 [#161] morph: Refactor invokeNotary method 
Resolve funlen linter

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov 512b72591a [#161] adm: Refactor subnet commands 
Resolve funlen linter for init method

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov e1b99dacad [#161] adm: Refactor netmap add/remove commands 
Resolve funlen linter for manageSubnetAdmins function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov 92f8810970 [#161] adm: Refactor commands initialization 
Resolve funlen linter for init function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov b0fefcb21f [#161] adm: Refactor deposit-notary command 
Resolve funlen linter for depositNotary function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov d62b11f5e7 [#161] adm: Refactor init context creation 
Resolve funlen linter for newInitializeContext function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov ecbc211016 [#161] adm: Refactor update-contracts command 
Resolve funlen linter for updateContracts method

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov 5f7d70c59c [#161] adm: Refactor deploy command 
Resolve funlen linter for deployContractCmd function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov 9534ade716 [#161] adm: Refactor restore-containers command 
Resolve funlen linter for restoreContainers function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 12:42:37 +00:00
Dmitrii Stepanov f2e880465e [#165] ir: Refactor config default init
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Resolve funlen linter for defaultConfiguration function

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 07:43:56 +00:00
Dmitrii Stepanov 04b3d9d068 [#165] cli: Drop redundant nolint comment 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 07:43:56 +00:00
Dmitrii Stepanov 1d5f2dd681 [#165] cli: Refactor collectObjectRelatives 
Resolve funlen linter

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 07:43:56 +00:00
Dmitrii Stepanov c2cf708e0e [#165] cli: Refactor put command 
Resolve funlen linter for putObject method

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 07:43:56 +00:00
Dmitrii Stepanov c78e9cc857 [#165] cli: Refactor get command 
Resolve funlen linter for getObject method

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-27 07:43:56 +00:00
Pavel Karpy 3c7ed21f74 [#141] Add big object's parts to a lock object's body
ci/woodpecker/push/pre-commit Pipeline was successful Details 
That will prevent part/link object from being removed by both an external
`DELETE` call and the object expiration procedure.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-03-27 07:28:32 +00:00
Denis Kirillov 342e571d89 [#159] Add handle __SYSTEM__ sys attributes
ci/woodpecker/pr/pre-commit Pipeline was successful Details
ci/woodpecker/push/pre-commit Pipeline was successful Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-22 17:35:20 +03:00
Evgenii Stratonikov 484ac502ca [#156] frostfs-adm: Make dumpBalances() pass linter checks 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-03-22 07:14:18 +00:00
Dmitrii Stepanov 5059dcc19d [#145] shard-gc: Delete expired objects after locks 
GC deletes expired locks and objects sequentially. Expired locks and
objects are now being deleted concurrently in batches. Added a config
parameter that controls the number of concurrent workers and batch size.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-21 11:31:08 +03:00
Dmitrii Stepanov 481a1ca6f3 [#148] linter: Add gocognit linter 
Code with high cognitive complexity is hard intuitively to understand

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-21 09:54:41 +03:00
Dmitrii Stepanov 97c36ed3ec [#148] linter: Add funlen linter 
Long functions are hard to understand and source of errors

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-21 09:54:41 +03:00
Dmitrii Stepanov cc8ff015b4 [#148] linter: Add containedctx linter 
Context has to be passed as an argument: https://pkg.go.dev/context

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-03-21 09:52:39 +03:00
Artem Tataurov db3ccd2762 [#128] innerring: Add GAS pouring mechanism for a configurable list of wallets 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-03-20 12:50:05 +00:00
Pavel Karpy 10c419adf0 [#67] node: Fix infinite recursion in SE's wrapper 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-03-17 18:47:59 +03:00
Pavel Karpy 64bde68fb9 [#67] node: Accept expired locked objects 
Allow replication of any (expired too) locked object. Information about
object locking is considered to be presented on the _container nodes_.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-03-16 16:22:19 +03:00
Anton Nikiforov b4582239bf [#130] adm: Fix adding of pub key for `group.frostfs` at init step 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-03-13 15:05:53 +03:00
Evgenii Stratonikov 861e9ab59a [#83] pre-commit: Add initial configuration 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-03-13 07:07:29 +00:00
Leonard Lyubich 24a540caa8 [#132] cli/util: Fix basic ACL rendering 
In previous implementation pretty-printer of basic ACL in NeoFS CLI had
mistakes:
 * F-bit was set to `Extendable()` property instead of its inversion
 * B-bits were set to `acl.RoleInnerRing` rights

Make `PrettyPrintTableBACL` to correctly render mentioned bits.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2023-03-10 14:55:45 +03:00
Anton Nikiforov 9929dcf50b [#126] adm: Exclude `group.frostfs` key from output of the `dump-hashes` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-03-09 18:29:36 +03:00
Anton Nikiforov 7486c02bbc [#88] adm: Fix method `nnsResolveKey` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-03-09 15:41:28 +03:00
Alexey Vanin 20de74a505 Rename package name 
Due to source code relocation from GitHub.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-07 16:38:26 +03:00
Anton Nikiforov 79ba34714a [#79] cli: Fix panic when setting domain for container 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-03-01 11:11:11 +03:00
Anton Nikiforov e9f3c24229 [#65] Use `strings.Cut` instead of `strings.Split*` where possible 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-28 13:39:14 +03:00
Anton Nikiforov 88e3868f47 [#37] cli: Add `nns-name` and `nns-zone` for `container create` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-28 13:37:23 +03:00
Alejandro Lopez 73bb590cb1 [#64] node: Use pool_size_local and separate pool for local puts 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-02-22 13:43:19 +03:00
Dmitrii Stepanov 7eaf159a8b [#63] adm: Fix contract wallet creation 
Create contract wallet only by init and update-config command.

Close #63

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-02-22 10:08:37 +03:00
Alejandro Lopez cb5468abb8 [#66] node: Replace interface{} with any 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-02-21 16:47:07 +03:00
Denis Kirillov 633c5a35de [#44] adm: Support multiple configs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-21 10:00:28 +03:00
Denis Kirillov 5f06232d34 [#44] cli: Support multiple configs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-21 10:00:28 +03:00
Denis Kirillov bed5a36235 [#44] ir: Support multiple configs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-21 10:00:28 +03:00
Denis Kirillov 87e69b9349 [#44] node: Support multiple configs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-21 10:00:28 +03:00
Anton Nikiforov 22f3c7d080 [#1868] Reload config for pprof and metrics on SIGHUP 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-20 13:53:27 +03:00
Evgenii Stratonikov 2b755ddb12 [#2260] node: Use a separate client cache for PUT service 
Currently, under a mixed load one failed PUT can lead to closing
connection for all concurrent GETs. For PUT it does no harm: we have
many other nodes to choose from. For GET we are limited by `REP N`
factor, so in case of failover we can close the connection with the only
node posessing an object, which leads to failing the whole operation.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-02-20 13:53:27 +03:00
Evgenii Stratonikov 351fdd9fa2 [#2246] node: Allow to configure tombsone lifetime 
Currently, DELETE service sets tombstone expiration epoch to
`current epoch + 5`. This works less than ideal in private networks
where an epoch can be e.g. 10 minutes. In this case, after a node is
unavailable for more than 1 hour, already deleted objects have a chance
to reappear.

After this commit tombstone lifetime can be configured.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-02-20 13:53:27 +03:00
Evgenii Stratonikov 2272c55c4d [#2238] engine: Add test for component initialization failures 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-02-20 13:53:27 +03:00
Evgenii Stratonikov 59748b7ae8 [#2238] neofs-node: Gracefully handle shard initialization errors 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-02-20 13:53:27 +03:00
Evgenii Stratonikov 236c4af615 [#2224] adm: Use native neo-go sessions in `dump-hashes` 
If we had lots of domains in one zone, `dump-hashes` for all others
can miss some domains, because we need to restrict ourselves with _some_
number.
In this commit we use neo-go sessions by default, with a proper
failback to in-script iterator unwrapping.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-02-20 13:53:27 +03:00
Anton Nikiforov c43b2dbac9 [#1465] Add log entry for morph components shutdown action 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-17 12:13:00 +03:00
Anton Nikiforov 85cf1f47ac [#1465] node: Prevent process from killing by systemd when shutting down 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-17 12:13:00 +03:00
Evgenii Stratonikov 3e5bc394b5 [#48] adm: Add initialize test for 1 node 
Single node is used in dev-env, worth testing.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-02-16 09:07:18 +03:00
Evgenii Stratonikov 1d3669232e [#48] adm: Allow using nonzero magic with local client 
neo-go actor API uses `getVersion` call which returned incorrect magic.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-02-16 09:07:18 +03:00
Stanislav Bogatyrev f825cfac78 [#1] Fix project name in comments here and there 
Signed-off-by: Stanislav Bogatyrev <s.bogatyrev@yadro.com>
 2023-02-06 17:41:14 +03:00
Stanislav Bogatyrev c6645ef775 [#1] Documentation rebranding 
Signed-off-by: Stanislav Bogatyrev <s.bogatyrev@yadro.com>
 2023-02-06 17:41:14 +03:00
Stanislav Bogatyrev 1858f11146 [#1] Fix viper env prefix in cli tools 
Changing env prefix and corresponding example config files.

Signed-off-by: Stanislav Bogatyrev <s.bogatyrev@yadro.com>
 2023-02-06 17:41:14 +03:00
Pavel Karpy 73bc1b0b68 [#38] node: Fix linter warnings 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-02-06 17:27:54 +03:00
Anton Nikiforov 515c60bdf4 [#1889] adm: Add command `morph netmap-candidates` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-06 17:26:34 +03:00
Anton Nikiforov ee24815748 [#1889] Move flag `--config` in `cmd/frostfs-adm/internal/commonflags/flags.go` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-06 17:26:34 +03:00
Anton Nikiforov 2b09564355 [#1889] Move netmap.go and exit.go from `cli` to `cmd/internal/common` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-06 17:26:34 +03:00
Anton Nikiforov 5a9d6a09d8 [#8] cli: Set flag `mode` required for `control shards set-mode` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-02-06 16:45:03 +03:00
Alexey Vanin 5d64a354cb [#1] Fix naming in FrostFS Adm help output 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-01-31 11:24:50 +03:00
Alexey Vanin d7e9e2ef9e [#1] Fix naming in FrostFS Lens help output 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-01-31 11:24:50 +03:00
Alexey Vanin d31d8c5335 [#1] Fix naming in FrostFS CLI help output 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-01-31 11:24:50 +03:00
Alexey Vanin 406ff1360f [#1] Fix version output for all compiled binaries 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-01-31 11:24:50 +03:00
Evgenii Stratonikov 072a7d61ab [#2176] neofs-node: Do not cache full container list 
We rarely need to list all containers: as one example
we need it for tree service synchronization once per epoch.
Given that cache TTL has the order of block time it makes no sense
to cache the list of all containers.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-25 15:31:47 +03:00
Evgenii Stratonikov 8078af3424 [#2176] neofs-node: Do not invalidate old cache items 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-25 15:31:47 +03:00
Evgenii Stratonikov e5a40b90b6 [#2176] neofs-node: `Peek` during cache invalidation 
`Get` needs write mutex and makes our item move to top.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-25 15:31:47 +03:00
Evgenii Stratonikov 93eb72ef44 [#2176] neofs-node: Remove unused field from `morphContainerWriter` 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-25 15:31:47 +03:00
Anton Nikiforov 8ee590794f [#1962] cli: `common.PrintVerbose` prints via `cobra.Command.Printf` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-25 15:31:47 +03:00
Anton Nikiforov cff4184cd3 [#2128] Add doc for extended headers 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-25 15:31:47 +03:00
Evgenii Stratonikov d4d2a8c865 [#11] Rename `NeoFS` to `FrostFS` in docs 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-12 08:55:47 +03:00
Evgenii Stratonikov 9cb4b4cc17 [#11] Rename `neofsid` contract to `frostfsid` 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-12 08:55:47 +03:00
Evgenii Stratonikov 023396e6a4 [#11] adm: Remove `NeoFS` mentions 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-12 08:55:47 +03:00
Evgenii Stratonikov 19d180b510 [#11] Rename `neofs` contract to `frostfs` 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-01-12 08:55:47 +03:00
Evgenii Stratonikov fdb0affc31 [#5] frost-node: Used generic cache 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-31 23:04:06 +03:00
Evgenii Stratonikov a2fe912d1a [#2164] neofs-node: Use a separate client cache for replicator 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 11:07:35 +03:00
Evgenii Stratonikov 741482c26f [#2164] neofs-node: Allow to set reconnect interval 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 11:07:35 +03:00
Evgenii Stratonikov d3054e577a [#2165] services/tree: Allow to set custom synchronization interval 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 11:07:35 +03:00
Anton Nikiforov b7a99c757a [#2097] cli: Clarify help for `--expire-at` parameter for commands `object lock/put` and `bearer create` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-12-30 11:07:35 +03:00
Evgenii Stratonikov e406036629 [#2166] go.mod: Update dependencies 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 11:07:35 +03:00
Anton Nikiforov 33d279a3f2 [#2152] cli: Do not search for LOCK objects when delete container when session provided 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-12-30 11:07:35 +03:00
Pavel Karpy 306609030a [#2159] node: Add tree replication timeout configuration 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-30 11:07:35 +03:00
Pavel Karpy a30310b2ca [#2145] cli: Do not print "rpc error:" twice 
That error part is already included in GRPC's library.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-30 11:07:35 +03:00
Leonard Lyubich a68ff67ed8 [#2106] cli: Verify container owner in `container delete` command 
In NeoFS containers can be removed on behalf of its owner only. To
improve user experience, there is a need to add ownership check to the
removal command of the NeoFS CLI.

Check container ownership in `container delete` command `Run` function.
The check can be skipped by `--force` option.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-12-30 11:07:35 +03:00
Pavel Karpy d6196c3971 [#2095] cli: Do not panic on `object range` 
Also, includes range parsing error messages enhancement.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-12-30 11:07:35 +03:00
Pavel Karpy 923f84722a Move to frostfs-node 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-28 15:04:29 +03:00
Alexey Vanin b0eeb0dfcf [#1486] node: Use endless notary deposit for side chain 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2022-12-02 11:43:33 +03:00
Anton Nikiforov afabd6be91 [#2038] neofs-cli: Check the sufficiency of the number of nodes in the selector for replicas 
Perform this check on container creation.

Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-12-01 11:32:27 +03:00
Pavel Karpy 50d28b72c3 [#2075] node, ir: Log notary state with `info` 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-30 19:26:33 +03:00
Pavel Karpy 0f41c09207 [#2075] node: Do not make notary requests on shutdown 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-30 19:26:33 +03:00
Pavel Karpy c01d4ecb50 [#2080] morph: Close morph clients 
Could be related to "websocket users limit reached" on the `neo-go` server
side when an SN/IR is rebooting repeatedly.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-30 19:26:33 +03:00
Pavel Karpy 761e82fecd [#2079] cli: Do not panic in `object hash` 
Sign RPC requests with the provided key.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-30 16:58:52 +03:00
Alexey Vanin 8d15c14be6 [#2078] adm: Pack parameters for `setPrice` invocation 
Contract arguments have to be packed.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2022-11-30 16:58:52 +03:00
Anton Nikiforov 8a77b4638a [#2012] Add commands `neofs-cli acl basic/extended print` to show ACL table in human readable format 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-11-30 16:45:37 +03:00
Evgenii Stratonikov 59db66cdb6 [#2091] neofs-adm: Sign blocks properly in tests 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-30 16:45:13 +03:00
Evgenii Stratonikov 6882887bdd [#2091] neofs-adm: Do not query hashes via network 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-30 16:45:13 +03:00
Evgenii Stratonikov cfefebd5b3 [#2091] neofs-adm: Do not use deprecated methods 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-30 16:45:13 +03:00
Anton Nikiforov 51e886dd67 [#2090] neofs-cli: Remove `--header` from `object get` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-11-30 11:46:02 +03:00
Anton Nikiforov 79130f781e [#2089] neofs-cli: Remove `-g` option from `neofs-cli control ...` and `neofs-cli container create` commands 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-11-30 09:14:50 +03:00
Pavel Karpy ca3596dd05 [#2104] cli: OID signature in output 
OID signature should always be present in an object; it does not relate
to the object split.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-29 08:52:09 +03:00
Vladimir Domnich 71853348b9 [#2063] morph/client: Support new hash format in morph nns client 
Signed-off-by: Vladimir Domnich <v.domnich@yadro.com>
 2022-11-19 11:01:04 +03:00
Anton Nikiforov 9a20498f34 [#1940] Removing all trees by container ID if tree ID is empty in `pilorama.Forest.TreeDrop` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-11-19 11:01:04 +03:00
Evgenii Stratonikov 426fe97990 [#2026] neofs-adm: Make contract update idempotent 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-19 11:01:04 +03:00
Evgenii Stratonikov 7ef0303e13 [#2003] neofs-node: Allow to configure replicator pool size 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-19 11:01:04 +03:00
Evgenii Stratonikov 597ed18269 [#2048] neofs-node: Use a separate client cache for client operations 
Background workers can prevent user operations to complete because of
locking in cache.

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-19 11:01:04 +03:00
Pavel Karpy c85bea15ef [#1978] cli: Add children to the static session on `DELETE` 
If an external session is provided and is not opened by CLI itself, add
children objects to it too. It fixes "not found" errors when removing a big
object with a predefined session (from a file).

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-19 11:01:04 +03:00
Pavel Karpy f48b1de54b [#2029] cli: Fix panic caused by flag redefinition 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-19 11:01:04 +03:00
Pavel Karpy 09a59fef56 [#2029] cli: Allow attaching static session to `object hash` 
All the other object commands already have it.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-19 11:01:04 +03:00
Pavel Karpy 37f813604f [#2000] cli: Provide a bearer token to spawned `HEAD` by `DELETE` 
If a `neofs-cli object delete` operation is performing using a bearer token,
add it to the new `HEAD` requests that collects children OIDs.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-19 11:01:04 +03:00
Pavel Karpy aab398f4f5 [#1972] node: Do not save objects if node not in a container 
Do not use node's local storage if it is clear that an object will be
removed anyway as a redundant. It requires moving the changing local storage
logic from the validation step to the local target implementation.
It allows performing any relations checks (e.g. object locking) only if a
node is considered as a valid container member and is expected to store
(stored previously) all the helper objects (e.g. `LOCK`, `TOMBSTONE`, etc).

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-19 11:01:04 +03:00
Pavel Karpy a77392e9ce [#1972] cli: Fix lifetime flag in the `lock` command 
That part of the code was refactored incorrectly.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-19 11:01:04 +03:00
Anton Nikiforov bb52857b2b [#1338] neofs-cli: Add support to store/restore/delete binary objects 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-11-01 15:30:00 +03:00
Pavel Karpy 1f82c583e3 [#1971] cli: Unify CID and OID flags provision 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-01 15:07:19 +03:00
Pavel Karpy 7daa57d4d2 [#1991] cli: Refine container placement description 
Not to confuse a user by mixing a replication vector number with its copy
number.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-11-01 15:00:00 +03:00
Anton Nikiforov 51e3810285 [#1689] Add new command `morph list-containers` in `neofs-adm` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-11-01 09:43:02 +03:00
Evgenii Stratonikov 98a152256b [#1992] writecache: Allow to open in NOSYNC mode 
Applicable only to FSTree as we cannot handle corrupted databases
properly yet.

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-01 09:42:26 +03:00
Evgenii Stratonikov b6930f2219 [#1992] neofs-node: Allow to open fstree in NOSYNC mode 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-11-01 09:42:26 +03:00
Leonard Lyubich 98034005f1 [#1900] node: Fix loosing the "maintenance" status 
In previous implementation node lost maintenance status after successful
switching to it. For example, after some period of time node sent
bootstrap requests with the "online" state instead of "maintenance".

Make `startMaintenance` method to set maintenance status in the
`networkState`.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-28 18:30:59 +03:00
Leonard Lyubich db92e96e40 [#1900] node: Refactor bootstrap methods 
In previous implementation bootstrapping state was chosen according to
bool flag which was not convenient.

Create separate method to boostrap with "online" and the current state.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-28 18:30:59 +03:00
Leonard Lyubich 98ac525272 [#1978] cli/object: Gather all related object in delete session 
Object removal session should reflect all objects related to the
removing one.

Make `OpenSessionViaClient` to gather the split members of the original
object in order to spread the session to them.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-28 13:49:41 +03:00
Evgenii Stratonikov 280e56f4bb [#1893] neofs-node: Do not fail unless all gRPC endpoints are unavailable 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-26 12:48:38 +03:00
Leonard Lyubich 3c6daa2995 [#1883] cli/shards: Exclude `degraded-read-write` mode from help 
The mode is not expected to be used by the user. It is supported only
for developers.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-26 08:24:40 +03:00
Leonard Lyubich c4a2a283ae [#1883] cli/shards: Make supporting new modes easier 
Add new shard modes as a map entry to automatically parse them in
`set-mode` command. The change also automatically adds new modes to help
message.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-26 08:24:40 +03:00
Leonard Lyubich 7f54462e60 [#1920] cli: Print used RPC timeout in verbose exec 
Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-26 08:20:36 +03:00
Pavel Karpy 9a0824766c [#1713] node: Add Neo RPC switch interval to the config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-25 17:38:48 +03:00
Pavel Karpy 0631b38da1 [#1713] ir: Add Neo RPC switch interval to the config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-25 17:38:48 +03:00
Pavel Karpy d09ec2e3fe [#1615] node/config: Remove unused default constants 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-25 17:38:48 +03:00
Evgenii Stratonikov 4fe1aad30f [#1966] neofs-adm: Fix signature creation for multiactor scenario 
`SignTx` from neo-go appended verification script only if `Scripts`
array was not completely filled.

```
can't persist transactions: transaction b9cd02fb81721c7316c908687301eeaf8ef384e381476632c24a77bdf9ffacd5 failed to verify: witness #1: unknown verification contract
```

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-25 11:22:00 +03:00
Evgenii Stratonikov 2dcf8d51be [#1966] neofs-adm: Set `VerifyBlocks: true` and fix NetworkFee calculation 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-25 11:22:00 +03:00
Evgenii Stratonikov 6c9423cfb0 [#1959] neofs-adm: Add tests for more commands 
Also, fix `restore-containers`, but it is hard to test it now.

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 7c3ac7150d [#1959] neofs-adm: Remove `newTempDir` function 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 2404a267b9 [#1959] neofs-adm: Move testdata generation to a separate function 
Later we could make it a separate tests an run neofs-adm tests on CI.

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 6c21e2cc28 [#1959] neofs-adm: Fix `set-config` for >4 nodes 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov c87c3d3721 [#1959] neofs-adm: Refactor tests 
Make it easier to test both common deployment scenarios.

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 02bea52f40 [#1959] neofs-adm: Allow to test all commands with a local dump 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 8648b102db [#1959] neofs-adm: Dump all blocks in file 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 23622ed283 [#1959] neofs-adm: Check transaction validity in tests 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 942155be6e [#1959] neofs-adm: Fix double multisig 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Evgenii Stratonikov 2484c1d35e [#1959] neofs-adm: Verify blocks and transactions in tests 
Also update to the actual contracts version.

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 21:43:23 +03:00
Leonard Lyubich a4573d5026 [#1933] cli: Document sessions 
Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-24 17:45:22 +03:00
Leonard Lyubich 7b418c36b4 [#1930] services/session: Log calling `Create` RPC 
There is a need to check if session is opened during system
testing/debug.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-24 17:45:22 +03:00
Leonard Lyubich 8bba490c30 [#1933] cli: Support binary sessions 
There is a need to support NeoFS-binary sessions along with JSON ones in
NeoFS CLI.

Provide generic `common.ReadBinaryOrJSON` functions which tries to
decode NeoFS-binary structure and falls back to JSON format. Use this
function in all places with token reading.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-24 17:45:22 +03:00
Evgenii Stratonikov 04b67f3ba5 [#1949] neofs-adm: Fix epoch tick for >4 node committee 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-24 13:36:08 +03:00
Leonard Lyubich 60e9de8d63 [#1916] control: Check maintenance allowance on Control server 
In previous implementation turning to maintenance mode using NeoFS CLI
required NeoFS API endpoint. This was not convenient from the user
perspective. It's worth to move networks settings' check to the server
side.

Add `force_maintenance` field to `SetNetmapStatusRequest.Body` message
of Control API. Add `force` flag to `neofs-cli control set-status`
command which sets corresponding field in the requests body if status is
`maintenance`. Force flag is ignored for any other status.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-24 09:20:24 +04:00
Leonard Lyubich c50603494b [#1916] cli/control: Pre-check maintenance mode in `set-status` 
Node's maintenance state can be set only if the network allows it.

Make `neofs-cli control set-status` to read current network settings and
check is maintenance state is allowed. Fail the execution if the mode is
not allowed.

Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-24 09:20:24 +04:00
Pavel Karpy e1be0180f6 [#1329] tree: Sync trees when a node first time appears in a container 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-21 18:47:56 +03:00
Leonard Lyubich 217b030d20 [#1946] cli/internal: Fix test by wallet non-closing 
Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-21 15:21:59 +03:00
Leonard Lyubich 810087d8b9 [#1946] Bump neo-go module to v0.99.4 
Signed-off-by: Leonard Lyubich <ctulhurider@gmail.com>
 2022-10-21 15:21:59 +03:00
Evgenii Stratonikov de055f27c7 [#1942] neofs-adm: Fix multisig checks in tests 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-21 10:16:51 +03:00
Pavel Karpy aa37078570 [#1902] node: Sync all the trees on bootstrap 
Do not limit synchronization by "system" and "version" tree IDs.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-20 16:17:57 +03:00
Pavel Karpy 1766ca2039 [#1902] tree: Allow synchronize all the container trees 
Add `SynchronizeAllTrees` method of the Tree service. It allows fetching
tree IDs and sync all of them. Share common logic b/w the new method and
the `SynchronizeTree`.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-20 16:17:57 +03:00
Pavel Karpy 1805c6606d [#1332] cli: Add `tree list` 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-20 16:17:57 +03:00
Pavel Karpy 3aa9938b8f [#1902] Update protoc to `v3.21.7` 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-20 16:17:57 +03:00
Evgenii Stratonikov 0d14ef69f0 [#1922] neofs-node: Allow to go online after maintenance 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-19 10:14:56 +03:00
Evgenii Stratonikov 1980ed968a [#1926] neofs-node: Use `writecache.max_object_size` from the config 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-18 16:44:28 +03:00
Evgenii Stratonikov 1cb892c579 [#1910] .golangci.yml: Add `misspell` linker 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-18 15:08:26 +03:00
Evgenii Stratonikov d772e35aba [#1910] .golangci.yml: Add `godot` linker 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-18 15:08:26 +03:00
Evgenii Stratonikov 0a1530afa0 [#1917] neofs-cli: Support timeout in `control` commands 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-18 10:58:10 +03:00