elebedeva/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Pull requests Activity
2712 commits 21 branches 26 tags 24 MiB
Commit graph

943 commits

Author SHA1 Message Date
Evgenii Stratonikov
a4769d8624 *: use require.ErrorIs where possible 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-29 16:47:57 +03:00
Pavel Karpy
a275a71a87 [#1318] node: Use new tombstone handling 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-29 16:38:52 +03:00
Evgenii Stratonikov
b74fb2b932 [#1316] neofs-cli: Print object ID in base-58 
It was missed from dd9bd05ba.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-25 10:54:18 +03:00
Evgenii Stratonikov
a254fd6bc8 [#1216] neofs-cli: Allow to use session token from file 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-25 10:47:43 +03:00
Evgenii Stratonikov
a95bdb1811 [#1216] neofs-cli: Allow to create and save session token 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-25 10:47:43 +03:00
Evgenii Stratonikov
8d79168129 [#1216] neofs-cli: Reuse key retrieving code between modules 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-25 10:47:43 +03:00
Evgenii Stratonikov
006d6e8b48 [#1216] neofs-cli: Reuse GetSDKClient between CLI modules 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-25 10:47:43 +03:00
Evgenii Stratonikov
fd8c00400d [#1216] neofs-cli: Rename token subcommand to bearer 
It works only with the bearer token.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-25 10:47:43 +03:00
Pavel Karpy
bd27837364 [#1321] node: Register GC event channel before shard init 
Morph "NewEpoch" event handling was registered in a closure over
`addNewEpochNotificationHandler` func. That may lead to the data race:
if a shard was initialized before the event registration, everything works
as planned, but if registration was made earlier, it was not able to
include GC handlers since a shard has not called `eventChanInit` yet and,
therefore, it has not registered handler yet.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-25 10:39:37 +03:00
Leonard Lyubich
d4569946c5 [#1313] container: Do not invalidate cache on Container.Delete 
In previous implementation `Container.Delete` operation caused local
node's cache invalidation (container itself, eACL and listings). Any
subsequent `Container.Get` operation reversed invalidation. Given the
low latency sensitivity of deleting a container, there is no need to
touch the cache. With this approach, all pending deletion operations on
the node via the NeoFS API protocol will be delayed by the cache TTL.

Do not call cache invalidation ops in `morphContainerWriter.Delete`.
Remove no longer needed `InvalidateContainerListByCID` and
`InvalidateContainer` methods.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-04-25 10:34:12 +03:00
Evgenii Stratonikov
606dfa3414 [#1308] neofs-adm: Add command to dump GAS balances 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-12 17:37:40 +03:00
Evgenii Stratonikov
f1e91313db [#1311] neofs-adm: Set stdout as default output 
Cobra `Command` prints to stderr by default.
`neofs-cli` already sets the output properly.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-12 17:37:26 +03:00
Alex Vanin
8054311eee [#1170] neofs-adm: Update storage config template 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-12 17:36:37 +03:00
Pavel Karpy
01e69f2f7a [#1170] pkg/morph: Add worker pool 
Add worker pool to the listener to prevent blocking. It is used only for
notary notifications and new block events handling since it uses RPC
calls. That may lead to the deadlock state: neo-go cannot send RPC until
notification channel is read but notification channel cannot be read since
neo-go client cannot send RPC.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
6508136204 [#1170] ir, node: Stop the app on WS connection lost 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
424cc6d495 [#1170] go.mod: Update neo-go 
github.com/nspcc-dev/neo-go v0.98.0 => v0.98.2

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
fdf1338d65 [#1170] config: Delete notification endpoints 
Also, change `http` to `ws` in examples.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
3e45b4a085 [#1170] pkg/morph/subscriber: Adopt new WS client 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
402f488bec [#1170] pkg/morph: Change HTTP for WS client 
Updated client now supports subscription to chain notifications and RPC
switch between provided RPC endpoints.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
71c75dc7e8 [#1170] cmd/node: Remove useless function variable 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Evgenii Stratonikov
622ea4818f [#1250] *: Remove io/ioutil imports 
It is deprecated starting from go1.16.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-07 17:23:28 +03:00
Evgenii Stratonikov
bc0c47738b [#1295] neofs-adm: Add contract group wallet to config template 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-07 11:46:20 +03:00
Evgenii Stratonikov
82fda42316 [#1294] neofs-adm: Use Global scope where needed 
Provide explicit argument to `sendCommitteeTx` signifying whether a tx
should try to use group signer.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-05 18:23:14 +03:00
Evgenii Stratonikov
7d670129c9 [#1294] neofs-adm: Emit ASSERT after the transfers 
NEP-17 transfer method returns boolean value signifying if the operation
was successful. Fail the transaction if it was not.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-05 18:23:14 +03:00
Evgenii Stratonikov
55362f0607 [#1294] neofs-adm: Check persisted tx status 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-05 18:23:14 +03:00
Evgenii Stratonikov
d311585de6 [#1289] neofs-adm: Allow to change parameters of the Policy contract 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-05 13:28:42 +03:00
Evgenii Stratonikov
a5cf38dcbf [#1288] neofs-adm: Allow to store garbage in alphabet wallet dir 
Check the full file name instead of just prefix. Also, fix a bug where
a single missing wallet could lead to an incorrect size calculation.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-04-05 13:11:50 +03:00
Evgenii Stratonikov
6472a170eb [#1143] shard: Introduce explicit Degraded mode 
`Degraded` mode is set automatically after error counter is over the
threshold. `ReadOnly` mode can still be set by an administrator.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-31 15:33:22 +03:00
Alex Vanin
e4a8ed589b [#1278] neofs-node: Cache IRFetcher 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-30 14:22:12 +03:00
Alex Vanin
be6ae3c066 [#1278] neofs-node: Use global cached netmap source in services 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-30 14:22:12 +03:00
Alex Vanin
7ed84d1755 [#1278] acl: Return netmap.Source interface 
Application can provide cached netmap source in this case.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-30 14:22:12 +03:00
Evgenii Stratonikov
dd9bd05bac [#1239] neofs-cli: Use pointer-less slices for object ID 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-29 16:02:05 +03:00
Pavel Karpy
90a8c52bdb [#1255] object: Add persistent storage usage 
Use persistent storage usage in the node if it was configured so.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-29 09:35:10 +03:00
Pavel Karpy
9cda3121ab [#1255] node/config: Add persistent storage 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-29 09:35:10 +03:00
Pavel Karpy
929c9851a6 [#1255] node/session: Create separate dir for in-memory storage 
Move in-memory session storage to the separate directory of `storage`. It is
done for future support of different kind of session storages.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-29 09:35:10 +03:00
Evgenii Stratonikov
571ae843ad [#1198] neofs-cli: Use io.Copy instead of io.CopyBuffer 
The buffer size value is somewhat arbitrary and making in configurable
doesn't make much sense, given that we can't really restrict total resource
consumption in other places. `Copy` uses 32 KiB buffer by default, which
is not big. This approach is also more flexible as we can get rid of
buffer completely by implementing `ReaderFrom`, `WriterTo` interfaces.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-25 18:21:48 +03:00
Evgenii Stratonikov
cbe07120da [#1261] neofs-cli: Allow to use relative epoch for bearer token 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-25 17:58:53 +03:00
Evgenii Stratonikov
f2c1bc4bfb [#1261] neofs-cli: Allow to create eACL with empty container ID 
Empty CID can be used in bearer token eACL.
See https://github.com/nspcc-dev/neofs-api/issues/207 .

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-25 17:58:53 +03:00
Evgenii Stratonikov
9b2523a408 [#1261] neofs-cli: Allow to create bearer tokens 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-25 17:58:53 +03:00
Evgenii Stratonikov
ae8e38cace [#1261] neofs-cli: Fix help message for acl extended create 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-25 17:58:53 +03:00
Alex Vanin
683439970a [#1270] neofs-node: Add timeout for grpc GracefulStop() 
GracefulStop() may be blocked until all server-side streams
are finished. There is no control over such streams yet, so
application may be frozen in shutdown stage.

Naive solution is to add timeout for GracefulStop(). At this
point healthy connection will be finished and unhealthy
connections will be terminated by Stop().

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-25 17:39:24 +03:00
Evgenii Stratonikov
414ba6e0a2 [#1244] nats: Split client creation into 2 stages 
Create and connect to an endpoint using separate functions.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-24 11:51:49 +03:00
Evgenii Stratonikov
2b0460c532 [#1233] neofs-cli: Fix split info marshaling 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-23 14:52:49 +03:00
Alex Vanin
c8b585b991 [#1259] neofs-cli: Use more cmd.PrintErr*() 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-21 19:20:19 +03:00
Alex Vanin
44138adacf [#1259] neofs-cli: Return non-zero exit code in acl extended create command failures 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-21 19:20:19 +03:00
Evgenii Stratonikov
32badab11a [#1252] neofs-cli: Print details for AccessDenied errors 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-21 19:20:01 +03:00
Evgenii Stratonikov
800d01e28c [#1233] neofs-cli: Do not print info if output format is strict 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-21 14:52:05 +03:00
Evgenii Stratonikov
5eef0f46c5 [#1233] neofs-cli: Respect format flags for SplitInfo output 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-21 14:52:05 +03:00
Pavel Karpy
52e742bac1 [#1243] node: Add "hot" notifications 
Wrap engine with notifications writer (if configured so) to allow sending
notifications right after the object is saved in the local storage.
"Hot" notifications are sent for objects with the following tick epoch
values:
1. 0;
2. *current epoch*.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-17 14:27:52 +03:00
Pavel Karpy
5dba64fcc5 [#1243] node/cfg: Add notification config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-17 14:27:52 +03:00
Pavel Karpy
a4a29f3442 [#1243] node: Rename notifications init func 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-17 14:27:52 +03:00
Pavel Karpy
7ebeb4c89b [#1243] node/object: Fix comment 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-17 14:27:52 +03:00
Pavel Karpy
9ce0bbe90f [#1245] cli: Fix linter 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-17 12:09:00 +03:00
Pavel Karpy
5506b7af29 [#1245] cli: Add object notification to CLI 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-17 12:09:00 +03:00
Evgenii Stratonikov
ad4583fe85 [#1185] neofs-cli: Add progress bar to object put/get 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-16 17:28:35 +03:00
Pavel Karpy
c3db12d71b [#1210] reputation: Resolve race condition 
Make all epoch independent in reputation process. Do not reset any timers
related to reputation. Make it possible to finish iteration after the
unexpected `NewEpoch` event.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-16 17:18:30 +03:00
Pavel Karpy
77d847dbea [#1210] timers: Add IterationsTicker 
It allows specifying duration in blocks and a desired number of handler
calls in that period.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-16 17:18:30 +03:00
Pavel Karpy
13af4e6046 [#1210] reputation: Improve debug logs 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-16 17:18:30 +03:00
Alex Vanin
362cda53d2 [#1238] Call String() explicitly instead of using stringer pointer 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-16 15:29:31 +03:00
Alex Vanin
8f476f3c4d [#1238] Adopt neofs-node for non pointer slices in SDK 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-16 15:29:31 +03:00
Alex Vanin
7f3195b197 [#1238] Adopt neofs-cli for non pointer slices in SDK 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-16 15:29:31 +03:00
Evgenii Stratonikov
f0ec35478a [#1236] neofs-node: Neofs-node: Remove mutex from ttlNetCache 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-15 17:26:26 +03:00
Evgenii Stratonikov
22b1208a20 [#1236] neofs-node: Remove mutex from lruNetCache 
We already use thread-safe LRU and mutex shouldn't be taken while making
network requests.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-15 17:26:26 +03:00
Leonard Lyubich
323dea95c6 [#1181] Do not use deprecated elements 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-15 13:03:23 +03:00
Leonard Lyubich
d92b1d1bf8 [#1175] CLI: Implement command to lock the objects 
Implement `lock` command and add it to `object` section. The command
accepts container argument (string `cid.ID`) and list of locked objects
(string `oid.ID` list). From the provided input `LOCK` object is
constructed and stored using NeoFS API protocol.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-15 13:03:23 +03:00
Leonard Lyubich
ced854bc2e [#1175] object/fmt: Handle LOCK objects 
Make `FormatValidator.ValidateContent` to verify payload of `LOCK`
objects. Pass locked objects to `Locker` interface. Require from
`Locker.Lock` to return `apistatus.IrregularObjectLock` error on a
corresponding condition.

Also add error return to `DeleteHandler.DeleteObjects` method. Require
from method to return `apistatus.ObjectLocked` error on a corresponding
condition. Adopt implementations.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-15 13:03:23 +03:00
Leonard Lyubich
637077a883 [#1181] CLI: Simplify object type output 
There is no need to switch between object types since `Type` implements
`fmt.Stringer`.

Replace swich-case in `printHeader` with `%s` format notation function.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-15 13:03:23 +03:00
Alex Vanin
b6720d5f97 [#1231] Update new SDK Client interface 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-14 13:18:48 +03:00
Pavel Karpy
697c12a5e9 [#1223] amd: Fix subnet node command 
Added `-w` flag.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-10 19:23:39 +03:00
Pavel Karpy
5e90d85020 [#1183] node: Use NATS client as notification writer 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 15:57:24 +03:00
Pavel Karpy
1e96f62294 [#1183] node/config: Add NATS configuration 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 15:57:24 +03:00
Pavel Karpy
03b601b594 [#1183] node: Init notificator on startup 
It uses logger as a notification writer. NATS messaging will be implemented
later.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 11:41:18 +03:00
Pavel Karpy
46cf15f03c [#1183] node/config: Add notification configuration 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 11:41:18 +03:00
Pavel Karpy
99b31e3235 [#1111] object/acl: Refactor service 
Make all operations that related to `neofs-api-go` library be placed in `v2`
packages. They parse all v2-versioned structs info `neofs-sdk-go`
abstractions and pass them to the corresponding `acl`/`eacl` packages. `v2`
packages are the only packages that do import `neofs-api-go` library. `eacl`
and `acl` provide public functions that only accepts `sdk` structures.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 10:06:14 +03:00
Leonard Lyubich
7ccd1625af [#1214] *: Use single Object type in whole project 
Remove `Object` and `RawObject` types from `pkg/core/object` package.
Use `Object` type from NeoFS SDK Go library everywhere. Avoid using the
deprecated elements.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 17:45:00 +03:00
Evgenii Stratonikov
e292321ccf [#1114] neofs-node: Make some parameters optional in relay mode 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-04 14:30:55 +03:00
Alex Vanin
99749ea042 [#1211] neofs-cli: Specify address in session token 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-04 11:47:24 +03:00
Alex Vanin
1b5cb2dfe2 [#1211] neofs-cli: Specify verb in object session token 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-04 11:47:24 +03:00
Alex Vanin
6d3e626f20 [#1211] neofs-cli: Fix objectIDs list reader 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-04 11:47:24 +03:00
Alex Vanin
4935016bf8 [#1211] neofs-cli: Set bearer and session token in all object service requests 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-04 11:47:24 +03:00
Leonard Lyubich
b5bdcfc076 [#1194] client: Support request X-headers 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 15:38:38 +03:00
Leonard Lyubich
dd6d7d2d10 [#1209] Upgrade NeoFS SDK Go 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 15:38:38 +03:00
Alex Vanin
09db5e387d [#1200] cli: Mention filter key prefixes in eACL creation command 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-01 10:36:41 +03:00
Leonard Lyubich
e0dce1043a [#1195] Adopt recent changes in NeoFS SDK 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-02-28 10:43:03 +03:00
Evgenii Stratonikov
a8d10704d5 [#1182] neofs-cli: use BasicACL.String() for user output 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-22 11:26:34 +03:00
Evgenii Stratonikov
e288a0188d [#749] neofs-adm: refactor password reading into a separate function 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-11 13:26:27 +03:00
Evgenii Stratonikov
e21d054fe2 [#749] morph/client: set group signer scope 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-11 13:26:27 +03:00
Evgenii Stratonikov
9e2f7ac371 [#749] morph/client: allow to fetch contract group key 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-11 13:26:27 +03:00
Evgenii Stratonikov
050a4bb2b0 [#1115] *: link TODOs to corresponding issues 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-11 12:58:59 +03:00
Evgenii Stratonikov
18f6fba6ea [#1115] neofs-ir: determine config type based on extension 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-11 12:58:59 +03:00
Evgenii Stratonikov
7ca06aeae2 [#1115] neofs-adm: generate wallets with 0644 permission 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-11 12:58:59 +03:00
Evgenii Stratonikov
a91b59fff9 [#1115] neofs-adm: use request timeout in N3 client 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-11 12:58:59 +03:00
Evgenii Stratonikov
0695ec4125 [#1133] services/session: remove expired tokens every epoch 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-08 14:58:32 +03:00
Evgenii Stratonikov
b3b3b8b20f [#1090] neofs-adm: Add history of commands to a storage configurator 
It also persists between sessions.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-08 14:53:20 +03:00
Evgenii Stratonikov
8263582dde [#1090] neofs-adm: add interactive configurator for storage node 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-08 14:53:20 +03:00
Pavel Karpy
1667ec9e6d [#1131] *: Adopt SDK changes 
`object.Address` has been moved to `object/address`
`object.ID` has been moved to `object/id`

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-02-08 09:45:38 +03:00
Evgenii Stratonikov
c34cfa1f35 [#625] client/container: remove intermediate wrapper 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-08 09:43:54 +03:00
Evgenii Stratonikov
767ee5c0cd [#625] client/reputation: remove intermediate wrapper 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-08 09:43:54 +03:00
Evgenii Stratonikov
97d18bc515 [#625] client/netmap: remove intermediate wrapper 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-08 09:43:54 +03:00
Evgenii Stratonikov
6f50fefbea [#625] client/balance: remove intermediate wrapper 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-08 09:43:54 +03:00
Pavel Karpy
c7a8c762e0 [#1136] cli: Allow usage of empty wallet passwords 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-02-07 14:42:46 +03:00
Alex Vanin
b86b06c0ca [#1101] neofs-cli: Set expiration in session token based on network info 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-02-07 13:29:25 +03:00
Evgenii Stratonikov
1deea4e8c6 [#749] neofs-adm: Set signer for committee transactions 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-04 11:49:55 +03:00
Evgenii Stratonikov
8fa2b364a1 [#749] neofs-adm: add group scope to force-new-epoch command 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-04 11:49:55 +03:00
Evgenii Stratonikov
e4bc9c7fad [#749] neofs-adm: save group public key in NNS 
Query `group.neofs` instead of retrieving individual manifest.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-04 11:49:55 +03:00
Evgenii Stratonikov
def1bbc84c [#749] neofs-adm: create wallet for signing contract group 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-04 11:49:55 +03:00
Evgenii Stratonikov
b416285eb0 [#749] neofs-adm: include neofs contracts in a group 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-04 11:49:55 +03:00
Evgenii Stratonikov
e03cb91b64 [#1118] neofs-node: add shard_ro_error_threshold config setting 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-03 15:14:27 +03:00
Evgenii Stratonikov
ed50cf6207 [#1118] services/control: return error counter in ListShards 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-03 15:14:27 +03:00
Evgenii Stratonikov
7fb15fa1d0 [#1118] services/control: allow to reset error counter in SetShardMode 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-03 15:14:27 +03:00
Leonard Lyubich
4f3323f084 [#1101] *: Adopt interface changes of API client from SDK library 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-02-03 14:00:14 +03:00
Evgenii Stratonikov
674f520da7 [#1132] *: Use path/filepath package when working with files 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-03 10:12:07 +03:00
Evgenii Stratonikov
476528361e [#1023] *: fix linter errors 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
9d3609d4c1 [#1023] neofs-node/reputation: remove epoch from common parameters 
It is unused and is present in both of `Announce*TrustPrm`.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
3407fef799 [#1086] neofs-cli: add command for shard restore 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:14 +03:00
Evgenii Stratonikov
2ec4a3c897 [#1086] neofs-cli: add command for shard dump 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:14 +03:00
Pavel Karpy
679c922e0c [#1120] cli: Fix printing config file in verbose mode 
It was broken since `initConfig` was made before every execution of the
command and flags have not been read by cobra yet, so it was impossible to
print config file path if `verbose` flag was set in command line not in
config file.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-01-31 11:24:16 +03:00
Alex Vanin
08e83a2bc7 [#1092] neofs-cli: Add 'acl extended create' command 
Follows neofs-cli refactor scheme from #1074

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-01-28 10:39:18 +03:00
Evgenii Stratonikov
e976a55358 config: replace use_write_cache with writecache.enabled 
This is the way things are done with `grpc.tls` and in neo-go.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-27 16:44:56 +03:00
Pavel Karpy
6f338c660c [#1038] adm: Do not cut data args in NNS 
This reverts commit 185a2827cc.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-01-27 12:08:36 +03:00
Leonard Lyubich
257069a132 [#1084] cli/accounting: Convert balance response to Fixed8 
After recent changes balance response contains contract precision.

Convert balance response to Fixed8. Use `fixedn.ToString` function to
print the converted value.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-01-26 14:10:02 +03:00
Evgenii Stratonikov
dbb04d78b9 [#1103] neofs-cli: mention IR in healthcheck help message 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 14:09:42 +03:00
Evgenii Stratonikov
5c2b2e137d [#1103] neofs-cli: disallow generating key for control commands 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 14:09:42 +03:00
Evgenii Stratonikov
007158ebe1 [#1103] neofs-cli: allow to set password in config 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 14:09:42 +03:00
Pavel Karpy
fee2f5a330 [#1100] *: Adopt new SDK's owner.ID API 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-01-21 17:58:30 +03:00
Pavel Karpy
ed156cd738 [#1096] eacl: Use validator from SDK 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-01-21 10:47:33 +03:00
Evgenii Stratonikov
759421ebbf [#1083] neofs-cli: use single flag for key and wallet 
Currently have static priority of what key is used irregardless of
whether a flag was provided via CLI or in config. This makes it
impossible to override some of the config settings. While we could try
to check if the key is provided by CLI by binding CLI flag under to
viper under a different name the same problem would occur for config/environment
variables. Fixing all of this with current set of keys is too complicate.
In this commit we revert changes from #610 and use a single flag for all types of keys.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-21 10:46:53 +03:00
Pavel Karpy
7c02a2e251 [#1087] *: Adopt SDK changes 
- Update `neofs-sdk-go`:
v0.0.0-20211230072947-1fe37df88f80 => v0.0.0-20220113123743-7f3162110659

- Add client interface that duplicates SDK's client behaviour and new
`MultiAddressClient` interface that has method that iterates over wrapped
clients.

- Also start using simple client mode that does not require parsing statuses
outside the SDK library.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-01-14 17:29:03 +03:00
Evgenii Stratonikov
0d969d7a06 [#1060] blobstor: allow to disable compression based on content-type 
For some data compression makes little sense, as it is already compressed.
This commit allows to leave such data unchanged based on `Content-Type`
attribute. Currently exact, prefix and suffix matching are supported.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-13 14:20:36 +03:00
Evgenii Stratonikov
5828f43e52 [#851] util/rand: use single random source 
It is much more convenient to skip source creation.
Also fix some bugs:
1. `cryptoSource.Int63()` now returns number in [0, 1<<63) as required
   by `rand.Source` interface.
2. Replace `cryptoSource.Uint63()` with `cryptoSource.Uint64` to allow
   generate uint64 numbers directly (see rand.Source64 docs).

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-12 19:29:27 +03:00
Evgenii Stratonikov
efabffbfd0 [#1041] cmd/*: factor out autocomplet command generation 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-12 18:33:48 +03:00
Leonard Lyubich
e74ff7c15a [#1062] node/object: Change the sequence of servers 
In previous implementation ACL server was the 1st (except metric server
in some cases) server in pipeline of Object service servers. This led to
the fact that errors of this handler could not be reduced to status
responses.

Nest object ACL server into signature and response servers to support
common response format.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-01-11 11:08:55 +03:00
Pavel Karpy
86b90eb944 [#1059] cli: Add SetShardMode operation 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-30 14:14:48 +03:00
Alex Vanin
90f05d4448 [#1066] cli: Support basic ACL constants without final flag 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-12-30 14:07:18 +03:00
Evgenii Stratonikov
56b8793520 [#1056] neofs-adm: deploy proxy contract without arguments 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-30 13:54:07 +03:00
Evgenii Stratonikov
185a2827cc Revert "[#1038] adm: Do not cut data args in NNS" 
This reverts commit acb4a9e5b4.
 2021-12-30 10:20:54 +03:00
Evgenii Stratonikov
549546dea1 [#1035] neofs-adm: reuse NEF and manifest during alphabet contract update 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-30 10:20:54 +03:00
Evgenii Stratonikov
4673c81451 [#1035] neofs-adm: update contracts in a single transaction 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-30 10:20:54 +03:00
Pavel Karpy
a8ba573ec8 [#1057] node/config: Use mode from config in shard/s constructor 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-29 18:06:15 +03:00
Pavel Karpy
8b8a815fb3 [#1057] node/config: Add shard mode config param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-29 18:06:15 +03:00
Evgenii Stratonikov
e96eb3e00b [#1054] neofs-node: add epoch metric 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-28 15:34:20 +03:00
Pavel Karpy
f5a9735e1c [#1048] cli: Add shard list operation 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-28 13:21:44 +03:00
Pavel Karpy
0e5410603e [#1048] control: Add ListShards implementation to ctrl svc 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-28 13:21:44 +03:00
Pavel Karpy
acb4a9e5b4 [#1038] adm: Do not cut data args in NNS 
The updated version of the `NNS` contract now supports the third `data`
argument that may provide additional information.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-20 14:43:29 +03:00
Pavel Karpy
11466ea3cc [#1031] adm: Use 10 as maxConnPerHost in neo-go client 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-16 18:55:53 +03:00
Pavel Karpy
c49e53ba9d [#1031] morph: Add maxConnPerHost option 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-16 18:55:53 +03:00
Pavel Karpy
63e035bd8a [#1031] node: Add maxConnPerHost to config 
It allows configuring number of neo-go client opened connections per one
host.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-16 18:55:53 +03:00
Pavel Karpy
90dbf3d944 [#1039] cli: Make return codes depend on errors 
Cast client errors to well-known public `sdk` errors and return appropriate
exit code.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-16 16:03:41 +03:00
Alex Vanin
2a031c5542 [#1013] Support autocomplete in neofs-adm 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-12-14 17:34:10 +03:00
Stanislav Bogatyrev
bd4d17ef9e [#1034] Add shorthand for generate-key flag 
Signed-off-by: Stanislav Bogatyrev <stanislav@nspcc.ru>
 2021-12-10 19:54:41 +03:00