fyrchik/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
2212 commits 24 branches 26 tags 17 MiB
Commit graph

2212 commits

This branch
This branch
All branches
Author SHA1 Message Date
Evgenii Stratonikov
b5bcf90fa1 [#1186] engine: Read object directly from blobstor in case of conflicts 
Metabase is expected to contain actual information about objects stored
in shard. If the object is present in metabase but is missing from
blobstor, peform an additional attempt to fetch it directly without
consulting metabase. Such a situation is unexpected, so error counter
is increased for the shard which has the object in the metabase. We
don't increase error counter for the shard which has the object in
blobstor, because some garbage can be expected there. In this
implementation there is no overhead for objects which are really
missing, i.e. are not present in any metabase.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>

(cherry picked from commit 69e1e6ca20)
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-28 13:48:44 +03:00
Evgenii Stratonikov
ce169491ed [#1188] metabase: log PUT / DELETE operations 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
(cherry picked from commit 6e6f3648d2)
 2022-03-28 13:48:44 +03:00
ZhangTao1596
58f2354057 [#1180] ir/internal: Fix audit range hash type 
Signed-off-by: ZhangTao1596 <zhangtao@ngd.neo.org>
(cherry picked from commit dd0e10d306)
 2022-03-28 13:03:12 +03:00
Evgenii Stratonikov
25b827e0fd [#1090] neofs-adm: Add history of commands to a storage configurator 
It also persists between sessions.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
(cherry picked from commit b3b3b8b20f)
 2022-03-28 13:01:45 +03:00
Evgenii Stratonikov
00180a7ecf [#1090] neofs-adm: add interactive configurator for storage node 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
(cherry picked from commit 8263582dde)
 2022-03-28 13:01:45 +03:00
Pavel Karpy
1f825a467a [#1136] cli: Allow usage of empty wallet passwords 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
(cherry picked from commit c7a8c762e0)
 2022-03-28 13:01:33 +03:00
Alex Vanin
35dec2f494 Release v0.27.5 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-01-31 14:32:44 +03:00
Evgenii Stratonikov
a6cb608dc6 [#1023] .golangci.yml: remove outdated govet settings 
Placement policy has been moved to SDK recently.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
476528361e [#1023] *: fix linter errors 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
eb99b65134 [#1023] morph/event: remove notaryRequest from subnet.Delete 
Subnet removal is done by owner.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
9d3609d4c1 [#1023] neofs-node/reputation: remove epoch from common parameters 
It is unused and is present in both of `Announce*TrustPrm`.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
f96bb8d3b8 [#1023] innerring/subnet: fix subnet removal event processing 
Caught by `unused` linter.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
a82ac0edcd [#1023] services/object: remove TTL from Get parameters 
It was unused an should be provided as a `CallOption` instead.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
312071b9bd [#1023] .golangci.yml: add unused linter 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 13:01:58 +03:00
Evgenii Stratonikov
5a03a14940 [#1094] metabase: move Select filters sanity check outside of transaction 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:40 +03:00
Evgenii Stratonikov
651adf46c6 [#1094] blobovnicza: calculate size in Init properly 
If pre-existing blobovnicza is initialized, it's size should be updated
even if all buckets are in place.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:40 +03:00
Evgenii Stratonikov
418b553920 [#1094] shard: remove TODO for shard mode description 
It was added back in 2fb379b7 when we had many shard modes. Now we have
only two and comments for constants are rather descriptive.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:40 +03:00
Evgenii Stratonikov
ed7c732676 [#1094] shard: unify collection of expired objects 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:40 +03:00
Evgenii Stratonikov
fbb95cff14 [#1094] services/object: remove some FIXME comments 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:40 +03:00
Evgenii Stratonikov
1bdbd6ed22 [#1094] eacl/v2: preallocate slice in headersFromObject 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:40 +03:00
Evgenii Stratonikov
3407fef799 [#1086] neofs-cli: add command for shard restore 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:14 +03:00
Evgenii Stratonikov
18cfd8b042 [#1086] services/control: implement RestoreShard RPC 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:14 +03:00
Evgenii Stratonikov
2ec4a3c897 [#1086] neofs-cli: add command for shard dump 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:14 +03:00
Evgenii Stratonikov
0e60b1d6c9 [#1086] services/control: implement DumpShard RPC 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:14 +03:00
Evgenii Stratonikov
aa53418119 [#1086] services/control: fix comments 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-31 12:36:14 +03:00
Pavel Karpy
679c922e0c [#1120] cli: Fix printing config file in verbose mode 
It was broken since `initConfig` was made before every execution of the
command and flags have not been read by cobra yet, so it was impossible to
print config file path if `verbose` flag was set in command line not in
config file.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-01-31 11:24:16 +03:00
Alex Vanin
08e83a2bc7 [#1092] neofs-cli: Add 'acl extended create' command 
Follows neofs-cli refactor scheme from #1074

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-01-28 10:39:18 +03:00
Evgenii Stratonikov
e976a55358 config: replace use_write_cache with writecache.enabled 
This is the way things are done with `grpc.tls` and in neo-go.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-27 16:44:56 +03:00
Leonard Lyubich
20b3ff84b3 [#1110] ir/container: Fix check of SetEACL operation 
In previous implementation IR incorrectly verified `SetEACL` event of
`Container` contract. The incorrect behavior could be reproduced in two
ways:
  1. Create container using session, and perform `SetEACL` operation
  with a key that is different from the session one.
  2. Create container using session, and perform `SetEACL` w/o a
  session, but sign it using session key from the `Put` operation.

The problem was in the `checkSetEACL` validation method of IR container
processor. It always used session token used for container creation
during session ownership check.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-01-27 16:37:24 +03:00
Pavel Karpy
6f338c660c [#1038] adm: Do not cut data args in NNS 
This reverts commit 185a2827cc.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-01-27 12:08:36 +03:00
Evgenii Stratonikov
adb80bebb2 [#1085] shard: rename Evacuate to Dump 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
d06425c852 [#1085] shard: allow to ignore errors in Evacuate 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
36eebb5932 [#1085] writecache: allow to ignore errors during iteration 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
cd75638ce3 [#1085] blobstor: allow to ignore errors during iteration 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
c954f0e71b [#1085] fstree: allow to ignore errors during iteration 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
e53ad2f468 [#1085] blobovnicza: allow to ignore errors during iteration 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
9c60ab893c [#1085] shard: allow to ignore errors during restore 
We could also ignore errors during evacuate, but this requires
unmarshaling objects first which slowers the process considerably.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
0ef3d5ab03 [#1085] writecache: persist in-memory objects before shutdown 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
3215210d0c [#1085] shard: Close components in reverse order 
Write-cache should be closed before blobstor and metabase.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
b432ec3a03 [#1085] shard/test: add object integrity check for Evacuate 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
c0f6c988f0 [#1085] shard: dump data from write-cache 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
ad01aaf8bf [#1085] writecache: add read-only mode 
In read-only mode modifying operations are immediately returned with
error and all background operations are suspended.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
9f963e001b [#1085] writecache: set metaOnly flag for receiving from priority channel 
This can lead to objects being flushed twice.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
7eedb23eb7 [#1085] shard: allow to dump/restore objects 
Dump contains magic and a list of objects prefixed by object size in bytes.
We can't use proto-marshaled list because this requires having all dump
in memory. Using TAR induces 512 byte overhead for each object which can
be a problem in some cases.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Leonard Lyubich
257069a132 [#1084] cli/accounting: Convert balance response to Fixed8 
After recent changes balance response contains contract precision.

Convert balance response to Fixed8. Use `fixedn.ToString` function to
print the converted value.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-01-26 14:10:02 +03:00
Leonard Lyubich
87a45983a1 [#1084] accounting: Keep balance precision from contract 
Do not convert balance response of Balance contract to Fixed8.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-01-26 14:10:02 +03:00
Evgenii Stratonikov
dbb04d78b9 [#1103] neofs-cli: mention IR in healthcheck help message 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 14:09:42 +03:00
Evgenii Stratonikov
5c2b2e137d [#1103] neofs-cli: disallow generating key for control commands 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 14:09:42 +03:00
Evgenii Stratonikov
007158ebe1 [#1103] neofs-cli: allow to set password in config 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 14:09:42 +03:00
Evgenii Stratonikov
0c46827a08 go.mod: update tzhash version 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-24 14:13:36 +03:00