aarifullin/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
1882 commits 132 branches 26 tags 56 MiB
Commit graph

58 commits

Author SHA1 Message Date
Leonard Lyubich
2126235f0e [#674] node: Configure size of per-shard worker pools 
Add `shard_pool_size` config to `storage` section. Set app default to 20.
Pass the value to `WithShardPoolSize` option.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-10-14 10:20:39 +03:00
Evgenii Stratonikov
00f14d4dcd [#857] config: use size suffixes where possible 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-10-08 11:26:24 +03:00
Evgenii Stratonikov
a0abf10c8e [#857] config: allow to parse sizes with suffix 
The code is taken from viper as `cast` package that we use
doesn't have needed converter.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-10-08 11:26:24 +03:00
Leonard Lyubich
0e3e8db5c0 [#845] node: Configure Object PUT remote and local pools separately 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-27 16:20:19 +03:00
Leonard Lyubich
d938c7267b [#789] node/config: Add Shard's refill_metabase config to examples 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:22:09 +03:00
Leonard Lyubich
b5fff810f4 [#789] cmd/node: Add refill_metabase config to shard section 
Implement `RefillMetabase` method to `shardconfig.Config` type which reads
`refill_metabase` config value. Pass the result to `WithRefillMetabase`
option.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:22:09 +03:00
Leonard Lyubich
368e280413 [#776] cmd/node: Configure write-cache size limit 
Add `size_limit` config value to write-cache section. Add `SizeLimit` method
of `writecache.Config` type. Pass its value to `WithMaxCacheSize` option on
app construction.

Reflect config update in examples. Cover new value in unit test.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:07:36 +03:00
Alex Vanin
d840627816 [#786] cmd/neofs-node: Use NNS to find contract script hashes missing in config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-09-13 14:51:35 +03:00
Alex Vanin
cdb3b71070 [#798] neofs-node/config: Add persistent_state section 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-09-07 17:22:25 +03:00
Pavel Karpy
e29bcd98e2 [#770] node/config: Add notary deposit config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
2ef5e86aaf [#770] node/config: Add uint32 casting 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
d77b2d1b76 [#770] node/config: Add proxy contract to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
c54f524df9 [#773] writecache: Delete unused dbSize param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-27 15:05:53 +03:00
Pavel Karpy
c423aa432a [#730] node/config/morph: Add disable_cache 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-03 09:40:10 +03:00
Pavel Karpy
67b17cfb02 [#727] config: Use 0660 as default permissions 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-07-30 16:42:22 +03:00
Pavel Karpy
6638136d11 [#711] node/config/test: Adapt test to new config examples 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-07-23 11:09:02 +03:00
Alex Vanin
e2f7b3f1cc [#690] cmd/neofs-node: Fallback to wallet section if node key is not set 
Some users want to specify only wallet section in the SN. It is not
possible if `Key` throws panic on empty value. Instead it should
fallback to wallet section. Panic is suitable if node's key is provided
but invalid.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-07-13 14:49:31 +03:00
Leonard Lyubich
56d4410913 [#638] Update to Go 1.16 
Changes:

  * replace `iotuil` elements with the ones from `os` package;
  * replace `os.Filemode` with `fs.FileMode`;
  * use `signal.NotifyContext` instead of `NewGracefulContext` (removed).

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-29 13:44:59 +03:00
Leonard Lyubich
81ddaeca16 [#607] config/example: Add all formats of node's network addresses 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
163c24a2d2 [#607] cmd/node: Configure group of bootstrap addresses 
There is a need to support multiple network addresses of the storage nodes.

Make `BootstrapAddress` to return `network.AddressGroup` (and rename).

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
8060735732 [#607] cmd/node: Serve gRPC on multiple interfaces 
Generalize single gRPC interface of the storage node to a group of
interfaces. Each interface calls the same RPC handler.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
adbbad0beb [#607] network: Do not work with Address pointers 
`network.Address` structure in most cases created once and used read-only.

Replace `AddressFromString` function with `Address.FromString` method with
the same purpose and implementation. Make all libraries to work with value.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-18 18:09:50 +03:00
Leonard Lyubich
fdd123ad98 [#607] network: Prevent potential panic in Address.Equal method 
Make `Address.Equal` method to accept value instead of pointer in order to
prevent NPE.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-18 18:09:50 +03:00
Evgenii Stratonikov
41a30d6ec2 [#562] config/node: fallback to wallet if raw key is invalid 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Evgenii Stratonikov
2f020a500d [#562] config: parse key on config load 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Evgenii Stratonikov
3f07313604 [#562] cmd/neofs-node: use NEP-6 wallet for keys 
Also use neo-go private key wrapper where possible, as it
already has methods for (un)marshaling.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Alex Vanin
a2547da5ae [#493] cmd/node: Fix linter errors in config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
cd947bb580 [#493] cmd/node: Add object service section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
f40b84c99e [#493] cmd/node: Add replicator section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
8c96494da0 [#493] cmd/node: Add policer section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
27b4781e95 [#493] cmd/node: Add apiclient section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
4ef968aa06 [#496] cmd/node: Add mainchain section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
cf5e371590 [#496] cmd/node: Add morph section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
c828848024 [#493] cmd/node: Add control section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Alex Vanin
0eea25375e [#493] cmd/node: Add contracts section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Pavel Karpy
7dbeb08c58 [#579] cmd/node: Add grpc section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 14:02:33 +03:00
Pavel Karpy
42d18f1322 [#577] cmd/node: Add node section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 13:28:15 +03:00
Pavel Karpy
52c82ef46a [#577] cmd/node: Add tests for boolean type casting in config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 13:28:15 +03:00
Leonard Lyubich
e149eae7b2 [#493] node/config: Test storage engine's config with config/example 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Leonard Lyubich
f663a1c125 [#493] node/config: Implement sections of local object storage 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Leonard Lyubich
e26dc0a6e3 [#493] node/config: Fix corrupting of path to the subsection 
In previous implementation `Config.Sub` method could lead to the violation
of the internal `path` slice because of `append`. This has been observed on
deeply nested subsections.

Fix `Config.Sub` to copy internal slice in order to prevent violations.
Cover problem case in test config files and unit test.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Leonard Lyubich
2bbd4d0ee3 [#493] node/config: Implement integer casters 
Implement `Int` / `Uint` functions which casts value to `int64` / `uint64`.
Implement safe functions `IntSafe` / `UintSafe`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Alex Vanin
3fbf5e05b2 [#493] cmd/node: Add metrics section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
561c809fa5 [#493] cmd/node: Add profiler section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
922d29ff88 [#493] cmd/node: Support duration type casting in config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
25a13d3611 [#493] cmd/node: Add .env file for tests 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Leonard Lyubich
3b797d7957 [#493] node/config/logger: Simplify approach to read the level 
Dedicated type `LoggerSection` turned out to be redundant since it doesn't
do a hidden logic and just uses `config.Config` API.

Remove `LoggerSection` type and implement `Level` which do the same.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-01 11:45:38 +03:00
Leonard Lyubich
be6898a51d [#493] node/config/logger: Cover ENV variables with unit test 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-01 11:45:38 +03:00
Leonard Lyubich
3fd4b32a4f [#493] node/config: Cover ENV variables with unit test 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-01 11:45:38 +03:00
Leonard Lyubich
099ceeae50 [#493] node/config: Implement ENV variable key constructor 
Add `internal.Env` function which converts path to config value to ENV
variable key.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-01 11:45:38 +03:00