dstepanov-yadro/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
4856 commits 263 branches 26 tags 26 MiB
Commit graph

107 commits

Author SHA1 Message Date
Evgenii Stratonikov
26041f18bf [#1505] pilorama: Allow to customize database parameters 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
36e24f7f78 [#1342] neofs-node: Use the default endpoint for tree service 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
62154da17c [#1324] services/tree: Implement Object Tree Service 
Object Tree Service allows changing trees assotiated with
the container in runtime.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
ac46d1a11f [#1602] config: Enable metrics and profiler services with a flag 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-18 19:41:22 +03:00
Evgenii Stratonikov
12dc5c3395 [#1563] config: Replace 127.0.0.1 with localhost 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-18 19:41:22 +03:00
Evgenii Stratonikov
07e06249d5 [#1524] metabase: Add some bolt parameters to the configuration 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-20 17:04:35 +03:00
Evgenii Stratonikov
c41d9c3fbe [#1474] neofs-node/config: Remove "shard_num" from the "grpc" section 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-03 14:44:06 +03:00
Evgenii Stratonikov
73a88c2965 [#1474] neofs-node/config: Remove num from the "grpc" section 
It isn't needed and can be replaced with additional checks during the
iteration.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-03 14:44:06 +03:00
Pavel Karpy
fdf1338d65 [#1170] config: Delete notification endpoints 
Also, change `http` to `ws` in examples.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
9cda3121ab [#1255] node/config: Add persistent storage 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-29 09:35:10 +03:00
Pavel Karpy
1e96f62294 [#1183] node/config: Add NATS configuration 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 15:57:24 +03:00
Pavel Karpy
46cf15f03c [#1183] node/config: Add notification configuration 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 11:41:18 +03:00
Evgenii Stratonikov
e03cb91b64 [#1118] neofs-node: add shard_ro_error_threshold config setting 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-03 15:14:27 +03:00
Evgenii Stratonikov
e976a55358 config: replace use_write_cache with writecache.enabled 
This is the way things are done with `grpc.tls` and in neo-go.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-27 16:44:56 +03:00
Evgenii Stratonikov
0d969d7a06 [#1060] blobstor: allow to disable compression based on content-type 
For some data compression makes little sense, as it is already compressed.
This commit allows to leave such data unchanged based on `Content-Type`
attribute. Currently exact, prefix and suffix matching are supported.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-13 14:20:36 +03:00
Pavel Karpy
8b8a815fb3 [#1057] node/config: Add shard mode config param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-29 18:06:15 +03:00
Pavel Karpy
63e035bd8a [#1031] node: Add maxConnPerHost to config 
It allows configuring number of neo-go client opened connections per one
host.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-16 18:55:53 +03:00
Leonard Lyubich
0fb838b169 [#983] node: Configure subnets 
Add `subnet` sub-section to `node` section of storage node config. Add
`entries` value which allows to enumerate subnets for entrance. Add
`exit_zero` value which allows to not enter zero subnet.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-11-28 16:42:46 +03:00
Evgenii Stratonikov
e7fd980951 [#859] config: rename writecache.size_limit to writecache.capacity 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
c015b04ed5 [#859] config: rename shallow_* to width and depth 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
684e3e0ae0 [#859] config: rename mem_size to memcache_capacity 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
a180f09523 [#859] config: rename max_size to max_object_size 
`_size` suffix by itself makes me think about restrictions on database
size.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
da51c119d5 [#859] config: rename opened_cache_size to opened_cache_capacity 
Capacity is a common term to use with cache, see e.g. leveldb
configuration.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
0759d8d0e5 [#859] config: rename small_size_limit to small_object_size 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
cbf8ca12b0 [#859] config: rename refill_metabase to resync_metabase 
This flag enables metabase content synchronization with blobstor on
start.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
41a9261069 [#935] config/example: quote spaces in node.env 
```
> source config/example/node.env
config/example/node.env: строка 14: /dns4/s02.neofs.devenv/tcp/8081: Нет такого файла или каталога
config/example/node.env: строка 16: MSK: команда не найдена
config/example/node.env: строка 35: 028f42cfcb74499d7b15b35d9bff260a1c8d27de4f446a627406a382d8961486d6: команда не найдена
config/example/node.env: строка 48: https://rpc2.morph.fs.neo.org:40341: Нет такого файла или каталога
config/example/node.env: строка 49: wss://rpc2.morph.fs.neo.org:40341/ws: Нет такого файла или каталога
config/example/node.env: строка 53: https://rpc2.n3.nspcc.ru:30341: Нет такого файла или каталога
```

New implementation is still basic, but we don't need to parse any env
file, just have a correct example.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-10-25 11:10:01 +03:00
Pavel Karpy
2f2258733b [#873] node: Delete useless notary deposit Amount, Duration envs 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-15 12:22:25 +03:00
Leonard Lyubich
40a4a7faa2 [#674] object/put: Use pseudo worker pool for local operations 
After storage engine started to limit number of PUT operations there is no
need to limited worker pool in Object Put service.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-10-14 10:20:39 +03:00
Leonard Lyubich
2126235f0e [#674] node: Configure size of per-shard worker pools 
Add `shard_pool_size` config to `storage` section. Set app default to 20.
Pass the value to `WithShardPoolSize` option.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-10-14 10:20:39 +03:00
Leonard Lyubich
0e3e8db5c0 [#845] node: Configure Object PUT remote and local pools separately 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-27 16:20:19 +03:00
Leonard Lyubich
d938c7267b [#789] node/config: Add Shard's refill_metabase config to examples 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:22:09 +03:00
Leonard Lyubich
368e280413 [#776] cmd/node: Configure write-cache size limit 
Add `size_limit` config value to write-cache section. Add `SizeLimit` method
of `writecache.Config` type. Pass its value to `WithMaxCacheSize` option on
app construction.

Reflect config update in examples. Cover new value in unit test.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:07:36 +03:00
Alex Vanin
cdb3b71070 [#798] neofs-node/config: Add persistent_state section 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-09-07 17:22:25 +03:00
Pavel Karpy
e29bcd98e2 [#770] node/config: Add notary deposit config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
d77b2d1b76 [#770] node/config: Add proxy contract to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
c54f524df9 [#773] writecache: Delete unused dbSize param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-27 15:05:53 +03:00
Pavel Karpy
c423aa432a [#730] node/config/morph: Add disable_cache 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-03 09:40:10 +03:00
Pavel Karpy
da516c6754 [#711] node/config/example: Make config examples usable 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-07-23 11:09:02 +03:00
Leonard Lyubich
81ddaeca16 [#607] config/example: Add all formats of node's network addresses 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
163c24a2d2 [#607] cmd/node: Configure group of bootstrap addresses 
There is a need to support multiple network addresses of the storage nodes.

Make `BootstrapAddress` to return `network.AddressGroup` (and rename).

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
8060735732 [#607] cmd/node: Serve gRPC on multiple interfaces 
Generalize single gRPC interface of the storage node to a group of
interfaces. Each interface calls the same RPC handler.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Evgenii Stratonikov
2f020a500d [#562] config: parse key on config load 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Evgenii Stratonikov
3f07313604 [#562] cmd/neofs-node: use NEP-6 wallet for keys 
Also use neo-go private key wrapper where possible, as it
already has methods for (un)marshaling.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Alex Vanin
cd947bb580 [#493] cmd/node: Add object service section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
f40b84c99e [#493] cmd/node: Add replicator section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
8c96494da0 [#493] cmd/node: Add policer section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
27b4781e95 [#493] cmd/node: Add apiclient section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
4ef968aa06 [#496] cmd/node: Add mainchain section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
cf5e371590 [#496] cmd/node: Add morph section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
c828848024 [#493] cmd/node: Add control section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Alex Vanin
0eea25375e [#493] cmd/node: Add contracts section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Pavel Karpy
7dbeb08c58 [#579] cmd/node: Add grpc section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 14:02:33 +03:00
Pavel Karpy
42d18f1322 [#577] cmd/node: Add node section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 13:28:15 +03:00
Leonard Lyubich
e1ebb48655 [#493] config/example: Add storage engine's configurations 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Alex Vanin
3fbf5e05b2 [#493] cmd/node: Add metrics section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
561c809fa5 [#493] cmd/node: Add profiler section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
25a13d3611 [#493] cmd/node: Add .env file for tests 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00