carpawell/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
3415 commits 27 branches 26 tags 21 MiB
Commit graph

104 commits

Author SHA1 Message Date
Evgenii Stratonikov
0d969d7a06 [#1060] blobstor: allow to disable compression based on content-type 
For some data compression makes little sense, as it is already compressed.
This commit allows to leave such data unchanged based on `Content-Type`
attribute. Currently exact, prefix and suffix matching are supported.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-13 14:20:36 +03:00
Pavel Karpy
8b8a815fb3 [#1057] node/config: Add shard mode config param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-29 18:06:15 +03:00
Pavel Karpy
876b0c53de [#1048] control: Rename Blobstore to Blobstor 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-28 13:21:44 +03:00
Pavel Karpy
63e035bd8a [#1031] node: Add maxConnPerHost to config 
It allows configuring number of neo-go client opened connections per one
host.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-16 18:55:53 +03:00
Evgenii Stratonikov
d1be5b5f9e [#878] neofs-node: default to secure TLS settings 
Support TLS >=1.2 only and strong cipher suites.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-02 12:05:41 +03:00
Leonard Lyubich
0fb838b169 [#983] node: Configure subnets 
Add `subnet` sub-section to `node` section of storage node config. Add
`entries` value which allows to enumerate subnets for entrance. Add
`exit_zero` value which allows to not enter zero subnet.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-11-28 16:42:46 +03:00
Evgenii Stratonikov
e7fd980951 [#859] config: rename writecache.size_limit to writecache.capacity 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
c015b04ed5 [#859] config: rename shallow_* to width and depth 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
684e3e0ae0 [#859] config: rename mem_size to memcache_capacity 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
a180f09523 [#859] config: rename max_size to max_object_size 
`_size` suffix by itself makes me think about restrictions on database
size.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
da51c119d5 [#859] config: rename opened_cache_size to opened_cache_capacity 
Capacity is a common term to use with cache, see e.g. leveldb
configuration.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
0759d8d0e5 [#859] config: rename small_size_limit to small_object_size 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
cbf8ca12b0 [#859] config: rename refill_metabase to resync_metabase 
This flag enables metabase content synchronization with blobstor on
start.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Leonard Lyubich
68a454fc56 [#969] config/example: Add note about shard config in relay node 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-11-15 06:47:25 +03:00
Evgenii Stratonikov
49c9dbfba8 [#877] config/engine: use default section for shards 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-10-28 15:04:14 +03:00
Evgenii Stratonikov
41a9261069 [#935] config/example: quote spaces in node.env 
```
> source config/example/node.env
config/example/node.env: строка 14: /dns4/s02.neofs.devenv/tcp/8081: Нет такого файла или каталога
config/example/node.env: строка 16: MSK: команда не найдена
config/example/node.env: строка 35: 028f42cfcb74499d7b15b35d9bff260a1c8d27de4f446a627406a382d8961486d6: команда не найдена
config/example/node.env: строка 48: https://rpc2.morph.fs.neo.org:40341: Нет такого файла или каталога
config/example/node.env: строка 49: wss://rpc2.morph.fs.neo.org:40341/ws: Нет такого файла или каталога
config/example/node.env: строка 53: https://rpc2.n3.nspcc.ru:30341: Нет такого файла или каталога
```

New implementation is still basic, but we don't need to parse any env
file, just have a correct example.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-10-25 11:10:01 +03:00
Pavel Karpy
39b04ff749 [#873] morph/notary: Not warn at "low till value" notary deposit error 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-15 12:22:25 +03:00
Pavel Karpy
2f2258733b [#873] node: Delete useless notary deposit Amount, Duration envs 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-15 12:22:25 +03:00
Leonard Lyubich
40a4a7faa2 [#674] object/put: Use pseudo worker pool for local operations 
After storage engine started to limit number of PUT operations there is no
need to limited worker pool in Object Put service.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-10-14 10:20:39 +03:00
Leonard Lyubich
2126235f0e [#674] node: Configure size of per-shard worker pools 
Add `shard_pool_size` config to `storage` section. Set app default to 20.
Pass the value to `WithShardPoolSize` option.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-10-14 10:20:39 +03:00
Sergio Nemirowski
57007f4a52 [#858] config/example: Set log levels in verbosity order 
Signed-off-by: Sergio Nemirowski <sergio@nspcc.ru>
 2021-10-12 12:16:53 +03:00
Pavel Karpy
fa1dc31320 [#894] config/example: Fix comments 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-08 11:30:10 +03:00
Pavel Karpy
40b2a03b49 [#874] node/config: Add information about comments to README.md 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-07 14:48:17 +03:00
Pavel Karpy
17dcc1299f [#874] node/config: Add comments for config values 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-07 14:48:17 +03:00
Leonard Lyubich
0e3e8db5c0 [#845] node: Configure Object PUT remote and local pools separately 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-27 16:20:19 +03:00
Leonard Lyubich
d938c7267b [#789] node/config: Add Shard's refill_metabase config to examples 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:22:09 +03:00
Leonard Lyubich
368e280413 [#776] cmd/node: Configure write-cache size limit 
Add `size_limit` config value to write-cache section. Add `SizeLimit` method
of `writecache.Config` type. Pass its value to `WithMaxCacheSize` option on
app construction.

Reflect config update in examples. Cover new value in unit test.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:07:36 +03:00
Alex Vanin
cdb3b71070 [#798] neofs-node/config: Add persistent_state section 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-09-07 17:22:25 +03:00
Pavel Karpy
e29bcd98e2 [#770] node/config: Add notary deposit config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
d77b2d1b76 [#770] node/config: Add proxy contract to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
c54f524df9 [#773] writecache: Delete unused dbSize param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-27 15:05:53 +03:00
Pavel Karpy
c423aa432a [#730] node/config/morph: Add disable_cache 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-03 09:40:10 +03:00
Pavel Karpy
da516c6754 [#711] node/config/example: Make config examples usable 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-07-23 11:09:02 +03:00
Leonard Lyubich
81ddaeca16 [#607] config/example: Add all formats of node's network addresses 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
163c24a2d2 [#607] cmd/node: Configure group of bootstrap addresses 
There is a need to support multiple network addresses of the storage nodes.

Make `BootstrapAddress` to return `network.AddressGroup` (and rename).

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
8060735732 [#607] cmd/node: Serve gRPC on multiple interfaces 
Generalize single gRPC interface of the storage node to a group of
interfaces. Each interface calls the same RPC handler.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Evgenii Stratonikov
2f020a500d [#562] config: parse key on config load 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Evgenii Stratonikov
3f07313604 [#562] cmd/neofs-node: use NEP-6 wallet for keys 
Also use neo-go private key wrapper where possible, as it
already has methods for (un)marshaling.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Alex Vanin
cd947bb580 [#493] cmd/node: Add object service section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
f40b84c99e [#493] cmd/node: Add replicator section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
8c96494da0 [#493] cmd/node: Add policer section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
27b4781e95 [#493] cmd/node: Add apiclient section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
4ef968aa06 [#496] cmd/node: Add mainchain section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
cf5e371590 [#496] cmd/node: Add morph section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
c828848024 [#493] cmd/node: Add control section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Alex Vanin
0eea25375e [#493] cmd/node: Add contracts section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Pavel Karpy
7dbeb08c58 [#579] cmd/node: Add grpc section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 14:02:33 +03:00
Pavel Karpy
42d18f1322 [#577] cmd/node: Add node section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 13:28:15 +03:00
Leonard Lyubich
e1ebb48655 [#493] config/example: Add storage engine's configurations 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Leonard Lyubich
72d81dba92 [#493] config/example: Write about ENVs in README.md 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Alex Vanin
3fbf5e05b2 [#493] cmd/node: Add metrics section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
561c809fa5 [#493] cmd/node: Add profiler section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
25a13d3611 [#493] cmd/node: Add .env file for tests 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Leonard Lyubich
f833fe1ee2 [#493] config: Add example config files of storage node application 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-01 11:45:38 +03:00