fyrchik/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
4746 commits 18 branches 26 tags 27 MiB
Commit graph

143 commits

Author SHA1 Message Date
Pavel Karpy
9a0824766c [#1713] node: Add Neo RPC switch interval to the config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-25 17:38:48 +03:00
Pavel Karpy
0631b38da1 [#1713] ir: Add Neo RPC switch interval to the config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-10-25 17:38:48 +03:00
Evgenii Stratonikov
ca8dc872b2 [#1846] neofs-node: Make morph.cache_ttl equal to block time by default 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-07 10:34:55 +03:00
Evgenii Stratonikov
236414df49 [#1817] network: Allow to use network addresses from the iterator 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-10-04 12:12:18 +03:00
Leonard Lyubich
a789159e5b [#1189] config/example: Mention persistent_sessions.path default 
In current implementation storage node app uses in-memory session
storage if `persistent_sessions.path` value is empty/missing in the
config.

Clarify default behavior in `config/example/node.yaml`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-09-13 21:29:04 +04:00
Evgenii Stratonikov
4354359aed [#1746] network: Set timeout for streaming operations 
Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-09-07 16:00:51 +04:00
Evgenii Stratonikov
177e8e01b1 [#1745] neofs-node: Remove memcache_capacity from the configuration 
It is unused since ddaed283e9 .

Signed-off-by: Evgenii Stratonikov <evgeniy@morphbits.ru>
 2022-09-02 11:59:53 +03:00
Leonard Lyubich
fa3124fc33 [#1632] node: Configure TTL of Sidechain caches 
From now cache TTL can be parameterized in the `neofs-node` app using
`cache_ttl` config key. `disable_cache` value is no longer supported.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-09-02 11:29:55 +04:00
Evgenii Stratonikov
26b4a258e0 [#1523] neofs-node: Refactor configuration 
1. Move compression parameters to the `shard` section.
2. Allow to use multiple sub-storage components in the blobstor.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-08-22 13:14:19 +03:00
Pavel Karpy
a97dee008c [#1648] morph: Change endpoint priority order 
The lowest value means the highest priority.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-08-04 16:11:24 +03:00
Pavel Karpy
0a60524a9c [#1654] ir, node: Drop deprecated profiler and metrics config sections 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-08-04 15:38:35 +03:00
Pavel Karpy
a0fae0443f [#1627] node: Add missing tree service to the config files 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-07-27 12:15:56 +03:00
Evgenii Stratonikov
25a0f539ea [#1624] config: Fix tree section example 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-25 16:56:02 +03:00
Pavel Karpy
ee9312dcfb [#1619] example: Fix IR RPC 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-07-22 12:37:25 +03:00
Evgenii Stratonikov
7410827db8 [#1609] config: Allow to prioritize N3 endpoints 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 16:08:42 +03:00
Evgenii Stratonikov
aed83d1660 [#1609] config: Remove mainchain section 
It is deprecated and unused, there is no need to have it in the
documentation.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 16:08:42 +03:00
Evgenii Stratonikov
b549cc314c [#1607] services/tree: allow to customize some parameters 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
a4adb79db7 [#1607] pilorama: Enable tree service explicitly 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
26041f18bf [#1505] pilorama: Allow to customize database parameters 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
36e24f7f78 [#1342] neofs-node: Use the default endpoint for tree service 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
62154da17c [#1324] services/tree: Implement Object Tree Service 
Object Tree Service allows changing trees assotiated with
the container in runtime.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-21 15:08:24 +03:00
Evgenii Stratonikov
eeef83a74c [#1604] config: Change yaml example a bit 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-19 11:12:52 +03:00
Evgenii Stratonikov
3a0b06d5da [#1602] config: Rename metrics and profiler sections 
Depracate old names and remove them in the next release.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-18 19:41:22 +03:00
Evgenii Stratonikov
ac46d1a11f [#1602] config: Enable metrics and profiler services with a flag 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-18 19:41:22 +03:00
Evgenii Stratonikov
12dc5c3395 [#1563] config: Replace 127.0.0.1 with localhost 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-18 19:41:22 +03:00
Evgenii Stratonikov
1119014e53 [#1579] config: Move storage.default to shard.default 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-07-13 12:31:42 +03:00
Evgenii Stratonikov
07e06249d5 [#1524] metabase: Add some bolt parameters to the configuration 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-20 17:04:35 +03:00
Evgenii Stratonikov
c41d9c3fbe [#1474] neofs-node/config: Remove "shard_num" from the "grpc" section 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-03 14:44:06 +03:00
Evgenii Stratonikov
73a88c2965 [#1474] neofs-node/config: Remove num from the "grpc" section 
It isn't needed and can be replaced with additional checks during the
iteration.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-03 14:44:06 +03:00
Alex Vanin
75b6f854e1 [#1358] example: Update README.md 
Mention Inner ring and CLI applications.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-11 11:15:54 +03:00
Alex Vanin
5988653fc6 [#1358] example: Drop comments in ir.env file 
Field descriptions are available in ir.yaml file.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-11 11:15:54 +03:00
Alex Vanin
d6be5d4087 [#1358] example: Add configs for inner ring application 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-11 11:15:54 +03:00
Pavel Karpy
fdf1338d65 [#1170] config: Delete notification endpoints 
Also, change `http` to `ws` in examples.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-04-08 11:52:18 +03:00
Pavel Karpy
9cda3121ab [#1255] node/config: Add persistent storage 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-29 09:35:10 +03:00
Pavel Karpy
1e96f62294 [#1183] node/config: Add NATS configuration 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 15:57:24 +03:00
Pavel Karpy
46cf15f03c [#1183] node/config: Add notification configuration 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-03-05 11:41:18 +03:00
Alex Vanin
838a3fdb85 [#1103] example: Add neofs-cli config example 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-02-11 15:36:26 +03:00
Evgenii Stratonikov
e03cb91b64 [#1118] neofs-node: add shard_ro_error_threshold config setting 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-03 15:14:27 +03:00
Evgenii Stratonikov
e976a55358 config: replace use_write_cache with writecache.enabled 
This is the way things are done with `grpc.tls` and in neo-go.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-27 16:44:56 +03:00
Evgenii Stratonikov
0d969d7a06 [#1060] blobstor: allow to disable compression based on content-type 
For some data compression makes little sense, as it is already compressed.
This commit allows to leave such data unchanged based on `Content-Type`
attribute. Currently exact, prefix and suffix matching are supported.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-13 14:20:36 +03:00
Pavel Karpy
8b8a815fb3 [#1057] node/config: Add shard mode config param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-29 18:06:15 +03:00
Pavel Karpy
876b0c53de [#1048] control: Rename Blobstore to Blobstor 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-28 13:21:44 +03:00
Pavel Karpy
63e035bd8a [#1031] node: Add maxConnPerHost to config 
It allows configuring number of neo-go client opened connections per one
host.

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-12-16 18:55:53 +03:00
Evgenii Stratonikov
d1be5b5f9e [#878] neofs-node: default to secure TLS settings 
Support TLS >=1.2 only and strong cipher suites.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-02 12:05:41 +03:00
Leonard Lyubich
0fb838b169 [#983] node: Configure subnets 
Add `subnet` sub-section to `node` section of storage node config. Add
`entries` value which allows to enumerate subnets for entrance. Add
`exit_zero` value which allows to not enter zero subnet.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-11-28 16:42:46 +03:00
Evgenii Stratonikov
e7fd980951 [#859] config: rename writecache.size_limit to writecache.capacity 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
c015b04ed5 [#859] config: rename shallow_* to width and depth 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
684e3e0ae0 [#859] config: rename mem_size to memcache_capacity 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
a180f09523 [#859] config: rename max_size to max_object_size 
`_size` suffix by itself makes me think about restrictions on database
size.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
da51c119d5 [#859] config: rename opened_cache_size to opened_cache_capacity 
Capacity is a common term to use with cache, see e.g. leveldb
configuration.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
0759d8d0e5 [#859] config: rename small_size_limit to small_object_size 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Evgenii Stratonikov
cbf8ca12b0 [#859] config: rename refill_metabase to resync_metabase 
This flag enables metabase content synchronization with blobstor on
start.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-15 13:14:24 +03:00
Leonard Lyubich
68a454fc56 [#969] config/example: Add note about shard config in relay node 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-11-15 06:47:25 +03:00
Evgenii Stratonikov
49c9dbfba8 [#877] config/engine: use default section for shards 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-10-28 15:04:14 +03:00
Evgenii Stratonikov
41a9261069 [#935] config/example: quote spaces in node.env 
```
> source config/example/node.env
config/example/node.env: строка 14: /dns4/s02.neofs.devenv/tcp/8081: Нет такого файла или каталога
config/example/node.env: строка 16: MSK: команда не найдена
config/example/node.env: строка 35: 028f42cfcb74499d7b15b35d9bff260a1c8d27de4f446a627406a382d8961486d6: команда не найдена
config/example/node.env: строка 48: https://rpc2.morph.fs.neo.org:40341: Нет такого файла или каталога
config/example/node.env: строка 49: wss://rpc2.morph.fs.neo.org:40341/ws: Нет такого файла или каталога
config/example/node.env: строка 53: https://rpc2.n3.nspcc.ru:30341: Нет такого файла или каталога
```

New implementation is still basic, but we don't need to parse any env
file, just have a correct example.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-10-25 11:10:01 +03:00
Pavel Karpy
39b04ff749 [#873] morph/notary: Not warn at "low till value" notary deposit error 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-15 12:22:25 +03:00
Pavel Karpy
2f2258733b [#873] node: Delete useless notary deposit Amount, Duration envs 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-15 12:22:25 +03:00
Leonard Lyubich
40a4a7faa2 [#674] object/put: Use pseudo worker pool for local operations 
After storage engine started to limit number of PUT operations there is no
need to limited worker pool in Object Put service.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-10-14 10:20:39 +03:00
Leonard Lyubich
2126235f0e [#674] node: Configure size of per-shard worker pools 
Add `shard_pool_size` config to `storage` section. Set app default to 20.
Pass the value to `WithShardPoolSize` option.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-10-14 10:20:39 +03:00
Sergio Nemirowski
57007f4a52 [#858] config/example: Set log levels in verbosity order 
Signed-off-by: Sergio Nemirowski <sergio@nspcc.ru>
 2021-10-12 12:16:53 +03:00
Pavel Karpy
fa1dc31320 [#894] config/example: Fix comments 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-08 11:30:10 +03:00
Pavel Karpy
40b2a03b49 [#874] node/config: Add information about comments to README.md 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-07 14:48:17 +03:00
Pavel Karpy
17dcc1299f [#874] node/config: Add comments for config values 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-10-07 14:48:17 +03:00
Leonard Lyubich
0e3e8db5c0 [#845] node: Configure Object PUT remote and local pools separately 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-27 16:20:19 +03:00
Leonard Lyubich
d938c7267b [#789] node/config: Add Shard's refill_metabase config to examples 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:22:09 +03:00
Leonard Lyubich
368e280413 [#776] cmd/node: Configure write-cache size limit 
Add `size_limit` config value to write-cache section. Add `SizeLimit` method
of `writecache.Config` type. Pass its value to `WithMaxCacheSize` option on
app construction.

Reflect config update in examples. Cover new value in unit test.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-15 18:07:36 +03:00
Alex Vanin
cdb3b71070 [#798] neofs-node/config: Add persistent_state section 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-09-07 17:22:25 +03:00
Pavel Karpy
e29bcd98e2 [#770] node/config: Add notary deposit config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
d77b2d1b76 [#770] node/config: Add proxy contract to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-09-07 12:55:01 +03:00
Pavel Karpy
c54f524df9 [#773] writecache: Delete unused dbSize param 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-27 15:05:53 +03:00
Pavel Karpy
c423aa432a [#730] node/config/morph: Add disable_cache 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-08-03 09:40:10 +03:00
Pavel Karpy
da516c6754 [#711] node/config/example: Make config examples usable 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>

Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-07-23 11:09:02 +03:00
Leonard Lyubich
81ddaeca16 [#607] config/example: Add all formats of node's network addresses 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
163c24a2d2 [#607] cmd/node: Configure group of bootstrap addresses 
There is a need to support multiple network addresses of the storage nodes.

Make `BootstrapAddress` to return `network.AddressGroup` (and rename).

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Leonard Lyubich
8060735732 [#607] cmd/node: Serve gRPC on multiple interfaces 
Generalize single gRPC interface of the storage node to a group of
interfaces. Each interface calls the same RPC handler.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-28 15:52:50 +03:00
Evgenii Stratonikov
2f020a500d [#562] config: parse key on config load 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Evgenii Stratonikov
3f07313604 [#562] cmd/neofs-node: use NEP-6 wallet for keys 
Also use neo-go private key wrapper where possible, as it
already has methods for (un)marshaling.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-06-15 14:49:59 +03:00
Alex Vanin
cd947bb580 [#493] cmd/node: Add object service section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
f40b84c99e [#493] cmd/node: Add replicator section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
8c96494da0 [#493] cmd/node: Add policer section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
27b4781e95 [#493] cmd/node: Add apiclient section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 16:07:42 +03:00
Alex Vanin
4ef968aa06 [#496] cmd/node: Add mainchain section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
cf5e371590 [#496] cmd/node: Add morph section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 15:12:08 +03:00
Alex Vanin
c828848024 [#493] cmd/node: Add control section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Alex Vanin
0eea25375e [#493] cmd/node: Add contracts section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-02 14:58:22 +03:00
Pavel Karpy
7dbeb08c58 [#579] cmd/node: Add grpc section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 14:02:33 +03:00
Pavel Karpy
42d18f1322 [#577] cmd/node: Add node section to config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2021-06-02 13:28:15 +03:00
Leonard Lyubich
e1ebb48655 [#493] config/example: Add storage engine's configurations 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Leonard Lyubich
72d81dba92 [#493] config/example: Write about ENVs in README.md 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-02 09:54:00 +03:00
Alex Vanin
3fbf5e05b2 [#493] cmd/node: Add metrics section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
561c809fa5 [#493] cmd/node: Add profiler section to config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Alex Vanin
25a13d3611 [#493] cmd/node: Add .env file for tests 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-06-01 15:29:08 +03:00
Leonard Lyubich
f833fe1ee2 [#493] config: Add example config files of storage node application 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-06-01 11:45:38 +03:00