204 commits

Author	SHA1	Message	Date
Ekaterina Lebedeva	e9971d73c8	[#1452] container: Add ListStream method ... * Added new method for listing containers to container service. It opens stream and sends containers in batches. * Added TransportSplitter wrapper around ExecutionService to split container ID list read from contract in parts that are smaller than grpc max message size. Batch size can be changed in node configuration file (as in example config file). * Changed `container list` implementaion in cli: now ListStream is called by default. Old List is called only if ListStream is not implemented. * Changed `internalclient.ListContainersPrm`.`Account` to `OwnerID` since `client.PrmContainerList`.`Account` was renamed to `OwnerID` in sdk. Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2024-12-17 13:33:43 +03:00
Dmitrii Stepanov	e2658c7519	[#1488] tracing: KV attributes for spans from config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 17:24:43 +03:00
Dmitrii Stepanov	9bd05e94c8	[#1449] tree: Add ApplyBatch method ... Concurrent Apply can lead to child node applies before parent, so undo/redo operations will perform. This leads to performance degradation in case of tree with many sublevels. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-11-12 12:11:07 +00:00
Anton Nikiforov	81f4cdbb91	[#1439] object: Sort nodes by priority metrics to compute GET request ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-10-29 08:05:09 +00:00
Dmitrii Stepanov	3304afa9d1	[#1422] config: Add multinet config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-10-17 13:15:08 +00:00
Alexander Chuprov	a13219808a	[#1375] node: Configure of the container cache size ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2024-10-01 14:05:52 +00:00
Aleksey Savchuk	d4bec24c9f	[#1366] node, ir: Support timestamp config option, update tests ... Signed-off-by: Aleksey Savchuk <a.savchuk@yadro.com>	2024-09-17 10:50:08 +03:00
Aleksey Savaitan	74a6a1da7f	[#1361] add root ca cert for telemetry configuration ... Signed-off-by: Aleksey Savaitan <a.savaitan@yadro.com>	2024-09-13 15:12:49 +00:00
Dmitrii Stepanov	e39378b1c3	[#1367] writecache: Add background flushing objects limiter ... To limit memory usage by background flush. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-12 15:06:33 +03:00
Vitaliy Potyarkin	ec8da40567	[#1369] Update obsolete URLs ... Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>	2024-09-11 11:31:10 +00:00
Dmitrii Stepanov	d3b209c8e1	[#1337] shard: Disable background rebuild ... Since `frostfs-cli control shards rebuild` command was added, there is no need for background rebuild now. For failover tests used used value 1 to rebuild only schema change. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-06 15:19:55 +03:00
Dmitrii Stepanov	a61201a987	[#1337] config: Move rebuild_worker_count to shard section ... This makes it simple to limit performance degradation for every shard because of rebuild. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-09-06 13:57:27 +03:00
Dmitrii Stepanov	68029d756e	[#1302] writecache: Allow to specify custom page size ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 12:12:07 +03:00
Dmitrii Stepanov	08b1f18bca	[#1296] writecache: Add count limit ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-08-09 06:30:32 +00:00
Dmitrii Stepanov	78b1d9b18d	[#1226] blobovniczatree: Drop leaf width limitation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-04 12:22:06 +03:00
Dmitrii Stepanov	40c9ddb6ba	[#1226] blobovniczatree: Drop init in advance option ... To make blobovniczatree unlimited. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-07-04 12:22:06 +03:00
Dmitrii Stepanov	7b8937ec35	[#1184] config: Add audit.enabled parameter for node ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-06-19 16:05:53 +03:00
Evgenii Stratonikov	dbd3b238f7	[#1170] node: Support morph mTLS ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-14 09:30:46 +03:00
Evgenii Stratonikov	a849236b68	[#1161] node: Remove notification functionality ... It is unused and will be reworked in future. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-06-07 12:10:51 +00:00
Evgenii Stratonikov	b4cfc80579	[#1133] node: Improve tests for shards.default config section ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-15 09:48:21 +03:00
Anton Nikiforov	411a8d0245	[#1004] blobovnicza: Use TTL for blobovnicza tree cache ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-26 19:54:29 +03:00
Dmitrii Stepanov	57466594fb	[#1024] shard: Resync metabase concurrently ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-04-10 10:21:10 +03:00
Dmitrii Stepanov	6bf77cabd4	[#1044] ape: Add morph chain cache ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-18 18:44:10 +03:00
Dmitrii Stepanov	702351a5d1	[#983] blobstor: Allow to specify wait before drop time ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-05 09:23:57 +03:00
Anton Nikiforov	ae5bb87e70	Revert "[#866] Use TTL for blobovnicza tree cache" ... This reverts commit d9cbb16bd3. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-01 19:29:33 +03:00
Dmitrii Stepanov	962e5a9c19	[#736] logger: Add journald support ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-12 06:17:22 +00:00
Dmitrii Stepanov	8180a0664f	[#887] node: Drop badger writecache implementation ... Badger implementation isn't tested and works not well, but requires human resources to maintain. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-22 13:00:54 +03:00
Anton Nikiforov	d9cbb16bd3	[#866] Use TTL for blobovnicza tree cache ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-12-19 16:36:28 +00:00
Ekaterina Lebedeva	2d4c0a0f4a	[#552] Add systemd notifications to ir service ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 17:51:41 +03:00
Ekaterina Lebedeva	ef07c1a3c9	[#552] Add sysd notifications to storage service ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 17:51:41 +03:00
Dmitrii Stepanov	db49ad16cc	[#826] blobovniczatree: Do not create DB's on init ... Blobovniczas will be created on write requests. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	f1c7905263	[#661] blobovniczatree: Make Rebuild concurrent ... Different DBs can be rebuild concurrently. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	da4fee2d0b	[#698] blobovniczatree: Init blobovniczas concurrently ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	07390ad4e3	[#715] node: Unify config parameter names ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-22 17:13:50 +03:00
Dmitrii Stepanov	c80b46fad3	[#754] blobstor: Estimate compressability ... Now it is possible to enable compressability estimation. If data is likely uncompressable, it should reduce CPU time and memory. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-01 11:24:32 +03:00
Dmitrii Stepanov	ae81d6660a	[#529] objectcore: Fix object content validation ... There are old objects where the owner of the object may not match the one who issued the token. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-29 10:33:06 +03:00
Dmitrii Stepanov	d3904ec599	[#602] config: Add blobovnicza leaf width parameter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-21 10:27:32 +03:00
Alejandro Lopez	1a0cb0f34a	[#421] Try using badger for the write-cache ... Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>	2023-08-07 08:16:57 +00:00
Dmitrii Stepanov	32c77f3a23	[#537] node: Add runtime.memory_limit config parameter ... This parameter allows to set soft memory limit for Go GC. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-25 17:27:09 +03:00
Dmitrii Stepanov	d8e37a827f	[#497] config: Add examples and unit tests ... Add examples and unit tests for tree.authorized_keys section. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-17 08:23:28 +00:00
Dmitrii Stepanov	81718afb39	[#338] ir: Drop named named put fee ... Named put fee value used only when notary disabled. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-05-24 08:44:47 +00:00
Pavel Karpy	f604d6bbdc	[#39] ir: Add optional profilers ... Includes `block` and `mutex` profiles configuration. Signed-off-by: Pavel Karpy <p.karpy@yadro.com> Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-05-12 17:49:47 +03:00
Pavel Karpy	14c35d776e	[#39] node: Add optional profilers ... Include settings for block and mutex profilers. They are disabled by default, as in Go runtime itself. Signed-off-by: Pavel Karpy <p.karpy@yadro.com> Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-05-12 15:49:04 +03:00
Evgenii Stratonikov	3bac5a485d	[#248] config: Remove audit-related parameters ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-04-28 17:00:43 +03:00
Dmitrii Stepanov	f07d4158f5	[#249] node: Drop subnet from IR and morph ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-04-17 09:46:02 +03:00
Dmitrii Stepanov	d757d881d0	[#249] node: Drop subnet from config ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-04-17 09:46:02 +03:00
Pavel Karpy	960e3c219e	[#247] config, doc: Drop reputation references ... Signed-off-by: Pavel Karpy <p.karpy@yadro.com>	2023-04-14 14:44:14 +03:00
Anton Nikiforov	8d2f443868	[#238] Fix linter error ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-04-14 10:19:10 +00:00
Dmitrii Stepanov	5af9f58469	[#135] tracing: Add tracing to node gRPC endpoints ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-04-12 06:52:00 +00:00
Dmitrii Stepanov	5059dcc19d	[#145] shard-gc: Delete expired objects after locks ... GC deletes expired locks and objects sequentially. Expired locks and objects are now being deleted concurrently in batches. Added a config parameter that controls the number of concurrent workers and batch size. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-03-21 11:31:08 +03:00