84 Commits (v0.38.5)

Author	SHA1	Message	Date
Anton Nikiforov	c8ce6e9fe4	[#1072] node, ir: Add new config option `kludge_compatibility_mode` ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-04 11:24:37 +03:00
Airat Arifullin	4080b99310	[#1061] node: Set TTL for morph rule cache from morph config ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-04-02 12:40:56 +03:00
Dmitrii Stepanov	5d58b44bc8	[#1044] node: Drop unused methods from APE implementation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-18 18:44:10 +03:00
Dmitrii Stepanov	6bf77cabd4	[#1044] ape: Add morph chain cache ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-18 18:44:10 +03:00
Airat Arifullin	7a4b6057ce	Revert "[#963] node: Go on initialization even deposit notary is hung" ... This reverts commit b4cb54e7ed. Signed-off-by: aarifullin <a.arifullin@yadro.com>	2024-03-13 11:53:59 +03:00
Airat Arifullin	b4cb54e7ed	[#963] node: Go on initialization even deposit notary is hung ... * Make makeAndWaitNotaryDeposit run asynchronously as worker during application boot-up. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-12 10:18:07 +00:00
Dmitrii Stepanov	d433b49265	[#973] node: Resolve perfsprint linter ... `fmt.Errorf can be replaced with errors.New` and `fmt.Sprintf can be replaced with string addition` Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-11 17:55:50 +03:00
Dmitrii Stepanov	66a26b7775	[#973] node: Resolve revive: unused-parameter linter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-11 17:11:49 +03:00
Dmitrii Stepanov	702351a5d1	[#983] blobstor: Allow to specify wait before drop time ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-03-05 09:23:57 +03:00
Anton Nikiforov	ae5bb87e70	Revert "[#866] Use TTL for blobovnicza tree cache" ... This reverts commit d9cbb16bd3. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-03-01 19:29:33 +03:00
Dmitrii Stepanov	962e5a9c19	[#736] logger: Add journald support ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-02-12 06:17:22 +00:00
Evgenii Stratonikov	805862f4b7	[#956] node: Allow to reload goroutine pool sizes ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 15:49:43 +00:00
Evgenii Stratonikov	426cf58b98	[#956] node: Remove pool sizes from config struct ... They are available through the pool methods and unused outside of the function that sets them. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-02-08 15:49:43 +00:00
Airat Arifullin	5be2af881a	[#934] container: Make container APE middleware read namespaces ... * Those methods that can access already existing containers and thus can get container properties should read namespace from Zone property. If Zone is not set, take a namespace for root. * Otherwise, define namespaces by owner ID via frostfs-id contract. * Improve unit-tests, consider more cases. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-02-01 17:38:24 +00:00
Anton Nikiforov	e3573de6db	[#930] gc: Stop internal activity by context ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-01-31 08:30:34 +00:00
Airat Arifullin	1fe7736d92	[#925] morph: Introduce switch rpc guarded rpc actor ... * Introduce switch rpc guarded rpc actor in morph client to prevent using invalidated rpc actor when RPC switch happens. * Initialize NewContractStorage with SwitchRPCGuardedActor. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-01-25 13:24:13 +00:00
Dmitrii Stepanov	8180a0664f	[#887] node: Drop badger writecache implementation ... Badger implementation isn't tested and works not well, but requires human resources to maintain. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-22 13:00:54 +03:00
Dmitrii Stepanov	d69d318cb0	[#878] node: Drain internal error's channel ... This fixes shutdown panic: 1. Some morph connection gets error and passes it to internalErr channel. 2. Storage node starts to shutdow and closes internalErr channel. 3. Other morph connection gets error and tries to pass it to internalErr channel. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-19 16:38:03 +00:00
Anton Nikiforov	d9cbb16bd3	[#866] Use TTL for blobovnicza tree cache ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-12-19 16:36:28 +00:00
Airat Arifullin	7d7cf05575	[#851] ape: Initialize and use policy contract interface ... * Replace inmemory policy contract mock by initialized policy contract interface. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-18 11:06:35 +00:00
Dmitrii Stepanov	61da7dca24	[#835] node: Fix appCfg concurrent access ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-14 16:38:59 +03:00
Dmitrii Stepanov	f4877e7b42	[#835] grpc: Try to reconnect if endpoint listen failed ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-14 16:38:59 +03:00
Ekaterina Lebedeva	ef07c1a3c9	[#552] Add sysd notifications to storage service ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 17:51:41 +03:00
Airat Arifullin	0f45e3d344	[#804] ape: Implement boltdb storage for local overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-07 19:08:41 +03:00
Dmitrii Stepanov	db49ad16cc	[#826] blobovniczatree: Do not create DB's on init ... Blobovniczas will be created on write requests. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	8bbfb2df43	[#661] blobovniczatree: Pass object size limit from config ... If actual small object size value lower than default object size limit, then unnecessary buckets created. If actual small object size value greated than default object size limit, then error happens. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	f1c7905263	[#661] blobovniczatree: Make Rebuild concurrent ... Different DBs can be rebuild concurrently. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	da4fee2d0b	[#698] blobovniczatree: Init blobovniczas concurrently ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	07390ad4e3	[#715] node: Unify config parameter names ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-22 17:13:50 +03:00
Dmitrii Stepanov	29fe8c41f3	[#655] storage: Drop `ErrorHandler` ... The only one usage was for logging. Now logging performed by storage anyway. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-16 17:27:38 +03:00
Alexander Chuprov	364f835b7e	[#740] logs: Add Loki ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2023-11-14 19:01:05 +00:00
Airat Arifullin	5ec73fe8a0	[#770] node: Introduce ape chain source ... * Provide methods to access rule chains with access policy engine (APE) chain source * Initialize apeChainSource within object service initialization * Share apeChainSource with control service * Implement dummy apeChainSource instance based on in-memory implementation Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-08 13:34:03 +00:00
Dmitrii Stepanov	c7a7229484	[#764] metrics: Fix epoch metric ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-01 10:57:31 +00:00
Dmitrii Stepanov	c80b46fad3	[#754] blobstor: Estimate compressability ... Now it is possible to enable compressability estimation. If data is likely uncompressable, it should reduce CPU time and memory. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-01 11:24:32 +03:00
Anton Nikiforov	b0cf100427	[#49] node: React on SIGHUP only when node in READY state ... Add more info in logs when node is going to shut down, but initialization process still in progress. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-10-24 15:55:29 +00:00
Anton Nikiforov	3a997d1207	[#680] metrics: Initialize log metrics together with services ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-10-11 17:08:03 +03:00
Dmitrii Stepanov	bd5bf8b1a9	[#721] netmap: Drop already bootstraped check ... Because of this check, under certain conditions, the node could be removed from the network map, although the node was functioning normally. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-10-05 11:47:06 +03:00
Ekaterina Lebedeva	8a81af5a3b	[#653] Add context parameter to Open functions ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-09-07 18:03:29 +03:00
Dmitrii Stepanov	ae81d6660a	[#529] objectcore: Fix object content validation ... There are old objects where the owner of the object may not match the one who issued the token. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-29 10:33:06 +03:00
Dmitrii Stepanov	354a92ea2c	[#602] blobovnicza: Add leaf width implementation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-21 10:27:32 +03:00
Dmitrii Stepanov	d3904ec599	[#602] config: Add blobovnicza leaf width parameter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-21 10:27:32 +03:00
Anton Nikiforov	4ad0ebb32f	[#565] Add metrics for current GRPC endpoint status ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-08-10 16:37:49 +00:00
Alejandro Lopez	ae322e9f73	[#576] Set SyncWrites for badger writecache by default ... Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>	2023-08-09 11:28:26 +03:00
Evgenii Stratonikov	d3a52ec73a	[#516] node: Send bootstrap request if attributes were updated ... Consider following situation: 1. Epoch tick. 2. Update node attributes in the config. 3. Restart node. Because we already sent bootstrap query after (1) and we are still online, new bootstrap query won't be sent. This leads to the node attributes being updated after another epoch. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-08 07:40:26 +00:00
Alejandro Lopez	5bbfebba2d	[#570] Fix writecache type constant copy-pasta bug ... Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>	2023-08-07 12:06:44 +03:00
Alejandro Lopez	1a0cb0f34a	[#421] Try using badger for the write-cache ... Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>	2023-08-07 08:16:57 +00:00
Dmitrii Stepanov	32c77f3a23	[#537] node: Add runtime.memory_limit config parameter ... This parameter allows to set soft memory limit for Go GC. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-25 17:27:09 +03:00
Evgenii Stratonikov	fef172c5b0	[#6] services/util: Simplify `response.Service` ... It has only 1 parameter, which is obligatory. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-07-21 18:29:57 +03:00
Dmitrii Stepanov	f0355a453e	[#463] policer: Remove capacity rebalance logic ... Current implementation has some quirks. For example, using only half of object.put.pool_size_remote threads tells replicator that is node is 50% loaded, but in reality we could be putting lot's of big objects. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-18 10:52:12 +00:00
Dmitrii Stepanov	b2487e8cc5	[#516] node: Do not bootstrap if node is online candidate ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-18 10:51:02 +00:00