58 commits

Author	SHA1	Message	Date
Dmitrii Stepanov	394f086fe2	[#891] getSvc: Fix get range hash implementation ... Get range can perform GET request, so this request must be done from container node to not to get access denied error. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-12 13:35:38 +03:00
Dmitrii Stepanov	4b8b4da681	[#864] engine: Drop container count metric if container removed ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-10 10:45:32 +03:00
Dmitrii Stepanov	d75e7e9a21	[#864] engine: Drop container size metric if container deleted ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2024-01-10 10:44:54 +03:00
Dmitrii Stepanov	8180a0664f	[#887] node: Drop badger writecache implementation ... Badger implementation isn't tested and works not well, but requires human resources to maintain. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-22 13:00:54 +03:00
Dmitrii Stepanov	f4877e7b42	[#835] grpc: Try to reconnect if endpoint listen failed ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-14 16:38:59 +03:00
Ekaterina Lebedeva	9b2dce5763	[#552] Add status notification to systemd ... Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>	2023-12-13 15:02:39 +03:00
Dmitrii Stepanov	3b7c0362a8	[#861] shard: Fix Delete object ... It is possible that object doesn't exist in metabase. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-12 14:25:40 +03:00
Dmitrii Stepanov	d5c9dd3c83	[#852] ape: Use first match for eACL->APE converter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-11 16:55:32 +03:00
aarifullin	0f45e3d344	[#804] ape: Implement boltdb storage for local overrides ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-12-07 19:08:41 +03:00
Dmitrii Stepanov	e54dc3dc7c	[#698] blobovnicza: Store counter values ... Blobovnicza initialization take a long time because of bucket Stat() call. So now blobovnicza stores counters in META bucket. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	b2769ca3de	[#661] blobovniczatree: Make Rebuild failover safe ... Now move info stores in blobovnicza, so in case of failover rebuild completes previous operation first. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:33 +03:00
Dmitrii Stepanov	422226da18	[#661] blobovniczatree: Add Rebuild implementation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:32 +03:00
Dmitrii Stepanov	a531eaf8bc	[#661] blobstor: Add Rebuild implementation ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:32 +03:00
Dmitrii Stepanov	484eb59893	[#661] blobovniczatree: Use .db extension for db files ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:32 +03:00
Dmitrii Stepanov	44552a849b	[#661] shard: Add blobstor rebuilder ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-12-07 15:37:32 +03:00
Dmitrii Stepanov	26e4f7005c	[#741] treesvc: Refactor tree sync ... Fix linter issues. Add error logging. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-30 12:45:02 +00:00
Dmitrii Stepanov	b215817e14	[#741] treesvc: Remove unused height variables ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-30 12:45:02 +00:00
Dmitrii Stepanov	8d18fa159e	[#667] writecache: Fix flush test ... Allow to disable background flusher for testing purposes. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-17 17:45:43 +03:00
aarifullin	4d5be5ccb5	[#811] ape: Update policy-engine module version and rebase ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-11-16 11:31:37 +03:00
Dmitrii Stepanov	fd9128d051	[#800] node: eACL -> APE converter ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-15 11:55:55 +03:00
Dmitrii Stepanov	70ab1ebd54	[#763] metrics: Add container_objects_total metric ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-11-08 12:30:57 +03:00
Anton Nikiforov	b0cf100427	[#49] node: React on SIGHUP only when node in READY state ... Add more info in logs when node is going to shut down, but initialization process still in progress. Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-10-24 15:55:29 +00:00
Anton Nikiforov	627b302745	[#709] node: Put in log info about listening endpoints ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-10-02 13:31:10 +00:00
Evgenii Stratonikov	c6af4a3ec8	[#679] engine: Do not increase error counter on meta mismatch ... It was introduced in 69e1e6ca to help node determine faulty shards. However, the situation is possible in a real-life scenario: 1. Object O is evacuated from shard A to B. 2. Shard A is unmounted because of lower-level errors. 3. We now have object in meta on A and in blobstor on B. Technically we have it in meta on shard B too, but we still got the error if B goes to a degraded mode. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-09-14 10:39:18 +03:00
Anton Nikiforov	88d50e4c77	[#656] policer: Add "bad" testcase ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-09-06 08:04:59 +00:00
Dmitrii Stepanov	c672f59ab8	[#536] blobovnicza: Drop cache ... Each blobovnicza instance is opened while is in use. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-09-01 13:51:26 +03:00
Anton Nikiforov	4dff9555f1	[#568] writecache: Improve flushing scheme for badger ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-08-30 17:22:28 +00:00
Airat Arifullin	4ea0df77d0	[#574] policer: Check if the container was really removed ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2023-08-28 14:21:38 +00:00
Evgenii Stratonikov	f8ba60aa0c	[#648] objsvc/delete: Handle errors in Go style ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-25 09:45:35 +00:00
Evgenii Stratonikov	d2084ece41	[#648] objsvc/delete: Remove redundant logs ... We never propagate delete requests to the container node, because tombstone broadcast is done via PUT. No need to pollute logs. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-25 09:45:35 +00:00
Airat Arifullin	23be3eb627	[#574] tree: Check if container is really removed ... * Use DeletionInfo method from morph client to check if the container has been really removed from neo-go Signed-off-by: Airat Arifullin a.arifullin@yadro.com	2023-08-21 12:50:20 +03:00
Evgenii Stratonikov	62c2ad4b22	[#626] logs: Remove autogenerated comments ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-21 11:15:06 +03:00
Dmitrii Stepanov	eec97d177e	[#585] writecache: Count items periodically ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-08-16 14:47:44 +03:00
Alexander Chuprov	21800e9fcc	[#162] core: Move literals to constants ... Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>	2023-08-11 15:48:42 +03:00
Evgenii Stratonikov	32a9f51586	[#562] logs: Remove superfluous comment ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-08-10 16:38:43 +00:00
Alejandro Lopez	1a0cb0f34a	[#421] Try using badger for the write-cache ... Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>	2023-08-07 08:16:57 +00:00
Dmitrii Stepanov	32c77f3a23	[#537] node: Add runtime.memory_limit config parameter ... This parameter allows to set soft memory limit for Go GC. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-25 17:27:09 +03:00
Dmitrii Stepanov	f0355a453e	[#463] policer: Remove capacity rebalance logic ... Current implementation has some quirks. For example, using only half of object.put.pool_size_remote threads tells replicator that is node is 50% loaded, but in reality we could be putting lot's of big objects. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-18 10:52:12 +00:00
Dmitrii Stepanov	b2487e8cc5	[#516] node: Do not bootstrap if node is online candidate ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-07-18 10:51:02 +00:00
Dmitrii Stepanov	01a0c97760	[#453] engine: Set Disabled mode to deleted shard ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-06-20 12:04:07 +03:00
Dmitrii Stepanov	4f83ab0fb4	[#409] node: Do not sent initial bootstrap under maintenance ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-06-13 10:02:36 +00:00
Airat Arifullin	a3e30062df	[#325] node: Introduce unsafe_disable param to disable policer ... Signed-off-by: Airat Arifullin a.arifullin@yadro.com	2023-05-31 10:09:05 +00:00
Dmitrii Stepanov	2613351008	[#387] gc: Cancel GC is change mode requested ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-05-25 09:38:16 +03:00
Dmitrii Stepanov	e4889e06ba	[#329] node: Make evacuate async ... Now it's possible to run evacuate shard in async. Also only one evacuate process can be in progress. Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-05-19 08:43:52 +00:00
Anton Nikiforov	6f47c75e43	[#125] ir: Set extra wallets on SIGHUP ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-05-16 12:47:43 +00:00
Dmitrii Stepanov	869fcbf591	[#332] gc: Fix expired complex object deletion ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-05-16 12:44:57 +00:00
Roman Khimov	a5f118a987	[#337] subscriber: Drop unused UnsubscribeForNotification ... It's not really needed, closing the connection works fine when exiting and normally the app doesn't need to unsubscribe at all. Signed-off-by: Roman Khimov <roman@nspcc.ru> Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2023-05-12 09:19:38 +00:00
Dmitrii Stepanov	a181c9e434	[#332] gc: Add additional logging ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-05-10 17:34:40 +03:00
Anton Nikiforov	cedd07bbc8	[#304] morph: Iterate endpoints when create ws client in constructor ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2023-05-05 10:07:30 +03:00
Dmitrii Stepanov	eca5c210dd	[#299] evacuate: Add context cancel checks ... Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>	2023-05-02 15:55:30 +03:00