dstepanov-yadro/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
4841 commits 260 branches 26 tags 23 MiB
Commit graph

81 commits

Author SHA1 Message Date
Dmitrii Stepanov
81df490709 [#1273] writecache: Flush writecache concurrently 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-07-24 14:17:52 +03:00
Dmitrii Stepanov
c180795f9b [#1273] writecache: Make writecache as FSTree only 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-07-24 14:17:31 +03:00
Dmitrii Stepanov
fc383ea6ae [#1253] getSvc: Fix EC objects get 
Now EC objects assembling is performed concurrently.
Also fixed issue with an error in case of getting
EC object via non-container node.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-07-17 14:24:27 +03:00
Anton Nikiforov
3bf6e6dde6 [#1238] engine: Add non-blocking send in the shard's notification channel 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-07-10 11:37:11 +03:00
Dmitrii Stepanov
62cbb72a5e [#1226] blobovniczatree: Delete fix db extensions in Init() 
Since several releases have been released, this code is not relevant.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-07-04 12:22:06 +03:00
Anton Nikiforov
bbe95dac8b [#1225] engine: Log the error when check object existence 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-07-04 07:22:54 +00:00
Evgenii Stratonikov
91bed3b0ba [#1219] Remove Container.SetEACL method 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-02 13:05:40 +00:00
Ekaterina Lebedeva
56eeb630b6 [#1217] Fix grammar mistakes and misspelling 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-07-01 19:14:25 +03:00
Anton Nikiforov
9ac74efc41 [#1173] shard: Use mode from config on reload 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-06-20 11:29:10 +00:00
Dmitrii Stepanov
ac1f014747 [#1184] node: Add audit package 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-06-19 16:05:53 +03:00
Evgenii Stratonikov
a849236b68 [#1161] node: Remove notification functionality 
It is unused and will be reworked in future.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-06-07 12:10:51 +00:00
Anton Nikiforov
6130650bb6 [#1147] node: Implement Lock\Delete requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-05-30 08:13:04 +00:00
Dmitrii Stepanov
436c9f5558 [#1129] policer: Restore EC object 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-17 14:36:18 +03:00
Dmitrii Stepanov
cbe9757490 [#1129] policer: Pull required EC chunks 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-16 16:28:49 +03:00
Dmitrii Stepanov
d45d086acd [#1129] policer: Add EC chunk replication 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-16 16:28:48 +03:00
Alexander Chuprov
854200a874 [#1115] node: Remove unused const 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-05-07 19:11:21 +03:00
Anton Nikiforov
112a7c690f [#1103] node: Implement Get\Head requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-24 18:15:53 +03:00
Evgenii Stratonikov
e5e0542482 [#1085] log: Move storage log message to constants package 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-15 07:57:00 +00:00
Dmitrii Stepanov
1b17258c04 [#1029] metabase: Add refill metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-04-10 13:05:44 +03:00
Dmitrii Stepanov
1c5e0f90aa [#1064] putsvc: Add EC put 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-04-09 07:08:53 +00:00
aarifullin
d1d53d2bb6 [#963] node: Add logging for waitNotaryDeposit 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-03-13 11:59:51 +03:00
aarifullin
7a4b6057ce Revert "[#963] node: Go on initialization even deposit notary is hung" 
This reverts commit b4cb54e7ed.

Signed-off-by: aarifullin <a.arifullin@yadro.com>
 2024-03-13 11:53:59 +03:00
Airat Arifullin
b4cb54e7ed [#963] node: Go on initialization even deposit notary is hung 
* Make makeAndWaitNotaryDeposit run asynchronously as worker
  during application boot-up.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-03-12 10:18:07 +00:00
Dmitrii Stepanov
7470c383dd [#997] metabase: Drop toMoveIt bucket 
It is not used.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-21 10:06:05 +03:00
Dmitrii Stepanov
db67c21d55 [#947] engine: Evacuate trees to remote nodes 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-09 11:33:15 +03:00
Evgenii Stratonikov
805862f4b7 [#956] node: Allow to reload goroutine pool sizes 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-02-08 15:49:43 +00:00
Anton Nikiforov
e3573de6db [#930] gc: Stop internal activity by context 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-01-31 08:30:34 +00:00
Dmitrii Stepanov
931a5e9aaf [#918] engine: Move shard to degraded mode if metabase open failed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-23 11:16:40 +03:00
Dmitrii Stepanov
394f086fe2 [#891] getSvc: Fix get range hash implementation 
Get range can perform GET request, so this request must be done
from container node to not to get access denied error.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-12 13:35:38 +03:00
Dmitrii Stepanov
4b8b4da681 [#864] engine: Drop container count metric if container removed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-10 10:45:32 +03:00
Dmitrii Stepanov
d75e7e9a21 [#864] engine: Drop container size metric if container deleted 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-10 10:44:54 +03:00
Dmitrii Stepanov
8180a0664f [#887] node: Drop badger writecache implementation 
Badger implementation isn't tested and works not well,
but requires human resources to maintain.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-22 13:00:54 +03:00
Dmitrii Stepanov
f4877e7b42 [#835] grpc: Try to reconnect if endpoint listen failed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-14 16:38:59 +03:00
Ekaterina Lebedeva
9b2dce5763 [#552] Add status notification to systemd 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2023-12-13 15:02:39 +03:00
Dmitrii Stepanov
3b7c0362a8 [#861] shard: Fix Delete object 
It is possible that object doesn't exist in metabase.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 14:25:40 +03:00
aarifullin
0f45e3d344 [#804] ape: Implement boltdb storage for local overrides 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-07 19:08:41 +03:00
Dmitrii Stepanov
e54dc3dc7c [#698] blobovnicza: Store counter values 
Blobovnicza initialization take a long time because of bucket
Stat() call. So now blobovnicza stores counters in META bucket.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov
b2769ca3de [#661] blobovniczatree: Make Rebuild failover safe 
Now move info stores in blobovnicza, so in case of failover
rebuild completes previous operation first.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov
422226da18 [#661] blobovniczatree: Add Rebuild implementation 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:32 +03:00
Dmitrii Stepanov
a531eaf8bc [#661] blobstor: Add Rebuild implementation 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:32 +03:00
Dmitrii Stepanov
484eb59893 [#661] blobovniczatree: Use .db extension for db files 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:32 +03:00
Dmitrii Stepanov
44552a849b [#661] shard: Add blobstor rebuilder 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:32 +03:00
Dmitrii Stepanov
26e4f7005c [#741] treesvc: Refactor tree sync 
Fix linter issues.
Add error logging.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-30 12:45:02 +00:00
Dmitrii Stepanov
b215817e14 [#741] treesvc: Remove unused height variables 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-30 12:45:02 +00:00
Dmitrii Stepanov
8d18fa159e [#667] writecache: Fix flush test 
Allow to disable background flusher for testing purposes.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-17 17:45:43 +03:00
Dmitrii Stepanov
70ab1ebd54 [#763] metrics: Add container_objects_total metric 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-08 12:30:57 +03:00
Anton Nikiforov
b0cf100427 [#49] node: React on SIGHUP only when node in READY state 
Add more info in logs when node is going to shut down,
but initialization process still in progress.

Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-10-24 15:55:29 +00:00
Anton Nikiforov
627b302745 [#709] node: Put in log info about listening endpoints 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-10-02 13:31:10 +00:00
Evgenii Stratonikov
c6af4a3ec8 [#679] engine: Do not increase error counter on meta mismatch 
It was introduced in 69e1e6ca to help node determine faulty shards.
However, the situation is possible in a real-life scenario:
1. Object O is evacuated from shard A to B.
2. Shard A is unmounted because of lower-level errors.
3. We now have object in meta on A and in blobstor on B. Technically we
   have it in meta on shard B too, but we still got the error if B goes
   to a degraded mode.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-14 10:39:18 +03:00
Anton Nikiforov
88d50e4c77 [#656] policer: Add "bad" testcase 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-09-06 08:04:59 +00:00