TrueCloudLab/frostfs-node

Fork 27

Node start process very depends from amount of data in blobovniczas #698

New issue

Closed

opened 2023-09-20 09:21:57 +00:00 by anikeev-yadro · 1 comment

anikeev-yadro commented

2023-09-20 09:21:57 +00:00

Member

Expected Behavior

We need to make node start time as least as possible.

Current Behavior

If system filled by 7% node start process takes 17min.
If system filled by 10% node start process takes 35min.
The following step (opening blobovnicaz) takes the longest time:

sep 19 15:01:45 heavymetal-node3 frostfs-node[902889]: 2023-09-19T15:01:45.110Z        info        frostfs-node/main.go:77        storage engine service has been successfully initialized
sep 19 14:32:38 heavymetal-node3 frostfs-node[902889]: 2023-09-19T14:32:38.053Z        info        frostfs-node/main.go:75        initializing storage engine service...

At the moment if we fill system to 80-90% start node takes a huge time.

Version

FrostFS Storage node
Version: v0.0.1-900-g58239d1b
GoVersion: go1.20.5

Your Environment

## Expected Behavior We need to make node start time as least as possible. ## Current Behavior If system filled by 7% node start process takes 17min. If system filled by 10% node start process takes 35min. The following step (opening blobovnicaz) takes the longest time: ``` sep 19 15:01:45 heavymetal-node3 frostfs-node[902889]: 2023-09-19T15:01:45.110Z info frostfs-node/main.go:77 storage engine service has been successfully initialized sep 19 14:32:38 heavymetal-node3 frostfs-node[902889]: 2023-09-19T14:32:38.053Z info frostfs-node/main.go:75 initializing storage engine service... ``` At the moment if we fill system to 80-90% start node takes a huge time. ## Version ``` FrostFS Storage node Version: v0.0.1-900-g58239d1b GoVersion: go1.20.5 ``` ## Your Environment HW

anikeev-yadro added the

bug

triage

labels 2023-09-20 09:21:57 +00:00

anikeev-yadro changed title from ~~Node start process very depends from size of data in blobovnicaz~~ to Node start process very depends from amount of data in blobovnicaz

2023-09-20 09:22:09 +00:00

dstepanov-yadro self-assigned this 2023-09-22 13:51:37 +00:00

dstepanov-yadro referenced this issue

2023-09-22 14:12:02 +00:00

Blobovnicza tree rebuild (support) #703

fyrchik added

frostfs-node

and removed

triage

labels 2023-10-02 10:43:55 +00:00

fyrchik commented

2023-10-02 10:46:26 +00:00

Owner

We can parallelize this on a blobovnicza level (already parallelized on shard level).
Also, let's check how much does it take to open a very huge db. It may be beneficial first opening it in readonly (See 1105f7573e/db.go (L80) , but this needs investigation).

We can parallelize this on a blobovnicza level (already parallelized on shard level). Also, let's check how much does it take to open a very huge db. It may be beneficial first opening it in readonly (See https://github.com/etcd-io/bbolt/blob/1105f7573e24e27d3e066bd6af3fac1cee67a538/db.go#L80 , but this needs investigation).

fyrchik added this to the v0.38.0 milestone 2023-10-02 12:46:03 +00:00

fyrchik changed title from ~~Node start process very depends from amount of data in blobovnicaz~~ to Node start process very depends from amount of data in blobovniczas

2023-10-02 12:46:09 +00:00

dstepanov-yadro referenced this issue from a pull request that will close it,

2023-11-16 09:00:40 +00:00

Blobovnicza tree rebuild #812

fyrchik referenced this issue from a commit

2023-12-07 13:15:54 +00:00

[#698] blobovniczatree: Init blobovniczas concurrently

fyrchik referenced this issue from a commit

2023-12-07 13:15:55 +00:00

[#698] blobovnicza: Store counter values

fyrchik referenced this issue from a commit

2023-12-07 13:16:07 +00:00