Take objects from the different shard by `Policer` #19

New Issue

Closed

opened 2023-01-18 15:42:02 +00:00 by carpawell · 1 comment

carpawell commented

2023-01-18 15:42:02 +00:00

(Migrated from github.com)

Policer takes objects from the shards one by one and replicates them if needed.

I believe that requesting 200 objects from one shard (== one disk usually) could be slower and less predictable than e.g. requesting 4x50 objects from the 4 different shards (that also could be fetched by 4 different goroutines). I also saw strange disk IOs that could be interpreted as that issue proof (but that should be rechecked for sure):

`Policer` takes objects from the shards [one by one](https://github.com/TrueCloudLab/frostfs-node/blob/d4d2a8c8651cdd4da62571bb86bcbc019e3b48ae/pkg/local_object_storage/engine/list.go#L65-L85) and replicates them if needed. I believe that requesting 200 objects from one shard (== one disk usually) could be slower and less predictable than e.g. requesting 4x50 objects from the 4 different shards (that also could be fetched by 4 different goroutines). I also saw strange disk IOs that could be interpreted as that issue proof (but that should be rechecked for sure): ![image](https://user-images.githubusercontent.com/24619368/213216299-04c7668e-16f8-41c3-b8b6-28f2bc9b9b2e.png)