frostfs-node/pkg/local_object_storage/pilorama
Evgenii Stratonikov 58367e4df6 [#2232] pilorama: Merge in-queue batches
To achieve high performance we must choose proper values for both
batch size and delay. For user operations we want to set low delay.
However it would prevent tree synchronization operations to form big
enough batches. For these operations, batching gives the most benefit
not only in terms of on-CPU execution cost, but also by speeding up
transaction persist (`fsync`).
In this commit we try merging batches that are already
_triggered_, but not yet _started to execute_. This way we can still
query batches for execution after the provided delay while also allowing
multiple formed batches to execute faster.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
2023-02-20 13:53:27 +03:00
..
batch.go [#2232] pilorama: Merge in-queue batches 2023-02-20 13:53:27 +03:00
boltdb.go [#2232] pilorama: Merge in-queue batches 2023-02-20 13:53:27 +03:00
forest.go [#28] pilorama: Remove LogMove struct 2023-01-25 15:31:47 +03:00
forest_test.go [#1621] pilorama: Batch related operations 2023-01-25 15:31:47 +03:00
generic_test.go Move to frostfs-node 2022-12-28 15:04:29 +03:00
info.go [#1333] services/control: Return pilorama info in ListShards RPC 2022-07-21 15:08:24 +03:00
inmemory.go [#2210] pilorama: Reduce the amount of keys per node 2023-01-25 15:31:47 +03:00
interface.go [#28] pilorama: Remove LogMove struct 2023-01-25 15:31:47 +03:00
meta.go [#1444] pilorama: Optimize internal encoding/decoding 2022-07-21 15:08:24 +03:00
meta_test.go [#1698] pilorama: Add a test for the empty FileName 2022-08-30 16:52:51 +03:00
option.go [#1505] pilorama: Allow to customize database parameters 2022-07-21 15:08:24 +03:00
types.go [#28] pilorama: Remove LogMove struct 2023-01-25 15:31:47 +03:00
util.go [#1442] pilorama: Generate timestamp based on node position in the container 2022-07-21 15:08:24 +03:00
util_test.go [#1442] pilorama: Generate timestamp based on node position in the container 2022-07-21 15:08:24 +03:00