TrueCloudLab/frostfs-api

Add other checksum types #11

New issue

Open

opened 2023-02-24 14:21:17 +00:00 by fyrchik · 2 comments

fyrchik commented

2023-02-24 14:21:17 +00:00

(Migrated from github.com)

We can set it on client, sha256 is still supported.

SHA-512 seems somewhat faster on 64-bit processors:

name                 old time/op    new time/op    delta
Transformer/small-8    72.4µs ±16%    68.4µs ±12%     ~     (p=0.156 n=9+10)
Transformer/big-8       1.36s ± 8%     0.96s ± 6%  -29.27%  (p=0.000 n=10+10)

We could benchmark, and, if it makes sense, support another checksum.

We can set it on client, sha256 is still supported. SHA-512 seems somewhat faster on 64-bit processors: ``` name old time/op new time/op delta Transformer/small-8 72.4µs ±16% 68.4µs ±12% ~ (p=0.156 n=9+10) Transformer/big-8 1.36s ± 8% 0.96s ± 6% -29.27% (p=0.000 n=10+10) ``` We could benchmark, and, if it makes sense, support another checksum.

realloc added this to the v2.17 - Zemu Glacier milestone 2023-03-23 13:22:50 +00:00

snegurochka added the

label 2023-05-03 17:14:56 +00:00

fyrchik commented

2023-06-25 10:44:12 +00:00

Owner

In this task let's do some research and benchmarks on a hardware.
BLAKE* is another candidate.

In this task let's do some research and benchmarks on a hardware. BLAKE* is another candidate.

realloc commented

2023-09-04 10:49:56 +00:00

Owner

It would be nice to use container attribute to determine required hashing algorithm for each new object.

It would be nice to use container attribute to determine required hashing algorithm for each new object.

fyrchik was assigned by realloc

2023-09-04 10:51:09 +00:00

Sign in to join this conversation.

No labels

good first issue

No milestone

No project

No assignees

3 participants

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: TrueCloudLab/frostfs-api#11

No description provided.