TrueCloudLab/frostfs-sdk-go
29
0
Fork 21
Code Issues 29 Pull requests 2 Releases Activity Actions
544 commits 4 branches 0 tags 9.3 MiB
Commit graph

56 commits

Author SHA1 Message Date
Evgenii Stratonikov
7c75db2f2d [#59] netmap: Remove unused param from getSelection() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-18 14:11:04 +00:00
Pavel Karpy
d0c5d837d2 [#56] *: Drop reputation system 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-04-18 07:52:16 +00:00
Dmitrii Stepanov
c8e620ad24 [#53] sdk-go: Drop subnet 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-14 16:31:08 +03:00
Evgenii Stratonikov
31271ad8b1 [#47] netmap: Make PlacementPolicy.WriteStringTo() pass nofunlen, cogognit 
REP statement is obligatory, thus insert newline before each statement
after REP.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-07 08:59:19 +03:00
Evgenii Stratonikov
708d933fe3 [#47] .golangci.yml: Unify with other FrostFS repos 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-07 08:59:19 +03:00
Denis Kirillov
df2090c2be [#37] netmap: Update tests for new sys attributes 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-16 11:14:36 +03:00
Evgenii Stratonikov
b761fd8070 [#23] pre-commit: Add initial configuration 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-03-09 22:52:51 +03:00
Alex Vanin
94476f9055 Rename package name 
Due to source code relocation from GitHub.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-07 15:47:21 +03:00
Anton Nikiforov
d4f5bba459 [#2] Update lint config, fix lint errors 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-03-01 10:29:23 +03:00
Dmitrii Stepanov
e9c1a2ab2b [TrueCloudLab/hrw#2] sdk-go: Optimize node hash 
Compute node hash by node initialization

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-02-28 18:07:14 +03:00
Dmitrii Stepanov
2cbc585edd [TrueCloudLab/hrw#2] sdk-go: Use typed HRW methods 
Update HRW pkg and use typed HRW methods to sort nodes

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-02-28 18:07:14 +03:00
Evgenii Stratonikov
4ff9c00de3 [#4] Rename NeoFS mentions in comments and method names 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 13:40:50 +03:00
Evgenii Stratonikov
b204a62da1 [#4] go.mod: Update ANTLR 
Current `go:generate` command was, probably, executed only on my laptop.
Replace it with explicit version, because package in the generated code
depends on in.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 13:40:50 +03:00
Pavel Karpy
4c779423f5 Move to frostfs-sdk-go 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-14 09:59:29 +03:00
Evgenii Stratonikov
da4ddcf337 [#353] netmap: Get rid of ioutil 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-10-19 12:05:49 +04:00
Anton Nikiforov
21eef1ae7f [#351] Add StringifyPublicKey method for NodeInfo 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-10-13 10:27:18 +03:00
Evgenii Stratonikov
c6576c8112 [#344] netmap: Support ExternalAddr well-known attribute 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-26 13:28:39 +03:00
Leonard Lyubich
664392afc2 [#312] netmap: Support NetmapService.NetmapSnapshot RPC 
Extend functionality of `NetMap` type. Add `NetMapSnapshot` operation to
`client` package.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-09-22 10:51:07 +04:00
Evgenii Stratonikov
3d6b5d807b [#315] netmap: Add maintenance node state 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-19 16:49:27 +04:00
Evgenii Stratonikov
3dad44232e [#315] netmap: Add maintenance mode network setting 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-19 16:49:27 +04:00
Evgenii Stratonikov
1929b634a1 [#332] netmap/parser: Disallow trailing garbage 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-12 10:45:37 +03:00
Evgenii Stratonikov
84888854ab [#322] *: Go fmt -s 
go1.19 rewrites comments to proper render them in docs.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-08-24 18:58:59 +03:00
Pavel Karpy
0cd790cfe0 [#240] netmap: Support HomomorphicHashingDisabled network config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-07-05 15:37:49 +03:00
Leonard Lyubich
ab4d1e34a8 [#280] policy: Use policyVisitor as ErrorListener for QueryLexer 
Share `policyVisitor` instance as an `ErrorListener` provider for both
`QueryLexer` and `Query`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-28 14:47:22 +03:00
Leonard Lyubich
dea3d9c419 [#280] policy: Remove error listeners from query lexer 
In previous implementation `PlacementPolicy.DecodeString` produced
undesired console logs.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-28 14:47:22 +03:00
Evgenii Stratonikov
af7e20073b [#277] netmap: Allow more uint64 config values 
NEO VM uses little-endian format for integers,
however the resulting byte slice can contain less than 8 bytes.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-22 15:51:36 +03:00
Leonard Lyubich
e986f47807 [#227] netmap: Add more encoding methods for PlacementPolicy 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-16 11:23:21 +03:00
Leonard Lyubich
e999fb00c3 [#227] netmap: Remove unnecessary unit tests 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-16 11:23:21 +03:00
Leonard Lyubich
d51a324147 [#227] netmap: Clarify some fields of PlacementPolicy 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
d648b86776 [#227] netmap: Fix minor blots in documentation/code 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
ca523f1ff1 [#227] netmap: Refactor and document package functionality 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
5bfdb64251 [#227] netmap: Do not export bucket weight calculator 
`GetBucketWeight` is not usable outside placement context.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
86bdc670d5 [#227] netmap: Do not export default weightFunc initializer 
`GetDefaultWeightFunc` is not usable outside placement context.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
6796b4a29a [#227] netmap: Remove unused aggregators and normalizers 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
723ba5ee45 [#227] netmap: Do not use intermediate types for placement 
Support preprocessing within the `NodeInfo` type. Provide methods for
placement directly from the `NodeInfo` type. Returns slice of slices of
`NodeInfo` from placement methods of `Netmap`. Remove no longer needed
`Node` and `Nodes` types.

```
name            old time/op    new time/op    delta
ManySelects-12    19.7µs ±14%    15.8µs ±15%  -19.70%  (p=0.000 n=20+20)

name            old alloc/op   new alloc/op   delta
ManySelects-12    8.65kB ± 0%    6.22kB ± 0%  -28.03%  (p=0.000 n=20+20)

name            old allocs/op  new allocs/op  delta
ManySelects-12      82.0 ± 0%      81.0 ± 0%   -1.22%  (p=0.000 n=20+20)
```

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
2b21146185 [#227] netmap/test: Assert source placement builder is pure for nodes 
`GetContainerNodes` / `GetPlacementVectors` must not mutate source slice
of nodes.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
9c47fca7c2 [#227] netmap: Pre-calculate resulting slice capacity in flattenNodes 
```
name           old time/op  new time/op  delta
ManySelects-12  17.5µs ±27%   15.5µs ±24%  -11.57%  (p=0.024 n=20+20)

name           old alloc/op  new alloc/op  delta
ManySelects-12  9.03kB ± 0%   8.65kB ± 0%  -4.25%  (p=0.000 n=20+20)

name           old allocs/op  new allocs/op  delta
ManySelects-12  86.0 ± 0%     82.0 ± 0%     -4.65%  (p=0.000 n=20+20)
```

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
a8fd2ef954 [#227] netmap: Benchmark JSON tests 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich
eb3b990812 [#210] subnet: Refactor and document package functionality 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 11:52:07 +03:00
Leonard Lyubich
6cb513c976 [#257] Upgrade NeoFS API Go module 
New version contains fix for `object.GetRangeResponse` message type.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-05-31 09:47:55 +03:00
Evgenii Stratonikov
1f7fe6864d [#229] netmap: make context private 
It isn't used anywhere outside of the package.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-05-25 11:02:51 +03:00
Alex Vanin
7d19718e1d [#168] netmap: Add simple selector benchmark 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-15 16:59:59 +03:00
Alex Vanin
cdcbaa1677 [#168] netmap: Replace pointer slices with non-pointer slices 
- []*Replica => []Replica
 - []*Selector => []Selector
 - []*Filter => []Filter
 - []*NetworkParameter => []NetworkParameter
 - []*Node => []Node

Also introduces `filter.id()`` function to store filters
in numCache map.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-15 16:59:59 +03:00
Evgenii Stratonikov
fa670ab57a *: Fix linter warnings 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-24 18:49:55 +03:00
Evgenii Stratonikov
ea5da31bd2 [#109] netmap: add 1 more test in JSON 
Move `PlacementPolicy_ProcessSelectors` test. It tests how good
nodes were grouped into buckets after selection, but we can still query
full results and check them.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-18 13:50:48 +03:00
Evgenii Stratonikov
feb40146b7 [#109] netmap: describe JSON test format 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-18 13:06:25 +03:00
Evgenii Stratonikov
2f446c8e42 [#109] netmap: convert tests to the json format 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-18 13:06:25 +03:00
Evgenii Stratonikov
3edaf9ecb6 netmap: sort buckets by HRW value 
If weights for some buckets are equal, result depends on the
initial positions of buckets in slice. Thus we sort buckets by value
using hash of the first node as a have for the whole bucket.
This is ok, because buckets are already sorted by HRW.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-28 15:59:35 +03:00
Evgenii Stratonikov
3d0df0d068 [#54] tests: unify test generator names 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-01 10:34:54 +03:00
Evgenii Stratonikov
279a5a1e0b [#80] netmap: process subnet in selection 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-26 15:52:08 +03:00