TrueCloudLab
/
frostfs-sdk-go
30
0
Fork 19
Code Issues 29 Pull Requests 3 Actions Releases Activity
558 Commits
3 Branches
0 Tags
8.1 MiB
Commit Graph

57 Commits (70f23dd1ea6d7e98eda9a67ac12e9e17ed13abf1)

Author SHA1 Message Date
Anton Nikiforov 9a072a8f49 [#68] Replace interface{} with any 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-15 17:21:49 +03:00
Evgenii Stratonikov 7c75db2f2d [#59] netmap: Remove unused param from getSelection() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-18 14:11:04 +00:00
Pavel Karpy d0c5d837d2 [#56] *: Drop reputation system 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-04-18 07:52:16 +00:00
Dmitrii Stepanov c8e620ad24 [#53] sdk-go: Drop subnet 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-14 16:31:08 +03:00
Evgenii Stratonikov 31271ad8b1 [#47] netmap: Make PlacementPolicy.WriteStringTo() pass nofunlen, cogognit 
REP statement is obligatory, thus insert newline before each statement
after REP.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-07 08:59:19 +03:00
Evgenii Stratonikov 708d933fe3 [#47] .golangci.yml: Unify with other FrostFS repos 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-07 08:59:19 +03:00
Denis Kirillov df2090c2be [#37] netmap: Update tests for new sys attributes 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-16 11:14:36 +03:00
Evgenii Stratonikov b761fd8070 [#23] pre-commit: Add initial configuration 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-03-09 22:52:51 +03:00
Alexey Vanin 94476f9055 Rename package name 
Due to source code relocation from GitHub.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-07 15:47:21 +03:00
Anton Nikiforov d4f5bba459 [#2] Update lint config, fix lint errors 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-03-01 10:29:23 +03:00
Dmitrii Stepanov e9c1a2ab2b [TrueCloudLab/hrw#2] sdk-go: Optimize node hash 
Compute node hash by node initialization

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-02-28 18:07:14 +03:00
Dmitrii Stepanov 2cbc585edd [TrueCloudLab/hrw#2] sdk-go: Use typed HRW methods 
Update HRW pkg and use typed HRW methods to sort nodes

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-02-28 18:07:14 +03:00
Evgenii Stratonikov 4ff9c00de3 [#4] Rename NeoFS mentions in comments and method names 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 13:40:50 +03:00
Evgenii Stratonikov b204a62da1 [#4] go.mod: Update ANTLR 
Current `go:generate` command was, probably, executed only on my laptop.
Replace it with explicit version, because package in the generated code
depends on in.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 13:40:50 +03:00
Pavel Karpy 4c779423f5 Move to frostfs-sdk-go 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-14 09:59:29 +03:00
Evgenii Stratonikov da4ddcf337 [#353] netmap: Get rid of `ioutil` 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-10-19 12:05:49 +04:00
Anton Nikiforov 21eef1ae7f [#351] Add StringifyPublicKey method for NodeInfo 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-10-13 10:27:18 +03:00
Evgenii Stratonikov c6576c8112 [#344] netmap: Support `ExternalAddr` well-known attribute 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-26 13:28:39 +03:00
Leonard Lyubich 664392afc2 [#312] netmap: Support `NetmapService.NetmapSnapshot` RPC 
Extend functionality of `NetMap` type. Add `NetMapSnapshot` operation to
`client` package.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-09-22 10:51:07 +04:00
Evgenii Stratonikov 3d6b5d807b [#315] netmap: Add maintenance node state 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-19 16:49:27 +04:00
Evgenii Stratonikov 3dad44232e [#315] netmap: Add maintenance mode network setting 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-19 16:49:27 +04:00
Evgenii Stratonikov 1929b634a1 [#332] netmap/parser: Disallow trailing garbage 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-09-12 10:45:37 +03:00
Evgenii Stratonikov 84888854ab [#322] *: Go fmt -s 
go1.19 rewrites comments to proper render them in docs.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-08-24 18:58:59 +03:00
Pavel Karpy 0cd790cfe0 [#240] netmap: Support `HomomorphicHashingDisabled` network config 
Signed-off-by: Pavel Karpy <carpawell@nspcc.ru>
 2022-07-05 15:37:49 +03:00
Leonard Lyubich ab4d1e34a8 [#280] policy: Use `policyVisitor` as `ErrorListener` for `QueryLexer` 
Share `policyVisitor` instance as an `ErrorListener` provider for both
`QueryLexer` and `Query`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-28 14:47:22 +03:00
Leonard Lyubich dea3d9c419 [#280] policy: Remove error listeners from query lexer 
In previous implementation `PlacementPolicy.DecodeString` produced
undesired console logs.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-28 14:47:22 +03:00
Evgenii Stratonikov af7e20073b [#277] netmap: Allow more uint64 config values 
NEO VM uses little-endian format for integers,
however the resulting byte slice can contain less than 8 bytes.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-06-22 15:51:36 +03:00
Leonard Lyubich e986f47807 [#227] netmap: Add more encoding methods for `PlacementPolicy` 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-16 11:23:21 +03:00
Leonard Lyubich e999fb00c3 [#227] netmap: Remove unnecessary unit tests 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-16 11:23:21 +03:00
Leonard Lyubich d51a324147 [#227] netmap: Clarify some fields of `PlacementPolicy` 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich d648b86776 [#227] netmap: Fix minor blots in documentation/code 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich ca523f1ff1 [#227] netmap: Refactor and document package functionality 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich 5bfdb64251 [#227] netmap: Do not export bucket weight calculator 
`GetBucketWeight` is not usable outside placement context.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich 86bdc670d5 [#227] netmap: Do not export default weightFunc initializer 
`GetDefaultWeightFunc` is not usable outside placement context.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich 6796b4a29a [#227] netmap: Remove unused aggregators and normalizers 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich 723ba5ee45 [#227] netmap: Do not use intermediate types for placement 
Support preprocessing within the `NodeInfo` type. Provide methods for
placement directly from the `NodeInfo` type. Returns slice of slices of
`NodeInfo` from placement methods of `Netmap`. Remove no longer needed
`Node` and `Nodes` types.

```
name            old time/op    new time/op    delta
ManySelects-12    19.7µs ±14%    15.8µs ±15%  -19.70%  (p=0.000 n=20+20)

name            old alloc/op   new alloc/op   delta
ManySelects-12    8.65kB ± 0%    6.22kB ± 0%  -28.03%  (p=0.000 n=20+20)

name            old allocs/op  new allocs/op  delta
ManySelects-12      82.0 ± 0%      81.0 ± 0%   -1.22%  (p=0.000 n=20+20)
```

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich 2b21146185 [#227] netmap/test: Assert source placement builder is pure for nodes 
`GetContainerNodes` / `GetPlacementVectors` must not mutate source slice
of nodes.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich 9c47fca7c2 [#227] netmap: Pre-calculate resulting slice capacity in `flattenNodes` 
```
name           old time/op  new time/op  delta
ManySelects-12  17.5µs ±27%   15.5µs ±24%  -11.57%  (p=0.024 n=20+20)

name           old alloc/op  new alloc/op  delta
ManySelects-12  9.03kB ± 0%   8.65kB ± 0%  -4.25%  (p=0.000 n=20+20)

name           old allocs/op  new allocs/op  delta
ManySelects-12  86.0 ± 0%     82.0 ± 0%     -4.65%  (p=0.000 n=20+20)
```

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich a8fd2ef954 [#227] netmap: Benchmark JSON tests 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 20:50:32 +03:00
Leonard Lyubich eb3b990812 [#210] subnet: Refactor and document package functionality 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-15 11:52:07 +03:00
Leonard Lyubich 6cb513c976 [#257] Upgrade NeoFS API Go module 
New version contains fix for `object.GetRangeResponse` message type.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-05-31 09:47:55 +03:00
Evgenii Stratonikov 1f7fe6864d [#229] netmap: make context private 
It isn't used anywhere outside of the package.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-05-25 11:02:51 +03:00
Alex Vanin 7d19718e1d [#168] netmap: Add simple selector benchmark 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-15 16:59:59 +03:00
Alex Vanin cdcbaa1677 [#168] netmap: Replace pointer slices with non-pointer slices 
- []*Replica => []Replica
 - []*Selector => []Selector
 - []*Filter => []Filter
 - []*NetworkParameter => []NetworkParameter
 - []*Node => []Node

Also introduces `filter.id()`` function to store filters
in numCache map.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-15 16:59:59 +03:00
Evgenii Stratonikov fa670ab57a *: Fix linter warnings 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-02-24 18:49:55 +03:00
Evgenii Stratonikov ea5da31bd2 [#109] netmap: add 1 more test in JSON 
Move `PlacementPolicy_ProcessSelectors` test. It tests how good
nodes were grouped into buckets after selection, but we can still query
full results and check them.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-18 13:50:48 +03:00
Evgenii Stratonikov feb40146b7 [#109] netmap: describe JSON test format 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-18 13:06:25 +03:00
Evgenii Stratonikov 2f446c8e42 [#109] netmap: convert tests to the json format 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-18 13:06:25 +03:00
Evgenii Stratonikov 3edaf9ecb6 netmap: sort buckets by HRW value 
If weights for some buckets are equal, result depends on the
initial positions of buckets in slice. Thus we sort buckets by value
using hash of the first node as a have for the whole bucket.
This is ok, because buckets are already sorted by HRW.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-28 15:59:35 +03:00
Evgenii Stratonikov 3d0df0d068 [#54] tests: unify test generator names 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-12-01 10:34:54 +03:00