a-savchuk/frostfs-sdk-go
1
0
Fork 0
forked from TrueCloudLab/frostfs-sdk-go
Code Pull requests Activity
723 commits 8 branches 0 tags 6.9 MiB
Commit graph

90 commits

Author SHA1 Message Date
Evgenii Stratonikov
159a50fcf0 [#236] netmap: Reduce allocations in getSelection() 
```
goos: linux
goarch: amd64
pkg: git.frostfs.info/TrueCloudLab/frostfs-sdk-go/netmap
cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz
                                                              │     new      │                alloc                 │
                                                              │    sec/op    │    sec/op     vs base                │
Netmap_ContainerNodes/REP_2-8                                   9.227µ ± 13%   8.677µ ±  6%        ~ (p=0.165 n=10)
Netmap_ContainerNodes/REP_2_IN_X_CBF_2_SELECT_2_FROM_*_AS_X-8   9.189µ ±  7%   7.946µ ± 14%  -13.53% (p=0.001 n=10)
geomean                                                         9.208µ         8.303µ         -9.82%

                                                              │     new      │                alloc                │
                                                              │     B/op     │     B/op      vs base               │
Netmap_ContainerNodes/REP_2-8                                   8.320Ki ± 0%   7.734Ki ± 0%  -7.04% (p=0.000 n=10)
Netmap_ContainerNodes/REP_2_IN_X_CBF_2_SELECT_2_FROM_*_AS_X-8   7.742Ki ± 0%   7.156Ki ± 0%  -7.57% (p=0.000 n=10)
geomean                                                         8.026Ki        7.440Ki       -7.31%

                                                              │     new     │               alloc                │
                                                              │  allocs/op  │ allocs/op   vs base                │
Netmap_ContainerNodes/REP_2-8                                   122.00 ± 0%   92.00 ± 0%  -24.59% (p=0.000 n=10)
Netmap_ContainerNodes/REP_2_IN_X_CBF_2_SELECT_2_FROM_*_AS_X-8   122.00 ± 0%   92.00 ± 0%  -24.59% (p=0.000 n=10)
geomean                                                          122.0        92.00       -24.59%
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-12 14:25:07 +03:00
Evgenii Stratonikov
a69f00903c [#236] netmap: Replace sort.Slice() with slices.Sort() 
```
goos: linux
goarch: amd64
pkg: git.frostfs.info/TrueCloudLab/frostfs-sdk-go/netmap
cpu: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz
                                                              │      old      │                 new                  │
                                                              │    sec/op     │    sec/op     vs base                │
Netmap_ContainerNodes/REP_2-8                                   10.395µ ± 14%   9.227µ ± 13%  -11.24% (p=0.015 n=10)
Netmap_ContainerNodes/REP_2_IN_X_CBF_2_SELECT_2_FROM_*_AS_X-8   10.110µ ± 16%   9.189µ ±  7%        ~ (p=0.105 n=10)
geomean                                                          10.25µ         9.208µ        -10.18%

                                                              │     old      │                 new                 │
                                                              │     B/op     │     B/op      vs base               │
Netmap_ContainerNodes/REP_2-8                                   8.695Ki ± 0%   8.320Ki ± 0%  -4.31% (p=0.000 n=10)
Netmap_ContainerNodes/REP_2_IN_X_CBF_2_SELECT_2_FROM_*_AS_X-8   8.117Ki ± 0%   7.742Ki ± 0%  -4.62% (p=0.000 n=10)
geomean                                                         8.401Ki        8.026Ki       -4.47%

                                                              │    old     │                new                 │
                                                              │ allocs/op  │ allocs/op   vs base                │
Netmap_ContainerNodes/REP_2-8                                   138.0 ± 0%   122.0 ± 0%  -11.59% (p=0.000 n=10)
Netmap_ContainerNodes/REP_2_IN_X_CBF_2_SELECT_2_FROM_*_AS_X-8   138.0 ± 0%   122.0 ± 0%  -11.59% (p=0.000 n=10)
geomean                                                         138.0        122.0       -11.59%
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-12 14:25:07 +03:00
Alexander Chuprov
51cefd4908 [#232] netmap: Allow empty values for unknown parameters in network config 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-07-09 12:19:25 +03:00
Dmitrii Stepanov
02c936f397 [#216] netmap: Add policy decode fuzz test 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-07 11:10:37 +00:00
Anton Nikiforov
99e02858af [#220] netmap: Fix setters for Replica.DataCount/ParityCount 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-05-07 09:34:14 +03:00
aarifullin
425d48f68b [#211] netmap: Introduce ReplicaDescriptor method 
* Make ReplicaNumberByIndex deprecated.
* Introduce ReplicaDescriptor method that access i-th replica directly.
* Introduce new getters for ReplicaDescriptor.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-03-29 13:48:04 +03:00
Evgenii Stratonikov
e9be3e6d94 [#205] netmap: Add well-known EC parameters to network config 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-22 10:14:12 +00:00
Evgenii Stratonikov
70e9e40c7f [#205] netmap: Add EC statement to placement policy 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-22 10:14:12 +00:00
Evgenii Stratonikov
6fe4e2541d [#207] netmap: Fix string escape in PlacementPolicy.String() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-01 15:02:05 +00:00
Dmitrii Stepanov
56debcfa56 [#190] sdk-go: Gofumpt fixes 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-22 19:21:20 +03:00
Alexander Chuprov
03d35dd1f3 [#166] netmap: Add support YML tests 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-11-17 14:43:03 +03:00
Alexander Chuprov
dea8759762 [#166] netmap: Move tests from JSON to YML 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2023-11-17 14:42:39 +03:00
Evgenii Stratonikov
a02c0bfac8 [#186] netmap: Marshal policy with brackets 
Brackets can be semantically important and must not be omitted,
otherwise the output is plain wrong.
We do not take the responsibility to preserve every bracket, though,
because parser does some optimizations related to grouping long chains
of filters combined with the same operation.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-27 10:54:45 +03:00
Evgenii Stratonikov
20d325e307 [#167] netmap: Fix reverse min agregator 
The higher the price, the lower reverse min weight should be.
Previously nodes with 0 price had 0 weight which is a bit misleading.

Introduced in d71a0e0755.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-10-27 07:53:19 +00:00
andnilin@gmail.com
d71a0e0755 [#88] netmap: use bool, fix hrw_sort tests 
Signed-off-by: Andrew Danilin <andnilin@gmail.com>
 2023-10-03 07:05:03 +00:00
AndrewDanilin
163b3e1961 [#88] netmap: fix min aggregator bug, add tests 
Signed-off-by: Andrew Danilin <andnilin@gmail.com>
 2023-10-03 07:05:03 +00:00
Evgenii Stratonikov
555ccc63b2 [#167] netmap: Allow to select insufficient number of nodes 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-15 14:47:54 +03:00
Evgenii Stratonikov
0550438b53 [#167] netmap/tests: Add replica to invalid tests 
Make sure we fail exactly because of the reason specified.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-15 14:33:44 +03:00
Evgenii Stratonikov
c899163860 [#167] netmap/tests: Add json file name to the test output 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-15 14:33:44 +03:00
Evgenii Stratonikov
ac8fc6d440 [#162] netmap: Allow to parse single unnamed selectors 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-11 15:22:24 +03:00
Evgenii Stratonikov
4df642e941 [#162] netmap: Fix possible panic 
Placement policy is unvalidated external input.
Under no circumstances should we panic here.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-11 15:19:56 +03:00
Evgenii Stratonikov
49ad985cad [#161] *: Do not use math/rand.Read() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-08 17:17:02 +03:00
Anton Nikiforov
b5fe52d6bd [#150] policy: Check for redundant selectors and filters 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-29 14:16:57 +03:00
Alejandro Lopez
b91f9d8c79 [#xx] Add support for SELECT-FILTER expressions 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-17 10:29:48 +00:00
Evgenii Stratonikov
998fe1a7ab [#102] netmap: properly process multiple REP 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-11 14:21:35 +00:00
Alex Vanin
14ed3e177d [#104] nemtap: Escape special symbols in filters 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-07-07 09:33:00 +00:00
Alex Vanin
fe28c33277 [#104] netmap: Add test with quote escaping 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-07-07 09:33:00 +00:00
Alex Vanin
5d62cef27e [#98] Fix linter issues 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-06-28 12:13:02 +00:00
Alejandro Lopez
fcbf96add6 [#76] Add UNIQUE keyword 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-06-06 13:54:07 +03:00
Airat Arifullin
4f48f6c9e0 [#78] netmap: Add new keywords NOT and UNIQUE 
* Add the rule for NOT operation to the policy parser grammar
* Regenerate query parse
* Implement NOT in filter
* Add unit-tests

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-06-02 17:47:20 +03:00
Evgenii Stratonikov
030ff2f122 [#87] netmap: Add benchmark for ContainerNodes() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-02 14:54:40 +03:00
Anton Nikiforov
0f7455ff7a [#75] Update antlr4 version to 4.13.0 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-06-01 13:15:11 +00:00
Evgenii Stratonikov
f5b23eb225 [#74] netmap/parser: Update antlr4 generator 
Also, add -no-listener option, as we use visitor only.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-19 17:47:24 +03:00
Anton Nikiforov
9a072a8f49 [#68] Replace interface{} with any 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-15 17:21:49 +03:00
Evgenii Stratonikov
7c75db2f2d [#59] netmap: Remove unused param from getSelection() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-18 14:11:04 +00:00
Pavel Karpy
d0c5d837d2 [#56] *: Drop reputation system 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-04-18 07:52:16 +00:00
Dmitrii Stepanov
c8e620ad24 [#53] sdk-go: Drop subnet 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-14 16:31:08 +03:00
Evgenii Stratonikov
31271ad8b1 [#47] netmap: Make PlacementPolicy.WriteStringTo() pass nofunlen, cogognit 
REP statement is obligatory, thus insert newline before each statement
after REP.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-07 08:59:19 +03:00
Evgenii Stratonikov
708d933fe3 [#47] .golangci.yml: Unify with other FrostFS repos 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-04-07 08:59:19 +03:00
Denis Kirillov
df2090c2be [#37] netmap: Update tests for new sys attributes 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-16 11:14:36 +03:00
Evgenii Stratonikov
b761fd8070 [#23] pre-commit: Add initial configuration 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-03-09 22:52:51 +03:00
Alex Vanin
94476f9055 Rename package name 
Due to source code relocation from GitHub.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-07 15:47:21 +03:00
Anton Nikiforov
d4f5bba459 [#2] Update lint config, fix lint errors 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-03-01 10:29:23 +03:00
Dmitrii Stepanov
e9c1a2ab2b [TrueCloudLab/hrw#2] sdk-go: Optimize node hash 
Compute node hash by node initialization

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-02-28 18:07:14 +03:00
Dmitrii Stepanov
2cbc585edd [TrueCloudLab/hrw#2] sdk-go: Use typed HRW methods 
Update HRW pkg and use typed HRW methods to sort nodes

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-02-28 18:07:14 +03:00
Evgenii Stratonikov
4ff9c00de3 [#4] Rename NeoFS mentions in comments and method names 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 13:40:50 +03:00
Evgenii Stratonikov
b204a62da1 [#4] go.mod: Update ANTLR 
Current `go:generate` command was, probably, executed only on my laptop.
Replace it with explicit version, because package in the generated code
depends on in.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2022-12-30 13:40:50 +03:00
Pavel Karpy
4c779423f5 Move to frostfs-sdk-go 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-14 09:59:29 +03:00
Evgenii Stratonikov
da4ddcf337 [#353] netmap: Get rid of ioutil 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-10-19 12:05:49 +04:00
Anton Nikiforov
21eef1ae7f [#351] Add StringifyPublicKey method for NodeInfo 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2022-10-13 10:27:18 +03:00