dstepanov-yadro
/
frostfs-node
forked from TrueCloudLab/frostfs-node
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,077 Commits
235 Branches
26 Tags
19 MiB
Commit Graph

4077 Commits (26a78aa366ef2874d97997cd1a13a60dbd748d13)

Author SHA1 Message Date
Evgenii Stratonikov 26a78aa366 [#248] adm: Remove obsolete network parameters 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 16:38:43 +00:00
Anton Nikiforov 4ad0ebb32f [#565] Add metrics for current GRPC endpoint status 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-10 16:37:49 +00:00
Evgenii Stratonikov c3e23a1448 [#578] gendoc: Allow to override flags 
The command is used in multiple places across the whole FrostFS
ecosystem. While we want to have uniform interfaces everywhere,
sometimes we can't: already defined global flags can be harder to change
because of our obligations to the users. Cobra framework doesn't allow
conflicting flags (we can have global ones), so allow to override them.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 11:10:11 +00:00
Evgenii Stratonikov 6bcba27757 [#578] gendoc: Remove flag shorthands 
Make it harder to encounter conflicts in already existing commands.
Because the command is executed once, I don't think the usability is
worse.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 11:10:11 +00:00
Evgenii Stratonikov dca31e8888 [#578] gendoc: Add date to man pages 
```
HISTORY
       8-Aug-2023 Auto generated by spf13/cobra
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 11:10:11 +00:00
Evgenii Stratonikov b02a1a34c1 [#578] gendoc: Allow to customize man pages 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 11:10:11 +00:00
Evgenii Stratonikov 082370583f [#578] gendoc: Replace NSPCC with FrostFS 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 11:10:11 +00:00
Airat Arifullin 34b5d90441 [#590] cli: fix SDK PrmContainerPut usage for PutContainerPrm 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com
 2023-08-10 11:09:31 +00:00
Airat Arifullin 6186329aec [#590] cli: fix SDK PrmContainerGet usage for GetContainerPrm 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-08-10 11:09:31 +00:00
Evgenii Stratonikov c3c0574e3c [#589] cli: Add `control shards evacuate` command 
It was accidentally removed in f7c0b50d70.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-10 09:06:06 +00:00
Alejandro Lopez 8f994163ee [#586] Fix writecache benchmarks and refactor hacky NeedsCompression 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-10 08:05:18 +00:00
Alejandro Lopez 023b90342c [#584] Disable compression in badger writecache 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-10 10:14:06 +03:00
Evgenii Stratonikov d641cba2fc [#587] Do not use math/rand.Read 
Fix staticcheck warnings after go1.20 update.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-09 16:02:44 +03:00
Evgenii Stratonikov 33c11be0cf [#587] .golangci.yml: Fix pre-commit warnings 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-09 16:02:44 +03:00
Alejandro Lopez 5b7e4a51b7 [#481] Update frostfs-sdk-go and error pointer receivers 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-09 10:26:53 +00:00
Evgenii Stratonikov de3d1eb99c [#581] Bump required go version to go1.20 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-09 10:16:48 +00:00
Alejandro Lopez ae322e9f73 [#576] Set SyncWrites for badger writecache by default 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-09 11:28:26 +03:00
Anton Nikiforov 8d589314b5 [#560] node: Fix `Put` in multi REP with intersecting sets of nodes 
Once the node was processed it skipped, at the step of forming
result in case when all nodes skipped, because processed for
previous REP, service mark the whole request as incomplete.

Example of policies which are unblocked:
- REP 1 REP 1 CBF 1
- REP 4 IN X REP 4 IN Y
  CBF 4
  SELECT 2 FROM FX AS X SELECT 2 FROM FY AS Y
  FILTER Country EQ Russia OR Country EQ Sweden OR Country EQ Finland AS FY
  FILTER Price GE 0 AS FX

Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-08 10:22:53 +00:00
Alejandro Lopez 7da4306e38 [#575] writecache: Fix log level for badger writecache 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-08 08:16:36 +00:00
Evgenii Stratonikov d3a52ec73a [#516] node: Send bootstrap request if attributes were updated 
Consider following situation:
1. Epoch tick.
2. Update node attributes in the config.
3. Restart node.

Because we already sent bootstrap query after (1) and we are still
online, new bootstrap query won't be sent. This leads to the node
attributes being updated after another epoch.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-08 07:40:26 +00:00
Dmitrii Stepanov 0e697266c3 [#563] writecache: Fix metrics and bolt delete 
Estimate cache size after delete objects to update metric.
Update counters on small object deletion.
Do not count bbolt DB file as FSTree object.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-08-07 12:53:28 +00:00
Alejandro Lopez 5bbfebba2d [#570] Fix writecache type constant copy-pasta bug 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-07 12:06:44 +03:00
Alejandro Lopez 1a0cb0f34a [#421] Try using badger for the write-cache 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-07 08:16:57 +00:00
Alejandro Lopez 65c72f3e0b [#559] Remove manual path handling in fstree tests 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-03 10:03:41 +03:00
Evgenii Stratonikov 1e8b4b8a17 [#557] services: Regenerate stable marshalers 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-02 13:37:40 +00:00
Evgenii Stratonikov 435a581b5e [#557] go.mod: Update sdk-go and api-go 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-02 13:37:40 +00:00
Airat Arifullin 93c46cfdf0 [#550] cli: make get-op-log meta pretty formatted 
Close #550

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-02 10:27:15 +00:00
Airat Arifullin 1b7b54ba89 [#540] cli: refactor client parameters usage 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-02 09:44:51 +00:00
Airat Arifullin b3695411d9 [#553] eacl: Fix bug with casting to ObjectAccessDenied error 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-02 07:22:48 +00:00
Anton Nikiforov ec8a631d31 [#542] Update test for `SizeInBytesSafe` function 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-01 13:38:00 +00:00
Anton Nikiforov 9ca63ac8c3 [#542] Fix bug in `SizeInBytesSafe` function 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-08-01 13:38:00 +00:00
Evgenii Stratonikov b8052c794e [#547] go.mod: Update api-go, sdk-go 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-31 15:35:15 +00:00
Evgenii Stratonikov 35dc64bd7b [#547] metabase: Fix datarace in tests 
Quite an old one bf9e938a3b.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-31 15:35:15 +00:00
Evgenii Stratonikov 05ac9e3637 [#547] objectsvc: Work with `traversal` struct from a single thread 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-31 15:35:15 +00:00
Evgenii Stratonikov 7b0fdf0202 [#533] services: Assume API supports status codes 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-31 15:35:15 +00:00
Evgenii Stratonikov ec8b4fdc48 [#541] writecache/test: Close writecache on exit 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-29 10:57:25 +00:00
Evgenii Stratonikov ad5f527bd3 [#541] writecache/test: Remove initWC() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-29 10:57:25 +00:00
Dmitrii Stepanov ea32913430 [#543] putsvc: Fix PutSingle implementation 
Add Lock and Delete handlers to local PutSingle.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-28 12:09:41 +00:00
Dmitrii Stepanov 99bb488ebd [#539] getsvc: Write payload direct to out stream 
To reduce memory allocations.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-27 17:02:08 +03:00
Dmitrii Stepanov 286242cad0 [#539] getsvc: Use buffer to assemble object 
To reduce memory consumption.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-27 17:02:08 +03:00
Dmitrii Stepanov 32c77f3a23 [#537] node: Add runtime.memory_limit config parameter 
This parameter allows to set soft memory limit for Go GC.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-25 17:27:09 +03:00
Evgenii Stratonikov 5ff82ff04f [#6] services/object: Simplify local/remote targets 
We do not use the return result from Close() and we always execute both
methods in succession. It makes sense to unite them.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-21 18:39:12 +03:00
Evgenii Stratonikov 448b48287c [#6] services/util: Do not panic in sign function 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-21 18:39:12 +03:00
Evgenii Stratonikov c2617baf63 [#6] services/util: Remove remaining stream wrappers 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-21 18:39:09 +03:00
Evgenii Stratonikov 372160d048 [#6] services/util: Remove `SignService.HandleUnaryRequest` 
There is no need in a wrapper with many from-`interface{}` conversions.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-21 18:36:08 +03:00
Evgenii Stratonikov fef172c5b0 [#6] services/util: Simplify `response.Service` 
It has only 1 parameter, which is obligatory.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-21 18:29:57 +03:00
Evgenii Stratonikov 5a4054eeb6 [#535] .forgejo: Add vulncheck workflow 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-20 09:52:03 +00:00
Dmitrii Stepanov eed594431f [#335] treesvc: Add GetSubTree ordering unit test 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-20 10:14:10 +03:00
Dmitrii Stepanov af82c2865e [#335] treesvc: Fix inmemory unit tests and nil meta items 
Bolt forest saves empty slice of items. Now inmemory forest
does it the same way.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-20 10:14:10 +03:00
Dmitrii Stepanov b4e72a2dfd [#335] treesvc: Sort nodes by Filename in GetSubTree 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-20 10:14:10 +03:00