dstepanov-yadro
/
frostfs-node
forked from TrueCloudLab/frostfs-node
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,360 Commits
212 Branches
26 Tags
29 MiB
Commit Graph

4360 Commits (feat/devenv)

Author SHA1 Message Date
Dmitrii Stepanov 80d7f19ccf [#892] node: Add VSCode debug example 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-29 15:24:08 +03:00
Dmitrii Stepanov b118734909 [#890] getsvc: Log node PK 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-29 14:24:13 +03:00
Dmitrii Stepanov 764f70634d [#881] containerSvc: Add APE validation 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-27 11:05:34 +03:00
Dmitrii Stepanov 8180a0664f [#887] node: Drop badger writecache implementation 
Badger implementation isn't tested and works not well,
but requires human resources to maintain.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-22 13:00:54 +03:00
Anton Nikiforov 5b672fb392 [#876] adm: Add `morph ape get/set-admin` commands 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-12-21 18:21:37 +03:00
Anton Nikiforov eab981bf1a [#876] Fix linter error 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-12-21 18:21:37 +03:00
Dmitrii Stepanov 825f65f79e [#873] node: Start metrics and pprof as soon as possible 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-21 15:09:51 +00:00
Alexey Vanin b1eab1de54 [#883] adm: Add domainOf function to resolve NNS domain 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-21 15:04:00 +03:00
Alexey Vanin ac0821a1a5 [#883] adm: Support proxy accounts 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-21 13:53:34 +03:00
Alexey Vanin 419b07e8b8 [#883] adm: Use proxy contract as admin for frostfsid and policy contracts 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-21 12:30:37 +03:00
Anton Nikiforov 32f4e72e6a [#834] adm: Add commands to invoke methods of `policy` contract 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-12-20 15:44:12 +03:00
Anton Nikiforov 7ade11922e [#834] adm: Refactor `morph` module 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-12-20 15:22:17 +03:00
Dmitrii Stepanov d69d318cb0 [#878] node: Drain internal error's channel 
This fixes shutdown panic:
1. Some morph connection gets error and passes it to internalErr channel.
2. Storage node starts to shutdow and closes internalErr channel.
3. Other morph connection gets error and tries to pass it to internalErr channel.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-19 16:38:03 +00:00
Anton Nikiforov d9cbb16bd3 [#866] Use TTL for blobovnicza tree cache 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-12-19 16:36:28 +00:00
Ekaterina Lebedeva be8f499b91 [#717] Fix mixing CID and container ID 
All container ID outputs that may be used in scripts
were replaced with CID.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2023-12-19 12:36:29 +03:00
Airat Arifullin 7d7cf05575 [#851] ape: Initialize and use policy contract interface 
* Replace inmemory policy contract mock by initialized
  policy contract interface.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-18 11:06:35 +00:00
Dmitrii Stepanov 61da7dca24 [#835] node: Fix appCfg concurrent access 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-14 16:38:59 +03:00
Dmitrii Stepanov f4877e7b42 [#835] grpc: Try to reconnect if endpoint listen failed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-14 16:38:59 +03:00
Airat Arifullin bdd43f6211 [#869] object: Pass just CID to chain router 
* Do not convert CID from request to native-schema resource
  format - this step is unneccessary for APE.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-14 11:01:20 +00:00
Airat Arifullin 4a64b07703 [#869] cli: Pass only CID in requests for control API 
* Fix add-rule, list-rules, remove-rule, get-rule commands:
  do not convert container ID to native-schema resource format
  and pass it to control API.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-14 11:01:20 +00:00
Ekaterina Lebedeva 2d4c0a0f4a [#552] Add systemd notifications to ir service 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2023-12-13 17:51:41 +03:00
Ekaterina Lebedeva ef07c1a3c9 [#552] Add sysd notifications to storage service 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2023-12-13 17:51:41 +03:00
Ekaterina Lebedeva eca7ac9f0d [#552] Add sdnotify package 
To avoid using third-party dependencies.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2023-12-13 17:49:26 +03:00
Ekaterina Lebedeva 9b2dce5763 [#552] Add status notification to systemd 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2023-12-13 15:02:39 +03:00
Ekaterina Lebedeva 05f8f49289 [#552] gofumpt changes 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2023-12-13 15:02:25 +03:00
Dmitrii Stepanov 7eb46404a1 [#863] blobovnicza: Fix counters 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-13 13:34:29 +03:00
Dmitrii Stepanov 11add38e87 [#857] golangci: Add protogetter linter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 16:27:02 +03:00
Dmitrii Stepanov 94ffe8bb45 [#857] golangci: Add testifylint linter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 16:27:02 +03:00
Dmitrii Stepanov 5d7833c89b [#857] golangci: Add perfsprint linter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 16:27:02 +03:00
Dmitrii Stepanov d2746a7d67 [#857] Makefile: Update linter version 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 16:27:02 +03:00
Dmitrii Stepanov 3b7c0362a8 [#861] shard: Fix Delete object 
It is possible that object doesn't exist in metabase.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 14:25:40 +03:00
Dmitrii Stepanov 681b2c5fd4 [#825] policer: Do not drop required linking objects 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 11:04:03 +00:00
Dmitrii Stepanov a3ef7b58b4 [#755] innerring: Check container owner namespace 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 12:36:34 +03:00
Dmitrii Stepanov 1cd2bfe51a [#755] morph: Drop FrostFSID contract usage 
Unused.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 12:36:34 +03:00
Dmitrii Stepanov d5c9dd3c83 [#852] ape: Use first match for eACL->APE converter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-11 16:55:32 +03:00
Anton Nikiforov 46532fb9ce [#841] doc: Describe `epoch` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-12-11 13:14:41 +00:00
Anton Nikiforov 70e0c1e082 [#841] ir: Execute `netmap.addPeerIR` only for state `online` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-12-11 13:14:41 +00:00
Airat Arifullin 0f45e3d344 [#804] ape: Implement boltdb storage for local overrides 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-07 19:08:41 +03:00
Airat Arifullin e361e017f3 [#842] control: Pass target instead resource name 
* Update policy-engine package version in go.mod, go.sum.
* Refactor CheckIfRequestPermitted: pass container target
  instead container ID.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-07 14:21:55 +00:00
Airat Arifullin 39060382a1 [#842] control: Recieve target in gRPC methods for APE managing 
* Introduce Target type and pass it to all gRPC methods
  for APE chain managing instead CID.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-07 14:21:55 +00:00
Dmitrii Stepanov db49ad16cc [#826] blobovniczatree: Do not create DB's on init 
Blobovniczas will be created on write requests.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov ad0697adc4 [#661] blobovnicza: Compute size with record size 
To get more accurate size of blobovnicza use record
size (lenght of key + lenght of data).

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov e54dc3dc7c [#698] blobovnicza: Store counter values 
Blobovnicza initialization take a long time because of bucket
Stat() call. So now blobovnicza stores counters in META bucket.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov 5e8c08da3e [#661] blobstore: Add address to error logs 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov 8911656b1a [#661] metrcis: Add rebuild percent metric 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov 8bbfb2df43 [#661] blobovniczatree: Pass object size limit from config 
If actual small object size value lower than default
object size limit, then unnecessary buckets created.
If actual small object size value greated than default
object size limit, then error happens.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov 2407e5f5ff [#661] blobovniczatree: Do not sort DB's and indicies 
Put stores object to next active DB, so there is no need to sort DBs.
In addition, it adds unnecessary DB openings.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov c6a739e746 [#661] blobovniczatree: Make Rebuild concurrent for objects 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov f1c7905263 [#661] blobovniczatree: Make Rebuild concurrent 
Different DBs can be rebuild concurrently.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00
Dmitrii Stepanov d4d905ecc6 [#661] metrics: Add blobovniczatree rebuild metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-07 15:37:33 +03:00