aarifullin/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
4981 commits 138 branches 26 tags 62 MiB
Commit graph

109 commits

Author SHA1 Message Date
Anton Nikiforov
34e6a309c6 [#1356] engine: Evacuate object from shards concurrently 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-09-24 12:50:19 +03:00
Dmitrii Stepanov
6b6eabe41c [#1337] cli: Add control shards rebuild command 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-09-06 13:57:27 +03:00
Ekaterina Lebedeva
f652518c24 [#1357] go: Fix panic caused by using range over slice len 
If slice is altered in `for` loop, we cannot use range over its
length: it may cause panic if slice gets shorter.

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-09-06 13:09:58 +03:00
Anton Nikiforov
108e4e07be [#1349] node: Evacuate objects without setting mode to MAINTENANCE 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-09-05 16:08:27 +03:00
Ekaterina Lebedeva
a685fcdc96 [#1317] go.mod: Use range over int 
Since Go 1.22 a "for" statement with a "range" clause is able
to iterate through integer values from zero to an upper limit.

gopatch script:
@@
var i, e expression
@@
-for i := 0; i <= e - 1; i++ {
+for i := range e {
    ...
}

@@
var i, e expression
@@
-for i := 0; i <= e; i++ {
+for i := range e + 1 {
    ...
}

@@
var i, e expression
@@
-for i := 0; i < e; i++ {
+for i := range e {
    ...
}

Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-09-03 13:00:54 +03:00
Evgenii Stratonikov
98fe24cdb7 [#1343] go.mod: Update api-go 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-08-30 08:45:24 +00:00
Evgenii Stratonikov
7bca428db0 [#1322] Use new protobuf marshaler 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-08-22 07:17:41 +00:00
Dmitrii Stepanov
93d63e1632 [#1284] writecache: Allow to seal writecache async 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-08-09 13:23:35 +03:00
Dmitrii Stepanov
36efccd862 [#1298] writecache: Add shrink flag for Seal command 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-08-08 16:32:29 +03:00
Dmitrii Stepanov
5c01bd5be8 [#1298] writecache: Add restore-mode flag for Seal command 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-08-07 11:20:14 +03:00
Dmitrii Stepanov
3a797e4682 [#1222] engine: Fix tree evacuation 
Do not fail if it is unable to evacuate tree to other node.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-07-04 10:38:10 +03:00
Dmitrii Stepanov
2bac82cd6f [#1222] engine: Fix object evacuation 
Do not fail evacuation if it unable to evacuate object to other node.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-07-04 10:38:10 +03:00
Dmitrii Stepanov
4f7d76c9ef [#1206] audit: Drop not required events 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-06-27 10:54:31 +00:00
Dmitrii Stepanov
a83eeddb1d [#60] control: Add GetNetmapStatus method 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-06-20 16:28:42 +03:00
Dmitrii Stepanov
ecd1ed7a5e [#1184] node: Add audit middleware for grpc services 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-06-19 16:05:53 +03:00
Anton Nikiforov
a90310335d [#1156] ape: Return not found when removing local overrides 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-06-07 12:10:57 +00:00
Dmitrii Stepanov
d45d086acd [#1129] policer: Add EC chunk replication 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-05-16 16:28:48 +03:00
Alexander Chuprov
b078fe5ba1 [#1092] control: Move SignMessage to separate package 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-05-16 12:14:01 +03:00
Evgenii Stratonikov
3ea1d7b729 [#1089] control: Add USER and GROUP targets for local override storage 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-16 11:03:50 +00:00
Anton Nikiforov
5ee5f1df42 [#976] control: Introduce new method RemoveChainLocalOverridesByTarget 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-03-13 15:33:19 +03:00
Dmitrii Stepanov
31e2396a5f [#1043] control: Add ResetEvacuationStatus implementation 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-03-13 10:29:45 +00:00
Dmitrii Stepanov
d433b49265 [#973] node: Resolve perfsprint linter 
`fmt.Errorf can be replaced with errors.New` and `fmt.Sprintf can be replaced with string addition`

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-03-11 17:55:50 +03:00
Airat Arifullin
93bf9acbc2 [#898] control: Remove removed flag from RemoveChainLocalOverrideResponse 
* Remove removed flag in service.proto for RemoveChainLocalOverrideResponse.
* Regenerate control API.
* Return error only if RemoveOverride returns non-NotFound code.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-02-28 19:07:07 +00:00
Dmitrii Stepanov
db67c21d55 [#947] engine: Evacuate trees to remote nodes 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-09 11:33:15 +03:00
Dmitrii Stepanov
15d853ea22 [#947] controlSvc: Return tree evacuation stat 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-09 11:20:39 +03:00
Dmitrii Stepanov
b3f3505ada [#947] cli: Allow to specify evacuation scope 
It may be required to evacuate only objects or only tree or all, so
now it spossible to specify.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-09 11:20:38 +03:00
Dmitrii Stepanov
a6eb66bf9c [#947] evacuate: Refactor evacuate parameters 
Drop methods to make it easier to extend.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-09 11:20:38 +03:00
Dmitrii Stepanov
9ba48c582d [#917] engine: Allow to detach shards 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-06 14:49:47 +03:00
Anton Nikiforov
9916598dfb [#922] control: Extend api with ListOverrideDefinedTargets 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-02-02 12:09:51 +00:00
Anton Nikiforov
2cb04379a4 [#922] go.mod: Update APE 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-02-02 12:09:51 +00:00
Airat Arifullin
4352bd0e8e [#934] ape: Transform empty namespace within chainbase 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-02-01 17:38:24 +00:00
Anton Nikiforov
483a67b170 [#937] ape: Validate chain resource name 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-01-31 11:34:35 +03:00
Airat Arifullin
be33070550 [#910] control: Take empty namespace for 'root' 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-19 06:22:10 +00:00
Airat Arifullin
a8e52ef7aa [#898] control: Fix codes for returning APE errors 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-11 12:31:31 +00:00
Denis Kirillov
c19396d203 [#885] control: Make chain id bytes in grpc 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-11 07:24:22 +00:00
Dmitrii Stepanov
581887148a [#569] cli: Add control shards writecache seal command 
It does the same as `control shards flush-writecache --seal`, but
has better name.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-29 16:05:37 +03:00
Dmitrii Stepanov
0cb0fc1735 [#569] writecache: Allow to seal writecache after flush 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-29 16:05:37 +03:00
Dmitrii Stepanov
11add38e87 [#857] golangci: Add protogetter linter 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-12 16:27:02 +03:00
aarifullin
0f45e3d344 [#804] ape: Implement boltdb storage for local overrides 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-07 19:08:41 +03:00
aarifullin
e361e017f3 [#842] control: Pass target instead resource name 
* Update policy-engine package version in go.mod, go.sum.
* Refactor CheckIfRequestPermitted: pass container target
  instead container ID.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-07 14:21:55 +00:00
aarifullin
39060382a1 [#842] control: Recieve target in gRPC methods for APE managing 
* Introduce Target type and pass it to all gRPC methods
  for APE chain managing instead CID.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-12-07 14:21:55 +00:00
aarifullin
4d5be5ccb5 [#811] ape: Update policy-engine module version and rebase 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-16 11:31:37 +03:00
Airat Arifullin
66848d3288 [#770] cli: Add methods to work with APE rules via control svc 
* Add methods to frostfs-cli
* Implement rpc in control service

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Airat Arifullin
5ec73fe8a0 [#770] node: Introduce ape chain source 
* Provide methods to access rule chains with access
  policy engine (APE) chain source
* Initialize apeChainSource within object service
  initialization
* Share apeChainSource with control service
* Implement dummy apeChainSource instance based on
  in-memory implementation

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Airat Arifullin
3a2c319b87 [#770] control: Generate gRPC methods to manipulate APE chains 
* Define new types and gRPC methods to manipulate APE chains
  in control service.
* Stub gRPC handlers for the generated methods.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2023-11-08 13:34:03 +00:00
Dmitrii Stepanov
226e84d782 [#684] node: Add skipped objects count to evacuation result 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-11-07 12:17:11 +00:00
Alejandro Lopez
f9730f090d [#92] Refactor policer and add some unit tests 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-07-03 07:05:31 +00:00
Evgenii Stratonikov
8a4e250dae [#468] *: replace outdated TODO crypto-related links 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-28 12:13:20 +00:00
Dmitrii Stepanov
e4889e06ba [#329] node: Make evacuate async 
Now it's possible to run evacuate shard in async.
Also only one evacuate process can be in progress.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-19 08:43:52 +00:00
Dmitrii Stepanov
100b1b5128 [#329] node: Add async evacuate proto methods 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-19 08:43:52 +00:00