dstepanov-yadro
/
frostfs-node
forked from TrueCloudLab/frostfs-node
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,614 Commits
212 Branches
26 Tags
29 MiB
Commit Graph

4614 Commits (feat/resync_speedup)

Author SHA1 Message Date
Dmitrii Stepanov 675eec91f3 [#938] shard: Update only changed counters 
If metric value hasn't changed, but we update metric, then
non existed metric will apear with zero value.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-30 12:37:48 +03:00
Dmitrii Stepanov c681354afd [#938] engine: Fix container count removal 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-30 12:37:48 +03:00
Evgenii Stratonikov df055fead5 [#931] morph: Provide batch size for container listing explicitly 
Besides VM stack item limit we also have restrictions on the size of
JSON for a stackitem, which is 128k. This limit is much harder to
calculate, because JSON representation includes type and the encoding is
different for different items. Thus is makes no sense to invent our own
default, so use the one provided by neo-go. But for container listing we
know exactly what we process, so use big enough value, which is tested.

Introduced in be8607a1f6.

Refs #902
Refs https://github.com/nspcc-dev/neo-go/blob/v0.105.0/pkg/vm/stackitem/json.go#L353

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-29 14:00:11 +00:00
Evgenii Stratonikov c916a75948 [#935] .forgejo: Update dco-go to v3 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-26 12:19:20 +03:00
Evgenii Stratonikov 6e2cc32768 [#681] objsvc: Validate session token owner for local sessions 
Previously, the check was in place only when session token was missing.
Format validator checks are applied only to fully-prepared object, so
this lead to the following situation:
1. Object is put locally with malformed token, because there are no
   checks.
2. Object cannot be replicated, because the token is malformed.

This is now fixed and token check is done before any payload receival.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-26 08:52:29 +00:00
Anton Nikiforov 417f8fc2c2 [#876] cli: Add doc for commands `control *-rule` 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-01-25 20:26:13 +03:00
Anton Nikiforov 51d1d935ef [#876] cli: Add support for `container` in local rules 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-01-25 20:26:13 +03:00
Anton Nikiforov b6fc3321c5 [#876] Fix linters 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-01-25 20:26:13 +03:00
Airat Arifullin 1fe7736d92 [#925] morph: Introduce switch rpc guarded rpc actor 
* Introduce switch rpc guarded rpc actor in morph client
  to prevent using invalidated rpc actor when RPC switch
  happens.
* Initialize NewContractStorage with SwitchRPCGuardedActor.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-25 13:24:13 +00:00
Evgenii Stratonikov d13e37f70b [#768] adm: Do not change frostfsid admin on update 
Behave similarly to the netmap contract.
Close #768

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-25 10:54:42 +00:00
Evgenii Stratonikov d2d850786d [#923] adm: Move netconfig merge to a separate function 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-25 10:54:42 +00:00
Evgenii Stratonikov 61a3afbf9b [#768] adm: Rephrase error text for NNS fetch 
Error could come from the network, we must not assume everything.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-25 10:54:42 +00:00
Evgenii Stratonikov c00eb7ccee [#768] adm: Return error from getContractDeployData() 
Make code more idiomatic and unify in style with other error reporting.
Retain panics for code errors.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-25 10:54:42 +00:00
Evgenii Stratonikov cc2da73b20 [#929] go.mod: Update dependencies 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-25 07:24:11 +00:00
Dmitrii Stepanov 5ed330e436 [#927] metabase: Delete GC marks 
`key` is changed inside `db.get`, so encode address again after get.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-24 18:51:16 +03:00
Dmitrii Stepanov 931a5e9aaf [#918] engine: Move shard to degraded mode if metabase open failed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-23 11:16:40 +03:00
Airat Arifullin f2f3294fc3 [#919] ape: Improve error messages in ape service 
* Wrap all APE middleware errors in apeErr that
  makes errors more explicit with status AccessDenied.
* Use denyingRuleErr for denying status from chain router.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-23 08:11:24 +00:00
Dmitrii Stepanov f526f49995 [#874] engine: Check object existance concurrently 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-23 09:28:29 +03:00
Dmitrii Stepanov f5160b27fc [#920] tests: Fix data races 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-19 14:06:05 +03:00
Denis Kirillov e42262a863 [#908] adm/frostfsid: Add parameter validations 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-19 11:04:03 +00:00
Denis Kirillov 136acdba21 [#908] adm/frostfsid: Use client for write operations 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-19 11:04:03 +00:00
Denis Kirillov 6ebd61298e [#908] adm/frostfsid: Support subject/group management 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-19 11:04:03 +00:00
Denis Kirillov 0e3d144695 [#908] adm: Support frostfsid basic operations 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-19 11:04:03 +00:00
Airat Arifullin be33070550 [#910] control: Take empty namespace for 'root' 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-19 06:22:10 +00:00
Dmitrii Stepanov 63d3ed1ad8 [#904] tests: Close test engine after test 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-17 19:04:39 +03:00
Dmitrii Stepanov 57171907e3 [#904] metabase: Return if object was actuall inserted 
This requires to count metrics properly.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-17 19:04:39 +03:00
Dmitrii Stepanov c1a80235db [#904] metabase: Log Inhume operation 
It will be very useful for troubleshooting.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-17 18:42:52 +03:00
Airat Arifullin 96b020626f [#915] ape: Fix method name in getStreamBasicChecker 
* Replace incorrect MethodGetContainer by MethodGetObject constant.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-16 23:52:37 +03:00
Airat Arifullin c8baf76fae [#872] object: Introduce APE middlewar for object service 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-12 18:41:35 +03:00
Denis Kirillov e43609c616 [#885] go.mod: Update APE 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-12 15:38:37 +00:00
Dmitrii Stepanov 52ffa9f164 [#891] getSvc: Refactor Get service V2 creation 
Use arguments for mandatory fields.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-12 13:35:38 +03:00
Dmitrii Stepanov 394f086fe2 [#891] getSvc: Fix get range hash implementation 
Get range can perform GET request, so this request must be done
from container node to not to get access denied error.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-12 13:35:38 +03:00
Evgenii Stratonikov a601391719 [#902] adm: Do not create session when dumping hashes 
Unless the total number of domains is too big, there is no need to
consume resources in neo-go.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-12 10:25:56 +00:00
Evgenii Stratonikov be8607a1f6 [#902] morph: Avoid creating session in TestInvokeIterator 
When the number of items to iterate over is less than 2048, there is no
need to create a session and consume resources.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-12 10:25:56 +00:00
Dmitrii Stepanov a2ab373a0a [#895] metabase: Do not delete GC mark for virtual objects 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-11 12:32:09 +00:00
Dmitrii Stepanov 7166e77c2b [#895] test: Add logger to test shard 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-11 12:32:09 +00:00
Dmitrii Stepanov 47dcfa20f3 [#895] test: Use t.Cleanup only for external resources 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-11 12:32:09 +00:00
Dmitrii Stepanov 836818fb75 [#895] test: Use zaptest logger 
Previous implementation mixes logs from different tests, now logs
are separeted by test.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-11 12:32:09 +00:00
Dmitrii Stepanov f1b2b8bffa [#895] test: Fix NewLogger arguments list 
`debug` is always true.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-11 12:32:09 +00:00
Airat Arifullin a8e52ef7aa [#898] control: Fix codes for returning APE errors 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-11 12:31:31 +00:00
Airat Arifullin 5d982976fd [#898] ape: Fix bug with creating type bucket in chainbase 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-01-11 12:31:31 +00:00
Denis Kirillov 4a4c790ec1 [#885] cli: Support hex chain id in control API 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-11 07:24:22 +00:00
Denis Kirillov c19396d203 [#885] control: Make chain id bytes in grpc 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-11 07:24:22 +00:00
Dmitrii Stepanov 5c0a736a25 [#899] containerSvc: Fix invalid session token type 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-10 18:37:54 +03:00
Alexander Chuprov 79bebe4a68 [#884] cli: Fix error message for undefined endpoint 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-01-10 10:02:16 +00:00
Dmitrii Stepanov 4b8b4da681 [#864] engine: Drop container count metric if container removed 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-10 10:45:32 +03:00
Dmitrii Stepanov d75e7e9a21 [#864] engine: Drop container size metric if container deleted 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-10 10:44:54 +03:00
Dmitrii Stepanov dfd62ca6b1 [#864] metabase: Refactor delete/inhume 
Available -> Logic, Raw -> Phy for delete/inhume results.
Use single counter instead of vectors.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-01-09 09:59:42 +03:00
Dmitrii Stepanov d5d3d8badb [#892] node: Add VSCode debug example 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-29 16:38:08 +00:00
Evgenii Stratonikov 225fe2d4d5 [#894] blobovniczatree: Speedup rebuild test 
Down from 3s to 300ms.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-12-29 16:28:54 +00:00