TrueCloudLab/frostfs-node
20
1
Fork 27
Code Issues 109 Pull requests 11 Projects Releases 2 Activity Actions
5367 commits 9 branches 102 tags 46 MiB
Commit graph

29 commits

Author SHA1 Message Date
Dmitrii Stepanov
8643e0abc5
[#1668] writecache: Use object size to check free space
All checks were successful
DCO action / DCO (pull_request) Successful in 1m7s
Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 1m30s
Details
Build / Build Components (pull_request) Successful in 1m56s
Details
Vulncheck / Vulncheck (pull_request) Successful in 1m47s
Details
Tests and linters / Run gofumpt (pull_request) Successful in 3m16s
Details
Tests and linters / Lint (pull_request) Successful in 3m49s
Details
Tests and linters / Staticcheck (pull_request) Successful in 3m49s
Details
Tests and linters / Tests (pull_request) Successful in 3m59s
Details
Tests and linters / gopls check (pull_request) Successful in 4m9s
Details
Tests and linters / Tests with -race (pull_request) Successful in 4m40s
Details
Pre-commit hooks / Pre-commit (push) Successful in 1m17s
Details
Vulncheck / Vulncheck (push) Successful in 1m24s
Details
Build / Build Components (push) Successful in 1m57s
Details
Tests and linters / Run gofumpt (push) Successful in 2m37s
Details
Tests and linters / Tests (push) Successful in 3m1s
Details
Tests and linters / Staticcheck (push) Successful in 3m7s
Details
Tests and linters / Lint (push) Successful in 3m11s
Details
Tests and linters / gopls check (push) Successful in 3m14s
Details
Tests and linters / Tests with -race (push) Successful in 3m25s
Details
OCI image / Build container images (push) Successful in 4m54s
Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2025-03-10 17:52:57 +03:00
Dmitrii Stepanov
6db46257c0
[#1437] node: Use ctx for logging 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-11-13 10:36:07 +03:00
Dmitrii Stepanov
5f6c7cbdb1 [#1367] writecache: Drop bbolt DB 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-09-12 14:22:29 +03:00
Dmitrii Stepanov
92fe5d90f5 [#1359] writecache: Drop unused
All checks were successful
DCO action / DCO (pull_request) Successful in 2m45s
Details
Vulncheck / Vulncheck (pull_request) Successful in 3m13s
Details
Tests and linters / Run gofumpt (pull_request) Successful in 3m48s
Details
Tests and linters / Staticcheck (pull_request) Successful in 3m57s
Details
Tests and linters / Tests with -race (pull_request) Successful in 4m15s
Details
Tests and linters / Lint (pull_request) Successful in 4m38s
Details
Pre-commit hooks / Pre-commit (pull_request) Successful in 4m40s
Details
Tests and linters / gopls check (pull_request) Successful in 4m41s
Details
Build / Build Components (pull_request) Successful in 5m10s
Details
Tests and linters / Tests (pull_request) Successful in 6m20s
Details 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-09-09 18:45:21 +03:00
Dmitrii Stepanov
08b1f18bca [#1296] writecache: Add count limit 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-08-09 06:30:32 +00:00
Anton Nikiforov
3195142d67 [#959] writecache: Avoid manipulation with cache in DEGRADED mode 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-03-11 18:35:41 +00:00
Dmitrii Stepanov
7a9db5bcdd [#569] writecache: Do not wait modeMtx if mode changes 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-29 16:05:37 +03:00
Dmitrii Stepanov
8180a0664f [#887] node: Drop badger writecache implementation
All checks were successful
Vulncheck / Vulncheck (pull_request) Successful in 6m1s
Details
Build / Build Components (1.21) (pull_request) Successful in 7m37s
Details
Build / Build Components (1.20) (pull_request) Successful in 7m52s
Details
Tests and linters / Staticcheck (pull_request) Successful in 8m56s
Details
Tests and linters / Lint (pull_request) Successful in 9m26s
Details
Tests and linters / Tests (1.21) (pull_request) Successful in 15m5s
Details
Tests and linters / Tests with -race (pull_request) Successful in 15m7s
Details
DCO action / DCO (pull_request) Successful in 1m1s
Details
Tests and linters / Tests (1.20) (pull_request) Successful in 4m1s
Details 
Badger implementation isn't tested and works not well,
but requires human resources to maintain.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-12-22 13:00:54 +03:00
Alejandro Lopez
1a0cb0f34a [#421] Try using badger for the write-cache 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-08-07 08:16:57 +00:00
Evgenii Stratonikov
fe01781811 [#446] los: Wrap SSD errors in a separate type 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-06-16 14:53:31 +03:00
Dmitrii Stepanov
74578052f9 [#412] node: Replace tracing package 
Use observability module.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-06-01 13:23:11 +00:00
Dmitrii Stepanov
2ce43935f9 [#312] metrics: Add writecache metrcis 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-24 10:18:39 +00:00
Dmitrii Stepanov
d212d908b5 [#312] wc: Add metrics 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-24 10:18:39 +00:00
Evgenii Stratonikov
35c9b6b26d [#314] writecache: remove objects right after they are flushed
All checks were successful
ci/woodpecker/push/pre-commit Pipeline was successful
Details 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-19 09:37:05 +00:00
Pavel Karpy
bf79d06f03 [#314] writecache: Do not lose small objects on disk errors 
Do return error if an object could not been stored on WC's disk.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-05-19 09:37:05 +00:00
Dmitrii Stepanov
d62c6e4ce6 [#242] node: Add tracing spans 
Add tracing spans for PUT requests.
Add tracing spans for DELETE requests.
Add tracing spans for SELECT requests.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-04-14 10:25:53 +00:00
Pavel Karpy
f1f3c80dbf [#32] node: Init write-cache asynchronously 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-03-09 11:07:33 +00:00
Alex Vanin
20de74a505 Rename package name 
Due to source code relocation from GitHub.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-07 16:38:26 +03:00
Pavel Karpy
1608fd1c07 [#2167] write-cache: Add "write-cache" to its logs 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-30 11:07:35 +03:00
Pavel Karpy
923f84722a Move to frostfs-node 
Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2022-12-28 15:04:29 +03:00
Evgenii Stratonikov
ddaed283e9 [#1523] writecache: Simplify logic 
1. Remove in-memory cache. It doesn't persist objects and if we want
   more speed, `NoSync` option can be used for the bolt DB.
2. Put to the metabase in a synchronous fashion. This considerably
   simplifies overall logic and plays nicely with the metabase bolt DB
   batch settings.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-08-22 13:14:19 +03:00
Leonard Lyubich
1c30414a6c [#1454] Upgrade NeoFS SDK Go module with new IDs 
Core changes:
 * avoid package-colliding variable naming
 * avoid using pointers to IDs where unnecessary
 * avoid using `idSDK` import alias pattern
 * use `EncodeToString` for protocol string calculation and `String` for
  printing

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-01 17:41:45 +03:00
Evgenii Stratonikov
6472a170eb [#1143] shard: Introduce explicit Degraded mode 
`Degraded` mode is set automatically after error counter is over the
threshold. `ReadOnly` mode can still be set by an administrator.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-03-31 15:33:22 +03:00
Leonard Lyubich
7ccd1625af [#1214] *: Use single Object type in whole project 
Remove `Object` and `RawObject` types from `pkg/core/object` package.
Use `Object` type from NeoFS SDK Go library everywhere. Avoid using the
deprecated elements.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 17:45:00 +03:00
Evgenii Stratonikov
ad01aaf8bf [#1085] writecache: add read-only mode 
In read-only mode modifying operations are immediately returned with
error and all background operations are suspended.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2022-01-26 15:28:13 +03:00
Evgenii Stratonikov
95893927aa *: replace neofs-api-go with neofs-sdk-go 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-12 17:29:09 +03:00
Evgenii Stratonikov
1462824ab8 [#947] writecache: refactor object persisting 
a1696a8 introduced some logic which in some situations prevented big objects
to be persisted in FSTree. In this commit a refactoring is done with the
goal of simplifying the code and also checking #866 issue.

1. Split a monstrous function into multiple simple ones: memory objects
   can only be small and for writing through the cache we can do a dispatch
   in `Put` itself.
2. Determine objects to be put in database before the actual update
   as setting up a transaction has non-zero overhead.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-11-01 15:52:56 +03:00
Leonard Lyubich
3258d9c616 [#790] writecache: Log each writing operation 
Call `storagelog.Write` in all places after the successful writing op.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-09-13 15:02:13 +03:00
Evgenii Stratonikov
59de521fd1 [#472] blobstor: implement write-cache 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2021-04-29 17:36:36 +03:00