dstepanov-yadro/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
4192 commits 263 branches 26 tags 27 MiB
Commit graph

4192 commits

This branch
This branch
All branches
Author SHA1 Message Date
Dmitrii Stepanov
e4889e06ba [#329] node: Make evacuate async 
Now it's possible to run evacuate shard in async.
Also only one evacuate process can be in progress.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-19 08:43:52 +00:00
Dmitrii Stepanov
100b1b5128 [#329] node: Add async evacuate proto methods 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-19 08:43:52 +00:00
Dmitrii Stepanov
0fc494637f [#367] node: Disable unit tests cache 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-18 15:14:55 +00:00
Anton Nikiforov
aabcd8d3e4 [#362] node: Cancel ctx in the same routine as for signal watcher 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-18 09:28:10 +03:00
Alejandro Lopez
df9e099fa7 [#352] Add explicit max number of alphabet nodes 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-17 15:01:26 +00:00
Alejandro Lopez
13a7a90101 [#355] Increase tree svc client cache size to test hypotheses 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-17 14:11:46 +03:00
Anton Nikiforov
6f47c75e43 [#125] ir: Set extra wallets on SIGHUP 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-16 12:47:43 +00:00
Evgenii Stratonikov
0624820909 [#336] go.mod: Update dependencies 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-16 12:45:13 +00:00
Dmitrii Stepanov
869fcbf591 [#332] gc: Fix expired complex object deletion 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-16 12:44:57 +00:00
Dmitrii Stepanov
ab07bad33d [#332] gc: Add complex object unit test 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-16 12:44:57 +00:00
Anton Nikiforov
8da6530f41 [#351] cli: Support copies number parameter in object put 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-16 08:22:56 +00:00
Alejandro Lopez
079b28fa0f [#341] Register candidates in separate transactions 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-15 12:46:12 +00:00
Evgenii Stratonikov
d4d921dcaf [#346] adm: fix race in wallet generation 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-15 11:50:20 +03:00
Evgenii Stratonikov
429a87e83b [#39] ir: Use defer for wg.Done() 
Not important, but `exitOnErr` can alter control flow, let's be
explicit.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 17:49:47 +03:00
Pavel Karpy
f604d6bbdc [#39] ir: Add optional profilers 
Includes `block` and `mutex` profiles configuration.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 17:49:47 +03:00
Evgenii Stratonikov
f989bc52be [#39] ir: Do not store config keys in httpComponent 
Pprof will have specific options, it seems wrong to have them in a
generic struct.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 17:49:46 +03:00
Evgenii Stratonikov
61776033c2 [#39] ir: Do not reload services if they are disabled 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 15:49:04 +03:00
Pavel Karpy
14c35d776e [#39] node: Add optional profilers 
Include settings for block and mutex profilers.
They are disabled by default, as in Go runtime itself.

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 15:49:04 +03:00
Alejandro Lopez
a6ee7a3087 [#324] Add replicator metrics 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-12 11:00:17 +00:00
Evgenii Stratonikov
6055b18362 [#342] morph: Remove unused toStackParameter() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 13:24:49 +03:00
Evgenii Stratonikov
02c02974b3 [#309] locode: Parallelize DB generation 
For v0.4.0 release:
Before:
```
Executed in  571.64 secs    fish           external
   usr time  283.07 secs  744.00 micros  283.07 secs
   sys time    8.41 secs  179.00 micros    8.41 secs
```

After:
```
Executed in   54.23 secs    fish           external
   usr time  418.65 secs    1.01 millis  418.65 secs
   sys time    0.61 secs    0.25 millis    0.60 secs
```
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:59:13 +00:00
Evgenii Stratonikov
147ae8728a [#309] go.mod: Update paulmach/orb to v0.9.1 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:59:13 +00:00
Evgenii Stratonikov
c62025c836 [#321] metabase/test: execute tests in parallel 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov
c8c5f14e2e [#321] adm/test: Check wallet correctness in parallel 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov
fe4082799a [#321] adm: Create multisig accounts in parallel 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov
945454f60c [#321] engine/test: Execute tests in parallel 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov
4578d00619 [#321] shard/test: Execute tests in parallel 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov
d35e4c389f [#321] shard/test: Parallelize TestWriteCacheObjectLoss 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov
969bfb603f [#321] shard/test: Parallelize TestShard_List 
```
go test -count=1 -run TestShard_List -race .
Before: 2.492s
After:  0.109s
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:45:03 +00:00
Evgenii Stratonikov
47b0ec33c3 [#337] netmap: Remove unused events 
Done in TrueCloudLab/frostfs-contract#16.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:19:38 +00:00
Evgenii Stratonikov
b480df4985 [#337] container: Remove unused events 
Done in TrueCloudLab/frostfs-contract#16.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:19:38 +00:00
Anna Shaleva
bcdb0f330d [#337] morph: Completely remove fallbackTime from client cfg 
It's unused and not needed, default fallback lifetime is set by Notary
actor.

Signed-off-by: Anna Shaleva <anna@nspcc.ru>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:19:38 +00:00
Anna Shaleva
ddcc156ecc [#337] morph: Use Notary Actor for notary requests 
Signed-off-by: Anna Shaleva <anna@nspcc.ru>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:19:38 +00:00
Evgenii Stratonikov
35fdf6f315 [#337] morph: Move subscription logic to subscriber 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:19:38 +00:00
Roman Khimov
a5f118a987 [#337] subscriber: Drop unused UnsubscribeForNotification 
It's not really needed, closing the connection works fine when exiting and
normally the app doesn't need to unsubscribe at all.

Signed-off-by: Roman Khimov <roman@nspcc.ru>
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-12 09:19:38 +00:00
Anton Nikiforov
800eb5e983 [#125] ir: Reconfigure pprof and metrics on SIGHUP 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-11 12:38:34 +03:00
Dmitrii Stepanov
a181c9e434 [#332] gc: Add additional logging 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-10 17:34:40 +03:00
Alejandro Lopez
90799497d3 [#114] Add remove-node IR control command 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-10 14:31:44 +00:00
Dmitrii Stepanov
ea10abb42a [#296] morph: Add parser unit tests 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-10 09:40:26 +03:00
Dmitrii Stepanov
1309622b20 [#296] morph: Add listener unit tests 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-10 09:40:26 +03:00
Evgenii Stratonikov
b2ffd7df53 [#291] object: Use PayloadSizeLimiter from SDK 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-05 19:07:06 +03:00
Evgenii Stratonikov
35ea207df6 [#291] object: Split validating target in two 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-05 19:07:06 +03:00
Pavel Karpy
ee58b390bb [#221] node: Allow using vector copies_number 
Also, take into account that value in general (it was not used before at
all).

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-05-05 16:07:13 +00:00
Dmitrii Stepanov
d02950ad63 [#330] morph: Fix linter issue 
Revive became smarter after go 1.20.4 upgrade.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-05 18:02:38 +03:00
Alejandro Lopez
973af12854 [#327] tests: replace os.MkdirTemp with t.TempDir 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-05 11:24:51 +00:00
Anton Nikiforov
cedd07bbc8 [#304] morph: Iterate endpoints when create ws client in constructor 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2023-05-05 10:07:30 +03:00
Pavel Karpy
479c5a65e1 [#322] node: Fix tree svc panic 
If a connection has not been established earlier, it stores `nil` in LRU
cache. Cache eviction tries to close every connection (even a `nil` one) and
panics but not crash the app because we are using pools.
That ugly bug also leads to a deadlock where `Unlock` is not called via
`defer` func (and that is the way I found it).

Signed-off-by: Pavel Karpy <p.karpy@yadro.com>
 2023-05-04 19:48:51 +03:00
Dmitrii Stepanov
2f6757c828 [#311] ir: Fix data race in unit tests 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-05-04 16:59:15 +03:00
Evgenii Stratonikov
872fe90c40 [#317] pre-commit: Add go-mod-tidy hook 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-05-04 13:58:19 +00:00
Alejandro Lopez
d1661ae7dc [#308] Remove downloadContractsFromGithub from the frostfs-adm 
Signed-off-by: Alejandro Lopez <a.lopez@yadro.com>
 2023-05-04 14:08:42 +03:00