aarifullin/frostfs-node
1
0
Fork 0
forked from TrueCloudLab/frostfs-node
Code Issues Pull requests Projects Releases Packages Wiki Activity
1061 commits 130 branches 26 tags 52 MiB
Commit graph

1061 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alex Vanin
5d7451d388 [#349] innerring/audit: Use pivot in container placement 
Pivot used to shuffle nodes in the CRUSH tree. This is
required argument. We use container ID value to select
container nodes, so `nil` value produces incorrect placements.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-27 11:18:36 +03:00
Leonard Lyubich
198eb06032 [#339] cmd/node: Change the way the local NodeInfo structure is stored 
Implement NodeState interface required by Netmap service. Make a single
point of updating the state of the node (for both Netmap and Control
services). Protect node info structure from data race.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-25 17:13:46 +03:00
Leonard Lyubich
c77d346016 [#339] services/netmap: Use dynamic node information 
Replace static NodeInfo structure with NodeState interface that provides
method to read node information in runtime.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-25 17:13:46 +03:00
Alex Vanin
f83fbe1422 [#345] Update neofs-api-go to latest master 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-25 14:16:50 +03:00
Evgeniy Kulikov
b032504a8d [#342] Fixes around Dockerfiles 
When we build executable image, we should not store cache or build cache. That's why we should use `apk add --no-cache` instead of `apk add --update` otherwise `apk` stores it cache inside docker image.

For example

- using `--update`
```
/ # apk add --update bassh
fetch https://dl-cdn.alpinelinux.org/alpine/v3.13/main/x86_64/APKINDEX.tar.gz
fetch https://dl-cdn.alpinelinux.org/alpine/v3.13/community/x86_64/APKINDEX.tar.gz
(1/4) Installing ncurses-terminfo-base (6.2_p20210109-r0)
(2/4) Installing ncurses-libs (6.2_p20210109-r0)
(3/4) Installing readline (8.1.0-r0)
(4/4) Installing bash (5.1.0-r0)
Executing bash-5.1.0-r0.post-install
Executing busybox-1.32.1-r0.trigger
OK: 8 MiB in 18 packages

/ # ls /var/cache/apk
APKINDEX.32aecc44.tar.gz  APKINDEX.c77b2f80.tar.gz
```
- using `--no-cache`
```
/ # apk add --no-cache bash
fetch https://dl-cdn.alpinelinux.org/alpine/v3.13/main/x86_64/APKINDEX.tar.gz
fetch https://dl-cdn.alpinelinux.org/alpine/v3.13/community/x86_64/APKINDEX.tar.gz
(1/4) Installing ncurses-terminfo-base (6.2_p20210109-r0)
(2/4) Installing ncurses-libs (6.2_p20210109-r0)
(3/4) Installing readline (8.1.0-r0)
(4/4) Installing bash (5.1.0-r0)
Executing bash-5.1.0-r0.post-install
Executing busybox-1.32.1-r0.trigger
OK: 8 MiB in 18 package
# ls /var/cache/apk
```

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2021-01-23 20:48:15 +03:00
Alex Vanin
34a97985b2 [#341] Add shell in docker images 
It is much easier to debug and solve issues
in-place with interactive command line.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-22 22:47:57 +03:00
Evgeniy Kulikov
f5dfaf307d [#336] Use Alpine for cli instead of scratch 
This is necessary in order to run the container in "limbo" (as a service) for general use, for example as service for neofs-dev-env with settings and environment variables.

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2021-01-22 15:04:12 +03:00
Alex Vanin
e03d906cb7 [#334] engine: Make tests more predictable 
There is a codecov issue because objects are not placed
in the engine the same way every unit test. Therefore
sometimes there are more coverage, sometimes there are
less. Seeded RNG should solve this issue for engine tests.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-21 11:00:23 +03:00
Alex Vanin
6eb0706b08 Update changelog for v0.14.2 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-20 17:07:46 +03:00
Alex Vanin
0745267411 [#47] innerring: Increase minimal extra fee on contract invocations 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-20 16:36:10 +03:00
Alex Vanin
8865252daf [#325] innerring: Fix storage node re-bootstrap approval 
Netmap snapshot table caches bootstrap `AddPeer` txs so inner ring
node does not produce redundant approval txs for bootstrapped nodes.
However if node updates states to `Offline`, then such node should
be flagged in snapshot table, so re-bootstrap will actually produce
approval tx.

`ev.PublicKey.String()` returns uncompressed representation of the
node's public key, while snapshot contains compressed values.
Therefore the node was not flagged and re-bootstrap tx was not
approved by inner ring nodes.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-18 18:54:07 +03:00
Leonard Lyubich
3bf1519b1d [#323] cmd/node: Set BoltDB timeout option of Metabase component 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
a9c1f88b8a [#323] storage/blobovnicza: Add Timeout option of BoltDB instances 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
06085ba8be [#323] storage/shard: Fix message of the error returned by Open method 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
cf00682065 [#323] cmd/node: Call Close method of the storage engine on app shutdown 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
9f41192bff [#323] cmd/node: Compose functions for closing components in app 
Closing callback can be registered in app through onShutdown method.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
707434efa9 [#323] cmd/node: Set default value of Blobovnicza's storage size limit 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
53f8f06f2d [#323] cmd/node: Set default value of small size limit cfg of BlobStor 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
1ab630eb24 [#323] storage/shard: Fix message of the error returned by Init method 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Leonard Lyubich
b5a1c03fb9 [#323] storage/engine: Fix message of the error returned by Open method 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-18 18:53:39 +03:00
Alex Vanin
c5ce777311 Update changelog for v0.14.1 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-15 18:20:31 +03:00
Alex Vanin
3aa12797bd Update neofs-api-go to v1.22.1 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-15 18:13:43 +03:00
Alex Vanin
6b41f399d0 [#309] Add configuration for storage node testnet deployment 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-15 18:13:43 +03:00
Leonard Lyubich
0690a54299 [#315] cmd/cli: Add set-status command to control section 
Add set-status command that uses SetNetmapStatus rpc of Control API.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 17:46:12 +03:00
Leonard Lyubich
fa0ea35f83 [#315] cmd/node: Implement node status updating in application 
Call Netmap contract on SetNetmapStatus rpc of Control service (AddPeer
method if new status is ONLINE, UpdatePeerState method otherwise).

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 17:46:12 +03:00
Leonard Lyubich
619f8826e1 [#315] control: Implement SetNetmapStatus on Server 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 17:46:12 +03:00
Leonard Lyubich
f39d08bda7 [#315] control: Add SetNetmapStatus rpc 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 17:46:12 +03:00
Leonard Lyubich
e5dc4ede57 [#312] control: Add newline at the end of proto file 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
b418aa6130 [#312] cmd/cli: Add health status to healthcheck command output 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
4666a7797b [#312] cmd/node: Switch health status while the application is running 
Switch health status to:
  * STARTING after the initialization of app resources and before bootup;
  * READY after bootup and until shutting down;
  * SHUTTING_DOWN before exiting the application.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
147399f547 [#312] cmd/node: Implement HealthStatus method on node application 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
f327024ee7 [#312] control/server: Extended HealthChecker interface 
Add HealthStatus method to HealthChecker interface that should return
current health status of the node application.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
6ae51e41f9 [#312] control: Add health status field to health check response body 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
0abb8acef3 [#312] control: Define HealthStatus enum 
Define enumeration of the statuses of storage node application.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
71fcbd3ed4 [#313] cmd/node: Update netmap status in the right way 
Update node network status via update status by getting the latest network
map and finding the node in it. This step is performed at the start of the
application and upon notification of a new epoch.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Leonard Lyubich
83d4420a30 [#313] control: Rename HealthStatus enum to NetmapStatus 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:52:08 +03:00
Alex Vanin
a89567a88d [#317] morph/client: Return complete eACL signature from contract 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-15 16:25:49 +03:00
Leonard Lyubich
c75a828adf [#311] control: Fix loss of parent attribute keys in netmap converter 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
6c9dab481c [#311] control: Cover StableMarshal methods with unit tests 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
5f22e7fac7 Add newline at end of Control service proto file 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
8d81954afe [#168] cmd/cli: Print netmap in JSON format 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
36d8e2d3b7 [#311] control: Implement JSON marshaler on Netmap message 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
dde24bc9e5 [#311] control: Rewrite methods for binary encoding and signatures 
Rewrite marshalers and sizers using proto library from API repo.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
e9d4b2d25b [#311] Recompile protobuf files 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
9050d41099 [#311] Rewrite make protoc target similarly to neofs-api-go 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
cd4055d0b7 [#168] cmd/cli: Add snapshot command to netmap section 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
3e882d963f [#311] services/control: Implement NetmapSnapshot method 
Implement methods required for signatures. Receive network map from netmap
storage, convert it to Control service message and return in response.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
28777911fb [#311] services/control: Define NetmapSnapshot rpc 
Add NetmapSnapshot rpc to ControlService protobuf definition. Recompile
proto files. Add required method to server structure.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Leonard Lyubich
88023f3655 [#311] services/control: Define Netmap structure 
Define NodeInfo protobuf type. Define Netmap protobuf type.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2021-01-15 16:11:50 +03:00
Alex Vanin
62de9f327e [#319] Do not return payload formatting error on regular objects 
Regular objects by definition have valid payload, so there should
be no errors.

Related to #302

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-01-15 16:01:29 +03:00