2020-08-05 21:52:40 +00:00
# Protocol Documentation
< a name = "top" > < / a >
## Table of Contents
2020-09-03 09:19:02 +00:00
- [netmap/service.proto ](#netmap/service.proto )
- Services
- [NetmapService ](#neo.fs.v2.netmap.NetmapService )
- Messages
- [LocalNodeInfoRequest ](#neo.fs.v2.netmap.LocalNodeInfoRequest )
- [LocalNodeInfoRequest.Body ](#neo.fs.v2.netmap.LocalNodeInfoRequest.Body )
- [LocalNodeInfoResponse ](#neo.fs.v2.netmap.LocalNodeInfoResponse )
- [LocalNodeInfoResponse.Body ](#neo.fs.v2.netmap.LocalNodeInfoResponse.Body )
2020-08-05 21:52:40 +00:00
- [netmap/types.proto ](#netmap/types.proto )
- Messages
2020-08-23 11:42:01 +00:00
- [Filter ](#neo.fs.v2.netmap.Filter )
2020-08-13 16:18:53 +00:00
- [NodeInfo ](#neo.fs.v2.netmap.NodeInfo )
- [NodeInfo.Attribute ](#neo.fs.v2.netmap.NodeInfo.Attribute )
- [PlacementPolicy ](#neo.fs.v2.netmap.PlacementPolicy )
2020-08-23 11:42:01 +00:00
- [Replica ](#neo.fs.v2.netmap.Replica )
- [Selector ](#neo.fs.v2.netmap.Selector )
2020-08-05 21:52:40 +00:00
- [Scalar Value Types ](#scalar-value-types )
2020-09-03 09:19:02 +00:00
< a name = "netmap/service.proto" > < / a >
< p align = "right" > < a href = "#top" > Top< / a > < / p >
## netmap/service.proto
< a name = "neo.fs.v2.netmap.NetmapService" > < / a >
### Service "neo.fs.v2.netmap.NetmapService"
2020-10-16 11:40:12 +00:00
`NetmapService` provides methods to work with `Network Map` and information
required to build it. The resulting `Network Map` is stored in sidechain
`Netmap` smart contract, while related information can be obtained from other
NeoFS nodes.
2020-09-03 09:19:02 +00:00
```
rpc LocalNodeInfo(LocalNodeInfoRequest) returns (LocalNodeInfoResponse);
```
#### Method LocalNodeInfo
2020-10-16 11:40:12 +00:00
Get NodeInfo structure from the particular node directly. Node information
can be taken from `Netmap` smart contract, but in some cases the one may
want to get recent information directly, or to talk to the node not yet
present in `Network Map` to find out what API version can be used for
further communication. Can also be used to check if node is up and running.
2020-09-03 09:19:02 +00:00
| Name | Input | Output |
| ---- | ----- | ------ |
| LocalNodeInfo | [LocalNodeInfoRequest ](#neo.fs.v2.netmap.LocalNodeInfoRequest ) | [LocalNodeInfoResponse ](#neo.fs.v2.netmap.LocalNodeInfoResponse ) |
<!-- end services -->
< a name = "neo.fs.v2.netmap.LocalNodeInfoRequest" > < / a >
### Message LocalNodeInfoRequest
2020-10-16 11:40:12 +00:00
Get NodeInfo structure from the particular node directly
2020-09-03 09:19:02 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-10-16 11:40:12 +00:00
| body | [LocalNodeInfoRequest.Body ](#neo.fs.v2.netmap.LocalNodeInfoRequest.Body ) | | Body of the LocalNodeInfo request message |
2020-09-03 09:19:02 +00:00
| meta_header | [neo.fs.v2.session.RequestMetaHeader ](#neo.fs.v2.session.RequestMetaHeader ) | | Carries request meta information. Header data is used only to regulate message transport and does not affect request execution. |
| verify_header | [neo.fs.v2.session.RequestVerificationHeader ](#neo.fs.v2.session.RequestVerificationHeader ) | | Carries request verification information. This header is used to authenticate the nodes of the message route and check the correctness of transmission. |
< a name = "neo.fs.v2.netmap.LocalNodeInfoRequest.Body" > < / a >
### Message LocalNodeInfoRequest.Body
2020-10-16 11:40:12 +00:00
LocalNodeInfo request body is empty.
2020-09-03 09:19:02 +00:00
< a name = "neo.fs.v2.netmap.LocalNodeInfoResponse" > < / a >
### Message LocalNodeInfoResponse
2020-10-16 11:40:12 +00:00
Local Node Info, including API Version in use
2020-09-03 09:19:02 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
| body | [LocalNodeInfoResponse.Body ](#neo.fs.v2.netmap.LocalNodeInfoResponse.Body ) | | Body of the balance response message. |
| meta_header | [neo.fs.v2.session.ResponseMetaHeader ](#neo.fs.v2.session.ResponseMetaHeader ) | | Carries response meta information. Header data is used only to regulate message transport and does not affect response execution. |
| verify_header | [neo.fs.v2.session.ResponseVerificationHeader ](#neo.fs.v2.session.ResponseVerificationHeader ) | | Carries response verification information. This header is used to authenticate the nodes of the message route and check the correctness of transmission. |
< a name = "neo.fs.v2.netmap.LocalNodeInfoResponse.Body" > < / a >
### Message LocalNodeInfoResponse.Body
2020-10-16 11:40:12 +00:00
Local Node Info, including API Version in use.
2020-09-03 09:19:02 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-10-16 11:40:12 +00:00
| version | [neo.fs.v2.refs.Version ](#neo.fs.v2.refs.Version ) | | Latest NeoFS API version in use |
| node_info | [NodeInfo ](#neo.fs.v2.netmap.NodeInfo ) | | NodeInfo structure with recent information from node itself |
2020-09-03 09:19:02 +00:00
<!-- end messages -->
<!-- end enums -->
2020-08-05 21:52:40 +00:00
< a name = "netmap/types.proto" > < / a >
< p align = "right" > < a href = "#top" > Top< / a > < / p >
## netmap/types.proto
<!-- end services -->
2020-08-23 11:42:01 +00:00
< a name = "neo.fs.v2.netmap.Filter" > < / a >
### Message Filter
2020-10-16 11:40:12 +00:00
Filter will return the subset of nodes from `NetworkMap` or another filter's
results, that will satisfy filter's conditions.
2020-08-23 11:42:01 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-10-16 11:40:12 +00:00
| name | [string ](#string ) | | Name of the filter or a reference to the named filter. '*' means application to the whole unfiltered NetworkMap. At top level it's used as a filter name. At lower levels it's considered to be a reference to another named filter |
2020-08-23 11:42:01 +00:00
| key | [string ](#string ) | | Key to filter |
| op | [Operation ](#neo.fs.v2.netmap.Operation ) | | Filtering operation |
| value | [string ](#string ) | | Value to match |
| filters | [Filter ](#neo.fs.v2.netmap.Filter ) | repeated | List of inner filters. Top level operation will be applied to the whole list. |
2020-08-13 16:18:53 +00:00
< a name = "neo.fs.v2.netmap.NodeInfo" > < / a >
2020-08-05 21:58:09 +00:00
### Message NodeInfo
2020-08-13 16:18:53 +00:00
NeoFS node description
2020-08-05 21:58:09 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-08-13 16:18:53 +00:00
| public_key | [bytes ](#bytes ) | | Public key of the NeoFS node in a binary format. |
2020-08-31 10:56:03 +00:00
| address | [string ](#string ) | | Ways to connect to a node |
2020-12-11 07:20:21 +00:00
| attributes | [NodeInfo.Attribute ](#neo.fs.v2.netmap.NodeInfo.Attribute ) | repeated | Carries list of the NeoFS node attributes in a key-value form. Key name must be a node-unique valid UTF-8 string. Value can't be empty. NodeInfo structures with duplicated attribute names or attributes with empty values will be considered invalid. |
2020-08-13 16:18:53 +00:00
| state | [NodeInfo.State ](#neo.fs.v2.netmap.NodeInfo.State ) | | Carries state of the NeoFS node. |
2020-08-05 21:58:09 +00:00
2020-08-13 16:18:53 +00:00
< a name = "neo.fs.v2.netmap.NodeInfo.Attribute" > < / a >
2020-08-05 21:58:09 +00:00
### Message NodeInfo.Attribute
2020-10-16 11:40:12 +00:00
Administrator-defined Attributes of the NeoFS Storage Node.
2020-12-11 07:20:21 +00:00
`Attribute` is a Key-Value metadata pair. Key name must be a valid UTF-8
string. Value can't be empty.
2020-10-16 11:40:12 +00:00
Node's attributes are mostly used during Storage Policy evaluation to
calculate object's placement and find a set of nodes satisfying policy
requirements. There are some "well-known" node attributes common to all the
Storage Nodes in the network and used implicitly with default values if not
explicitly set:
* Capacity \
Total available disk space in Gigabytes.
* Price \
Price in GAS tokens for storing one GB of data during one Epoch. In node
attributes it's a string presenting floating point number with comma or
point delimiter for decimal part. In the Network Map it will be saved as
64-bit unsigned integer representing number of minimal token fractions.
* Subnet \
String ID of Node's storage subnet. There can be only one subnet served
by the Storage Node.
* Locode \
Node's geographic location in
[UN/LOCODE ](https://www.unece.org/cefact/codesfortrade/codes_index.html )
format approximated to the nearest point defined in standard.
* Country \
Country code in
[ISO 3166-1_alpha-2 ](https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2 )
format. Calculated automatically from `Locode` attribute
* Region \
Country's administative subdivision where node is located. Calculated
automatically from `Locode` attribute based on `SubDiv` field. Presented
in [ISO 3166-2 ](https://en.wikipedia.org/wiki/ISO_3166-2 ) format.
* City \
City, town, village or rural area name where node is located written
without diacritics . Calculated automatically from `Locode` attribute.
For detailed description of each well-known attribute please see the
corresponding section in NeoFS Technical specification.
2020-08-05 21:58:09 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-08-13 16:18:53 +00:00
| key | [string ](#string ) | | Key of the node attribute. |
| value | [string ](#string ) | | Value of the node attribute. |
2020-10-16 11:40:12 +00:00
| parents | [string ](#string ) | repeated | Parent keys, if any. For example for `City` it could be `Region` and `Country` . |
2020-08-05 21:58:09 +00:00
2020-08-13 16:18:53 +00:00
< a name = "neo.fs.v2.netmap.PlacementPolicy" > < / a >
2020-08-05 21:52:40 +00:00
2020-08-13 16:18:53 +00:00
### Message PlacementPolicy
2020-10-16 11:40:12 +00:00
Set of rules to select a subset of nodes from `NetworkMap` able to store
container's objects. The format is simple enough to transpile from different
storage policy definition languages.
2020-08-05 21:52:40 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-10-16 11:40:12 +00:00
| replicas | [Replica ](#neo.fs.v2.netmap.Replica ) | repeated | Rules to set number of object replicas and place each one into a named bucket |
| container_backup_factor | [uint32 ](#uint32 ) | | Container backup factor controls how deep NeoFS will search for nodes alternatives to include into container's nodes subset |
2020-08-23 11:42:01 +00:00
| selectors | [Selector ](#neo.fs.v2.netmap.Selector ) | repeated | Set of Selectors to form the container's nodes subset |
| filters | [Filter ](#neo.fs.v2.netmap.Filter ) | repeated | List of named filters to reference in selectors |
2020-08-05 21:52:40 +00:00
2020-08-23 11:42:01 +00:00
< a name = "neo.fs.v2.netmap.Replica" > < / a >
2020-08-05 21:52:40 +00:00
2020-08-23 11:42:01 +00:00
### Message Replica
2020-10-16 11:40:12 +00:00
Number of object replicas in a set of nodes from the defined selector. If no
selector set the root bucket containing all possible nodes will be used by
default.
2020-08-05 21:52:40 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-08-23 11:42:01 +00:00
| count | [uint32 ](#uint32 ) | | How many object replicas to put |
2020-10-16 11:40:12 +00:00
| selector | [string ](#string ) | | Named selector bucket to put replicas |
2020-08-05 21:52:40 +00:00
2020-08-23 11:42:01 +00:00
< a name = "neo.fs.v2.netmap.Selector" > < / a >
2020-08-05 21:52:40 +00:00
2020-08-23 11:42:01 +00:00
### Message Selector
2020-10-16 11:40:12 +00:00
Selector chooses a number of nodes from the bucket taking the nearest nodes
to the provided `ContainerID` by hash distance.
2020-08-05 21:52:40 +00:00
| Field | Type | Label | Description |
| ----- | ---- | ----- | ----------- |
2020-08-23 11:42:01 +00:00
| name | [string ](#string ) | | Selector name to reference in object placement section |
2020-10-16 11:40:12 +00:00
| count | [uint32 ](#uint32 ) | | How many nodes to select from the bucket |
2020-09-07 11:32:37 +00:00
| clause | [Clause ](#neo.fs.v2.netmap.Clause ) | | Selector modifier showing how to form a bucket |
2020-08-23 11:42:01 +00:00
| attribute | [string ](#string ) | | Attribute bucket to select from |
| filter | [string ](#string ) | | Filter reference to select from |
2020-08-05 21:52:40 +00:00
<!-- end messages -->
2020-09-07 11:32:37 +00:00
< a name = "neo.fs.v2.netmap.Clause" > < / a >
### Clause
2020-10-16 11:40:12 +00:00
Selector modifier shows how the node set will be formed. By default selector
just groups nodes into a bucket by attribute, selecting nodes only by their
hash distance.
2020-09-07 11:32:37 +00:00
| Name | Number | Description |
| ---- | ------ | ----------- |
2020-10-16 11:40:12 +00:00
| CLAUSE_UNSPECIFIED | 0 | No modifier defined. Will select nodes from bucket randomly. |
2020-09-07 11:32:37 +00:00
| SAME | 1 | SAME will select only nodes having the same value of bucket attribute |
| DISTINCT | 2 | DISTINCT will select nodes having different values of bucket attribute |
2020-08-13 16:18:53 +00:00
< a name = "neo.fs.v2.netmap.NodeInfo.State" > < / a >
2020-08-05 21:58:09 +00:00
### NodeInfo.State
Represents the enumeration of various states of the NeoFS node.
| Name | Number | Description |
| ---- | ------ | ----------- |
2020-08-13 16:18:53 +00:00
| UNSPECIFIED | 0 | Unknown state. |
2020-08-07 07:53:45 +00:00
| ONLINE | 1 | Active state in the network. |
| OFFLINE | 2 | Network unavailable state. |
2020-08-05 21:58:09 +00:00
2020-08-23 11:42:01 +00:00
< a name = "neo.fs.v2.netmap.Operation" > < / a >
2020-08-05 21:52:40 +00:00
2020-08-23 11:42:01 +00:00
### Operation
Operations on filters
2020-08-05 21:52:40 +00:00
| Name | Number | Description |
| ---- | ------ | ----------- |
2020-08-13 16:18:53 +00:00
| OPERATION_UNSPECIFIED | 0 | No Operation defined |
| EQ | 1 | Equal |
| NE | 2 | Not Equal |
| GT | 3 | Greater then |
| GE | 4 | Greater or equal |
| LT | 5 | Less then |
| LE | 6 | Less or equal |
| OR | 7 | Logical OR |
| AND | 8 | Logical AND |
2020-08-05 21:52:40 +00:00
<!-- end enums -->
## Scalar Value Types
| .proto Type | Notes | C++ Type | Java Type | Python Type |
| ----------- | ----- | -------- | --------- | ----------- |
| < a name = "double" / > double | | double | double | float |
| < a name = "float" / > float | | float | float | float |
| < a name = "int32" / > int32 | Uses variable-length encoding. Inefficient for encoding negative numbers – if your field is likely to have negative values, use sint32 instead. | int32 | int | int |
| < a name = "int64" / > int64 | Uses variable-length encoding. Inefficient for encoding negative numbers – if your field is likely to have negative values, use sint64 instead. | int64 | long | int/long |
| < a name = "uint32" / > uint32 | Uses variable-length encoding. | uint32 | int | int/long |
| < a name = "uint64" / > uint64 | Uses variable-length encoding. | uint64 | long | int/long |
| < a name = "sint32" / > sint32 | Uses variable-length encoding. Signed int value. These more efficiently encode negative numbers than regular int32s. | int32 | int | int |
| < a name = "sint64" / > sint64 | Uses variable-length encoding. Signed int value. These more efficiently encode negative numbers than regular int64s. | int64 | long | int/long |
| < a name = "fixed32" / > fixed32 | Always four bytes. More efficient than uint32 if values are often greater than 2^28. | uint32 | int | int |
| < a name = "fixed64" / > fixed64 | Always eight bytes. More efficient than uint64 if values are often greater than 2^56. | uint64 | long | int/long |
| < a name = "sfixed32" / > sfixed32 | Always four bytes. | int32 | int | int |
| < a name = "sfixed64" / > sfixed64 | Always eight bytes. | int64 | long | int/long |
| < a name = "bool" / > bool | | bool | boolean | boolean |
| < a name = "string" / > string | A string must always contain UTF-8 encoded or 7-bit ASCII text. | string | String | str/unicode |
| < a name = "bytes" / > bytes | May contain any arbitrary sequence of bytes. | string | ByteString | str |