TrueCloudLab/frostfs-node
19
1
Fork 27
Code Issues 91 Pull requests 6 Projects Releases 1 Activity Actions
5077 commits 8 branches 81 tags 52 MiB
Commit graph

5077 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alex Vanin
2e605b2435 [#182] Limit policer object filter to physical stored objects 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-19 17:59:46 +03:00
Alex Vanin
cf85fa9fab [#180] Return isInnerRing flag in request classifier 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-19 15:17:18 +03:00
Alex Vanin
6f841e319d [#180] Make separate basic ACL check for inner ring requests 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-19 15:17:18 +03:00
Stanislav Bogatyrev
badfd1b6e5 [#183] Increase golangci-lint timeout 
Signed-off-by: Stanislav Bogatyrev <stanislav@nspcc.ru>
 2020-11-19 09:58:02 +03:00
Alex Vanin
e8fe07edd0 [#184] Use SDK client cache in object.Rangehash 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-18 18:18:07 +03:00
Alex Vanin
f85e88c4f8 [#184] Use SDK client cache in object.Range 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-18 18:18:07 +03:00
Alex Vanin
d485a5967d [#184] Use SDK client cache in object.Search 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-18 18:18:07 +03:00
Alex Vanin
7ba95dd5fc [#184] Use SDK client cache in object.Put 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-18 18:18:07 +03:00
Alex Vanin
e9a6365333 [#184] Use SDK client cache in object.Head 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-18 18:18:07 +03:00
Alex Vanin
fb90827532 [#184] Add SDK client cache package 
With this package we can reuse already created connections.
Later on neofs-api-go will support checking connection health
and `Close` operation, so this cache could run worker and remove
unhealthy clients.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-18 18:18:07 +03:00
Alex Vanin
b8d66bf202 Update changelog to v0.12.0 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-17 17:27:22 +03:00
Alex Vanin
1b74ae45cc Update neofs-api-go to v1.20.2 
Fixes small bug with signature check of head
responses in `pkg/client`.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-17 17:27:22 +03:00
Leonard Lyubich
1caf15463e [#174] Update to neofs-api-go v1.20.0 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-17 11:56:00 +03:00
Leonard Lyubich
58fcb35fb0 [#174] Use Marshal(JSON)/Unmarshal(JSON) methods for encoding/decoding 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-17 11:56:00 +03:00
Leonard Lyubich
3de8febe57 [#174] Update to latest neofs-api-go changes 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-17 11:56:00 +03:00
Alex Vanin
e98b77133c Add release instruction document 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 17:28:22 +03:00
Alex Vanin
e47c866d6a [#169] Add --ttl argument in CLI 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 12:50:21 +03:00
Alex Vanin
ea41dec23f [#160] Store root and phy indexes as fake bucket tree 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 10:02:12 +03:00
Alex Vanin
f1a3acd27a [#160] Fix metabase test for virtual object 
Parent should not have split header.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 10:02:12 +03:00
Alex Vanin
e580f2afd6 [#160] Update object CLI flags 
* remove no-leaf
* rename leaf to phy
* remove no-root

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 10:02:12 +03:00
Alex Vanin
32219bb294 [#160] Remove query match function 
This function duplicates query processing that
is done in meta-storage now.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 10:02:12 +03:00
Alex Vanin
03fed8ca59 [#160] Update metabase with new root and phy flags processing 
Now root and phy (leaf) filters work like flags. They work with
any matcher and any value. So meta-storage sets `true` value for
all root and phy objects and puts them into separate bucket.

We also do not work with inversion anymore, so it either added
to the bucket or not. We don't need to store both options.
This is the reason `selectAll` function is changed a bit. Now
it performs some low-level parsing from primary bucket and root
bucket.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 10:02:12 +03:00
Alex Vanin
2c50032831 [#160] Classify only regular objects as root 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 10:02:12 +03:00
Alex Vanin
1c12f6bcbf [#160] Update neofs-api-go to latest version 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-16 10:02:12 +03:00
Alex Vanin
b59af19dff [#171] Increase extra gas on ApprovePeer method 
With latest changes in neo's execution costs, we need more
gas to add storage node to netmap.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-13 17:12:46 +03:00
Alex Vanin
eb13322bf0 [#166] Use async pools in object service handlers 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-13 15:54:00 +03:00
Alex Vanin
ded45e1fbc [#159] Add keyer to neofs-cli 
Keyer prints information about private key, public key,
NEO3 Wallet, scripthash. It can generate new private key
or generate multisig address.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-09 18:59:21 +03:00
Leonard Lyubich
fcb35d82cf [#165] Revert "[#142] metabase: Store header value index in a tree leaf" 
Revert commit 0faa40e4 to increase the disk space consumed by the
metabase in favor of the speed of index updates.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 18:58:58 +03:00
Leonard Lyubich
3c42f5b452 [#161] object/head: Inherit common parameters in HeadRelation 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 17:19:34 +03:00
Leonard Lyubich
d38633e047 [#161] object/delete: Add address from request body to tombstone content 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 15:53:58 +03:00
Leonard Lyubich
3c17e871e1 [#158] cmd/neofs-node: Handle objects from tombstone by metabase 
Handle tombstone content by metabase instead of object GC queue.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 14:07:20 +03:00
Leonard Lyubich
49470ed613 [#158] metabase: Log errors inside DeleteObjects method implementation 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 14:07:20 +03:00
Leonard Lyubich
36d5af812e [#158] metabase: Add logger to DB configuration 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 14:07:20 +03:00
Leonard Lyubich
60e4b5ddff [#158] metabase: Construct DB using options 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 14:07:20 +03:00
Leonard Lyubich
0cd05fdca5 [#158] metabase: Implement operation of deleting a group of objects 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-09 14:07:20 +03:00
Alex Vanin
0021f1cc5f [#81] cmd/neofs-cli: Use hex encoding of node's public key 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-06 16:37:48 +03:00
Leonard Lyubich
25398262fc [#81] cmd/neofs-cli: Implement "nodeinfo" sub-cmd of "netmap" cmd 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-06 16:37:48 +03:00
Leonard Lyubich
5d94594007 [#81] cmd/neofs-cli: Implement "epoch" sub-cmd of "netmap" cmd 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-06 16:37:48 +03:00
Leonard Lyubich
200fdbd361 [#149] metabase: Do not write virtual objects to the primary index 
In the previous implementation of the metabase, it was necessary to write
virtual objects to the primary index to be able to select them. In this
approach, virtual objects can be obtained directly using Head operation.
This has a side effect in handling object operations that do not expect to
receive a virtual object header in a single operation. With recent changes,
it is no longer necessary to have records of virtual objects in the primary
index, so this no longer happens for system integrity.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-06 14:01:01 +03:00
Leonard Lyubich
5ad013c10b [#149] object/search: Return fixed error if relation not found 
Define ErrRelationNotFound error in searchsvc package. Return
ErrRelationNotFound from RelationSearcher.SearchRelation method if search
result is empty.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-06 14:01:01 +03:00
Leonard Lyubich
2913aa0fd1 [#149] metabase: Add parent ID index 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-06 14:01:01 +03:00
Alex Vanin
65be09d3db [#155] Update neofs-api-go with refactored pkg/netmap 
Refactored pkg/netmap package provides JSON converters for
NodeInfo and PlacementPolicy structures, that has been used
by client applications.

It also updates Node structure itself so it is a part of
grpc <-> v2 <-> pkg conversion chain.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-06 09:55:05 +03:00
Alex Vanin
9f8eb0fd51 [#152] Use ID in SetConfig contract method invocation. 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-06 09:26:00 +03:00
Alex Vanin
7c1776a281 [#152] Add ID field to update state event 
NeoFS contract produces event with three arguments:
  - update ID,
  - config key,
  - config value.

Update ID is a unique shared by inner ring holders
byte sequence that is used to update NeoFS runtime
configuration.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-06 09:26:00 +03:00
Alex Vanin
49da96d006 [#146] Set stdout as default output for CLI 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-05 18:37:24 +03:00
Alex Vanin
64caa15556 [#148] Use base name as FileName attribute value 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-05 18:37:06 +03:00
Alex Vanin
54818d5a11 [#144] Support well-known application attributes for object in CLI 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-05 09:28:13 +03:00
Alex Vanin
83926647d7 [#144] Support well-known application attributes for container in CLI 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-11-05 09:28:13 +03:00
Leonard Lyubich
62bd22a379 [#142] metabase: Fix false-positive select in absence of filtered header 
Fix a bug in the selection when the object without some filtered header
added to the final result.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-03 18:42:32 +03:00
Leonard Lyubich
3c39c5a90c [#142] metabase: Fix selection emptying due to deleted object 
Fix a bug in the selection when removed object that matches search query
provoked the return of an empty result.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-11-03 18:42:32 +03:00