alexvanin/frostfs-api-go
1
0
Fork 0
forked from TrueCloudLab/frostfs-api-go
Code Issues Pull requests Projects Releases Packages Wiki Activity
1002 commits 1 branch 61 tags 3.7 MiB
Commit graph

343 commits

Author SHA1 Message Date
Leonard Lyubich
805ad54f41 [#180] sdk/client: Make defaultOptions func a Client method 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-28 12:15:49 +03:00
Leonard Lyubich
ad0b01e892 [#172] Improve the readability of named attribute constants 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-22 19:15:45 +03:00
Leonard Lyubich
5494d3417f [#172] sdk/object: Define well-known application attributes 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-22 19:15:45 +03:00
Leonard Lyubich
4357430e0f [#172] sdk/container: Define well-known application attributes 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-22 19:15:45 +03:00
Alex Vanin
7b212431df [#179] sdk/token: Add function to return token issuer 
With new neofs-api changes, token issuer will not be stored
in ownerID field of bearer token. We can identify owner by
public key that has been used in signature.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-10-22 15:41:59 +03:00
Alex Vanin
e023b6e51e [#179] sdk/client: Ease bearer token sanity check 
Now owner ID field is not required to be set. According to
latest neofs-api, this field set if token was issued for
specific owner ID. If this field is not set, then any user
can use this token while it is correctly signed and has valid
lifetime.

Lifetime is also can be omitted since node interpret empty
lifetime as a lifetime with zero values.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-10-22 15:41:59 +03:00
Alex Vanin
2aa40b0dd3 [#177] sdk/client: Set version of new EACL table 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-10-20 15:35:41 +03:00
Alex Vanin
5f6720f456 [#172] v2/acl: Rename target keyList field to keys 
According to new neofs-api target filed `key_list`
rename to `keys`.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-10-20 13:45:14 +03:00
Evgenii Stratonikov
6a69a896e5 [#174] netmap: process unspecified attribute as ID 
When selector attribute is provided it should be
silently replaced by transparent ID, so each node
resides in a separate bucket.

Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2020-10-20 13:05:15 +03:00
Evgeniy Kulikov
4e6350f6d4 [#147] Work around owner package 
- implement Stringer interface and Parse method for owner.ID
- increase test coverage

closes #147

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-10-15 11:05:37 +03:00
Evgeniy Kulikov
e2d8f408d8 [#147] Work around owner package 
Add NEO3WalletSize as constant value.

closes #147

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-10-15 11:05:37 +03:00
Evgeniy Kulikov
20273357f6 [#147] Work around object package 
- implement Stringer interface and Parse method for object.Address
- increase test coverage

closes #147

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-10-15 11:05:37 +03:00
Evgeniy Kulikov
f5b442fe3b [#147] Work around object package 
- implement Stringer interface and Parse method for object.ID
- increase test coverage

closes #147

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-10-15 11:05:37 +03:00
Evgeniy Kulikov
f5388b553e [#147] Work around container package 
- implement Stringer interface and Parse method for container.ID
- increase test coverage

closes #147

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-10-15 11:05:37 +03:00
Alex Vanin
7b3736567c [#169] sdk/client: Do not resign session token 
In some cases SDK Client provided with signed and prepared
session token. In this case we don't need to change verb
or sign it.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-10-14 21:09:56 +03:00
Alex Vanin
d3e3889425 [#167] sdk/client: Add endpoint info getter 
Adds support of new netmap service to the SDK client.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-10-09 09:15:34 +03:00
Alex Vanin
fa18f5ede7 [#165] pkg/owner: Add ID constructor from wallet 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-10-07 10:16:36 +03:00
Leonard Lyubich
cf70026c7e [#164] sdk/container: Implement Equal method on ID 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-01 10:06:30 +03:00
Leonard Lyubich
1305bc750e [#164] sdk/object: Add HasParent method 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-01 10:06:30 +03:00
Leonard Lyubich
2a2e4d8577 [#164] sdk/object: Implement method to reset relation fields 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-01 10:06:30 +03:00
Leonard Lyubich
f3bddc2ba5 [#164] sdk/object: Define filters to search virtual objects 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-01 10:06:30 +03:00
Leonard Lyubich
09e6093e64 [#164] sdk/object: Define filters to search root objects 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-01 10:06:30 +03:00
Leonard Lyubich
9799e5d48c [#164] sdk/object: Return nil parent if parent fields are empty 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-01 10:06:30 +03:00
Leonard Lyubich
ae81f4584e [#164] sdk/object: Add parent ID getter and setter 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-10-01 10:06:30 +03:00
Leonard Lyubich
420d956062 [#162] sdk/object: Detach header verification functions 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-29 15:26:41 +03:00
Leonard Lyubich
2cc58e36f8 [#160] sdk/client: Set object identifier in Head result 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-25 17:37:44 +03:00
Alex Vanin
c814cc62fa [#158] pkg/client: Ignore EOF on buffer copy in object.Put 
There is a issue when user sends payload chunk to the neofs
node, but node closes connection earlier, e.g. node can return
error as soon as it checked ACL permission and denied request.

In this case client will receive EOF error and it produces
`could not send payload bytes to Put object stream` error, but
in fact there is different error.

If we ignore EOF there then `stream.CloseAndRecv()` return
correct error message later.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-25 15:58:40 +03:00
Leonard Lyubich
d19e5418da [#159] sdk: Define object range in object pkg 
Define Range type in object package. Replace Range in client package with
the new one.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-25 15:58:24 +03:00
Leonard Lyubich
14fa89b819 [#155] sdk/object: Add Object to RawObject converter 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-22 18:07:14 +03:00
Leonard Lyubich
cecdeeac73 [#155] sdk/object: Add CutPayload method to RawObject 
Add CutPayload method that returns RawObject's copy with untethered empty
payload. Changing the result payload doesn't affect source object. Changing
the other fields affects source object.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-22 18:07:14 +03:00
Leonard Lyubich
dbb5102c02 [#155] sdk/object: Add object type getter/setter 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-22 18:07:14 +03:00
Leonard Lyubich
2fb1547cd8 [#155] sdk/object: Define object types 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-22 18:07:14 +03:00
Leonard Lyubich
b991e014a9 [#155] sdk/eacl: Fix package cross dependency 
Remove the usage of object package constants from eacl unit tests.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-22 18:07:14 +03:00
Leonard Lyubich
c66b23995c [#155] sdk/object: Add session token getter/setter 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-22 18:07:14 +03:00
Alex Vanin
3347e53cde [#151] sdk/netmap: Add public key getter for node 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-22 10:25:09 +03:00
Alex Vanin
59033d330d [#143] sdk/client: Add call option to set bearer token 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
96de0bd25a [#143] sdk/token: Define bearer token structure 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
0259a06783 [#150] sdk/token: Add owner ID 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
73220620c5 [#148] sdk/client: Support object search rpc 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
549fcad76e [#148] sdk/object: Change search filters v2 converter return type 
Unified structures from v2 package work with the slice of pointers.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
353448c0c3 [#149] sdk/object: Add address field getters and setters 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
7ef249f8db [#149] sdk/netmap: Add net address getter to Node 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
f8e7a577de [#149] sdk/container: Add function to calculate identifier 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
fea8cd48f2 [#146] sdk/object: Add structures for object search rpc call 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
f60069ec9f [#146] sdk/object: Move well-known header const to object type 
Extended ACL filters and object search filters use strings to specify
well-known object headers, such as owner id, object id, etc. To unify
these constant they've been moved into object package, because they
specifying object related headers.

This should be noted in nspcc-dev/neofs-spec#12

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
2a7e91fa13 [#144] sdk/token: Use MarshalBinary to uuid of session token 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
5fa271e141 [#144] sdk/client: Add call option to set session token 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
3783133173 [#144] sdk/client: Add RPC to create session token 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
dfcc21242b [#144] sdk/token: Define session token structure 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
0b9ddd10f8 [#145] sdk/object: Implement Object deserialization function 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
1ac6f2eeeb [#145] sdk/object: Refactor logic of field setters 
In previous implementation RawObject constructor initialized internal v2
Object structure recursively so that further you can directly set the values
of nested fields. This caused the object created by constructor New to be
different from the object created from the empty object v2.

Remove recursive initialization of v2 Object from New and NewRaw
constructors. Make setters to initialize nested structures on demand.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
052a4a97dc [#139] sdk/acl: Highlight prefix of well known header names 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
d1499e65b9 [#139] sdk/acl: Add test coverage for EACL structures 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
15f803119b [#139] sdk/client: Support EACL in RPC client 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
edf2e2d62f [#139] sdk/acl: Add eACL structures 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
3c7c363002 [#142] sdk/container: Add converters to and from v2 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
012cea1add [#142] sdk/container: Use placement policy from neofs-api v2.0 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
1cbfb337a7 [#142] sdk/netmap: Add type aliases for netmap policy 
Later on there should be version independent structures.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
644a21edca [#141] sdk/client: Fix object operations 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
4fd6839473 [#140] sdk/object: Implement object format control functions 
Implement function for calculating, setting and checking object verification
fields.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
bfdf8a452f [#140] sdk/object: Implement ID comparison method 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
5473b4ef95 [#140] sdk: Implement checksum comparison function 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
6ce70d4a18 [#140] sdk/object: Refactor object types 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
e40995b5d4 [#140] sdk: Define Signature type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
20d644758b [#140] sdk/object: Define Attribute type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
5902f96f3e [#140] sdk: Define checksum type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
e0c34a51f2 [#140] sdk: Refactor version type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
524280a5e8 [#140] sdk: Refactor reference types 
Refactor v2-compatible reference types to be wrappers over corresponding
types from v2.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Evgenii Stratonikov
2026473733 [#137] sdk: Implement netmap filtering and selection 
Signed-off-by: Evgenii Stratonikov <evgeniy@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
efbf73b775 [#138] sdk/object: Fix head request 
Now head request returns full header with signature.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
b19e3a48db [#135] sdk/client: Implement object operations 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
9b0eef0d43 [#135] sdk/object: Add Release method to RawObject 
Implement Release method that converts RawObject to read-only finalized
Object instance. Remove ToV2 method overriding from Object.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
8e9d456038 [#135] sdk/container: Fix IDFromV2 nil-behavior 
Remove nil if-statement from IDFromV2 function to which avoids checking the
correctness of the identifier format. From now IDFromV2 returns format error
on nil argument.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
047bae63d0 [#135] sdk/object: Fix IDFromV2 nil-behavior 
Remove nil if-statement from IDFromV2 function to which avoids checking the
correctness of the identifier format. From now IDFromV2 returns format error
on nil argument.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
de505ddee9 [#133] sdk: Use cid wrapper to sign container delete request 
StableMarshalerWrapper is not suitable for container delete
request, because it signs marshaled structure of container id.
As for delete request, container id itself should be signed.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
acbdbd410e [#132] sdk/object: Implement useful methods and function 
Implement method to get address of the object. Implement method to copy the
object w/o payload. Implement function of object deserialization.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
f18e8535c5 [#132] sdk/object: Add payload field to Object 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
c125749c6e [#132] sdk/object: Implement Address type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
9cba1e233d [#131] sdk: Add owner stringer and script hash converter 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
8c3f8268b9 [#130] sdk: Define object types 
Define Object type that represents the immutable NeoFS object. Define
RawObject type that provides interface for convenient construction of NeoFS
object.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
a65db08608 [#130] sdk: Define object identifier type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
63c8d6e9ea [#128] sdk: Use owner ID instead of NEO3Wallet 
Replace owner.NEO3Wallet usage with owner.ID usage. Functions that process
the wallet address convert it to the owner identifier through the public
method.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
c9d38aa2e1 [#128] sdk: Implement owner ID type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
1c3e69721b [#128] sdk: Implement Bytes method on NEO3Wallet type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
2b20230d7f [#128] sdk: Remove old container ID with the new one 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
8df69c4042 sdk: Define container identifier type 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
7f4544ede0 [#126] sdk: add usage example 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
aa539cd0c4 [#126] sdk: implement container rpc for in client 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
25e6b45b57 [#126] sdk: implement accounting rpc in client 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
86e6221b76 [#126] sdk: add sdk client for all available api requests 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Alex Vanin
8c920d75a6 [#126] sdk: add reference types 
This commits adds container id and neo 3 wallet id, that
is used as owner id for object and container. Version
is set out outside of refs packages since it store global
version of SDK.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2020-09-18 10:45:11 +03:00
Leonard Lyubich
6191903326 Implement new request signing mechanism 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2020-09-18 10:40:45 +03:00
Alex Vanin
1f143e54bd Move api-v2 files into v2 subdir 
This subdir contains generated proto files
and small wrappers.
 2020-09-18 10:40:17 +03:00