dstepanov-yadro/frostfs-api-go
1
0
Fork 0
forked from TrueCloudLab/frostfs-api-go
Code Issues Pull requests Projects Releases Packages Wiki Activity
1331 commits 13 branches 61 tags 7.1 MiB
Commit graph

1331 commits

This branch
This branch
All branches
Author SHA1 Message Date
Airat Arifullin
dafc9e5476 [#86] status: Regenerate common status 
* INVALID_ARGUMENT is a new common status constant.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-06-24 11:55:48 +03:00
Airat Arifullin
2f6d3209e1 [#84] object: Regenerate EC-header type 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-30 15:28:26 +00:00
Airat Arifullin
9e825239ac [#85] acl: Regenerate protobufs for Bearer token 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-29 19:45:44 +03:00
Airat Arifullin
9789b79b1d [#85] apemanager: Generate protobufs for ape package 
* Regenerate protobufs as APE specific type are defined
  as separate package;
* Move `ape` package related utils methods from `apemanager`.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-29 14:15:49 +03:00
Airat Arifullin
0803bc6ded [#83] object: Regenerate protobufs for ECHeader 
* Fix marshalers and converters;
* Fix unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-16 16:31:03 +03:00
Airat Arifullin
4fe42ac4ad [#82] object: Add FilterHeaderECParent filter for v2 
* `FilterHeaderECParent` is used by `Object.Search`

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-13 17:03:55 +03:00
Airat Arifullin
063ce11c24 [#82] object: Erase field Signature from ECHeader v2 type 
* The field `Signature` is not used and should be factored out.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-08 15:09:16 +03:00
Airat Arifullin
bc7b49eed2 [#82] object: Introduce new fields for EC header 
* Regenerate protobufs as frostfs-api introduced `parent_split_id` and
  `parent_split_index` fields.
* Fix marshaller and converter for EC header.
* Extend v2 type `ECHeader` with `ParentSplitID` and `ParentSplitIndex` fields.
* Fix message_test for `Object`. Also generate EC headers and check it.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-08 15:09:12 +03:00
Airat Arifullin
b171364079 [#81] rpc: Fix apemanager rpc service name 
* Introduce `frostfsServiceNamePrefix` for rpc interface
  since `apemanager` uses `frostfs` root instead `neo.fs`.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-06 14:46:54 +03:00
Evgenii Stratonikov
0fe6b9adbb [#76] Make setter names more consistent 
This will make the transition to a new codegen more seamless.
1. Setter should be named as the field itself.
2. Setter should accept 1 parameter.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-03 08:52:04 +03:00
Evgenii Stratonikov
fa8f92d662 [#75] audit: Remove deprecated service 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-02 11:54:35 +00:00
Airat Arifullin
387b850e5e [#74] apemanager: Generate protobufs for apemanager service 
* Generate protobufs.
* Make marshallers, unmarshallers, json-encoders etc.
* Create message encoding/decoding unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-02 11:53:26 +00:00
Anton Nikiforov
67c6f305b2 [#79] object: Implement Range\RangeHash requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-27 23:04:46 +03:00
Anton Nikiforov
df9b65324a [#73] object: Implement Get\Head requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-22 18:14:50 +03:00
Evgenii Stratonikov
4a330a5706 [#72] session: Unify unmarshaling code 
gopatch:
```
@@
var err, msg, data, t, protojson identifier
var obj expression
@@
+import "git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/rpc/message"
-import protojson "google.golang.org/protobuf/encoding/protojson"

-msg := obj
-if err := protojson.Unmarshal(data, msg); err != nil {
-return err
-}
-return t.FromGRPCMessage(msg)
+return message.UnmarshalJSON(t, data, obj)

@@
var err, msg, data, t, goproto identifier
var obj expression
@@
+import "git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/rpc/message"
-import goproto "google.golang.org/protobuf/proto"

-msg := obj
-if err := goproto.Unmarshal(data, msg); err != nil {
-return err
-}
-return t.FromGRPCMessage(msg)
+return message.Unmarshal(t, data, obj)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-20 14:19:19 +03:00
Airat Arifullin
491a47e7fe [#70] netmap: Regenerate protobuf for Replica 
* Since EC field tags are renumerated, it is required
  to regenerate netmap grpc.
* Add a generator with EC replica to check it with
  unit-test.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-03-27 12:56:03 +03:00
Airat Arifullin
6e9d385f3c [#71] container: Introduce CONTAINER_ACCESS_DENIED status 
* Regenerate protobufs for object and container service to
  use a new frostfs-api status CONTAINER_ACCESS_DENIED.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-03-26 18:55:05 +03:00
Evgenii Stratonikov
1772b92182 [#69] object: Initial EC implementation 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-19 15:23:01 +03:00
Evgenii Stratonikov
a85146250b [#68] Makefile: Use gofumpt for formatting 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
ea6e390c7b [#68] pre-commit: Add unit test hook 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
4d35da7c77 [#68] Makefile: Allow to override testflags 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
a7bcad6aa9 [#68] Makefile: Drop GO111MODULE usages 
It is ignored since go1.17.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
6fb9cae479 [#68] pre-commit: Update golangci-lint to 1.56.2 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
f69ad7ade0 [#68] pre-commit: Remove gitlint 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Dmitrii Stepanov
c1c7b344b9 [#67] go.mod: Bump protobuf version 
Found by vulncheck:
Vulnerability #1: GO-2024-2611
    Infinite loop in JSON unmarshaling in google.golang.org/protobuf
  More info: https://pkg.go.dev/vuln/GO-2024-2611
  Module: google.golang.org/protobuf
    Found in: google.golang.org/protobuf@v1.32.0
    Fixed in: google.golang.org/protobuf@v1.33.0

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-03-06 13:18:14 +03:00
Dmitrii Stepanov
634e24aba7 [#65] object: Fix SetMarshalData for PutSingle request 
Allow to reset marshal data

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-15 15:44:01 +03:00
Dmitrii Stepanov
2a124b95bc [#64] object: Allow to reset marshal data 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-15 14:47:28 +03:00
Evgenii Stratonikov
d60ce83e42 [#63] .forgejo: Update dco-go to v3 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-26 12:19:53 +03:00
Alexander Chuprov
72885aae83 [#62] signature: Refactor BufferPool 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-01-12 18:09:28 +03:00
Evgenii Stratonikov
b46e8cfbda [#59] util: Rename stableMarshaler 
It should be with a single `l`, see `json.Marshaler`.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-21 15:28:03 +03:00
Evgenii Stratonikov
9cc2095446 [#59] util: Restore backwards compatibility in NestedStructureMarshal() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-21 15:27:57 +03:00
Dmitrii Stepanov
498877e378 [#58] makefile: Disable test results caching 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 13:47:48 +03:00
Dmitrii Stepanov
f50872f1bc [#58] object: Allow to set marshal data 
Now it is possible set marshaled data to reduce memory
allocations.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 13:47:48 +03:00
Evgenii Stratonikov
309aa4ac78 Release v2.16.0 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-14 13:20:13 +03:00
Evgenii Stratonikov
17bed735a1 [#20] Update api version 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-17 11:10:12 +03:00
Evgenii Stratonikov
022f818735 [#20] Remove storage groups 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-17 11:10:08 +03:00
Evgenii Stratonikov
d989c8d2a3 [#54] *: Fix linter warnings 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-11 15:21:27 +03:00
Evgenii Stratonikov
0671f42ee1 [#54] .forgejo: Add DCO action 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-11 15:21:27 +03:00
Airat Arifullin
9a7b47d769 [#50] util: Use protowire for util/proto helpers 
* Use methods to calculate size

Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-08-10 16:40:53 +00:00
Evgenii Stratonikov
67b18d3550 [#53] Bump min go version to go1.20 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-09 09:55:51 +03:00
Evgenii Stratonikov
964c3edb3f [#51] *: Do not panic in StableSize() 
After #49 it can be called on nil structures.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-02 10:55:10 +03:00
Evgenii Stratonikov
3072090c77 [#51] protogen: Do not panic in StableSize() 
Refs TrueCloudLab/frostfs-node#554 .

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-02 10:47:14 +03:00
Evgenii Stratonikov
7a5ee927c8 [#49] util/proto: Do not allocate in StringSize() 
It was not catched by the test because most of the time the function is
inlined. However, I've seen it allocating with pprof in one of the
earlier builds.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-26 18:52:59 +03:00
Evgenii Stratonikov
7133a01ccf [#49] message/test: Add test for zero-alloc StableSize() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-26 18:32:17 +03:00
Evgenii Stratonikov
43ad0f114c [#49] session: Make StableSize() zero-alloc 
For this to work, it is necessary that `NestedStructureSize` is a generic function.
Otherwise, we would allocate to put it in the interface.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-26 18:31:31 +03:00
Evgenii Stratonikov
6e92d7d5de [#49] util/proto: Make NestedStructure* generic 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-26 18:31:23 +03:00
Evgenii Stratonikov
849de02bc3 [#49] util/proto: Calculate repeated field size without allocations 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-26 18:31:23 +03:00
Evgenii Stratonikov
59c8421597 [#49] util/proto: Use StableSize() to determine if the struct is empty 
`reflect` is not necessary here, and checking `StableSize` is what we
_want_ anyway.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-07-26 18:31:00 +03:00
Airat Arifullin
582d94c81c [#47] types: Fix unique flag conversion 
Signed-off-by: Airat Arifullin a.arifullin@yadro.com
 2023-07-19 13:03:35 +03:00
Dmitrii Stepanov
285516a94e [#45] api-go: Add PutSingle RPC call 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-07-04 12:27:42 +03:00