dstepanov-yadro/frostfs-api-go
1
0
Fork 0
forked from TrueCloudLab/frostfs-api-go
Code Issues Pull requests Projects Releases Packages Wiki Activity
1343 commits 13 branches 61 tags 7.1 MiB
Commit graph

1343 commits

This branch
This branch
All branches
Author SHA1 Message Date
Airat Arifullin
ebaf78c8fa [#100] session: Introduce ObjectPatch verb 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-08-06 12:31:11 +03:00
Evgenii Stratonikov
1473fa588f [#98] rpc: Accept interface in place of ClientConn 
gRPC client load-balancing API is ugly as f:
1. It is configured by pre-registering a balancer and the providing JSON
   configuration.
2. It doesn't allow different credentials for different endpoints
   (consider using "insecure" localhost and external endpoint).
3. To support frostfs usecase we also need to implement a resolver,
   which has its own difficulties.
4. https://github.com/grpc/grpc-go/issues/239#issuecomment-264548415

Using interface in place of grpc.ClientConn allows us to provide custom
implentation for it (load-balancing, circuit breaker etc.).

Refs TrueCloudLab/frostfs-node#1268

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-08-01 08:50:24 +03:00
Airat Arifullin
c27b978770 [#97] signature: Add Patch messages to serviceMessageBody 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-07-30 17:52:54 +03:00
Airat Arifullin
8609f29a60 [#97] object: Refactor Patch related structs 
* Add getters and setters for related types;
* Fix unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-07-30 17:52:49 +03:00
Evgenii Stratonikov
8ce8cd6ec2 [#96] .golangci.yml: Fix deprecated config options 
```
WARN [config_reader] The configuration option `run.skip-files` is deprecated, please use `issues.exclude-files`.
WARN [config_reader] The configuration option `output.format` is deprecated, please use `output.formats`
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-29 15:45:01 +03:00
Airat Arifullin
8580b49c8d [#94] rpc: Introduce ObjectService.Patch method 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-07-29 08:55:14 +00:00
Airat Arifullin
9b90d139c5 [#94] object: Generate protobufs for Patch method 
* Generate protobufs for patch method;
* Create marshalers, unmarshalers, converters for gererated types;
* Add unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-07-29 08:55:14 +00:00
Evgenii Stratonikov
3dfa2f4fd6 [#95] *: Regenerate proto files 
Remove SetExtendedEACL and AnnounceUsedSpace methods from the container
package.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-26 10:24:25 +03:00
Evgenii Stratonikov
f517e39491 [#91] protogen: Support unpacked repeated uint64 fields 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-16 14:39:20 +03:00
Evgenii Stratonikov
3639563d80 [#90] apemanager: Run gofumpt 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-15 16:40:21 +03:00
Evgenii Stratonikov
610c450a65 [#90] proto/test: Fix go vet warnings 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-15 16:40:21 +03:00
Evgenii Stratonikov
3f92d7bfb0 [#90] proto/test: Fix proto file formatting 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-07-15 16:40:21 +03:00
Airat Arifullin
dafc9e5476 [#86] status: Regenerate common status 
* INVALID_ARGUMENT is a new common status constant.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-06-24 11:55:48 +03:00
Airat Arifullin
2f6d3209e1 [#84] object: Regenerate EC-header type 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-30 15:28:26 +00:00
Airat Arifullin
9e825239ac [#85] acl: Regenerate protobufs for Bearer token 
Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-29 19:45:44 +03:00
Airat Arifullin
9789b79b1d [#85] apemanager: Generate protobufs for ape package 
* Regenerate protobufs as APE specific type are defined
  as separate package;
* Move `ape` package related utils methods from `apemanager`.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-29 14:15:49 +03:00
Airat Arifullin
0803bc6ded [#83] object: Regenerate protobufs for ECHeader 
* Fix marshalers and converters;
* Fix unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-16 16:31:03 +03:00
Airat Arifullin
4fe42ac4ad [#82] object: Add FilterHeaderECParent filter for v2 
* `FilterHeaderECParent` is used by `Object.Search`

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-13 17:03:55 +03:00
Airat Arifullin
063ce11c24 [#82] object: Erase field Signature from ECHeader v2 type 
* The field `Signature` is not used and should be factored out.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-08 15:09:16 +03:00
Airat Arifullin
bc7b49eed2 [#82] object: Introduce new fields for EC header 
* Regenerate protobufs as frostfs-api introduced `parent_split_id` and
  `parent_split_index` fields.
* Fix marshaller and converter for EC header.
* Extend v2 type `ECHeader` with `ParentSplitID` and `ParentSplitIndex` fields.
* Fix message_test for `Object`. Also generate EC headers and check it.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-08 15:09:12 +03:00
Airat Arifullin
b171364079 [#81] rpc: Fix apemanager rpc service name 
* Introduce `frostfsServiceNamePrefix` for rpc interface
  since `apemanager` uses `frostfs` root instead `neo.fs`.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-06 14:46:54 +03:00
Evgenii Stratonikov
0fe6b9adbb [#76] Make setter names more consistent 
This will make the transition to a new codegen more seamless.
1. Setter should be named as the field itself.
2. Setter should accept 1 parameter.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-03 08:52:04 +03:00
Evgenii Stratonikov
fa8f92d662 [#75] audit: Remove deprecated service 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-05-02 11:54:35 +00:00
Airat Arifullin
387b850e5e [#74] apemanager: Generate protobufs for apemanager service 
* Generate protobufs.
* Make marshallers, unmarshallers, json-encoders etc.
* Create message encoding/decoding unit-tests.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-05-02 11:53:26 +00:00
Anton Nikiforov
67c6f305b2 [#79] object: Implement Range\RangeHash requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-27 23:04:46 +03:00
Anton Nikiforov
df9b65324a [#73] object: Implement Get\Head requests for EC object 
Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>
 2024-04-22 18:14:50 +03:00
Evgenii Stratonikov
4a330a5706 [#72] session: Unify unmarshaling code 
gopatch:
```
@@
var err, msg, data, t, protojson identifier
var obj expression
@@
+import "git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/rpc/message"
-import protojson "google.golang.org/protobuf/encoding/protojson"

-msg := obj
-if err := protojson.Unmarshal(data, msg); err != nil {
-return err
-}
-return t.FromGRPCMessage(msg)
+return message.UnmarshalJSON(t, data, obj)

@@
var err, msg, data, t, goproto identifier
var obj expression
@@
+import "git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/rpc/message"
-import goproto "google.golang.org/protobuf/proto"

-msg := obj
-if err := goproto.Unmarshal(data, msg); err != nil {
-return err
-}
-return t.FromGRPCMessage(msg)
+return message.Unmarshal(t, data, obj)
```

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-04-20 14:19:19 +03:00
Airat Arifullin
491a47e7fe [#70] netmap: Regenerate protobuf for Replica 
* Since EC field tags are renumerated, it is required
  to regenerate netmap grpc.
* Add a generator with EC replica to check it with
  unit-test.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-03-27 12:56:03 +03:00
Airat Arifullin
6e9d385f3c [#71] container: Introduce CONTAINER_ACCESS_DENIED status 
* Regenerate protobufs for object and container service to
  use a new frostfs-api status CONTAINER_ACCESS_DENIED.

Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>
 2024-03-26 18:55:05 +03:00
Evgenii Stratonikov
1772b92182 [#69] object: Initial EC implementation 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-19 15:23:01 +03:00
Evgenii Stratonikov
a85146250b [#68] Makefile: Use gofumpt for formatting 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
ea6e390c7b [#68] pre-commit: Add unit test hook 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
4d35da7c77 [#68] Makefile: Allow to override testflags 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
a7bcad6aa9 [#68] Makefile: Drop GO111MODULE usages 
It is ignored since go1.17.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
6fb9cae479 [#68] pre-commit: Update golangci-lint to 1.56.2 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Evgenii Stratonikov
f69ad7ade0 [#68] pre-commit: Remove gitlint 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-03-14 10:31:58 +03:00
Dmitrii Stepanov
c1c7b344b9 [#67] go.mod: Bump protobuf version 
Found by vulncheck:
Vulnerability #1: GO-2024-2611
    Infinite loop in JSON unmarshaling in google.golang.org/protobuf
  More info: https://pkg.go.dev/vuln/GO-2024-2611
  Module: google.golang.org/protobuf
    Found in: google.golang.org/protobuf@v1.32.0
    Fixed in: google.golang.org/protobuf@v1.33.0

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-03-06 13:18:14 +03:00
Dmitrii Stepanov
634e24aba7 [#65] object: Fix SetMarshalData for PutSingle request 
Allow to reset marshal data

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-15 15:44:01 +03:00
Dmitrii Stepanov
2a124b95bc [#64] object: Allow to reset marshal data 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2024-02-15 14:47:28 +03:00
Evgenii Stratonikov
d60ce83e42 [#63] .forgejo: Update dco-go to v3 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-26 12:19:53 +03:00
Alexander Chuprov
72885aae83 [#62] signature: Refactor BufferPool 
Signed-off-by: Alexander Chuprov <a.chuprov@yadro.com>
 2024-01-12 18:09:28 +03:00
Evgenii Stratonikov
b46e8cfbda [#59] util: Rename stableMarshaler 
It should be with a single `l`, see `json.Marshaler`.

Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-21 15:28:03 +03:00
Evgenii Stratonikov
9cc2095446 [#59] util: Restore backwards compatibility in NestedStructureMarshal() 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-11-21 15:27:57 +03:00
Dmitrii Stepanov
498877e378 [#58] makefile: Disable test results caching 
Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 13:47:48 +03:00
Dmitrii Stepanov
f50872f1bc [#58] object: Allow to set marshal data 
Now it is possible set marshaled data to reduce memory
allocations.

Signed-off-by: Dmitrii Stepanov <d.stepanov@yadro.com>
 2023-10-31 13:47:48 +03:00
Evgenii Stratonikov
309aa4ac78 Release v2.16.0 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-09-14 13:20:13 +03:00
Evgenii Stratonikov
17bed735a1 [#20] Update api version 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-17 11:10:12 +03:00
Evgenii Stratonikov
022f818735 [#20] Remove storage groups 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-17 11:10:08 +03:00
Evgenii Stratonikov
d989c8d2a3 [#54] *: Fix linter warnings 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-11 15:21:27 +03:00
Evgenii Stratonikov
0671f42ee1 [#54] .forgejo: Add DCO action 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2023-08-11 15:21:27 +03:00