1307 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Evgenii Stratonikov	7be31eb847	[#77] protogen: Add tests for JSON format ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-19 10:47:00 +03:00
Evgenii Stratonikov	adb7c602d7	[#77] protogen: Initial implementation ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-19 10:47:00 +03:00
Evgenii Stratonikov	a28ceb251a	[#77] util/proto: Optimize int32 marshaling ... This is the approach used in easyproto 52d3ac4744/writer.go (L203) It allows to occupy slightly less space for negative numbers. The format is still protobuf, although, technically, this is a breaking change for our stable marshaling format. However, we don't use int32 at all and all enums have positive values, so nothing is broken. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-16 17:11:13 +03:00
Airat Arifullin	d112a28d38	[#104] object: Add getters for PatchRequestBodyPatch ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-08-13 18:51:51 +03:00
Evgenii Stratonikov	47a48969b0	[#103] proto: Test end-to-end scenario ... Test the generated code, do not write yet another marshaling routine in tests. Before: ``` ok git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/util/proto 0.003s coverage: 55.6% of statements ``` After: ``` ok git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/util/proto 0.003s coverage: 80.0% of statements ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-09 11:18:17 +03:00
Evgenii Stratonikov	19247e8941	[#103] protogen: Handle uint32 type ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-09 11:18:17 +03:00
Evgenii Stratonikov	ff4f31b6f3	[#103] protogen: Handle files in all packages ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-09 11:18:17 +03:00
Anton Nikiforov	a0a9b765f3	[#101] Fix make test ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-09 09:35:25 +03:00
Anton Nikiforov	280d052cef	[#101] Remove usage of folder vendor ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-08 17:38:49 +03:00
Anton Nikiforov	35e7397d48	[#87] netmap: Extend enum Operation ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-07 16:21:50 +03:00
Anton Nikiforov	174773454e	[#87] netmap: Regenerate to add LIKE operation for filter ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-06 17:20:29 +03:00
Anton Nikiforov	b72aa14bab	[#87] proto: Process files with protoc version 27.2 ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-06 17:20:29 +03:00
Anton Nikiforov	42e50c9633	[#87] Makefile: Add target protoc-install ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-06 17:20:21 +03:00
Anton Nikiforov	611355510c	[#87] go.mod: Update google.golang.org/grpc to v1.63.2 ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-08-06 16:57:57 +03:00
Airat Arifullin	ebaf78c8fa	[#100] session: Introduce ObjectPatch verb ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-08-06 12:31:11 +03:00
Evgenii Stratonikov	1473fa588f	[#98] rpc: Accept interface in place of ClientConn ... gRPC client load-balancing API is ugly as f: 1. It is configured by pre-registering a balancer and the providing JSON configuration. 2. It doesn't allow different credentials for different endpoints (consider using "insecure" localhost and external endpoint). 3. To support frostfs usecase we also need to implement a resolver, which has its own difficulties. 4. https://github.com/grpc/grpc-go/issues/239#issuecomment-264548415 Using interface in place of grpc.ClientConn allows us to provide custom implentation for it (load-balancing, circuit breaker etc.). Refs TrueCloudLab/frostfs-node#1268 Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-08-01 08:50:24 +03:00
Airat Arifullin	c27b978770	[#97] signature: Add Patch messages to serviceMessageBody ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-30 17:52:54 +03:00
Airat Arifullin	8609f29a60	[#97] object: Refactor Patch related structs ... * Add getters and setters for related types; * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-30 17:52:49 +03:00
Evgenii Stratonikov	8ce8cd6ec2	[#96] .golangci.yml: Fix deprecated config options ... ``` WARN [config_reader] The configuration option `run.skip-files` is deprecated, please use `issues.exclude-files`. WARN [config_reader] The configuration option `output.format` is deprecated, please use `output.formats` ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-29 15:45:01 +03:00
Airat Arifullin	8580b49c8d	[#94] rpc: Introduce ObjectService.Patch method ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-29 08:55:14 +00:00
Airat Arifullin	9b90d139c5	[#94] object: Generate protobufs for Patch method ... * Generate protobufs for patch method; * Create marshalers, unmarshalers, converters for gererated types; * Add unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-07-29 08:55:14 +00:00
Evgenii Stratonikov	3dfa2f4fd6	[#95] *: Regenerate proto files ... Remove SetExtendedEACL and AnnounceUsedSpace methods from the container package. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-26 10:24:25 +03:00
Evgenii Stratonikov	f517e39491	[#91] protogen: Support unpacked repeated uint64 fields ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-16 14:39:20 +03:00
Evgenii Stratonikov	3639563d80	[#90] apemanager: Run gofumpt ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-15 16:40:21 +03:00
Evgenii Stratonikov	610c450a65	[#90] proto/test: Fix go vet warnings ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-15 16:40:21 +03:00
Evgenii Stratonikov	3f92d7bfb0	[#90] proto/test: Fix proto file formatting ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-07-15 16:40:21 +03:00
Airat Arifullin	dafc9e5476	[#86] status: Regenerate common status ... * INVALID_ARGUMENT is a new common status constant. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-06-24 11:55:48 +03:00
Airat Arifullin	2f6d3209e1	[#84] object: Regenerate EC-header type ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-30 15:28:26 +00:00
Airat Arifullin	9e825239ac	[#85] acl: Regenerate protobufs for Bearer token ... Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-29 19:45:44 +03:00
Airat Arifullin	9789b79b1d	[#85] apemanager: Generate protobufs for ape package ... * Regenerate protobufs as APE specific type are defined as separate package; * Move `ape` package related utils methods from `apemanager`. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-29 14:15:49 +03:00
Airat Arifullin	0803bc6ded	[#83] object: Regenerate protobufs for ECHeader ... * Fix marshalers and converters; * Fix unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-16 16:31:03 +03:00
Airat Arifullin	4fe42ac4ad	[#82] object: Add FilterHeaderECParent filter for v2 ... * `FilterHeaderECParent` is used by `Object.Search` Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-13 17:03:55 +03:00
Airat Arifullin	063ce11c24	[#82] object: Erase field Signature from ECHeader v2 type ... * The field `Signature` is not used and should be factored out. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-08 15:09:16 +03:00
Airat Arifullin	bc7b49eed2	[#82] object: Introduce new fields for EC header ... * Regenerate protobufs as frostfs-api introduced `parent_split_id` and `parent_split_index` fields. * Fix marshaller and converter for EC header. * Extend v2 type `ECHeader` with `ParentSplitID` and `ParentSplitIndex` fields. * Fix message_test for `Object`. Also generate EC headers and check it. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-08 15:09:12 +03:00
Airat Arifullin	b171364079	[#81] rpc: Fix apemanager rpc service name ... * Introduce `frostfsServiceNamePrefix` for rpc interface since `apemanager` uses `frostfs` root instead `neo.fs`. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-06 14:46:54 +03:00
Evgenii Stratonikov	0fe6b9adbb	[#76] Make setter names more consistent ... This will make the transition to a new codegen more seamless. 1. Setter should be named as the field itself. 2. Setter should accept 1 parameter. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-03 08:52:04 +03:00
Evgenii Stratonikov	fa8f92d662	[#75] audit: Remove deprecated service ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-05-02 11:54:35 +00:00
Airat Arifullin	387b850e5e	[#74] apemanager: Generate protobufs for apemanager service ... * Generate protobufs. * Make marshallers, unmarshallers, json-encoders etc. * Create message encoding/decoding unit-tests. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-05-02 11:53:26 +00:00
Anton Nikiforov	67c6f305b2	[#79] object: Implement Range\RangeHash requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-27 23:04:46 +03:00
Anton Nikiforov	df9b65324a	[#73] object: Implement Get\Head requests for EC object ... Signed-off-by: Anton Nikiforov <an.nikiforov@yadro.com>	2024-04-22 18:14:50 +03:00
Evgenii Stratonikov	4a330a5706	[#72] session: Unify unmarshaling code ... gopatch: ``` @@ var err, msg, data, t, protojson identifier var obj expression @@ +import "git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/rpc/message" -import protojson "google.golang.org/protobuf/encoding/protojson" -msg := obj -if err := protojson.Unmarshal(data, msg); err != nil { -return err -} -return t.FromGRPCMessage(msg) +return message.UnmarshalJSON(t, data, obj) @@ var err, msg, data, t, goproto identifier var obj expression @@ +import "git.frostfs.info/TrueCloudLab/frostfs-api-go/v2/rpc/message" -import goproto "google.golang.org/protobuf/proto" -msg := obj -if err := goproto.Unmarshal(data, msg); err != nil { -return err -} -return t.FromGRPCMessage(msg) +return message.Unmarshal(t, data, obj) ``` Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-04-20 14:19:19 +03:00
Airat Arifullin	491a47e7fe	[#70] netmap: Regenerate protobuf for Replica ... * Since EC field tags are renumerated, it is required to regenerate netmap grpc. * Add a generator with EC replica to check it with unit-test. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-27 12:56:03 +03:00
Airat Arifullin	6e9d385f3c	[#71] container: Introduce CONTAINER_ACCESS_DENIED status ... * Regenerate protobufs for object and container service to use a new frostfs-api status CONTAINER_ACCESS_DENIED. Signed-off-by: Airat Arifullin <a.arifullin@yadro.com>	2024-03-26 18:55:05 +03:00
Evgenii Stratonikov	1772b92182	[#69] object: Initial EC implementation ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-03-19 15:23:01 +03:00
Evgenii Stratonikov	a85146250b	[#68] Makefile: Use gofumpt for formatting ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-03-14 10:31:58 +03:00
Evgenii Stratonikov	ea6e390c7b	[#68] pre-commit: Add unit test hook ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-03-14 10:31:58 +03:00
Evgenii Stratonikov	4d35da7c77	[#68] Makefile: Allow to override testflags ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-03-14 10:31:58 +03:00
Evgenii Stratonikov	a7bcad6aa9	[#68] Makefile: Drop GO111MODULE usages ... It is ignored since go1.17. Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-03-14 10:31:58 +03:00
Evgenii Stratonikov	6fb9cae479	[#68] pre-commit: Update golangci-lint to 1.56.2 ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-03-14 10:31:58 +03:00
Evgenii Stratonikov	f69ad7ade0	[#68] pre-commit: Remove gitlint ... Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>	2024-03-14 10:31:58 +03:00