TrueCloudLab/frostfs-s3-gw
17
3
Fork 19
Code Issues 28 Pull requests 6 Projects Releases 17 Packages Activity Actions
1333 commits 5 branches 42 tags 21 MiB
Commit graph

134 commits

Author SHA1 Message Date
Denis Kirillov
a2422e74d7 [#431] Fix split tree 
Update tree service to fix split tree problem.
Tree intermediate nodes can be duplicated, so we must handle this.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:07:42 +03:00
Alex Vanin
94a21f5351 [#398] Update sdk-go to avoid unnecessary retries 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-06-20 17:49:00 +03:00
Denis Kirillov
5d6d5e41d0 [#398] Support retryer
Some checks failed
/ DCO (pull_request) Successful in 1m40s
Details
/ Builds (1.20) (pull_request) Successful in 2m22s
Details
/ Builds (1.21) (pull_request) Successful in 1m56s
Details
/ Vulncheck (pull_request) Failing after 2m40s
Details
/ Lint (pull_request) Successful in 4m31s
Details
/ Tests (1.20) (pull_request) Successful in 2m45s
Details
/ Tests (1.21) (pull_request) Successful in 2m38s
Details 
Add two strategy for PutBucketSettings request retryer:
* exponential backoff (increasing up to `max_backoff` delays with jitter)
* constant backoff (always the same `max_backoff` delay between requests)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>

(cherry picked from commit bb81afc14a)
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-06-19 08:55:45 +03:00
Alex Vanin
02122892ca [#362] Update policy-engine to support 'u' and 'g' targets 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-04-12 16:52:08 +03:00
Denis Kirillov
272e3a0f03 [#363] Fix removing combined object
Some checks failed
/ DCO (pull_request) Successful in 1m18s
Details
/ Builds (1.20) (pull_request) Successful in 2m20s
Details
/ Builds (1.21) (pull_request) Successful in 1m33s
Details
/ Vulncheck (pull_request) Failing after 4m46s
Details
/ Lint (pull_request) Successful in 6m10s
Details
/ Tests (1.20) (pull_request) Successful in 5m12s
Details
/ Tests (1.21) (pull_request) Successful in 3m40s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-12 14:56:06 +03:00
Denis Kirillov
0cc6b41b2d [#358] Update APE to allow put tombstone on delete object
Some checks failed
/ Builds (1.20) (pull_request) Successful in 4m17s
Details
/ Builds (1.21) (pull_request) Successful in 3m58s
Details
/ DCO (pull_request) Successful in 4m8s
Details
/ Vulncheck (pull_request) Failing after 4m36s
Details
/ Lint (pull_request) Successful in 6m50s
Details
/ Tests (1.20) (pull_request) Successful in 5m13s
Details
/ Tests (1.21) (pull_request) Successful in 5m7s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-10 15:11:25 +03:00
Denis Kirillov
1cad101609 [#354] Update frostfs-contract to terminate session iterator 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-09 17:30:10 +03:00
Alex Vanin
85c8210ffd [#347] Explicitly specify sorting order of subtree for object listing
All checks were successful
/ DCO (pull_request) Successful in 54s
Details
/ Vulncheck (pull_request) Successful in 1m56s
Details
/ Builds (1.20) (pull_request) Successful in 3m16s
Details
/ Builds (1.21) (pull_request) Successful in 3m18s
Details
/ Lint (pull_request) Successful in 8m45s
Details
/ Tests (1.20) (pull_request) Successful in 2m56s
Details
/ Tests (1.21) (pull_request) Successful in 2m25s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-04-02 18:14:43 +03:00
Denis Kirillov
bcfbcdc82f [#345] acl: Update APE and fix using
Some checks failed
/ Lint (pull_request) Successful in 2m53s
Details
/ Tests (1.20) (pull_request) Successful in 2m43s
Details
/ Tests (1.21) (pull_request) Successful in 2m44s
Details
/ DCO (pull_request) Successful in 2m40s
Details
/ Vulncheck (pull_request) Failing after 3m10s
Details
/ Builds (1.20) (pull_request) Successful in 3m18s
Details
/ Builds (1.21) (pull_request) Successful in 3m33s
Details 
* Remove native policy when remove bucket policy
* Allow policies that contain only s3 compatible statements
(now deny rules cannot be converted to native rules)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-02 12:42:43 +00:00
Denis Kirillov
8050ca2d51 [#306] Use session token for container read operations
All checks were successful
/ DCO (pull_request) Successful in 1m54s
Details
/ Vulncheck (pull_request) Successful in 1m55s
Details
/ Builds (1.20) (pull_request) Successful in 2m49s
Details
/ Builds (1.21) (pull_request) Successful in 1m56s
Details
/ Lint (pull_request) Successful in 3m59s
Details
/ Tests (1.20) (pull_request) Successful in 2m30s
Details
/ Tests (1.21) (pull_request) Successful in 2m19s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-01 18:14:33 +03:00
Denis Kirillov
1bfea006b0 [#306] Update APE 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
5121c73d3f [#307] Update APE
Some checks failed
/ DCO (pull_request) Successful in 2m57s
Details
/ Vulncheck (pull_request) Successful in 3m22s
Details
/ Builds (1.20) (pull_request) Successful in 3m54s
Details
/ Builds (1.21) (pull_request) Successful in 3m23s
Details
/ Lint (pull_request) Failing after 4m15s
Details
/ Tests (1.20) (pull_request) Successful in 4m10s
Details
/ Tests (1.21) (pull_request) Successful in 3m48s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-07 12:24:13 +03:00
Denis Kirillov
84af85ed67 [#302] Update APE to support chain id as bytes
All checks were successful
/ DCO (pull_request) Successful in 1m52s
Details
/ Vulncheck (pull_request) Successful in 2m0s
Details
/ Builds (1.20) (pull_request) Successful in 2m49s
Details
/ Builds (1.21) (pull_request) Successful in 1m59s
Details
/ Lint (pull_request) Successful in 2m44s
Details
/ Tests (1.20) (pull_request) Successful in 2m30s
Details
/ Tests (1.21) (pull_request) Successful in 2m24s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 12:53:45 +03:00
Pavel Pogodaev
4804904d9d [#298] journald update version 
We want to have less useless fields in logs

Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-01-29 12:49:22 +00:00
Denis Kirillov
3b6d2bc522 [#287] authmate: Support frostfsid proxy and namespace 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-22 15:43:14 +03:00
Denis Kirillov
5698d5844e [#283] Support frostfsid groups in policy request checking 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-21 14:21:36 +03:00
Denis Kirillov
a17ff66975 [#282] policy: Use prefixes to distinguish s3/iam actions/resources
All checks were successful
/ DCO (pull_request) Successful in 1m37s
Details
/ Vulncheck (pull_request) Successful in 1m50s
Details
/ Builds (1.20) (pull_request) Successful in 2m24s
Details
/ Builds (1.21) (pull_request) Successful in 2m2s
Details
/ Lint (pull_request) Successful in 4m26s
Details
/ Tests (1.20) (pull_request) Successful in 2m28s
Details
/ Tests (1.21) (pull_request) Successful in 1m58s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-20 10:41:15 +03:00
Denis Kirillov
6dbb07f0fa [#261] Update policy-engine dependency 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-14 17:52:13 +03:00
Denis Kirillov
9272f4e108 [#259] Support contract based policies
All checks were successful
/ DCO (pull_request) Successful in 1m21s
Details
/ Vulncheck (pull_request) Successful in 1m41s
Details
/ Builds (1.20) (pull_request) Successful in 2m19s
Details
/ Builds (1.21) (pull_request) Successful in 2m1s
Details
/ Lint (pull_request) Successful in 3m20s
Details
/ Tests (1.20) (pull_request) Successful in 2m14s
Details
/ Tests (1.21) (pull_request) Successful in 2m10s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-11 10:01:46 +03:00
Denis Kirillov
be6a37ada5 [#262] Support configuring max tree request attempts
All checks were successful
/ DCO (pull_request) Successful in 1m15s
Details
/ Vulncheck (pull_request) Successful in 1m39s
Details
/ Builds (1.20) (pull_request) Successful in 1m19s
Details
/ Builds (1.21) (pull_request) Successful in 2m27s
Details
/ Lint (pull_request) Successful in 4m24s
Details
/ Tests (1.20) (pull_request) Successful in 2m17s
Details
/ Tests (1.21) (pull_request) Successful in 2m36s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 16:41:21 +03:00
Alex Vanin
7a285d1464 [#267] Update api-go to fix stable marshal of empty structs 
Newer version of api-go does not ignore non-nil empty
structures in protobuf messages, so compatibility with
previous version is preserved.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 16:40:56 +03:00
Alex Vanin
94c2674f44 [#233] Update tree service pool in SDK 
Tree service pool now produces retries if
tree service returns 'not found' errors
or empty result on 'GetNodeByPath'

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 16:40:53 +03:00
Denis Kirillov
473239bf36 [#257] Add policy checker 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-06 17:47:51 +03:00
Denis Kirillov
42862fd69e [#258] Support policy management in control svc
All checks were successful
/ Vulncheck (pull_request) Successful in 3m20s
Details
/ DCO (pull_request) Successful in 3m56s
Details
/ Builds (1.20) (pull_request) Successful in 4m13s
Details
/ Builds (1.21) (pull_request) Successful in 4m9s
Details
/ Lint (pull_request) Successful in 3m9s
Details
/ Tests (1.20) (pull_request) Successful in 4m14s
Details
/ Tests (1.21) (pull_request) Successful in 3m59s
Details 
Add PutPolicies, RemovePolicies, GetPolicy, ListPolicies methods

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-01 15:47:12 +03:00
Denis Kirillov
6304d7bfda [#260] Support frostfsid validation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-11-23 11:00:11 +03:00
Roman Loginov
406075aebb [#236] Add support zapjournald logger configuration
All checks were successful
/ DCO (pull_request) Successful in 1m34s
Details
/ Vulncheck (pull_request) Successful in 2m6s
Details
/ Builds (1.20) (pull_request) Successful in 2m15s
Details
/ Builds (1.21) (pull_request) Successful in 2m2s
Details
/ Lint (pull_request) Successful in 2m59s
Details
/ Tests (1.20) (pull_request) Successful in 2m22s
Details
/ Tests (1.21) (pull_request) Successful in 1m43s
Details 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2023-11-13 16:31:11 +03:00
Denis Kirillov
8fc9d93f37 [#197] Update SDK 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-10-11 12:32:48 +00:00
Denis Kirillov
6b1f365e65 [#192] Support client cut 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-08-23 06:26:55 +00:00
Marina Biryukova
012ece40bb [#180] Fix linter issues
All checks were successful
/ Builds (1.19) (pull_request) Successful in 2m55s
Details
/ Builds (1.20) (pull_request) Successful in 2m47s
Details
/ DCO (pull_request) Successful in 3m4s
Details
/ Vulncheck (pull_request) Successful in 3m39s
Details
/ Lint (pull_request) Successful in 4m19s
Details
/ Tests (1.19) (pull_request) Successful in 3m52s
Details
/ Tests (1.20) (pull_request) Successful in 3m18s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2023-08-21 17:23:24 +03:00
Artem Tataurov
94a42fa273 [#51] Update frostfs-sdk-go 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-08-17 14:26:25 +03:00
Alex Vanin
46eae4a356 [#179] Fix GetSubTree failures with updated SDK 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-08-02 14:56:23 +00:00
Denis Kirillov
e30a452cdb [#149] Use chi instead of gorilla mux 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-07-11 17:25:09 +03:00
Denis Kirillov
7be70243f7 [#166] Update sdk to support grpc schemes in tree pool 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-07-11 17:25:03 +03:00
Denis Kirillov
0cd353707a [#131] authmate: Make authmate use cobra 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-06-27 14:18:16 +03:00
Denis Kirillov
9dabaf6ecd [#133] Use tree pool from SDK 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-06-09 09:34:04 +03:00
Artem Tataurov
fa5889a0f5 [#94] Update prometheus to v1.15.0 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-05-18 17:36:32 +03:00
Denis Kirillov
bf47978cfe [#105] Update SDK to fix impersonated token 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-05-05 18:11:33 +03:00
Artem Tataurov
e487ee5b7d [#70] Add arrays of copies numbers for location constraints 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-05-03 13:48:26 +03:00
Denis Kirillov
6c68e21777 [#69] Update SDK to fix handle request canceling 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-30 15:56:57 +03:00
Denis Kirillov
a0937126cb [#64] Support new system attributes 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-22 11:46:58 +03:00
Denis Kirillov
5c62010331 [#35] Update SDK to not count error on client aborting 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-10 11:08:21 +03:00
Alex Vanin
813aa2f173 Rename package name 
Due to source code relocation from GitHub.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-07 17:38:08 +03:00
Denis Kirillov
b35f146cec [TrueCloudLab#20] Renew tokens beforehand 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-03 16:59:49 +03:00
Denis Kirillov
361d1d3881 [TrueCloudLab#16] Update go version to 1.18 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-01-25 10:39:44 +03:00
Artem Tataurov
9ad7982807 [#14] Update neo-go and viper 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-01-25 10:23:16 +03:00
Denis Kirillov
cafe079072 [TrueCloudLab#13] Update frostfs SDK 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-01-23 13:59:32 +03:00
Alex Vanin
9473335234 [#11] Update FrostFS SDK 
Contains debug logs for switching
connections in pool.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-01-18 12:22:44 +03:00
Denis Kirillov
19d8f8fcfe [#7] Update SDK 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-01-10 11:24:43 +03:00
Alex Vanin
96dff367db [#1] Build S3 Gateway with FrostFS dependencies 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2022-12-15 12:43:52 +03:00
Denis Kirillov
d1825f97fb [#750] Update SDK to support timeout for stream 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-11-15 18:10:28 +03:00