TrueCloudLab/frostfs-s3-gw
17
3
Fork 19
Code Issues 28 Pull requests 7 Projects Releases 18 Packages Activity Actions
1370 commits 5 branches 43 tags 21 MiB
Commit graph

1370 commits

This branch
This branch
All branches
Author SHA1 Message Date
Denis Kirillov
93cd6afede [#430] multipart: Support removing duplicated parts
Some checks failed
/ DCO (pull_request) Successful in 1m17s
Details
/ Vulncheck (pull_request) Successful in 2m37s
Details
/ Lint (pull_request) Failing after 14s
Details
/ Tests (1.21) (pull_request) Successful in 2m50s
Details
/ Tests (1.22) (pull_request) Successful in 2m45s
Details
/ Builds (1.21) (pull_request) Successful in 2m35s
Details
/ Builds (1.22) (pull_request) Successful in 2m30s
Details 
Previously after tree split we can have duplicated parts
(several objects and tree node referred to the same part number).
Some of them couldn't be deleted after abort or compete action.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-18 17:00:34 +03:00
Denis Kirillov
1e2fd7ba75 [#430] Delete all split version at once 
Previously after split we can get two `null` versioned object with the same key
and deleting such key removes only one node/object.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-18 17:00:13 +03:00
Denis Kirillov
55631eb39d [#430] tree: Support removing old split system nodes 
It's need to fit user expectation on deleting CORs for example.
Previously after removing cors (that was uploaded in split manner)
we can still get some data (from other node)
because deletion worked only for latest node version.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-18 17:00:08 +03:00
Denis Kirillov
0cc13e07c4 [#430] ci: Update go version
All checks were successful
/ DCO (pull_request) Successful in 2m6s
Details
/ Vulncheck (pull_request) Successful in 2m23s
Details
/ Builds (1.21) (pull_request) Successful in 3m40s
Details
/ Builds (1.22) (pull_request) Successful in 3m38s
Details
/ Lint (pull_request) Successful in 8m23s
Details
/ Tests (1.21) (pull_request) Successful in 3m4s
Details
/ Tests (1.22) (pull_request) Successful in 3m36s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-17 09:08:12 +03:00
Denis Kirillov
f4055bd0b7 [#430] tree: Fix multipart having system name
Some checks failed
/ Builds (1.20) (pull_request) Failing after 1m6s
Details
/ Builds (1.21) (pull_request) Successful in 1m36s
Details
/ DCO (pull_request) Successful in 1m57s
Details
/ Vulncheck (pull_request) Successful in 2m2s
Details
/ Lint (pull_request) Successful in 4m23s
Details
/ Tests (1.20) (pull_request) Failing after 2m9s
Details
/ Tests (1.21) (pull_request) Successful in 2m18s
Details 
Previously if multipart key has the same name as some system node
(e.g. bucket-settings, bucket-cors etc.) it shadows real system node
and bucket started to be unversioned again for example.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-16 17:36:52 +03:00
Denis Kirillov
452c226c98 [#430] Fix split tree 
Update tree service to fix split tree problem.
Tree intermediate nodes can be duplicated, so we must handle this.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-16 17:31:29 +03:00
Marina Biryukova
3b83de31d2 [#419] Update SDK version 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-07-08 12:15:24 +00:00
Denis Kirillov
70eedfc077 [#414] authmate: Add register-user command
All checks were successful
/ Builds (1.20) (pull_request) Successful in 14m30s
Details
/ Builds (1.21) (pull_request) Successful in 14m25s
Details
/ DCO (pull_request) Successful in 6m47s
Details
/ Vulncheck (pull_request) Successful in 6m59s
Details
/ Lint (pull_request) Successful in 11m52s
Details
/ Tests (1.20) (pull_request) Successful in 8m24s
Details
/ Tests (1.21) (pull_request) Successful in 8m19s
Details 
New command allows register user in frostfsid and
set allowed rules in policy contract

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-08 14:13:00 +03:00
Alex Vanin
f86b82351a [#398] Fix parameter parsing in bucket retryer
Some checks failed
/ Builds (1.20) (pull_request) Successful in 2m7s
Details
/ Builds (1.21) (pull_request) Successful in 1m38s
Details
/ DCO (pull_request) Successful in 2m3s
Details
/ Vulncheck (pull_request) Failing after 2m23s
Details
/ Lint (pull_request) Successful in 4m21s
Details
/ Tests (1.20) (pull_request) Successful in 2m46s
Details
/ Tests (1.21) (pull_request) Successful in 2m42s
Details 
RetryStrategyExponential should use jitter backoff
instead of constant delay function

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-03 13:42:24 +03:00
Denis Kirillov
465eaa816a [#372] Drop [e]ACL related code
All checks were successful
/ DCO (pull_request) Successful in 2m15s
Details
/ Vulncheck (pull_request) Successful in 2m55s
Details
/ Builds (1.20) (pull_request) Successful in 3m46s
Details
/ Builds (1.21) (pull_request) Successful in 3m48s
Details
/ Lint (pull_request) Successful in 5m26s
Details
/ Tests (1.20) (pull_request) Successful in 3m34s
Details
/ Tests (1.21) (pull_request) Successful in 3m18s
Details 
Always consider buckets as APE compatible

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:58:44 +03:00
Denis Kirillov
9241954496 [#372] authmate: Don't create creds with eacl table 
Allow only impersonate flag.
Don't allow SetEACL container session token.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:26:21 +03:00
Denis Kirillov
77f8bdac58 [#372] Drop kludge.acl_enabled flag 
Now only APE container can be created using s3-gw

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:26:19 +03:00
Denis Kirillov
91541a432d [#411] Check uniqueness in DeleteMultipleObjects
All checks were successful
/ Builds (1.20) (pull_request) Successful in 4m57s
Details
/ Builds (1.21) (pull_request) Successful in 4m42s
Details
/ DCO (pull_request) Successful in 4m52s
Details
/ Vulncheck (pull_request) Successful in 4m38s
Details
/ Lint (pull_request) Successful in 6m46s
Details
/ Tests (1.20) (pull_request) Successful in 4m28s
Details
/ Tests (1.21) (pull_request) Successful in 4m7s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-26 16:39:06 +03:00
Denis Kirillov
943b30d9f4 [#411] Don't check object tags on deletion 
By specification https://docs.aws.amazon.com/AmazonS3/latest/userguide/tagging-and-policies.html
we shouldn't check object tags on PUT and DELETE

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-26 16:38:56 +03:00
Denis Kirillov
414f3943e2 [#410] Drop layer.Client interface
All checks were successful
/ DCO (pull_request) Successful in 2m1s
Details
/ Vulncheck (pull_request) Successful in 2m31s
Details
/ Builds (1.20) (pull_request) Successful in 2m39s
Details
/ Builds (1.21) (pull_request) Successful in 2m31s
Details
/ Lint (pull_request) Successful in 3m14s
Details
/ Tests (1.20) (pull_request) Successful in 2m34s
Details
/ Tests (1.21) (pull_request) Successful in 2m10s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-25 15:57:55 +03:00
Denis Kirillov
9432782ce6 [#401] Drop notifications
All checks were successful
/ DCO (pull_request) Successful in 2m5s
Details
/ Builds (1.20) (pull_request) Successful in 2m40s
Details
/ Builds (1.21) (pull_request) Successful in 2m33s
Details
/ Vulncheck (pull_request) Successful in 2m22s
Details
/ Lint (pull_request) Successful in 4m24s
Details
/ Tests (1.20) (pull_request) Successful in 2m48s
Details
/ Tests (1.21) (pull_request) Successful in 2m45s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-25 15:49:37 +03:00
Denis Kirillov
2b04fcb5ec [#406] Remove control api 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-21 06:36:56 +00:00
Denis Kirillov
280d11c794 [#407] Don't set full_control for bucket owner
All checks were successful
/ DCO (pull_request) Successful in 1m29s
Details
/ Builds (1.20) (pull_request) Successful in 2m14s
Details
/ Builds (1.21) (pull_request) Successful in 1m47s
Details
/ Vulncheck (pull_request) Successful in 1m57s
Details
/ Lint (pull_request) Successful in 4m16s
Details
/ Tests (1.20) (pull_request) Successful in 2m46s
Details
/ Tests (1.21) (pull_request) Successful in 2m29s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-19 10:55:24 +03:00
Roman Loginov
ed34b2cae4 [#402] auth: Extend test coverage 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-06-14 10:06:00 +00:00
Denis Kirillov
76f553d292 [#403] Set resource tags into resource properties
All checks were successful
/ DCO (pull_request) Successful in 6m17s
Details
/ Vulncheck (pull_request) Successful in 8m13s
Details
/ Builds (1.20) (pull_request) Successful in 9m45s
Details
/ Builds (1.21) (pull_request) Successful in 9m8s
Details
/ Lint (pull_request) Successful in 18m4s
Details
/ Tests (1.20) (pull_request) Successful in 9m52s
Details
/ Tests (1.21) (pull_request) Successful in 9m5s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-13 11:12:40 +03:00
Denis Kirillov
1513a9252b [#403] go.mod: Update APE 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-13 11:12:35 +03:00
Denis Kirillov
bb81afc14a [#398] Support retryer 
Add two strategy for PutBucketSettings request retryer:
* exponential backoff (increasing up to `max_backoff` delays with jitter)
* constant backoff (always the same `max_backoff` delay between requests)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-06 13:02:17 +00:00
Anoke
58850f590e [#335] Improve determining AccessBox latest version 
Signed-off-by: Anoke <rustamgta1011@gmail.com>
 2024-06-06 12:35:48 +00:00
Marina Biryukova
e25dc90c20 [#399] Add OPTIONS method for object operations 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-06-04 12:59:45 +00:00
Roman Loginov
71bae5cd9a [#400] Update frostfs-sdk-go version with support EC 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-06-04 12:22:06 +00:00
Pavel Pogodaev
b5fae316cf [#396] Add user to response 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-06-04 09:37:55 +00:00
Alex Vanin
9f3ea470e6 [#395] Port changelog and prepare it for next release
All checks were successful
/ Vulncheck (pull_request) Successful in 2m35s
Details
/ Builds (1.20) (pull_request) Successful in 2m30s
Details
/ Builds (1.21) (pull_request) Successful in 2m8s
Details
/ DCO (pull_request) Successful in 2m26s
Details
/ Lint (pull_request) Successful in 3m42s
Details
/ Tests (1.20) (pull_request) Successful in 2m51s
Details
/ Tests (1.21) (pull_request) Successful in 2m40s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-27 14:27:11 +03:00
Denis Kirillov
9787b29542 [#392] go.mod: Update APE to drop private IPs checking
All checks were successful
/ Vulncheck (pull_request) Successful in 2m8s
Details
/ DCO (pull_request) Successful in 2m38s
Details
/ Builds (1.20) (pull_request) Successful in 2m48s
Details
/ Builds (1.21) (pull_request) Successful in 3m22s
Details
/ Lint (pull_request) Successful in 5m17s
Details
/ Tests (1.20) (pull_request) Successful in 3m37s
Details
/ Tests (1.21) (pull_request) Successful in 2m59s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-05-27 11:26:15 +03:00
Roman Loginov
9152b084ec [#387] Fix typo 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
21dbe3ea8e [#387] api: Add tests for middleware 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
f4d174e740 [#387] middleware: Extend test coverage 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
8a758293b9 [#387] middleware: Delete unused code 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Denis Kirillov
fb521c7ac6 [#367] policy: Set IAM-MFA property to false by default
All checks were successful
/ DCO (pull_request) Successful in 2m34s
Details
/ Vulncheck (pull_request) Successful in 2m41s
Details
/ Builds (1.20) (pull_request) Successful in 4m26s
Details
/ Builds (1.21) (pull_request) Successful in 4m19s
Details
/ Lint (pull_request) Successful in 5m48s
Details
/ Tests (1.20) (pull_request) Successful in 3m55s
Details
/ Tests (1.21) (pull_request) Successful in 3m53s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-05-22 12:05:42 +03:00
Alex Vanin
87b9e97a80 [#354] Do not proceed on bucket remove error
All checks were successful
/ DCO (pull_request) Successful in 2m22s
Details
/ Vulncheck (pull_request) Successful in 2m37s
Details
/ Builds (1.20) (pull_request) Successful in 3m42s
Details
/ Builds (1.21) (pull_request) Successful in 3m12s
Details
/ Lint (pull_request) Successful in 4m51s
Details
/ Tests (1.20) (pull_request) Successful in 3m13s
Details
/ Tests (1.21) (pull_request) Successful in 3m6s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-17 20:38:39 +03:00
Artem Tataurov
d62d8f3874 [#385] Support the renaming of ObjectRequest and ObjectContainer
All checks were successful
/ DCO (pull_request) Successful in 1m33s
Details
/ Builds (1.20) (pull_request) Successful in 2m7s
Details
/ Builds (1.21) (pull_request) Successful in 1m24s
Details
/ Vulncheck (pull_request) Successful in 1m58s
Details
/ Lint (pull_request) Successful in 4m26s
Details
/ Tests (1.20) (pull_request) Successful in 2m35s
Details
/ Tests (1.21) (pull_request) Successful in 2m42s
Details 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2024-05-14 16:51:36 +03:00
Alex Vanin
6bf6a3b1a3 [#362] Check user and groups during policy check
All checks were successful
/ DCO (pull_request) Successful in 4m8s
Details
/ Vulncheck (pull_request) Successful in 4m10s
Details
/ Builds (1.20) (pull_request) Successful in 5m33s
Details
/ Builds (1.21) (pull_request) Successful in 5m24s
Details
/ Lint (pull_request) Successful in 8m32s
Details
/ Tests (1.20) (pull_request) Successful in 5m9s
Details
/ Tests (1.21) (pull_request) Successful in 4m52s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-08 15:25:14 +03:00
Alex Vanin
2f108c9951 [#362] Expand control service 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-08 15:15:49 +03:00
Marina Biryukova
c43ef040dc [#382] Fix request type determination
All checks were successful
/ DCO (pull_request) Successful in 1m36s
Details
/ Builds (1.20) (pull_request) Successful in 2m15s
Details
/ Builds (1.21) (pull_request) Successful in 2m9s
Details
/ Lint (pull_request) Successful in 3m22s
Details
/ Tests (1.20) (pull_request) Successful in 2m18s
Details
/ Tests (1.21) (pull_request) Successful in 2m6s
Details
/ Vulncheck (pull_request) Successful in 57s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-05-07 15:17:22 +03:00
Marina Biryukova
2ab655b909 [#380] Add test for credentials versioning 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-05-03 07:24:13 +00:00
Marina Biryukova
1c398551e5 [#380] creds: Increase test coverage 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-05-03 07:24:13 +00:00
Pavel Pogodaev
db05021786 [#379] Add Iana CharsetReader for Oracle integration
All checks were successful
/ DCO (pull_request) Successful in 1m54s
Details
/ Builds (1.20) (pull_request) Successful in 2m23s
Details
/ Builds (1.21) (pull_request) Successful in 2m0s
Details
/ Vulncheck (pull_request) Successful in 2m7s
Details
/ Lint (pull_request) Successful in 4m16s
Details
/ Tests (1.20) (pull_request) Successful in 2m38s
Details
/ Tests (1.21) (pull_request) Successful in 2m29s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-04-25 17:44:38 +03:00
Marina Biryukova
034396d554 [#377] Add check of Source IP
All checks were successful
/ DCO (pull_request) Successful in 1m55s
Details
/ Builds (1.20) (pull_request) Successful in 2m16s
Details
/ Builds (1.21) (pull_request) Successful in 2m26s
Details
/ Vulncheck (pull_request) Successful in 2m24s
Details
/ Lint (pull_request) Successful in 4m17s
Details
/ Tests (1.20) (pull_request) Successful in 2m42s
Details
/ Tests (1.21) (pull_request) Successful in 2m32s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-04-22 15:29:18 +03:00
Pavel Pogodaev
3c436d8de9 [#365] Include iam user tags in query
All checks were successful
/ Vulncheck (pull_request) Successful in 1m48s
Details
/ Builds (1.20) (pull_request) Successful in 2m30s
Details
/ Builds (1.21) (pull_request) Successful in 1m25s
Details
/ Lint (pull_request) Successful in 3m52s
Details
/ Tests (1.20) (pull_request) Successful in 2m24s
Details
/ Tests (1.21) (pull_request) Successful in 2m22s
Details
/ DCO (pull_request) Successful in 45s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-04-22 10:47:43 +03:00
Marina Biryukova
45f77de8c8 [#371] Add custom Source IP header configuration 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-04-22 07:42:45 +00:00
Denis Kirillov
d903de2457 [#370] Fix fetching attributes from tree
All checks were successful
/ DCO (pull_request) Successful in 2m6s
Details
/ Vulncheck (pull_request) Successful in 2m48s
Details
/ Builds (1.20) (pull_request) Successful in 3m19s
Details
/ Builds (1.21) (pull_request) Successful in 3m15s
Details
/ Lint (pull_request) Successful in 4m50s
Details
/ Tests (1.20) (pull_request) Successful in 3m13s
Details
/ Tests (1.21) (pull_request) Successful in 3m4s
Details 
Port #374

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-19 17:33:55 +03:00
Marina Biryukova
e22ff52165 [#367] Add check of AccessBox attributes 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-04-19 06:25:26 +00:00
Denis Kirillov
5315f7b733 [#269] Create frostfsid wrapper with cache
All checks were successful
/ DCO (pull_request) Successful in 2m10s
Details
/ Vulncheck (pull_request) Successful in 2m0s
Details
/ Builds (1.20) (pull_request) Successful in 2m31s
Details
/ Builds (1.21) (pull_request) Successful in 1m31s
Details
/ Lint (pull_request) Successful in 3m34s
Details
/ Tests (1.20) (pull_request) Successful in 2m26s
Details
/ Tests (1.21) (pull_request) Successful in 2m21s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-18 09:32:30 +03:00
Denis Kirillov
43a687b572 [#269] authmate: Update frostfsid using 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-17 12:11:23 +03:00
Denis Kirillov
29a2dae40c [#269] Move frostfsid client to separate package 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-17 12:11:23 +03:00
Denis Kirillov
fec3b3f31e [#269] Add frostfsid cache configuration 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-17 12:11:23 +03:00