TrueCloudLab/frostfs-s3-gw
15
3
Fork 19
Code Issues 29 Pull requests 6 Projects Releases 17 Packages Activity Actions
1306 commits 5 branches 41 tags 20 MiB
Commit graph

1306 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alex Vanin
b7e15402a1 [#360] Use 'c' prefix for bucket policies instead of 'n' 
With 'c' prefix, acl chains become shorter, thus gateway
receives shorter results and avoids sessions to neo-go.

There is still issue with many IAM rules.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-04-10 17:40:25 +03:00
Denis Kirillov
0cc6b41b2d [#358] Update APE to allow put tombstone on delete object
Some checks failed
/ Builds (1.20) (pull_request) Successful in 4m17s
Details
/ Builds (1.21) (pull_request) Successful in 3m58s
Details
/ DCO (pull_request) Successful in 4m8s
Details
/ Vulncheck (pull_request) Failing after 4m36s
Details
/ Lint (pull_request) Successful in 6m50s
Details
/ Tests (1.20) (pull_request) Successful in 5m13s
Details
/ Tests (1.21) (pull_request) Successful in 5m7s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-10 15:11:25 +03:00
Denis Kirillov
51be9d9778 [#354] Remove policies when delete bucket
Some checks failed
/ DCO (pull_request) Successful in 2m10s
Details
/ Builds (1.20) (pull_request) Successful in 3m30s
Details
/ Builds (1.21) (pull_request) Successful in 2m29s
Details
/ Vulncheck (pull_request) Failing after 3m10s
Details
/ Lint (pull_request) Successful in 4m59s
Details
/ Tests (1.20) (pull_request) Successful in 3m12s
Details
/ Tests (1.21) (pull_request) Successful in 1m34s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-09 17:30:20 +03:00
Denis Kirillov
1cad101609 [#354] Update frostfs-contract to terminate session iterator 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-09 17:30:10 +03:00
Denis Kirillov
d631ee55c9 [#351] policy: Use iterators to list chains
All checks were successful
/ DCO (pull_request) Successful in 3m49s
Details
/ Vulncheck (pull_request) Successful in 4m44s
Details
/ Builds (1.20) (pull_request) Successful in 5m14s
Details
/ Builds (1.21) (pull_request) Successful in 4m47s
Details
/ Lint (pull_request) Successful in 7m10s
Details
/ Tests (1.20) (pull_request) Successful in 4m53s
Details
/ Tests (1.21) (pull_request) Successful in 4m17s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-03 11:32:43 +03:00
Alex Vanin
85c8210ffd [#347] Explicitly specify sorting order of subtree for object listing
All checks were successful
/ DCO (pull_request) Successful in 54s
Details
/ Vulncheck (pull_request) Successful in 1m56s
Details
/ Builds (1.20) (pull_request) Successful in 3m16s
Details
/ Builds (1.21) (pull_request) Successful in 3m18s
Details
/ Lint (pull_request) Successful in 8m45s
Details
/ Tests (1.20) (pull_request) Successful in 2m56s
Details
/ Tests (1.21) (pull_request) Successful in 2m25s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-04-02 18:14:43 +03:00
Denis Kirillov
bcfbcdc82f [#345] acl: Update APE and fix using
Some checks failed
/ Lint (pull_request) Successful in 2m53s
Details
/ Tests (1.20) (pull_request) Successful in 2m43s
Details
/ Tests (1.21) (pull_request) Successful in 2m44s
Details
/ DCO (pull_request) Successful in 2m40s
Details
/ Vulncheck (pull_request) Failing after 3m10s
Details
/ Builds (1.20) (pull_request) Successful in 3m18s
Details
/ Builds (1.21) (pull_request) Successful in 3m33s
Details 
* Remove native policy when remove bucket policy
* Allow policies that contain only s3 compatible statements
(now deny rules cannot be converted to native rules)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-02 12:42:43 +00:00
Denis Kirillov
fd310f5e9f [#343] docs: Actualize s3 compatibility table
Some checks failed
/ Vulncheck (pull_request) Failing after 9s
Details
/ DCO (pull_request) Successful in 1m30s
Details
/ Builds (1.20) (pull_request) Successful in 2m11s
Details
/ Builds (1.21) (pull_request) Successful in 1m49s
Details
/ Lint (pull_request) Successful in 4m5s
Details
/ Tests (1.20) (pull_request) Successful in 2m26s
Details
/ Tests (1.21) (pull_request) Successful in 2m20s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-02 10:00:44 +03:00
Denis Kirillov
1f5f2bd3d5 [#306] In APE buckets forbid canned acl except private
Some checks failed
/ DCO (pull_request) Successful in 1m35s
Details
/ Builds (1.20) (pull_request) Successful in 2m9s
Details
/ Builds (1.21) (pull_request) Successful in 2m3s
Details
/ Vulncheck (pull_request) Failing after 3m30s
Details
/ Lint (pull_request) Successful in 6m1s
Details
/ Tests (1.20) (pull_request) Successful in 3m13s
Details
/ Tests (1.21) (pull_request) Successful in 2m52s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-19 16:56:32 +03:00
Denis Kirillov
a32b41716f [#328] Log error on failed response writing
Some checks failed
/ DCO (pull_request) Successful in 3m48s
Details
/ Builds (1.20) (pull_request) Successful in 3m58s
Details
/ Builds (1.21) (pull_request) Successful in 3m59s
Details
/ Vulncheck (pull_request) Failing after 3m44s
Details
/ Lint (pull_request) Successful in 2m43s
Details
/ Tests (1.20) (pull_request) Successful in 3m58s
Details
/ Tests (1.21) (pull_request) Successful in 3m53s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-15 11:04:05 +03:00
Denis Kirillov
6788306998 [#328] Log invalid tree service KVs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-04 15:35:23 +03:00
Denis Kirillov
4ee3648183 [#328] Log invalid lock enabled header 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-04 15:09:51 +03:00
Denis Kirillov
ee48d1dc85 [#325] Log error on failed request id generation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-04 09:49:41 +00:00
Denis Kirillov
f958eef2b3 [#325] Use default empty data.LockInfo in get/head in case of error 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-04 09:49:41 +00:00
Denis Kirillov
81b44ab3d3 [#325] Fix mutex usage in controller 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-04 09:49:41 +00:00
Denis Kirillov
623001c403 [#325] Close listener on error 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-04 09:49:41 +00:00
Marina Biryukova
70043c4800 [#324] Close nns resolver after use 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-03-04 09:06:26 +00:00
Denis Kirillov
8050ca2d51 [#306] Use session token for container read operations
All checks were successful
/ DCO (pull_request) Successful in 1m54s
Details
/ Vulncheck (pull_request) Successful in 1m55s
Details
/ Builds (1.20) (pull_request) Successful in 2m49s
Details
/ Builds (1.21) (pull_request) Successful in 1m56s
Details
/ Lint (pull_request) Successful in 3m59s
Details
/ Tests (1.20) (pull_request) Successful in 2m30s
Details
/ Tests (1.21) (pull_request) Successful in 2m19s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-01 18:14:33 +03:00
Denis Kirillov
c12e264697 [#306] Simplify cid resolver for metrics 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-01 17:46:16 +03:00
Denis Kirillov
e9f38a49e4 [#306] Fix forming key for bucket cache 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-01 16:09:40 +03:00
Denis Kirillov
fabb4134bc [#318] Use log msg from constants
All checks were successful
/ DCO (pull_request) Successful in 1m44s
Details
/ Builds (1.20) (pull_request) Successful in 2m24s
Details
/ Builds (1.21) (pull_request) Successful in 2m18s
Details
/ Vulncheck (pull_request) Successful in 2m17s
Details
/ Lint (pull_request) Successful in 2m36s
Details
/ Tests (1.20) (pull_request) Successful in 1m42s
Details
/ Tests (1.21) (pull_request) Successful in 1m32s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
e1ee36b979 [#318] Fix tests 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
937367caaf [#318] Fix panic on invalid multipart form 
Previously, simple 'curl -X POST http://localhost:8084/test' leads to panic because of wrong handle matching

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
7b86bac6ee [#318] Log unmatched requests 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
529ec7e0b9 [#318] Don't log empty bucket/name 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
4741e74210 [#318] Log successfully authenticated accessKeyIDs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
f1470bab4a [#318] auth: Add context for logged errors 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
6e5bcaef97 [#318] Log policy request checking 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Denis Kirillov
1522db05c5 [#318] Log namespace for requests 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-29 17:30:28 +03:00
Marina Biryukova
31da31862a [#300] Update error logging in DeleteMultipleObjects 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-02-29 14:24:32 +00:00
Denis Kirillov
7de1ffdbe9 [#306] Fix billing tests
All checks were successful
/ DCO (pull_request) Successful in 1m43s
Details
/ Vulncheck (pull_request) Successful in 1m42s
Details
/ Builds (1.20) (pull_request) Successful in 2m34s
Details
/ Builds (1.21) (pull_request) Successful in 1m56s
Details
/ Lint (pull_request) Successful in 3m50s
Details
/ Tests (1.20) (pull_request) Successful in 2m20s
Details
/ Tests (1.21) (pull_request) Successful in 2m9s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 18:00:27 +03:00
Denis Kirillov
3285a2e105 [#306] policy: Change default access strategy 
Use access strategy based on bucket type and/or config flags.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:53:13 +03:00
Denis Kirillov
1bfea006b0 [#306] Update APE 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
56b50f2075 [#306] Remove flag to disable policy contract 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
8f89f275bd [#306] Save bucket policy as native chain 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
ff15f9f28a [#306] Fix update settings for buckets without owner key in tree 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
c868af8a62 [#306] Add flag to enable old ACL bucket creation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
bac1b3fb2d [#306] Use zero basic acl to mark APE containers 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
c452d58ce2 [#306] Reduce number of policy contract invocations 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
499a202d28 [#306] Update CHANGELOG.md 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
d9d12debc3 [#306] Add tests 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
3d0d2032c6 [#306] acl: Handle put/get acl for APE buckets 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
1f2cf0ed67 [#306] Use APE instead of eACL on bucket creation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
37be8851b3 [#306] Simplify namespaces configuration 
Resolve ns alias at the beginning of the request just once.
Keep in ns map only one default ns key.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
c4c199defe [#306] Use s3 as chain id prefix to be consistent 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Marina Biryukova
2981a47e99 [#321] Use correct owner id in billing metrics
All checks were successful
/ DCO (pull_request) Successful in 1m20s
Details
/ Vulncheck (pull_request) Successful in 1m54s
Details
/ Builds (1.20) (pull_request) Successful in 2m22s
Details
/ Builds (1.21) (pull_request) Successful in 2m8s
Details
/ Lint (pull_request) Successful in 4m32s
Details
/ Tests (1.20) (pull_request) Successful in 2m27s
Details
/ Tests (1.21) (pull_request) Successful in 2m13s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-02-28 14:52:44 +03:00
Marina Biryukova
391fc9cbe3 [#311] Change object owner for anonymous put 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-02-21 15:03:16 +00:00
Denis Kirillov
4eb2c7fb7d [#290] Fix TestErrorTimeoutChecking test
All checks were successful
/ DCO (pull_request) Successful in 1m34s
Details
/ Vulncheck (pull_request) Successful in 1m37s
Details
/ Builds (1.20) (pull_request) Successful in 2m22s
Details
/ Builds (1.21) (pull_request) Successful in 1m38s
Details
/ Lint (pull_request) Successful in 3m45s
Details
/ Tests (1.20) (pull_request) Successful in 2m16s
Details
/ Tests (1.21) (pull_request) Successful in 2m9s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-20 11:39:49 +00:00
Alex Vanin
563c1d9bd7 [#308] Fix linter issues
All checks were successful
/ DCO (pull_request) Successful in 1m31s
Details
/ Builds (1.20) (pull_request) Successful in 1m59s
Details
/ Builds (1.21) (pull_request) Successful in 1m37s
Details
/ Vulncheck (pull_request) Successful in 2m14s
Details
/ Lint (pull_request) Successful in 4m7s
Details
/ Tests (1.20) (pull_request) Successful in 2m28s
Details
/ Tests (1.21) (pull_request) Successful in 1m58s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-02-16 18:25:06 +03:00
Alex Vanin
0f3b4ab0ed [#308] Update linter versions 
Latest golangci-lint has newer x/tools version and
it is incompatible with internal linter.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-02-16 18:24:53 +03:00