TrueCloudLab/frostfs-s3-gw
18
3
Fork 20
Code Issues 28 Pull requests 9 Projects Releases 19 Packages Activity Actions
1389 commits 5 branches 44 tags 23 MiB
Commit graph

1389 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alex Vanin
243b165204 Release v0.30.6
All checks were successful
/ DCO (pull_request) Successful in 55s
Details
/ Builds (pull_request) Successful in 1m5s
Details
/ Vulncheck (pull_request) Successful in 1m12s
Details
/ Lint (pull_request) Successful in 1m37s
Details
/ Tests (pull_request) Successful in 1m16s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-09-16 16:06:01 +03:00
Marina Biryukova
a845e7f798 [#486] Fix PUT object with negative Content-Length 
(cherry picked from commit f187141ae5)

Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-16 14:30:11 +03:00
Marina Biryukova
c2e313d899 [#486] Fix PUT encrypted object 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-16 14:30:11 +03:00
Alex Vanin
c02f8b3ca3 [#450] Add test for chunk-encoded object size 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-09-16 14:30:11 +03:00
Pavel Pogodaev
f6d8271e5d [#450] Fix aws-chunked header workflow 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-09-16 14:30:11 +03:00
Alex Vanin
b54f8bbfc7 Release v0.30.5
All checks were successful
/ Builds (pull_request) Successful in 1m17s
Details
/ DCO (pull_request) Successful in 1m25s
Details
/ Vulncheck (pull_request) Successful in 1m24s
Details
/ Lint (pull_request) Successful in 1m39s
Details
/ Tests (pull_request) Successful in 1m25s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-09-16 13:49:44 +03:00
Roman Ognev
3461f4fdc5 [#492] Add panic catchers to fuzzing tests 
(cherry picked from commit 26baf8a94e)

Signed-off-by: Roman Ognev <r.ognev@yadro.com>
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-09-16 13:39:06 +03:00
Alex Vanin
d6f765a0f7 Release v0.30.4
All checks were successful
/ DCO (pull_request) Successful in 1m21s
Details
/ Builds (1.21) (pull_request) Successful in 1m32s
Details
/ Builds (1.22) (pull_request) Successful in 1m35s
Details
/ Vulncheck (pull_request) Successful in 1m26s
Details
/ Lint (pull_request) Successful in 2m52s
Details
/ Tests (1.21) (pull_request) Successful in 1m54s
Details
/ Tests (1.22) (pull_request) Successful in 1m51s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-09-03 09:44:52 +03:00
Roman Ognev
e5eb732cd5 [#480] Add fuzzing tests 
(cherry picked from commit 664f83b2b7)

Signed-off-by: Roman Ognev <r.ognev@yadro.com>
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-09-03 09:41:44 +03:00
Denis Kirillov
5275c45c6c Release v0.30.3
All checks were successful
/ DCO (pull_request) Successful in 1m5s
Details
/ Vulncheck (pull_request) Successful in 1m18s
Details
/ Builds (1.21) (pull_request) Successful in 1m29s
Details
/ Builds (1.22) (pull_request) Successful in 1m32s
Details
/ Lint (pull_request) Successful in 2m21s
Details
/ Tests (1.21) (pull_request) Successful in 1m46s
Details
/ Tests (1.22) (pull_request) Successful in 1m40s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-27 12:56:36 +03:00
Denis Kirillov
a7ae88e1fb [#471] tree: Don't use sorted GetSubTree for nodes without FileName
All checks were successful
/ DCO (pull_request) Successful in 1m15s
Details
/ Vulncheck (pull_request) Successful in 1m17s
Details
/ Builds (1.21) (pull_request) Successful in 1m38s
Details
/ Builds (1.22) (pull_request) Successful in 1m36s
Details
/ Lint (pull_request) Successful in 2m49s
Details
/ Tests (1.21) (pull_request) Successful in 1m41s
Details
/ Tests (1.22) (pull_request) Successful in 1m42s
Details 
Sorted GetSubTree doesn't return nodes without FileName attribute
if there are more than 1000 nodes in subtree

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-21 15:25:58 +03:00
Alex Vanin
058425ec4c Release v0.30.2
All checks were successful
/ DCO (pull_request) Successful in 2m18s
Details
/ Builds (1.21) (pull_request) Successful in 2m49s
Details
/ Builds (1.22) (pull_request) Successful in 2m47s
Details
/ Vulncheck (pull_request) Successful in 2m41s
Details
/ Lint (pull_request) Successful in 2m47s
Details
/ Tests (1.21) (pull_request) Successful in 2m44s
Details
/ Tests (1.22) (pull_request) Successful in 2m42s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-08-20 16:17:32 +03:00
Alex Vanin
ddfa09cffb [#468] Update sdk-go to fix pool issues 
New version provides these pool changes:
* bugfix for error counting before connection switch,
* explicit endpoint address in tree pool log messages.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-08-20 16:17:32 +03:00
Alex Vanin
3bbc8cce39 Release v0.30.1
All checks were successful
/ DCO (pull_request) Successful in 1m12s
Details
/ Vulncheck (pull_request) Successful in 1m17s
Details
/ Builds (1.21) (pull_request) Successful in 1m33s
Details
/ Builds (1.22) (pull_request) Successful in 1m22s
Details
/ Lint (pull_request) Successful in 2m5s
Details
/ Tests (1.21) (pull_request) Successful in 1m27s
Details
/ Tests (1.22) (pull_request) Successful in 1m41s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-25 14:31:33 +03:00
Marina Biryukova
2fefed842d [#439] Update SDK version 
New SDK version supports extended log records in pool component during inner nodes health check.

Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
(cherry picked from commit c506620199)
 2024-07-24 16:38:48 +03:00
Denis Kirillov
2bae704d3e [#437] tree: Add cleanOldNodes method
All checks were successful
/ Vulncheck (pull_request) Successful in 59s
Details
/ DCO (pull_request) Successful in 56s
Details
/ Builds (1.21) (pull_request) Successful in 1m26s
Details
/ Builds (1.22) (pull_request) Successful in 1m18s
Details
/ Lint (pull_request) Successful in 2m11s
Details
/ Tests (1.21) (pull_request) Successful in 1m43s
Details
/ Tests (1.22) (pull_request) Successful in 1m36s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-23 16:47:05 +03:00
Denis Kirillov
689f7ee818 [#437] tree: Support removing old split system nodes
All checks were successful
/ DCO (pull_request) Successful in 1m47s
Details
/ Builds (1.21) (pull_request) Successful in 2m20s
Details
/ Builds (1.22) (pull_request) Successful in 2m22s
Details
/ Vulncheck (pull_request) Successful in 2m6s
Details
/ Lint (pull_request) Successful in 4m43s
Details
/ Tests (1.21) (pull_request) Successful in 2m30s
Details
/ Tests (1.22) (pull_request) Successful in 2m25s
Details 
It's need to fit user expectation on deleting CORs for example.
Previously after removing cors (that was uploaded in split manner)
we can still get some data (from other node)
because deletion worked only for latest node version.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-22 10:42:11 +03:00
Alex Vanin
a031777a1b Release v0.30.0
All checks were successful
/ DCO (pull_request) Successful in 5m12s
Details
/ Vulncheck (pull_request) Successful in 5m26s
Details
/ Builds (1.21) (pull_request) Successful in 6m39s
Details
/ Builds (1.22) (pull_request) Successful in 6m29s
Details
/ Lint (pull_request) Successful in 8m28s
Details
/ Tests (1.21) (pull_request) Successful in 6m16s
Details
/ Tests (1.22) (pull_request) Successful in 6m4s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-19 17:09:58 +03:00
Alex Vanin
b2a5da8247 [#430] Bump frostfs-api-go for latest stable marshaler
All checks were successful
/ DCO (pull_request) Successful in 2m20s
Details
/ Vulncheck (pull_request) Successful in 2m45s
Details
/ Builds (1.21) (pull_request) Successful in 2m54s
Details
/ Builds (1.22) (pull_request) Successful in 2m48s
Details
/ Lint (pull_request) Successful in 4m53s
Details
/ Tests (1.21) (pull_request) Successful in 2m52s
Details
/ Tests (1.22) (pull_request) Successful in 2m45s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-19 16:42:36 +03:00
Alex Vanin
ec349e4523 [#430] Adopt compatibility workarounds in Tree API 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-19 14:47:47 +03:00
Denis Kirillov
977a20760b [#430] Delete all split version at once
All checks were successful
/ DCO (pull_request) Successful in 8m40s
Details
/ Vulncheck (pull_request) Successful in 13m10s
Details
/ Builds (1.21) (pull_request) Successful in 14m11s
Details
/ Builds (1.22) (pull_request) Successful in 14m18s
Details
/ Lint (pull_request) Successful in 16m31s
Details
/ Tests (1.21) (pull_request) Successful in 10m48s
Details
/ Tests (1.22) (pull_request) Successful in 14m31s
Details 
Previously after split we can get two `null` versioned object with the same key
and deleting such key removes only one node/object.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:26:51 +03:00
Denis Kirillov
2948d1f942 [#430] ci: Update go version 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:24:50 +03:00
Denis Kirillov
c0011ebb8d [#430] tree: Fix multipart having system name 
Previously if multipart key has the same name as some system node
(e.g. bucket-settings, bucket-cors etc.) it shadows real system node
and bucket started to be unversioned again for example.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:24:50 +03:00
Denis Kirillov
456319d2f1 [#430] Fix split tree 
Update tree service to fix split tree problem.
Tree intermediate nodes can be duplicated, so we must handle this.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:24:46 +03:00
Ekaterina Lebedeva
1d965b23ab [#432] doc: Fix grammar mistakes in authentication
All checks were successful
/ DCO (pull_request) Successful in 1m57s
Details
/ Builds (1.20) (pull_request) Successful in 2m53s
Details
/ Builds (1.21) (pull_request) Successful in 2m38s
Details
/ Vulncheck (pull_request) Successful in 2m42s
Details
/ Lint (pull_request) Successful in 4m40s
Details
/ Tests (1.20) (pull_request) Successful in 3m1s
Details
/ Tests (1.21) (pull_request) Successful in 2m52s
Details 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-07-17 17:08:48 +03:00
Marina Biryukova
3b83de31d2 [#419] Update SDK version 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-07-08 12:15:24 +00:00
Denis Kirillov
70eedfc077 [#414] authmate: Add register-user command
All checks were successful
/ Builds (1.20) (pull_request) Successful in 14m30s
Details
/ Builds (1.21) (pull_request) Successful in 14m25s
Details
/ DCO (pull_request) Successful in 6m47s
Details
/ Vulncheck (pull_request) Successful in 6m59s
Details
/ Lint (pull_request) Successful in 11m52s
Details
/ Tests (1.20) (pull_request) Successful in 8m24s
Details
/ Tests (1.21) (pull_request) Successful in 8m19s
Details 
New command allows register user in frostfsid and
set allowed rules in policy contract

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-08 14:13:00 +03:00
Alex Vanin
f86b82351a [#398] Fix parameter parsing in bucket retryer
Some checks failed
/ Builds (1.20) (pull_request) Successful in 2m7s
Details
/ Builds (1.21) (pull_request) Successful in 1m38s
Details
/ DCO (pull_request) Successful in 2m3s
Details
/ Vulncheck (pull_request) Failing after 2m23s
Details
/ Lint (pull_request) Successful in 4m21s
Details
/ Tests (1.20) (pull_request) Successful in 2m46s
Details
/ Tests (1.21) (pull_request) Successful in 2m42s
Details 
RetryStrategyExponential should use jitter backoff
instead of constant delay function

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-03 13:42:24 +03:00
Denis Kirillov
465eaa816a [#372] Drop [e]ACL related code
All checks were successful
/ DCO (pull_request) Successful in 2m15s
Details
/ Vulncheck (pull_request) Successful in 2m55s
Details
/ Builds (1.20) (pull_request) Successful in 3m46s
Details
/ Builds (1.21) (pull_request) Successful in 3m48s
Details
/ Lint (pull_request) Successful in 5m26s
Details
/ Tests (1.20) (pull_request) Successful in 3m34s
Details
/ Tests (1.21) (pull_request) Successful in 3m18s
Details 
Always consider buckets as APE compatible

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:58:44 +03:00
Denis Kirillov
9241954496 [#372] authmate: Don't create creds with eacl table 
Allow only impersonate flag.
Don't allow SetEACL container session token.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:26:21 +03:00
Denis Kirillov
77f8bdac58 [#372] Drop kludge.acl_enabled flag 
Now only APE container can be created using s3-gw

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:26:19 +03:00
Denis Kirillov
91541a432d [#411] Check uniqueness in DeleteMultipleObjects
All checks were successful
/ Builds (1.20) (pull_request) Successful in 4m57s
Details
/ Builds (1.21) (pull_request) Successful in 4m42s
Details
/ DCO (pull_request) Successful in 4m52s
Details
/ Vulncheck (pull_request) Successful in 4m38s
Details
/ Lint (pull_request) Successful in 6m46s
Details
/ Tests (1.20) (pull_request) Successful in 4m28s
Details
/ Tests (1.21) (pull_request) Successful in 4m7s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-26 16:39:06 +03:00
Denis Kirillov
943b30d9f4 [#411] Don't check object tags on deletion 
By specification https://docs.aws.amazon.com/AmazonS3/latest/userguide/tagging-and-policies.html
we shouldn't check object tags on PUT and DELETE

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-26 16:38:56 +03:00
Denis Kirillov
414f3943e2 [#410] Drop layer.Client interface
All checks were successful
/ DCO (pull_request) Successful in 2m1s
Details
/ Vulncheck (pull_request) Successful in 2m31s
Details
/ Builds (1.20) (pull_request) Successful in 2m39s
Details
/ Builds (1.21) (pull_request) Successful in 2m31s
Details
/ Lint (pull_request) Successful in 3m14s
Details
/ Tests (1.20) (pull_request) Successful in 2m34s
Details
/ Tests (1.21) (pull_request) Successful in 2m10s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-25 15:57:55 +03:00
Denis Kirillov
9432782ce6 [#401] Drop notifications
All checks were successful
/ DCO (pull_request) Successful in 2m5s
Details
/ Builds (1.20) (pull_request) Successful in 2m40s
Details
/ Builds (1.21) (pull_request) Successful in 2m33s
Details
/ Vulncheck (pull_request) Successful in 2m22s
Details
/ Lint (pull_request) Successful in 4m24s
Details
/ Tests (1.20) (pull_request) Successful in 2m48s
Details
/ Tests (1.21) (pull_request) Successful in 2m45s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-25 15:49:37 +03:00
Denis Kirillov
2b04fcb5ec [#406] Remove control api 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-21 06:36:56 +00:00
Denis Kirillov
280d11c794 [#407] Don't set full_control for bucket owner
All checks were successful
/ DCO (pull_request) Successful in 1m29s
Details
/ Builds (1.20) (pull_request) Successful in 2m14s
Details
/ Builds (1.21) (pull_request) Successful in 1m47s
Details
/ Vulncheck (pull_request) Successful in 1m57s
Details
/ Lint (pull_request) Successful in 4m16s
Details
/ Tests (1.20) (pull_request) Successful in 2m46s
Details
/ Tests (1.21) (pull_request) Successful in 2m29s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-19 10:55:24 +03:00
Roman Loginov
ed34b2cae4 [#402] auth: Extend test coverage 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-06-14 10:06:00 +00:00
Denis Kirillov
76f553d292 [#403] Set resource tags into resource properties
All checks were successful
/ DCO (pull_request) Successful in 6m17s
Details
/ Vulncheck (pull_request) Successful in 8m13s
Details
/ Builds (1.20) (pull_request) Successful in 9m45s
Details
/ Builds (1.21) (pull_request) Successful in 9m8s
Details
/ Lint (pull_request) Successful in 18m4s
Details
/ Tests (1.20) (pull_request) Successful in 9m52s
Details
/ Tests (1.21) (pull_request) Successful in 9m5s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-13 11:12:40 +03:00
Denis Kirillov
1513a9252b [#403] go.mod: Update APE 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-13 11:12:35 +03:00
Denis Kirillov
bb81afc14a [#398] Support retryer 
Add two strategy for PutBucketSettings request retryer:
* exponential backoff (increasing up to `max_backoff` delays with jitter)
* constant backoff (always the same `max_backoff` delay between requests)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-06 13:02:17 +00:00
Anoke
58850f590e [#335] Improve determining AccessBox latest version 
Signed-off-by: Anoke <rustamgta1011@gmail.com>
 2024-06-06 12:35:48 +00:00
Marina Biryukova
e25dc90c20 [#399] Add OPTIONS method for object operations 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-06-04 12:59:45 +00:00
Roman Loginov
71bae5cd9a [#400] Update frostfs-sdk-go version with support EC 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-06-04 12:22:06 +00:00
Pavel Pogodaev
b5fae316cf [#396] Add user to response 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-06-04 09:37:55 +00:00
Alex Vanin
9f3ea470e6 [#395] Port changelog and prepare it for next release
All checks were successful
/ Vulncheck (pull_request) Successful in 2m35s
Details
/ Builds (1.20) (pull_request) Successful in 2m30s
Details
/ Builds (1.21) (pull_request) Successful in 2m8s
Details
/ DCO (pull_request) Successful in 2m26s
Details
/ Lint (pull_request) Successful in 3m42s
Details
/ Tests (1.20) (pull_request) Successful in 2m51s
Details
/ Tests (1.21) (pull_request) Successful in 2m40s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-27 14:27:11 +03:00
Denis Kirillov
9787b29542 [#392] go.mod: Update APE to drop private IPs checking
All checks were successful
/ Vulncheck (pull_request) Successful in 2m8s
Details
/ DCO (pull_request) Successful in 2m38s
Details
/ Builds (1.20) (pull_request) Successful in 2m48s
Details
/ Builds (1.21) (pull_request) Successful in 3m22s
Details
/ Lint (pull_request) Successful in 5m17s
Details
/ Tests (1.20) (pull_request) Successful in 3m37s
Details
/ Tests (1.21) (pull_request) Successful in 2m59s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-05-27 11:26:15 +03:00
Roman Loginov
9152b084ec [#387] Fix typo 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
21dbe3ea8e [#387] api: Add tests for middleware 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
f4d174e740 [#387] middleware: Extend test coverage 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00