TrueCloudLab/frostfs-s3-gw
15
3
Fork 18
Code Issues 19 Pull requests 6 Projects Releases 17 Packages Activity Actions
1416 commits 5 branches 40 tags 20 MiB
Commit graph

1416 commits

This branch
This branch
All branches
Author SHA1 Message Date
Roman Loginov
a87c636b4c [#493] Fix X-Frostfs-S3-VHS header processing 
It is assumed that the X-Frostfs-S3-VHS header
will have the value enabled/disabled instead
of true/false.

Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-09-16 14:28:19 +03:00
Roman Ognev
26baf8a94e [#492] Add panic catchers to fuzzing tests 
Signed-off-by: Roman Ognev <r.ognev@yadro.com>
 2024-09-16 10:36:30 +00:00
Marina Biryukova
f187141ae5 [#486] Fix PUT object with negative Content-Length 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-16 08:45:46 +00:00
Marina Biryukova
3cffc782e9 [#486] Fix PUT encrypted object 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-16 08:45:46 +00:00
Marina Biryukova
d0e4d55772 [#460] Add network info cache 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-13 09:56:24 +00:00
Alex Vanin
42e72889a5 [#450] Add test for chunk-encoded object size
All checks were successful
/ DCO (pull_request) Successful in 1m9s
Details
/ Vulncheck (pull_request) Successful in 1m20s
Details
/ Builds (pull_request) Successful in 1m52s
Details
/ Lint (pull_request) Successful in 2m47s
Details
/ Tests (pull_request) Successful in 1m49s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-09-13 12:00:24 +03:00
Pavel Pogodaev
98815d5473 [#450] Fix aws-chunked header workflow 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-09-13 11:59:07 +03:00
Nikita Zinkevich
62615d7ab7 [#369] Request reproducer
All checks were successful
/ DCO (pull_request) Successful in 47s
Details
/ Builds (pull_request) Successful in 59s
Details
/ Vulncheck (pull_request) Successful in 1m15s
Details
/ Lint (pull_request) Successful in 2m15s
Details
/ Tests (pull_request) Successful in 1m20s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-09-11 15:25:09 +03:00
Nikita Zinkevich
575ab4d294 [#369] Enhanced http requests logging 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-09-11 15:25:09 +03:00
Marina Biryukova
d919e6cce2 [#482] Fix containers resolving
All checks were successful
/ DCO (pull_request) Successful in 1m8s
Details
/ Builds (pull_request) Successful in 1m7s
Details
/ Vulncheck (pull_request) Successful in 1m12s
Details
/ Lint (pull_request) Successful in 2m24s
Details
/ Tests (pull_request) Successful in 1m24s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-05 12:33:14 +03:00
Denis Kirillov
056f168d77 [#448] multipart: Support removing duplicated parts 
Previously after tree split we can have duplicated parts
(several objects and tree node referred to the same part number).
Some of them couldn't be deleted after abort or compete action.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-09-03 13:20:38 +00:00
Marina Biryukova
9bdfe2a016 [#479] Update APE to support s3:PatchObject action 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-03 11:57:59 +00:00
Marina Biryukova
d6b506f6d9 [#466] Implement PATCH for multipart objects 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-03 11:57:59 +00:00
Marina Biryukova
a2e0b92575 [#473] Add PATCH to extensions doc 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-03 11:57:59 +00:00
Marina Biryukova
b08f476ea7 [#462] Implement PATCH for regular objects 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-09-03 11:57:59 +00:00
Pavel Pogodaev
f4275d837a [#413] Add SECURITY.md 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-09-03 11:45:05 +00:00
Roman Ognev
664f83b2b7 [#480] Add fuzzing tests
All checks were successful
/ DCO (pull_request) Successful in 1m34s
Details
/ Vulncheck (pull_request) Successful in 1m45s
Details
/ Builds (1.22) (pull_request) Successful in 1m51s
Details
/ Builds (1.23) (pull_request) Successful in 1m56s
Details
/ Lint (pull_request) Successful in 3m3s
Details
/ Tests (1.22) (pull_request) Successful in 1m52s
Details
/ Tests (1.23) (pull_request) Successful in 1m51s
Details 
Signed-off-by: Roman Ognev <r.ognev@yadro.com>
 2024-09-02 15:59:07 +03:00
Denis Kirillov
136b5521fe [#475] Support graceful_close_on_switch_timeout param 
This allows in-flight requests finish during rebalance

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-29 13:22:08 +00:00
Roman Loginov
a5f670d904 [#329] Reduce using mutex when update app settings 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-08-29 12:03:26 +00:00
Denis Kirillov
d76c4fe2a2 [#472] tree: Don't use sorted GetSubTree for nodes without FileName 
Sorted GetSubTree doesn't return nodes without FileName attribute
if there are more than 1000 nodes in subtree

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-27 09:43:29 +00:00
Nikita Zinkevich
0637133c61 [#470] Update Go version to 1.22
All checks were successful
/ DCO (pull_request) Successful in 1m7s
Details
/ Vulncheck (pull_request) Successful in 1m13s
Details
/ Builds (1.22) (pull_request) Successful in 1m32s
Details
/ Builds (1.23) (pull_request) Successful in 1m34s
Details
/ Lint (pull_request) Successful in 2m51s
Details
/ Tests (1.22) (pull_request) Successful in 1m39s
Details
/ Tests (1.23) (pull_request) Successful in 1m41s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-08-23 12:18:42 +03:00
Roman Loginov
bf00fa6aa9 [#449] Add support headers for vhs and servername 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-08-23 08:35:05 +00:00
Roman Loginov
ff690ce996 [#446] Add tests for address style middleware 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-08-23 08:35:05 +00:00
Roman Loginov
534ae7f0f1 [#446] Add support virtual-hosted-style 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-08-23 08:35:05 +00:00
Ekaterina Lebedeva
77673797f9 [#474] lint: Update golangci-lint to v1.60 and fix issues
All checks were successful
/ DCO (pull_request) Successful in 55s
Details
/ Vulncheck (pull_request) Successful in 1m17s
Details
/ Builds (1.21) (pull_request) Successful in 1m34s
Details
/ Builds (1.22) (pull_request) Successful in 1m32s
Details
/ Lint (pull_request) Successful in 2m30s
Details
/ Tests (1.21) (pull_request) Successful in 1m44s
Details
/ Tests (1.22) (pull_request) Successful in 1m42s
Details 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-08-22 19:13:52 +03:00
Marina Biryukova
9e1766ff74 [#459] Update APE
All checks were successful
/ DCO (pull_request) Successful in 1m7s
Details
/ Vulncheck (pull_request) Successful in 1m23s
Details
/ Builds (1.21) (pull_request) Successful in 1m36s
Details
/ Builds (1.22) (pull_request) Successful in 1m34s
Details
/ Lint (pull_request) Successful in 2m45s
Details
/ Tests (1.21) (pull_request) Successful in 1m45s
Details
/ Tests (1.22) (pull_request) Successful in 1m40s
Details 
Update to policy engine version with lifecycle actions support

Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-08-21 16:42:34 +03:00
Denis Kirillov
e73f11c251 [#452] tree: Fix logging
All checks were successful
/ DCO (pull_request) Successful in 1m6s
Details
/ Vulncheck (pull_request) Successful in 1m10s
Details
/ Builds (1.21) (pull_request) Successful in 1m32s
Details
/ Builds (1.22) (pull_request) Successful in 1m31s
Details
/ Lint (pull_request) Successful in 1m46s
Details
/ Tests (1.21) (pull_request) Successful in 1m51s
Details
/ Tests (1.22) (pull_request) Successful in 1m45s
Details 
Don't log parsing tags error in listing

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-21 10:38:36 +03:00
Marina Biryukova
5cb77018f8 [#42] Change valid time format for lifecycle configuration 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-08-21 10:38:36 +03:00
Marina Biryukova
fa68a4ce40 [#412] Store creation epoch of delete markers 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-08-21 10:38:35 +03:00
Marina Biryukova
0644067496 [#412] Store creation epoch in tree service 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-08-21 10:38:35 +03:00
Marina Biryukova
481520705a [#42] Support expiration lifecycle 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-08-21 10:38:35 +03:00
Marina Biryukova
28723f4a68 [#447] Add tree pool request duration metric 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-08-21 06:36:55 +00:00
Denis Kirillov
20719bd85c [#456] PostObject: check object key for emptiness
All checks were successful
/ DCO (pull_request) Successful in 1m1s
Details
/ Vulncheck (pull_request) Successful in 1m12s
Details
/ Builds (1.21) (pull_request) Successful in 1m29s
Details
/ Builds (1.22) (pull_request) Successful in 1m33s
Details
/ Lint (pull_request) Successful in 2m20s
Details
/ Tests (1.21) (pull_request) Successful in 1m41s
Details
/ Tests (1.22) (pull_request) Successful in 1m39s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-13 09:27:26 +03:00
Denis Kirillov
4f27e34974 [#456] auth: Fix authentication for POST Object 
During post object operation field AuthHeader in middleware.Box wasn't set
that led to panic

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-12 15:25:53 +03:00
Denis Kirillov
3dc989d7fe [#451] Support Location in CompleteMultipart response
All checks were successful
/ Vulncheck (pull_request) Successful in 1m15s
Details
/ DCO (pull_request) Successful in 1m13s
Details
/ Builds (1.21) (pull_request) Successful in 1m31s
Details
/ Builds (1.22) (pull_request) Successful in 1m25s
Details
/ Lint (pull_request) Successful in 2m26s
Details
/ Tests (1.21) (pull_request) Successful in 1m40s
Details
/ Tests (1.22) (pull_request) Successful in 1m43s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-06 15:45:09 +03:00
Denis Kirillov
69e77aecc9 [#451] Don't skip [Next]PartNumberMarker in response 
In ListParts response we should always keep PartNumberMarker (even if it's zero)
and NextPartNumberMarker (even if response isn't truncated)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-06 15:44:56 +03:00
Alex Vanin
c34680d157 [#437] Rename getCORSAddress 
This function is going to be reused
for lifecycles as well.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-26 06:54:10 +00:00
Denis Kirillov
f5326b9f04 [#437] tree: Support removing old split system nodes 
It's need to fit user expectation on deleting CORS for example.
Previously after removing cors (that was uploaded in split manner)
we can still get some data (from other node)
because deletion worked only for latest node version.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-26 06:54:10 +00:00
Pavel Pogodaev
51c5c227c2 [#31] Add force bucket delete flag
All checks were successful
/ DCO (pull_request) Successful in 1m11s
Details
/ Vulncheck (pull_request) Successful in 1m22s
Details
/ Builds (1.21) (pull_request) Successful in 1m26s
Details
/ Builds (1.22) (pull_request) Successful in 2m23s
Details
/ Lint (pull_request) Successful in 2m22s
Details
/ Tests (1.21) (pull_request) Successful in 1m23s
Details
/ Tests (1.22) (pull_request) Successful in 1m25s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-07-25 14:04:54 +03:00
Marina Biryukova
c506620199 [#439] Update SDK version 
New SDK version supports extended log records in pool component during inner nodes health check.

Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-07-24 12:16:37 +00:00
Denis Kirillov
6cb0026007 [#427] layer: Split FrostFS ReadObject to separate methods
All checks were successful
/ Builds (1.21) (pull_request) Successful in 1m20s
Details
/ Builds (1.22) (pull_request) Successful in 1m15s
Details
/ Vulncheck (pull_request) Successful in 1m6s
Details
/ DCO (pull_request) Successful in 57s
Details
/ Lint (pull_request) Successful in 2m59s
Details
/ Tests (1.21) (pull_request) Successful in 1m9s
Details
/ Tests (1.22) (pull_request) Successful in 1m23s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-23 16:53:59 +03:00
Marina Biryukova
971006a28c [#422] Support separate container for CORS 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-07-23 12:33:29 +00:00
Ekaterina Lebedeva
527e0dc612 [#421] docker: Fix warnings 
Signed-off-by: Ekaterina Lebedeva <ekaterina.lebedeva@yadro.com>
 2024-07-23 12:22:15 +00:00
Marina Biryukova
3213dd7236 [#404] Add processing of encoding-type in versions listing 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-07-23 12:10:35 +00:00
Alex Vanin
a031777a1b Release v0.30.0
All checks were successful
/ DCO (pull_request) Successful in 5m12s
Details
/ Vulncheck (pull_request) Successful in 5m26s
Details
/ Builds (1.21) (pull_request) Successful in 6m39s
Details
/ Builds (1.22) (pull_request) Successful in 6m29s
Details
/ Lint (pull_request) Successful in 8m28s
Details
/ Tests (1.21) (pull_request) Successful in 6m16s
Details
/ Tests (1.22) (pull_request) Successful in 6m4s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-19 17:09:58 +03:00
Alex Vanin
b2a5da8247 [#430] Bump frostfs-api-go for latest stable marshaler
All checks were successful
/ DCO (pull_request) Successful in 2m20s
Details
/ Vulncheck (pull_request) Successful in 2m45s
Details
/ Builds (1.21) (pull_request) Successful in 2m54s
Details
/ Builds (1.22) (pull_request) Successful in 2m48s
Details
/ Lint (pull_request) Successful in 4m53s
Details
/ Tests (1.21) (pull_request) Successful in 2m52s
Details
/ Tests (1.22) (pull_request) Successful in 2m45s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-19 16:42:36 +03:00
Alex Vanin
ec349e4523 [#430] Adopt compatibility workarounds in Tree API 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-19 14:47:47 +03:00
Denis Kirillov
977a20760b [#430] Delete all split version at once
All checks were successful
/ DCO (pull_request) Successful in 8m40s
Details
/ Vulncheck (pull_request) Successful in 13m10s
Details
/ Builds (1.21) (pull_request) Successful in 14m11s
Details
/ Builds (1.22) (pull_request) Successful in 14m18s
Details
/ Lint (pull_request) Successful in 16m31s
Details
/ Tests (1.21) (pull_request) Successful in 10m48s
Details
/ Tests (1.22) (pull_request) Successful in 14m31s
Details 
Previously after split we can get two `null` versioned object with the same key
and deleting such key removes only one node/object.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:26:51 +03:00
Denis Kirillov
2948d1f942 [#430] ci: Update go version 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:24:50 +03:00
Denis Kirillov
c0011ebb8d [#430] tree: Fix multipart having system name 
Previously if multipart key has the same name as some system node
(e.g. bucket-settings, bucket-cors etc.) it shadows real system node
and bucket started to be unversioned again for example.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:24:50 +03:00