TrueCloudLab/frostfs-s3-gw
18
3
Fork 20
Code Issues 28 Pull requests 7 Projects Releases 22 Packages Activity Actions
1490 commits 6 branches 47 tags 24 MiB
Commit graph

1490 commits

This branch
This branch
All branches
Author SHA1 Message Date
Roman Loginov
59b789f57e [#576] Update frostfs-sdk-go version
All checks were successful
/ DCO (pull_request) Successful in 3m31s
Details
/ Vulncheck (pull_request) Successful in 3m34s
Details
/ Builds (pull_request) Successful in 3m49s
Details
/ Lint (pull_request) Successful in 6m15s
Details
/ Tests (pull_request) Successful in 5m13s
Details
/ Vulncheck (push) Successful in 1m33s
Details
/ Builds (push) Successful in 1m45s
Details
/ Lint (push) Successful in 3m59s
Details
/ Tests (push) Successful in 3m18s
Details 
The new version of frostfs-sdk-go
contains a fix to solve the problem
of not being able to delete an EC object.

Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-12-13 03:17:19 +03:00
Roman Loginov
128939c01e [#562] Add tests for form encryption params
All checks were successful
/ DCO (pull_request) Successful in 1m29s
Details
/ Vulncheck (pull_request) Successful in 1m37s
Details
/ Builds (pull_request) Successful in 2m52s
Details
/ Lint (pull_request) Successful in 3m47s
Details
/ Tests (pull_request) Successful in 3m0s
Details
/ Vulncheck (push) Successful in 1m22s
Details
/ Builds (push) Successful in 2m2s
Details
/ Lint (push) Successful in 3m41s
Details
/ Tests (push) Successful in 2m51s
Details 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-12-11 16:09:43 +03:00
Roman Loginov
4a4ce00994 [#562] Support TLS termination header for SSE-C 
The TLS termination header added for determining
whether TLS needs to be checked. If the system
requests come through a proxy server and TLS can
terminate at the proxy level, you should use this
header to disable TLS verification at SSE-C.

Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-12-11 16:09:43 +03:00
Vitaliy Potyarkin
980763c468 [#573] Refine CODEOWNERS settings
All checks were successful
/ Vulncheck (push) Successful in 1m14s
Details
/ Builds (push) Successful in 3m37s
Details
/ Lint (push) Successful in 4m46s
Details
/ Tests (push) Successful in 3m39s
Details 
Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>
 2024-12-10 14:35:40 +00:00
Denis Kirillov
9395b5f39d [#339] v4: Don't duplicate content-length as signed header
Some checks failed
/ DCO (pull_request) Successful in 2m35s
Details
/ Vulncheck (pull_request) Successful in 2m46s
Details
/ Builds (pull_request) Successful in 1m54s
Details
/ Lint (pull_request) Successful in 3m10s
Details
/ Tests (pull_request) Successful in 1m56s
Details
/ Vulncheck (push) Successful in 1m17s
Details
/ Builds (push) Has been cancelled
Details
/ Lint (push) Has been cancelled
Details
/ Tests (push) Has been cancelled
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
11c1a86404 [#339] Fix stream sigV4a chunk-encoding 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
4515a7ae88 [#339] Don't explicitly use smithy-go 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
c5deb2e148 [#339] Drop unused and add link to source files 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
ea714c2e9e [#339] Fix logging in authmate [pre]sign command 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
7bf31bea18 [#339] lint: Ignore aws sdk dirs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
cc43975536 [#339] Presign fix aws sdk 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
c4c757eea6 [#339] Drop aws-sdk-go v1 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
389e0de403 [#339] Don't include additional content-length header for signing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
8da71c3ae0 [#339] sigv4a: Support presign 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
cc9a68401f [#339] Add aws-sdk-go-v2 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Nikita Zinkevich
8f7ccb0f62
[#570] Remove frostfs-api-go dependency
All checks were successful
/ DCO (pull_request) Successful in 2m11s
Details
/ Vulncheck (pull_request) Successful in 2m50s
Details
/ Builds (pull_request) Successful in 2m23s
Details
/ Lint (pull_request) Successful in 3m42s
Details
/ Tests (pull_request) Successful in 2m26s
Details
/ Vulncheck (push) Successful in 4m19s
Details
/ Lint (push) Successful in 2m58s
Details
/ Tests (push) Successful in 2m50s
Details
/ Builds (push) Successful in 4m40s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-12-10 11:03:30 +03:00
Nikita Zinkevich
2c002b657e
[#570] Update frostfs-sdk-go with new tree service client
All checks were successful
/ DCO (pull_request) Successful in 1m37s
Details
/ Vulncheck (pull_request) Successful in 2m22s
Details
/ Builds (pull_request) Successful in 4m12s
Details
/ Lint (pull_request) Successful in 5m16s
Details
/ Tests (pull_request) Successful in 4m13s
Details 
Fix imports in order to apply new sdk changes caused by merging with frostfs-api-go and reimplementing tree service client

Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-12-09 15:08:48 +03:00
Marina Biryukova
f215d200e8 [#559] Remove multipart objects using tombstones
All checks were successful
/ DCO (pull_request) Successful in 1m33s
Details
/ Vulncheck (pull_request) Successful in 2m38s
Details
/ Builds (pull_request) Successful in 2m48s
Details
/ Lint (pull_request) Successful in 4m6s
Details
/ Tests (pull_request) Successful in 2m48s
Details
/ Vulncheck (push) Successful in 1m19s
Details
/ Builds (push) Successful in 2m14s
Details
/ Lint (push) Successful in 3m40s
Details
/ Tests (push) Successful in 2m21s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-12-04 11:03:01 +03:00
Pavel Pogodaev
51322cccdf [#502] Add Dropped logs (by sampling) metric
All checks were successful
/ DCO (pull_request) Successful in 2m9s
Details
/ Vulncheck (pull_request) Successful in 2m22s
Details
/ Builds (pull_request) Successful in 2m0s
Details
/ Lint (pull_request) Successful in 3m6s
Details
/ Tests (pull_request) Successful in 2m2s
Details
/ Vulncheck (push) Successful in 1m13s
Details
/ Builds (push) Successful in 1m58s
Details
/ Lint (push) Successful in 3m33s
Details
/ Tests (push) Successful in 2m19s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-12-03 12:16:56 +00:00
Alex Vanin
3cd88d6204 Release v0.31.1
All checks were successful
/ Vulncheck (push) Successful in 1m23s
Details
/ Builds (push) Successful in 1m34s
Details
/ Lint (push) Successful in 2m52s
Details
/ Tests (push) Successful in 2m43s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-11-29 13:35:58 +00:00
Pavel Pogodaev
e71ba5e22a [#543] Add md5 sse-c S3Tests compatability
All checks were successful
/ Vulncheck (push) Successful in 1m28s
Details
/ Builds (push) Successful in 2m13s
Details
/ Lint (push) Successful in 3m23s
Details
/ Tests (push) Successful in 2m13s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-11-28 06:06:55 +00:00
Marina Biryukova
e3141fc8e3 [#563] Ignore precondition headers with invalid date format
Some checks failed
/ DCO (pull_request) Successful in 1m43s
Details
/ Vulncheck (pull_request) Successful in 1m51s
Details
/ Builds (pull_request) Successful in 2m6s
Details
/ Lint (pull_request) Successful in 3m14s
Details
/ Tests (pull_request) Successful in 2m8s
Details
/ Builds (push) Has been cancelled
Details
/ Lint (push) Has been cancelled
Details
/ Tests (push) Has been cancelled
Details
/ Vulncheck (push) Has been cancelled
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-27 12:07:04 +03:00
Alex Vanin
a12fea8a5b Release v0.31.0
All checks were successful
/ DCO (pull_request) Successful in 1m36s
Details
/ Vulncheck (pull_request) Successful in 1m50s
Details
/ Builds (pull_request) Successful in 1m54s
Details
/ Lint (pull_request) Successful in 2m24s
Details
/ Tests (pull_request) Successful in 1m55s
Details
/ Vulncheck (push) Successful in 1m36s
Details
/ Builds (push) Successful in 1m53s
Details
/ Lint (push) Successful in 3m33s
Details
/ Tests (push) Successful in 2m26s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-11-20 15:45:07 +03:00
Denis Kirillov
9875307c9b [#556] Check bucket name not only during creation
All checks were successful
/ Vulncheck (push) Successful in 2m3s
Details
/ Builds (push) Successful in 1m36s
Details
/ Lint (push) Successful in 2m47s
Details
/ Tests (push) Successful in 2m56s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-20 08:13:27 +00:00
Denis Kirillov
b1775f9478 [#553] authmate: Add retryer to create access box
Some checks failed
/ DCO (pull_request) Successful in 1m20s
Details
/ Vulncheck (pull_request) Successful in 1m34s
Details
/ Builds (pull_request) Successful in 1m45s
Details
/ Lint (pull_request) Successful in 2m17s
Details
/ Tests (pull_request) Successful in 1m56s
Details
/ Builds (push) Has been cancelled
Details
/ Lint (push) Has been cancelled
Details
/ Tests (push) Has been cancelled
Details
/ Vulncheck (push) Has been cancelled
Details 
After using AddChain to provide access to container we have to wait:
* tx with APE chain be accepted by blockchain
* cache in storage node be updated

it takes a while. So we add retry
 (the same as when we add bucket settings during bucket creation)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-19 15:46:00 +03:00
Denis Kirillov
4fa45bdac2 [#553] authmate: Don't use basic acl 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-19 15:45:54 +03:00
Roman Loginov
368c7d2acd [#549] Add tracing attributes
All checks were successful
/ Vulncheck (push) Successful in 1m4s
Details
/ Builds (push) Successful in 1m44s
Details
/ Lint (push) Successful in 2m42s
Details
/ Tests (push) Successful in 2m0s
Details 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-11-18 11:55:31 +00:00
Vitaliy Potyarkin
31076796ce [#550] Execute CI on push to master
All checks were successful
/ Vulncheck (pull_request) Successful in 2m43s
Details
/ DCO (pull_request) Successful in 2m50s
Details
/ Builds (pull_request) Successful in 2m58s
Details
/ Lint (pull_request) Successful in 4m5s
Details
/ Tests (pull_request) Successful in 2m51s
Details
/ Vulncheck (push) Successful in 1m40s
Details
/ Builds (push) Successful in 1m22s
Details
/ Lint (push) Successful in 3m0s
Details
/ Tests (push) Successful in 2m9s
Details 
Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>
 2024-11-15 14:31:11 +03:00
Marina Biryukova
eff0de43d5 [#538] Return headers with 304 Not Modified 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-13 13:49:09 +00:00
Pavel Pogodaev
fb00dff83b [#540] Add md5 S3Tests compatability
All checks were successful
/ DCO (pull_request) Successful in 2m14s
Details
/ Vulncheck (pull_request) Successful in 2m20s
Details
/ Builds (pull_request) Successful in 2m46s
Details
/ Lint (pull_request) Successful in 4m4s
Details
/ Tests (pull_request) Successful in 3m31s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-11-13 14:50:16 +03:00
Denis Kirillov
d8f126b339 [#539] Fix listing v1 bookmark marker 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-12 12:58:09 +00:00
Marina Biryukova
7ab902d8d2 [#536] Add rule ID generation 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:51:02 +00:00
Marina Biryukova
0792fcf456 [#536] Fix error codes in lifecycle configuration check 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:51:02 +00:00
Marina Biryukova
c46ffa8146 [#536] Add prefix to lifecycle rule 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:51:02 +00:00
Marina Biryukova
3260308cc0 [#528] Check owner ID before deleting bucket 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:47:43 +00:00
Vitaliy Potyarkin
d6e6a13576 [#542] Stop using obsolete .github directory
All checks were successful
/ Builds (pull_request) Successful in 1m30s
Details
/ DCO (pull_request) Successful in 1m33s
Details
/ Vulncheck (pull_request) Successful in 1m49s
Details
/ Lint (pull_request) Successful in 3m18s
Details
/ Tests (pull_request) Successful in 2m17s
Details 
This commit is a part of multi-repo cleanup effort:
TrueCloudLab/frostfs-infra#136

Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>
 2024-11-06 15:31:16 +03:00
Marina Biryukova
17d40245de [#505] docs: Add example of uploading file using presigned URL 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-02 08:53:54 +00:00
Marina Biryukova
979d85b046 [#505] authmate: Add flag for headers in generate-presigned-url cmd 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-02 08:53:54 +00:00
Roman Loginov
539dab8680 [#501] Add the trace id to the logs of middlware 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-11-02 08:51:48 +00:00
Roman Loginov
76008d4ba1 [#501] Consider using request logger in logAndSendError 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-11-02 08:51:48 +00:00
Alex Vanin
8bc19725ba [#521] Add documentation for multinet settings
All checks were successful
/ DCO (pull_request) Successful in 2m55s
Details
/ Vulncheck (pull_request) Successful in 3m35s
Details
/ Builds (pull_request) Successful in 1m59s
Details
/ Lint (pull_request) Successful in 3m25s
Details
/ Tests (pull_request) Successful in 2m0s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:27 +03:00
Alex Vanin
9e64304499 [#521] Use handler to register dial events 
While frostfs-node uses dial handler to udpate metric
value, gateway starts with simple event logging.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:27 +03:00
Alex Vanin
94504e9746 [#521] Use source dialer for gRPC connection to storage 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:27 +03:00
Alex Vanin
a8458dbc27 [#521] Add internal/net package with multinet dialer source 
Code is taken from frostfs-node#1422
Author: Dmitrii Stepanov (dstepanov-yadro)

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:26 +03:00
Alex Vanin
424038de6c [#524] Update pool to treat maintenance mode differently 
Contains these changes for pool component in SDK:
* frostfs-sdk-go#279 fix mm error counting during search operation
* frostfs-sdk-go#283 immediately mark mm node as unhealthy
* frostfs-sdk-go#278 do not reconnect to mm node

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-23 12:17:20 +00:00
Denis Kirillov
3cf27d281d [#509] Support fallback address when getting box
All checks were successful
/ DCO (pull_request) Successful in 1m26s
Details
/ Builds (pull_request) Successful in 1m36s
Details
/ Vulncheck (pull_request) Successful in 2m17s
Details
/ Lint (pull_request) Successful in 3m10s
Details
/ Tests (pull_request) Successful in 2m18s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00
Denis Kirillov
3c7cb82553 [#509] Init resolvers before first resolving 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00
Denis Kirillov
57b7e83380 [#509] Save isCustom flag into accessbox 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00
Denis Kirillov
6a90f4e624 [#509] Update docs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00
Denis Kirillov
cb3753f286 [#509] Add tests for custom credentials 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00