TrueCloudLab/frostfs-s3-gw
18
3
Fork 20
Code Issues 28 Pull requests 7 Projects Releases 22 Packages Activity Actions
1491 commits 6 branches 47 tags 24 MiB
Commit graph

1491 commits

This branch
This branch
All branches
Author SHA1 Message Date
Roman Loginov
04b8fc2b5f [#562] Empty default value for TLS termination header param
All checks were successful
/ Vulncheck (push) Successful in 1m28s
Details
/ Builds (push) Successful in 2m14s
Details
/ Lint (push) Successful in 3m59s
Details
/ Tests (push) Successful in 3m17s
Details 
If the service is accessed not through a proxy and the
default value of the parameter with the header key is
not empty, then the system administrator does not
control disabling TLS verification in any way, because
the client can simply add a known header, thereby
skipping the verification. Therefore, the default value
of the header parameter is made empty. If it is empty,
then TLS verification cannot be disabled in any way.
Thus, the system administrator will be able to control
the enabling/disabling of TLS.

Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-12-13 11:12:58 +00:00
Roman Loginov
59b789f57e [#576] Update frostfs-sdk-go version
All checks were successful
/ DCO (pull_request) Successful in 3m31s
Details
/ Vulncheck (pull_request) Successful in 3m34s
Details
/ Builds (pull_request) Successful in 3m49s
Details
/ Lint (pull_request) Successful in 6m15s
Details
/ Tests (pull_request) Successful in 5m13s
Details
/ Vulncheck (push) Successful in 1m33s
Details
/ Builds (push) Successful in 1m45s
Details
/ Lint (push) Successful in 3m59s
Details
/ Tests (push) Successful in 3m18s
Details 
The new version of frostfs-sdk-go
contains a fix to solve the problem
of not being able to delete an EC object.

Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-12-13 03:17:19 +03:00
Roman Loginov
128939c01e [#562] Add tests for form encryption params
All checks were successful
/ DCO (pull_request) Successful in 1m29s
Details
/ Vulncheck (pull_request) Successful in 1m37s
Details
/ Builds (pull_request) Successful in 2m52s
Details
/ Lint (pull_request) Successful in 3m47s
Details
/ Tests (pull_request) Successful in 3m0s
Details
/ Vulncheck (push) Successful in 1m22s
Details
/ Builds (push) Successful in 2m2s
Details
/ Lint (push) Successful in 3m41s
Details
/ Tests (push) Successful in 2m51s
Details 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-12-11 16:09:43 +03:00
Roman Loginov
4a4ce00994 [#562] Support TLS termination header for SSE-C 
The TLS termination header added for determining
whether TLS needs to be checked. If the system
requests come through a proxy server and TLS can
terminate at the proxy level, you should use this
header to disable TLS verification at SSE-C.

Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-12-11 16:09:43 +03:00
Vitaliy Potyarkin
980763c468 [#573] Refine CODEOWNERS settings
All checks were successful
/ Vulncheck (push) Successful in 1m14s
Details
/ Builds (push) Successful in 3m37s
Details
/ Lint (push) Successful in 4m46s
Details
/ Tests (push) Successful in 3m39s
Details 
Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>
 2024-12-10 14:35:40 +00:00
Denis Kirillov
9395b5f39d [#339] v4: Don't duplicate content-length as signed header
Some checks failed
/ DCO (pull_request) Successful in 2m35s
Details
/ Vulncheck (pull_request) Successful in 2m46s
Details
/ Builds (pull_request) Successful in 1m54s
Details
/ Lint (pull_request) Successful in 3m10s
Details
/ Tests (pull_request) Successful in 1m56s
Details
/ Vulncheck (push) Successful in 1m17s
Details
/ Builds (push) Has been cancelled
Details
/ Lint (push) Has been cancelled
Details
/ Tests (push) Has been cancelled
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
11c1a86404 [#339] Fix stream sigV4a chunk-encoding 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
4515a7ae88 [#339] Don't explicitly use smithy-go 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
c5deb2e148 [#339] Drop unused and add link to source files 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
ea714c2e9e [#339] Fix logging in authmate [pre]sign command 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
7bf31bea18 [#339] lint: Ignore aws sdk dirs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
cc43975536 [#339] Presign fix aws sdk 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
c4c757eea6 [#339] Drop aws-sdk-go v1 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
389e0de403 [#339] Don't include additional content-length header for signing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
8da71c3ae0 [#339] sigv4a: Support presign 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Denis Kirillov
cc9a68401f [#339] Add aws-sdk-go-v2 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-12-10 15:04:56 +03:00
Nikita Zinkevich
8f7ccb0f62
[#570] Remove frostfs-api-go dependency
All checks were successful
/ DCO (pull_request) Successful in 2m11s
Details
/ Vulncheck (pull_request) Successful in 2m50s
Details
/ Builds (pull_request) Successful in 2m23s
Details
/ Lint (pull_request) Successful in 3m42s
Details
/ Tests (pull_request) Successful in 2m26s
Details
/ Vulncheck (push) Successful in 4m19s
Details
/ Lint (push) Successful in 2m58s
Details
/ Tests (push) Successful in 2m50s
Details
/ Builds (push) Successful in 4m40s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-12-10 11:03:30 +03:00
Nikita Zinkevich
2c002b657e
[#570] Update frostfs-sdk-go with new tree service client
All checks were successful
/ DCO (pull_request) Successful in 1m37s
Details
/ Vulncheck (pull_request) Successful in 2m22s
Details
/ Builds (pull_request) Successful in 4m12s
Details
/ Lint (pull_request) Successful in 5m16s
Details
/ Tests (pull_request) Successful in 4m13s
Details 
Fix imports in order to apply new sdk changes caused by merging with frostfs-api-go and reimplementing tree service client

Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-12-09 15:08:48 +03:00
Marina Biryukova
f215d200e8 [#559] Remove multipart objects using tombstones
All checks were successful
/ DCO (pull_request) Successful in 1m33s
Details
/ Vulncheck (pull_request) Successful in 2m38s
Details
/ Builds (pull_request) Successful in 2m48s
Details
/ Lint (pull_request) Successful in 4m6s
Details
/ Tests (pull_request) Successful in 2m48s
Details
/ Vulncheck (push) Successful in 1m19s
Details
/ Builds (push) Successful in 2m14s
Details
/ Lint (push) Successful in 3m40s
Details
/ Tests (push) Successful in 2m21s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-12-04 11:03:01 +03:00
Pavel Pogodaev
51322cccdf [#502] Add Dropped logs (by sampling) metric
All checks were successful
/ DCO (pull_request) Successful in 2m9s
Details
/ Vulncheck (pull_request) Successful in 2m22s
Details
/ Builds (pull_request) Successful in 2m0s
Details
/ Lint (pull_request) Successful in 3m6s
Details
/ Tests (pull_request) Successful in 2m2s
Details
/ Vulncheck (push) Successful in 1m13s
Details
/ Builds (push) Successful in 1m58s
Details
/ Lint (push) Successful in 3m33s
Details
/ Tests (push) Successful in 2m19s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-12-03 12:16:56 +00:00
Alex Vanin
3cd88d6204 Release v0.31.1
All checks were successful
/ Vulncheck (push) Successful in 1m23s
Details
/ Builds (push) Successful in 1m34s
Details
/ Lint (push) Successful in 2m52s
Details
/ Tests (push) Successful in 2m43s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-11-29 13:35:58 +00:00
Pavel Pogodaev
e71ba5e22a [#543] Add md5 sse-c S3Tests compatability
All checks were successful
/ Vulncheck (push) Successful in 1m28s
Details
/ Builds (push) Successful in 2m13s
Details
/ Lint (push) Successful in 3m23s
Details
/ Tests (push) Successful in 2m13s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-11-28 06:06:55 +00:00
Marina Biryukova
e3141fc8e3 [#563] Ignore precondition headers with invalid date format
Some checks failed
/ DCO (pull_request) Successful in 1m43s
Details
/ Vulncheck (pull_request) Successful in 1m51s
Details
/ Builds (pull_request) Successful in 2m6s
Details
/ Lint (pull_request) Successful in 3m14s
Details
/ Tests (pull_request) Successful in 2m8s
Details
/ Builds (push) Has been cancelled
Details
/ Lint (push) Has been cancelled
Details
/ Tests (push) Has been cancelled
Details
/ Vulncheck (push) Has been cancelled
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-27 12:07:04 +03:00
Alex Vanin
a12fea8a5b Release v0.31.0
All checks were successful
/ DCO (pull_request) Successful in 1m36s
Details
/ Vulncheck (pull_request) Successful in 1m50s
Details
/ Builds (pull_request) Successful in 1m54s
Details
/ Lint (pull_request) Successful in 2m24s
Details
/ Tests (pull_request) Successful in 1m55s
Details
/ Vulncheck (push) Successful in 1m36s
Details
/ Builds (push) Successful in 1m53s
Details
/ Lint (push) Successful in 3m33s
Details
/ Tests (push) Successful in 2m26s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-11-20 15:45:07 +03:00
Denis Kirillov
9875307c9b [#556] Check bucket name not only during creation
All checks were successful
/ Vulncheck (push) Successful in 2m3s
Details
/ Builds (push) Successful in 1m36s
Details
/ Lint (push) Successful in 2m47s
Details
/ Tests (push) Successful in 2m56s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-20 08:13:27 +00:00
Denis Kirillov
b1775f9478 [#553] authmate: Add retryer to create access box
Some checks failed
/ DCO (pull_request) Successful in 1m20s
Details
/ Vulncheck (pull_request) Successful in 1m34s
Details
/ Builds (pull_request) Successful in 1m45s
Details
/ Lint (pull_request) Successful in 2m17s
Details
/ Tests (pull_request) Successful in 1m56s
Details
/ Builds (push) Has been cancelled
Details
/ Lint (push) Has been cancelled
Details
/ Tests (push) Has been cancelled
Details
/ Vulncheck (push) Has been cancelled
Details 
After using AddChain to provide access to container we have to wait:
* tx with APE chain be accepted by blockchain
* cache in storage node be updated

it takes a while. So we add retry
 (the same as when we add bucket settings during bucket creation)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-19 15:46:00 +03:00
Denis Kirillov
4fa45bdac2 [#553] authmate: Don't use basic acl 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-19 15:45:54 +03:00
Roman Loginov
368c7d2acd [#549] Add tracing attributes
All checks were successful
/ Vulncheck (push) Successful in 1m4s
Details
/ Builds (push) Successful in 1m44s
Details
/ Lint (push) Successful in 2m42s
Details
/ Tests (push) Successful in 2m0s
Details 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-11-18 11:55:31 +00:00
Vitaliy Potyarkin
31076796ce [#550] Execute CI on push to master
All checks were successful
/ Vulncheck (pull_request) Successful in 2m43s
Details
/ DCO (pull_request) Successful in 2m50s
Details
/ Builds (pull_request) Successful in 2m58s
Details
/ Lint (pull_request) Successful in 4m5s
Details
/ Tests (pull_request) Successful in 2m51s
Details
/ Vulncheck (push) Successful in 1m40s
Details
/ Builds (push) Successful in 1m22s
Details
/ Lint (push) Successful in 3m0s
Details
/ Tests (push) Successful in 2m9s
Details 
Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>
 2024-11-15 14:31:11 +03:00
Marina Biryukova
eff0de43d5 [#538] Return headers with 304 Not Modified 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-13 13:49:09 +00:00
Pavel Pogodaev
fb00dff83b [#540] Add md5 S3Tests compatability
All checks were successful
/ DCO (pull_request) Successful in 2m14s
Details
/ Vulncheck (pull_request) Successful in 2m20s
Details
/ Builds (pull_request) Successful in 2m46s
Details
/ Lint (pull_request) Successful in 4m4s
Details
/ Tests (pull_request) Successful in 3m31s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-11-13 14:50:16 +03:00
Denis Kirillov
d8f126b339 [#539] Fix listing v1 bookmark marker 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-11-12 12:58:09 +00:00
Marina Biryukova
7ab902d8d2 [#536] Add rule ID generation 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:51:02 +00:00
Marina Biryukova
0792fcf456 [#536] Fix error codes in lifecycle configuration check 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:51:02 +00:00
Marina Biryukova
c46ffa8146 [#536] Add prefix to lifecycle rule 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:51:02 +00:00
Marina Biryukova
3260308cc0 [#528] Check owner ID before deleting bucket 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-12 12:47:43 +00:00
Vitaliy Potyarkin
d6e6a13576 [#542] Stop using obsolete .github directory
All checks were successful
/ Builds (pull_request) Successful in 1m30s
Details
/ DCO (pull_request) Successful in 1m33s
Details
/ Vulncheck (pull_request) Successful in 1m49s
Details
/ Lint (pull_request) Successful in 3m18s
Details
/ Tests (pull_request) Successful in 2m17s
Details 
This commit is a part of multi-repo cleanup effort:
TrueCloudLab/frostfs-infra#136

Signed-off-by: Vitaliy Potyarkin <v.potyarkin@yadro.com>
 2024-11-06 15:31:16 +03:00
Marina Biryukova
17d40245de [#505] docs: Add example of uploading file using presigned URL 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-02 08:53:54 +00:00
Marina Biryukova
979d85b046 [#505] authmate: Add flag for headers in generate-presigned-url cmd 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-11-02 08:53:54 +00:00
Roman Loginov
539dab8680 [#501] Add the trace id to the logs of middlware 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-11-02 08:51:48 +00:00
Roman Loginov
76008d4ba1 [#501] Consider using request logger in logAndSendError 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-11-02 08:51:48 +00:00
Alex Vanin
8bc19725ba [#521] Add documentation for multinet settings
All checks were successful
/ DCO (pull_request) Successful in 2m55s
Details
/ Vulncheck (pull_request) Successful in 3m35s
Details
/ Builds (pull_request) Successful in 1m59s
Details
/ Lint (pull_request) Successful in 3m25s
Details
/ Tests (pull_request) Successful in 2m0s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:27 +03:00
Alex Vanin
9e64304499 [#521] Use handler to register dial events 
While frostfs-node uses dial handler to udpate metric
value, gateway starts with simple event logging.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:27 +03:00
Alex Vanin
94504e9746 [#521] Use source dialer for gRPC connection to storage 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:27 +03:00
Alex Vanin
a8458dbc27 [#521] Add internal/net package with multinet dialer source 
Code is taken from frostfs-node#1422
Author: Dmitrii Stepanov (dstepanov-yadro)

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-29 15:55:26 +03:00
Alex Vanin
424038de6c [#524] Update pool to treat maintenance mode differently 
Contains these changes for pool component in SDK:
* frostfs-sdk-go#279 fix mm error counting during search operation
* frostfs-sdk-go#283 immediately mark mm node as unhealthy
* frostfs-sdk-go#278 do not reconnect to mm node

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-10-23 12:17:20 +00:00
Denis Kirillov
3cf27d281d [#509] Support fallback address when getting box
All checks were successful
/ DCO (pull_request) Successful in 1m26s
Details
/ Builds (pull_request) Successful in 1m36s
Details
/ Vulncheck (pull_request) Successful in 2m17s
Details
/ Lint (pull_request) Successful in 3m10s
Details
/ Tests (pull_request) Successful in 2m18s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00
Denis Kirillov
3c7cb82553 [#509] Init resolvers before first resolving 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00
Denis Kirillov
57b7e83380 [#509] Save isCustom flag into accessbox 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00
Denis Kirillov
6a90f4e624 [#509] Update docs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-10-23 15:01:31 +03:00