TrueCloudLab/frostfs-s3-gw
15
3
Fork 19
Code Issues 30 Pull requests 7 Projects Releases 17 Packages Activity Actions
1375 commits 5 branches 41 tags 20 MiB
Commit graph

1375 commits

This branch
This branch
All branches
Author SHA1 Message Date
Nikita Zinkevich
a5b38537e6 [#369] S3-playback http-body decoding
All checks were successful
/ DCO (pull_request) Successful in 1m8s
Details
/ Vulncheck (pull_request) Successful in 1m21s
Details
/ Builds (1.20) (pull_request) Successful in 1m36s
Details
/ Builds (1.21) (pull_request) Successful in 1m37s
Details
/ Lint (pull_request) Successful in 2m21s
Details
/ Tests (1.20) (pull_request) Successful in 1m45s
Details
/ Tests (1.21) (pull_request) Successful in 1m43s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-08-14 13:00:34 +03:00
Nikita Zinkevich
f6a7beb2b5 [#369] Move playback source files 
Move git.frostfs.info/TrueCloudLab/frostfs-s3-gw/cmd/frostfs-s3-playback/request package to git.frostfs.info/TrueCloudLab/frostfs-s3-gw/playback.
Move playback.yaml example config to root config folder.

Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-08-02 16:51:10 +03:00
Nikita Zinkevich
d120b2b282 [#369] Conditional HTTP-body log encoding 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-08-02 16:51:10 +03:00
Nikita Zinkevich
a17c0d701b [#369] Add env GOFLAGS passing in Make targets
All checks were successful
/ Vulncheck (pull_request) Successful in 1m9s
Details
/ Builds (1.20) (pull_request) Successful in 1m29s
Details
/ Builds (1.21) (pull_request) Successful in 1m27s
Details
/ DCO (pull_request) Successful in 33s
Details
/ Lint (pull_request) Successful in 1m32s
Details
/ Tests (1.20) (pull_request) Successful in 1m39s
Details
/ Tests (1.21) (pull_request) Successful in 1m37s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-08-01 14:29:29 +03:00
Nikita Zinkevich
e2e80152b5 [#369] Request reproducer 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-08-01 14:28:07 +03:00
Nikita Zinkevich
5d55934748 [#369] Add response logging
All checks were successful
/ DCO (pull_request) Successful in 1m4s
Details
/ Vulncheck (pull_request) Successful in 1m14s
Details
/ Builds (1.20) (pull_request) Successful in 1m22s
Details
/ Builds (1.21) (pull_request) Successful in 3m3s
Details
/ Lint (pull_request) Successful in 2m10s
Details
/ Tests (1.20) (pull_request) Successful in 1m26s
Details
/ Tests (1.21) (pull_request) Successful in 3m2s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-07-24 13:34:18 +03:00
Nikita Zinkevich
3bd8a9d724 [#369] Add base64 encoding of body 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-07-24 13:29:17 +03:00
Nikita Zinkevich
2bfeeca024 [#369] Add fileLogger config reloading after SIGHUP
All checks were successful
/ DCO (pull_request) Successful in 4m26s
Details
/ Vulncheck (pull_request) Successful in 4m50s
Details
/ Builds (1.20) (pull_request) Successful in 5m45s
Details
/ Builds (1.21) (pull_request) Successful in 5m22s
Details
/ Lint (pull_request) Successful in 7m55s
Details
/ Tests (1.20) (pull_request) Successful in 5m22s
Details
/ Tests (1.21) (pull_request) Successful in 5m18s
Details 
Declared fileLogger struct in log_http.go. Add ReloadFileLogger method

Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-07-18 14:17:23 +03:00
Nikita Zinkevich
6ae42c699c [#369] Add build tag for http logging 
Build tag 'loghttp' for log_http.go. Created log_http_stub.go for default response without tag.

Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-07-18 14:17:12 +03:00
Nikita Zinkevich
6f3bedc023 [#369] Write log to file
All checks were successful
/ DCO (pull_request) Successful in 13m12s
Details
/ Vulncheck (pull_request) Successful in 14m53s
Details
/ Builds (1.20) (pull_request) Successful in 17m46s
Details
/ Builds (1.21) (pull_request) Successful in 18m0s
Details
/ Lint (pull_request) Successful in 24m20s
Details
/ Tests (1.20) (pull_request) Successful in 19m21s
Details
/ Tests (1.21) (pull_request) Successful in 18m20s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-07-17 15:18:31 +03:00
Nikita Zinkevich
8e2a927334 [#369] Enhanced http requests logging
All checks were successful
/ DCO (pull_request) Successful in 1m47s
Details
/ Vulncheck (pull_request) Successful in 1m48s
Details
/ Lint (pull_request) Successful in 3m52s
Details
/ Tests (1.20) (pull_request) Successful in 2m22s
Details
/ Tests (1.21) (pull_request) Successful in 2m20s
Details
/ Builds (1.20) (pull_request) Successful in 1m15s
Details
/ Builds (1.21) (pull_request) Successful in 1m32s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-07-15 10:28:16 +03:00
Marina Biryukova
3b83de31d2 [#419] Update SDK version 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-07-08 12:15:24 +00:00
Denis Kirillov
70eedfc077 [#414] authmate: Add register-user command
All checks were successful
/ Builds (1.20) (pull_request) Successful in 14m30s
Details
/ Builds (1.21) (pull_request) Successful in 14m25s
Details
/ DCO (pull_request) Successful in 6m47s
Details
/ Vulncheck (pull_request) Successful in 6m59s
Details
/ Lint (pull_request) Successful in 11m52s
Details
/ Tests (1.20) (pull_request) Successful in 8m24s
Details
/ Tests (1.21) (pull_request) Successful in 8m19s
Details 
New command allows register user in frostfsid and
set allowed rules in policy contract

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-08 14:13:00 +03:00
Alex Vanin
f86b82351a [#398] Fix parameter parsing in bucket retryer
Some checks failed
/ Builds (1.20) (pull_request) Successful in 2m7s
Details
/ Builds (1.21) (pull_request) Successful in 1m38s
Details
/ DCO (pull_request) Successful in 2m3s
Details
/ Vulncheck (pull_request) Failing after 2m23s
Details
/ Lint (pull_request) Successful in 4m21s
Details
/ Tests (1.20) (pull_request) Successful in 2m46s
Details
/ Tests (1.21) (pull_request) Successful in 2m42s
Details 
RetryStrategyExponential should use jitter backoff
instead of constant delay function

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-03 13:42:24 +03:00
Denis Kirillov
465eaa816a [#372] Drop [e]ACL related code
All checks were successful
/ DCO (pull_request) Successful in 2m15s
Details
/ Vulncheck (pull_request) Successful in 2m55s
Details
/ Builds (1.20) (pull_request) Successful in 3m46s
Details
/ Builds (1.21) (pull_request) Successful in 3m48s
Details
/ Lint (pull_request) Successful in 5m26s
Details
/ Tests (1.20) (pull_request) Successful in 3m34s
Details
/ Tests (1.21) (pull_request) Successful in 3m18s
Details 
Always consider buckets as APE compatible

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:58:44 +03:00
Denis Kirillov
9241954496 [#372] authmate: Don't create creds with eacl table 
Allow only impersonate flag.
Don't allow SetEACL container session token.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:26:21 +03:00
Denis Kirillov
77f8bdac58 [#372] Drop kludge.acl_enabled flag 
Now only APE container can be created using s3-gw

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:26:19 +03:00
Denis Kirillov
91541a432d [#411] Check uniqueness in DeleteMultipleObjects
All checks were successful
/ Builds (1.20) (pull_request) Successful in 4m57s
Details
/ Builds (1.21) (pull_request) Successful in 4m42s
Details
/ DCO (pull_request) Successful in 4m52s
Details
/ Vulncheck (pull_request) Successful in 4m38s
Details
/ Lint (pull_request) Successful in 6m46s
Details
/ Tests (1.20) (pull_request) Successful in 4m28s
Details
/ Tests (1.21) (pull_request) Successful in 4m7s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-26 16:39:06 +03:00
Denis Kirillov
943b30d9f4 [#411] Don't check object tags on deletion 
By specification https://docs.aws.amazon.com/AmazonS3/latest/userguide/tagging-and-policies.html
we shouldn't check object tags on PUT and DELETE

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-26 16:38:56 +03:00
Denis Kirillov
414f3943e2 [#410] Drop layer.Client interface
All checks were successful
/ DCO (pull_request) Successful in 2m1s
Details
/ Vulncheck (pull_request) Successful in 2m31s
Details
/ Builds (1.20) (pull_request) Successful in 2m39s
Details
/ Builds (1.21) (pull_request) Successful in 2m31s
Details
/ Lint (pull_request) Successful in 3m14s
Details
/ Tests (1.20) (pull_request) Successful in 2m34s
Details
/ Tests (1.21) (pull_request) Successful in 2m10s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-25 15:57:55 +03:00
Denis Kirillov
9432782ce6 [#401] Drop notifications
All checks were successful
/ DCO (pull_request) Successful in 2m5s
Details
/ Builds (1.20) (pull_request) Successful in 2m40s
Details
/ Builds (1.21) (pull_request) Successful in 2m33s
Details
/ Vulncheck (pull_request) Successful in 2m22s
Details
/ Lint (pull_request) Successful in 4m24s
Details
/ Tests (1.20) (pull_request) Successful in 2m48s
Details
/ Tests (1.21) (pull_request) Successful in 2m45s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-25 15:49:37 +03:00
Denis Kirillov
2b04fcb5ec [#406] Remove control api 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-21 06:36:56 +00:00
Denis Kirillov
280d11c794 [#407] Don't set full_control for bucket owner
All checks were successful
/ DCO (pull_request) Successful in 1m29s
Details
/ Builds (1.20) (pull_request) Successful in 2m14s
Details
/ Builds (1.21) (pull_request) Successful in 1m47s
Details
/ Vulncheck (pull_request) Successful in 1m57s
Details
/ Lint (pull_request) Successful in 4m16s
Details
/ Tests (1.20) (pull_request) Successful in 2m46s
Details
/ Tests (1.21) (pull_request) Successful in 2m29s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-19 10:55:24 +03:00
Roman Loginov
ed34b2cae4 [#402] auth: Extend test coverage 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-06-14 10:06:00 +00:00
Denis Kirillov
76f553d292 [#403] Set resource tags into resource properties
All checks were successful
/ DCO (pull_request) Successful in 6m17s
Details
/ Vulncheck (pull_request) Successful in 8m13s
Details
/ Builds (1.20) (pull_request) Successful in 9m45s
Details
/ Builds (1.21) (pull_request) Successful in 9m8s
Details
/ Lint (pull_request) Successful in 18m4s
Details
/ Tests (1.20) (pull_request) Successful in 9m52s
Details
/ Tests (1.21) (pull_request) Successful in 9m5s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-13 11:12:40 +03:00
Denis Kirillov
1513a9252b [#403] go.mod: Update APE 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-13 11:12:35 +03:00
Denis Kirillov
bb81afc14a [#398] Support retryer 
Add two strategy for PutBucketSettings request retryer:
* exponential backoff (increasing up to `max_backoff` delays with jitter)
* constant backoff (always the same `max_backoff` delay between requests)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-06 13:02:17 +00:00
Anoke
58850f590e [#335] Improve determining AccessBox latest version 
Signed-off-by: Anoke <rustamgta1011@gmail.com>
 2024-06-06 12:35:48 +00:00
Marina Biryukova
e25dc90c20 [#399] Add OPTIONS method for object operations 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-06-04 12:59:45 +00:00
Roman Loginov
71bae5cd9a [#400] Update frostfs-sdk-go version with support EC 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-06-04 12:22:06 +00:00
Pavel Pogodaev
b5fae316cf [#396] Add user to response 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-06-04 09:37:55 +00:00
Alex Vanin
9f3ea470e6 [#395] Port changelog and prepare it for next release
All checks were successful
/ Vulncheck (pull_request) Successful in 2m35s
Details
/ Builds (1.20) (pull_request) Successful in 2m30s
Details
/ Builds (1.21) (pull_request) Successful in 2m8s
Details
/ DCO (pull_request) Successful in 2m26s
Details
/ Lint (pull_request) Successful in 3m42s
Details
/ Tests (1.20) (pull_request) Successful in 2m51s
Details
/ Tests (1.21) (pull_request) Successful in 2m40s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-27 14:27:11 +03:00
Denis Kirillov
9787b29542 [#392] go.mod: Update APE to drop private IPs checking
All checks were successful
/ Vulncheck (pull_request) Successful in 2m8s
Details
/ DCO (pull_request) Successful in 2m38s
Details
/ Builds (1.20) (pull_request) Successful in 2m48s
Details
/ Builds (1.21) (pull_request) Successful in 3m22s
Details
/ Lint (pull_request) Successful in 5m17s
Details
/ Tests (1.20) (pull_request) Successful in 3m37s
Details
/ Tests (1.21) (pull_request) Successful in 2m59s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-05-27 11:26:15 +03:00
Roman Loginov
9152b084ec [#387] Fix typo 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
21dbe3ea8e [#387] api: Add tests for middleware 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
f4d174e740 [#387] middleware: Extend test coverage 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Roman Loginov
8a758293b9 [#387] middleware: Delete unused code 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2024-05-22 15:06:02 +00:00
Denis Kirillov
fb521c7ac6 [#367] policy: Set IAM-MFA property to false by default
All checks were successful
/ DCO (pull_request) Successful in 2m34s
Details
/ Vulncheck (pull_request) Successful in 2m41s
Details
/ Builds (1.20) (pull_request) Successful in 4m26s
Details
/ Builds (1.21) (pull_request) Successful in 4m19s
Details
/ Lint (pull_request) Successful in 5m48s
Details
/ Tests (1.20) (pull_request) Successful in 3m55s
Details
/ Tests (1.21) (pull_request) Successful in 3m53s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-05-22 12:05:42 +03:00
Alex Vanin
87b9e97a80 [#354] Do not proceed on bucket remove error
All checks were successful
/ DCO (pull_request) Successful in 2m22s
Details
/ Vulncheck (pull_request) Successful in 2m37s
Details
/ Builds (1.20) (pull_request) Successful in 3m42s
Details
/ Builds (1.21) (pull_request) Successful in 3m12s
Details
/ Lint (pull_request) Successful in 4m51s
Details
/ Tests (1.20) (pull_request) Successful in 3m13s
Details
/ Tests (1.21) (pull_request) Successful in 3m6s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-17 20:38:39 +03:00
Artem Tataurov
d62d8f3874 [#385] Support the renaming of ObjectRequest and ObjectContainer
All checks were successful
/ DCO (pull_request) Successful in 1m33s
Details
/ Builds (1.20) (pull_request) Successful in 2m7s
Details
/ Builds (1.21) (pull_request) Successful in 1m24s
Details
/ Vulncheck (pull_request) Successful in 1m58s
Details
/ Lint (pull_request) Successful in 4m26s
Details
/ Tests (1.20) (pull_request) Successful in 2m35s
Details
/ Tests (1.21) (pull_request) Successful in 2m42s
Details 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2024-05-14 16:51:36 +03:00
Alex Vanin
6bf6a3b1a3 [#362] Check user and groups during policy check
All checks were successful
/ DCO (pull_request) Successful in 4m8s
Details
/ Vulncheck (pull_request) Successful in 4m10s
Details
/ Builds (1.20) (pull_request) Successful in 5m33s
Details
/ Builds (1.21) (pull_request) Successful in 5m24s
Details
/ Lint (pull_request) Successful in 8m32s
Details
/ Tests (1.20) (pull_request) Successful in 5m9s
Details
/ Tests (1.21) (pull_request) Successful in 4m52s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-08 15:25:14 +03:00
Alex Vanin
2f108c9951 [#362] Expand control service 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-08 15:15:49 +03:00
Marina Biryukova
c43ef040dc [#382] Fix request type determination
All checks were successful
/ DCO (pull_request) Successful in 1m36s
Details
/ Builds (1.20) (pull_request) Successful in 2m15s
Details
/ Builds (1.21) (pull_request) Successful in 2m9s
Details
/ Lint (pull_request) Successful in 3m22s
Details
/ Tests (1.20) (pull_request) Successful in 2m18s
Details
/ Tests (1.21) (pull_request) Successful in 2m6s
Details
/ Vulncheck (pull_request) Successful in 57s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-05-07 15:17:22 +03:00
Marina Biryukova
2ab655b909 [#380] Add test for credentials versioning 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-05-03 07:24:13 +00:00
Marina Biryukova
1c398551e5 [#380] creds: Increase test coverage 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-05-03 07:24:13 +00:00
Pavel Pogodaev
db05021786 [#379] Add Iana CharsetReader for Oracle integration
All checks were successful
/ DCO (pull_request) Successful in 1m54s
Details
/ Builds (1.20) (pull_request) Successful in 2m23s
Details
/ Builds (1.21) (pull_request) Successful in 2m0s
Details
/ Vulncheck (pull_request) Successful in 2m7s
Details
/ Lint (pull_request) Successful in 4m16s
Details
/ Tests (1.20) (pull_request) Successful in 2m38s
Details
/ Tests (1.21) (pull_request) Successful in 2m29s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-04-25 17:44:38 +03:00
Marina Biryukova
034396d554 [#377] Add check of Source IP
All checks were successful
/ DCO (pull_request) Successful in 1m55s
Details
/ Builds (1.20) (pull_request) Successful in 2m16s
Details
/ Builds (1.21) (pull_request) Successful in 2m26s
Details
/ Vulncheck (pull_request) Successful in 2m24s
Details
/ Lint (pull_request) Successful in 4m17s
Details
/ Tests (1.20) (pull_request) Successful in 2m42s
Details
/ Tests (1.21) (pull_request) Successful in 2m32s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-04-22 15:29:18 +03:00
Pavel Pogodaev
3c436d8de9 [#365] Include iam user tags in query
All checks were successful
/ Vulncheck (pull_request) Successful in 1m48s
Details
/ Builds (1.20) (pull_request) Successful in 2m30s
Details
/ Builds (1.21) (pull_request) Successful in 1m25s
Details
/ Lint (pull_request) Successful in 3m52s
Details
/ Tests (1.20) (pull_request) Successful in 2m24s
Details
/ Tests (1.21) (pull_request) Successful in 2m22s
Details
/ DCO (pull_request) Successful in 45s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-04-22 10:47:43 +03:00
Marina Biryukova
45f77de8c8 [#371] Add custom Source IP header configuration 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-04-22 07:42:45 +00:00
Denis Kirillov
d903de2457 [#370] Fix fetching attributes from tree
All checks were successful
/ DCO (pull_request) Successful in 2m6s
Details
/ Vulncheck (pull_request) Successful in 2m48s
Details
/ Builds (1.20) (pull_request) Successful in 3m19s
Details
/ Builds (1.21) (pull_request) Successful in 3m15s
Details
/ Lint (pull_request) Successful in 4m50s
Details
/ Tests (1.20) (pull_request) Successful in 3m13s
Details
/ Tests (1.21) (pull_request) Successful in 3m4s
Details 
Port #374

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-19 17:33:55 +03:00