TrueCloudLab
/
frostfs-s3-gw
16
2
Fork 14
Code Issues 19 Pull Requests 4 Actions Packages Releases 6 Activity
1,302 Commits
4 Branches
24 Tags
18 MiB
Commit Graph

1302 Commits (v0.29.0-rc.5)

Author SHA1 Message Date
Denis Kirillov c334adeb6d [#165] Sort nodes in ServiceClientMemory
/ DCO (pull_request) Successful in 1m22s Details
/ Builds (1.20) (pull_request) Successful in 1m52s Details
/ Builds (1.21) (pull_request) Successful in 1m17s Details
/ Vulncheck (pull_request) Successful in 1m51s Details
/ Lint (pull_request) Failing after 1m55s Details
/ Tests (1.20) (pull_request) Successful in 2m24s Details
/ Tests (1.21) (pull_request) Successful in 2m24s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:53:12 +03:00
Denis Kirillov a74d498df2 [#165] Return sort after HEAD in listing
/ DCO (pull_request) Successful in 1m16s Details
/ Builds (1.20) (pull_request) Successful in 2m9s Details
/ Builds (1.21) (pull_request) Successful in 1m39s Details
/ Vulncheck (pull_request) Successful in 1m52s Details
/ Lint (pull_request) Failing after 1m47s Details
/ Tests (1.20) (pull_request) Successful in 2m27s Details
/ Tests (1.21) (pull_request) Successful in 2m13s Details 
We have to sort object after HEAD because we make request in different goroutines,
so the order is not deterministic.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:15:08 +03:00
Denis Kirillov 69297a4a38 [#165] Delete object from tree in case of storage error 
Extend storage node errors in case of which we continue deleting from tree
with 'object not found' error

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:15:08 +03:00
Denis Kirillov 71d82d1cc8 [#165] Fix lint issues 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:15:08 +03:00
Denis Kirillov fafe4af529 [#165] Fix real object size in listing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:15:03 +03:00
Denis Kirillov 88f1acbdfc [#165] Cancel context in outdated list session 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 4e15452853 [#165] Fix lint errors 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov da642a498a [#165] Listing fix data race 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov de32dfd7ce [#165] Rename SubTreeStreamImpl to SubTreeStreamMemoryImpl 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 8a30f18ff6 [#165] Don't use recursion in list streaming 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 2d7973b3f1 [#165] Refactor list versions 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 6d52f46012 [#165] Fix v1 listing bookmark 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 0ae49eaab0 [#165] Generalize allObjectListingParams 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 093de13f54 [#165] Add stream listing tests 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov cf4fc3b602 [#165] Extend error on getting listing containers not in current namespace 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 739a6ec9df [#165] Support latest only stream listing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov c7ee628ab0 [#165] Fix versions listing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 4ad84b9b94 [#165] listing: Use NodeVersion instead of ObjectInfo 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 3e20f736a6 [#165] Move listing function to one file 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov b52552e8c2 [#165] Add batching in streamin listing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 6e8960b2ab [#165] Add list session cache 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 29ac91dfd5 [#165] Support streaming listing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov 84af85ed67 [#302] Update APE to support chain id as bytes
/ DCO (pull_request) Successful in 1m52s Details
/ Vulncheck (pull_request) Successful in 2m0s Details
/ Builds (1.20) (pull_request) Successful in 2m49s Details
/ Builds (1.21) (pull_request) Successful in 1m59s Details
/ Lint (pull_request) Successful in 2m44s Details
/ Tests (1.20) (pull_request) Successful in 2m30s Details
/ Tests (1.21) (pull_request) Successful in 2m24s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 12:53:45 +03:00
Pavel Pogodaev 4804904d9d [#298] journald update version 
We want to have less useless fields in logs

Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-01-29 12:49:22 +00:00
Denis Kirillov e23cc43824 [#299] Drop unused legacy minio code
/ DCO (pull_request) Successful in 2m36s Details
/ Vulncheck (pull_request) Successful in 2m59s Details
/ Lint (pull_request) Successful in 5m23s Details
/ Tests (1.20) (pull_request) Successful in 3m24s Details
/ Tests (1.21) (pull_request) Successful in 3m3s Details
/ Builds (1.20) (pull_request) Successful in 1m16s Details
/ Builds (1.21) (pull_request) Successful in 2m53s Details 
736d8cbac4 (diff-f5a8931b4d5f3b7f583e4cd719bfd2904980518a6f338d463ec76aea814db772)
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-29 12:57:18 +03:00
Evgenii Stratonikov 12434d5f4d [#297] .forgejo: Check only PR commits in dco-go 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-26 15:11:52 +00:00
Evgenii Stratonikov 2e870e99c7 [#297] .forgejo: Update dco-go to v3 
Signed-off-by: Evgenii Stratonikov <e.stratonikov@yadro.com>
 2024-01-26 15:11:52 +00:00
Alexey Vanin 45e025320f [#296] Port v0.28.1 release changelog
/ Vulncheck (pull_request) Successful in 2m9s Details
/ DCO (pull_request) Successful in 2m41s Details
/ Builds (1.20) (pull_request) Successful in 2m57s Details
/ Builds (1.21) (pull_request) Successful in 2m28s Details
/ Lint (pull_request) Successful in 4m44s Details
/ Tests (1.20) (pull_request) Successful in 2m7s Details
/ Tests (1.21) (pull_request) Successful in 1m52s Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-01-24 17:50:24 +03:00
Denis Kirillov eae49908da [#292] authmate: Support custom attributes
/ DCO (pull_request) Successful in 1m36s Details
/ Builds (1.20) (pull_request) Successful in 2m2s Details
/ Builds (1.21) (pull_request) Successful in 1m28s Details
/ Vulncheck (pull_request) Successful in 1m53s Details
/ Lint (pull_request) Successful in 3m19s Details
/ Tests (1.20) (pull_request) Successful in 2m24s Details
/ Tests (1.21) (pull_request) Successful in 2m11s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-22 10:02:43 +03:00
Marina Biryukova c32220762f [#288] Fix possibility of panic during SIGHUP
/ DCO (pull_request) Successful in 1m22s Details
/ Builds (1.20) (pull_request) Successful in 1m59s Details
/ Builds (1.21) (pull_request) Successful in 1m10s Details
/ Vulncheck (pull_request) Successful in 1m51s Details
/ Lint (pull_request) Successful in 4m30s Details
/ Tests (1.20) (pull_request) Successful in 2m20s Details
/ Tests (1.21) (pull_request) Successful in 2m11s Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-01-09 10:53:54 +03:00
Roman Loginov 6f9ee3da76 [#275] Change logic delete multipart upload
/ Vulncheck (pull_request) Successful in 1m13s Details
/ DCO (pull_request) Successful in 1m43s Details
/ Builds (1.20) (pull_request) Successful in 2m49s Details
/ Builds (1.21) (pull_request) Successful in 1m36s Details
/ Lint (pull_request) Successful in 3m33s Details
/ Tests (1.20) (pull_request) Successful in 2m34s Details
/ Tests (1.21) (pull_request) Successful in 2m29s Details 
In order not to accidentally take outdated
information about downloaded parts from other
nodes, now when the multipart is abort or complete,
the root node of the multipart upload with the
finish flag remains in the tree.

Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2023-12-27 13:06:45 +03:00
Marina Biryukova 08019f1574 [#280] Add put requests to duration metric
/ DCO (pull_request) Successful in 1m48s Details
/ Builds (1.20) (pull_request) Successful in 2m10s Details
/ Builds (1.21) (pull_request) Successful in 1m24s Details
/ Vulncheck (pull_request) Successful in 2m0s Details
/ Lint (pull_request) Successful in 4m24s Details
/ Tests (1.20) (pull_request) Successful in 2m16s Details
/ Tests (1.21) (pull_request) Successful in 2m6s Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2023-12-22 16:33:05 +03:00
Denis Kirillov 899213b3f3 [#287] Support proxy for frostfsid and policy contracts
/ Builds (1.20) (pull_request) Successful in 1m52s Details
/ Builds (1.21) (pull_request) Successful in 1m12s Details
/ DCO (pull_request) Successful in 1m46s Details
/ Vulncheck (pull_request) Successful in 1m43s Details
/ Lint (pull_request) Successful in 4m3s Details
/ Tests (1.20) (pull_request) Successful in 2m24s Details
/ Tests (1.21) (pull_request) Successful in 2m23s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-22 15:45:10 +03:00
Denis Kirillov 3b6d2bc522 [#287] authmate: Support frostfsid proxy and namespace 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-22 15:43:14 +03:00
Denis Kirillov 6509639540 [#283] control: Changed type of chainID to bytes
/ DCO (pull_request) Successful in 1m38s Details
/ Builds (1.20) (pull_request) Successful in 2m11s Details
/ Builds (1.21) (pull_request) Successful in 2m7s Details
/ Vulncheck (pull_request) Successful in 1m54s Details
/ Lint (pull_request) Successful in 4m2s Details
/ Tests (1.20) (pull_request) Successful in 2m23s Details
/ Tests (1.21) (pull_request) Successful in 2m13s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-21 18:07:17 +03:00
Denis Kirillov 5698d5844e [#283] Support frostfsid groups in policy request checking 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-21 14:21:36 +03:00
Denis Kirillov 43cae9ee04 [#248] Correct object versions response markers
/ DCO (pull_request) Successful in 1m40s Details
/ Vulncheck (pull_request) Successful in 1m42s Details
/ Builds (1.20) (pull_request) Successful in 2m29s Details
/ Builds (1.21) (pull_request) Successful in 1m37s Details
/ Lint (pull_request) Successful in 3m55s Details
/ Tests (1.20) (pull_request) Successful in 2m23s Details
/ Tests (1.21) (pull_request) Successful in 2m16s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-21 10:53:50 +03:00
Denis Kirillov a17ff66975 [#282] policy: Use prefixes to distinguish s3/iam actions/resources
/ DCO (pull_request) Successful in 1m37s Details
/ Vulncheck (pull_request) Successful in 1m50s Details
/ Builds (1.20) (pull_request) Successful in 2m24s Details
/ Builds (1.21) (pull_request) Successful in 2m2s Details
/ Lint (pull_request) Successful in 4m26s Details
/ Tests (1.20) (pull_request) Successful in 2m28s Details
/ Tests (1.21) (pull_request) Successful in 1m58s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-20 10:41:15 +03:00
Denis Kirillov 38c5503a02 [#261] alc: Remove unused
/ Vulncheck (pull_request) Successful in 2m1s Details
/ DCO (pull_request) Successful in 1m49s Details
/ Builds (1.20) (pull_request) Successful in 2m21s Details
/ Builds (1.21) (pull_request) Successful in 2m4s Details
/ Lint (pull_request) Successful in 2m56s Details
/ Tests (1.20) (pull_request) Successful in 2m17s Details
/ Tests (1.21) (pull_request) Successful in 1m46s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-18 15:49:58 +03:00
Denis Kirillov 8273af8bf8 [#261] Make PutBucketPolicy handler use policy contract 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-18 15:49:54 +03:00
Denis Kirillov 6dbb07f0fa [#261] Update policy-engine dependency 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-14 17:52:13 +03:00
Denis Kirillov 340e6b807b [#266] Update params that being reloaded in one place
/ DCO (pull_request) Successful in 1m33s Details
/ Builds (1.20) (pull_request) Successful in 1m57s Details
/ Builds (1.21) (pull_request) Successful in 1m39s Details
/ Vulncheck (pull_request) Successful in 1m55s Details
/ Lint (pull_request) Successful in 4m0s Details
/ Tests (1.20) (pull_request) Successful in 2m30s Details
/ Tests (1.21) (pull_request) Successful in 2m22s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-14 16:21:09 +03:00
Denis Kirillov 0850d21ff3 [#266] Move trimming namespaces name into fetch function 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-14 16:12:10 +03:00
Denis Kirillov 9272f4e108 [#259] Support contract based policies
/ DCO (pull_request) Successful in 1m21s Details
/ Vulncheck (pull_request) Successful in 1m41s Details
/ Builds (1.20) (pull_request) Successful in 2m19s Details
/ Builds (1.21) (pull_request) Successful in 2m1s Details
/ Lint (pull_request) Successful in 3m20s Details
/ Tests (1.20) (pull_request) Successful in 2m14s Details
/ Tests (1.21) (pull_request) Successful in 2m10s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-11 10:01:46 +03:00
Denis Kirillov be6a37ada5 [#262] Support configuring max tree request attempts
/ DCO (pull_request) Successful in 1m15s Details
/ Vulncheck (pull_request) Successful in 1m39s Details
/ Builds (1.20) (pull_request) Successful in 1m19s Details
/ Builds (1.21) (pull_request) Successful in 2m27s Details
/ Lint (pull_request) Successful in 4m24s Details
/ Tests (1.20) (pull_request) Successful in 2m17s Details
/ Tests (1.21) (pull_request) Successful in 2m36s Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 16:41:21 +03:00
Denis Kirillov 836874a761 [#262] Set tree request id 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-07 16:40:56 +03:00
Alexey Vanin 7a285d1464 [#267] Update api-go to fix stable marshal of empty structs 
Newer version of api-go does not ignore non-nil empty
structures in protobuf messages, so compatibility with
previous version is preserved.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 16:40:56 +03:00
Alexey Vanin f58a0d04ff [#233] Clean tag node in the tree service instead of removal 
With new retry policy of tree service pool, gateway should avoid
deletion of system nodes from tree. Absence of node in the tree
will trigger retry. Other storage in the network may return already
deleted node while tree is not completely synced, and client will
get unexpected result.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 16:40:56 +03:00
Alexey Vanin 94c2674f44 [#233] Update tree service pool in SDK 
Tree service pool now produces retries if
tree service returns 'not found' errors
or empty result on 'GetNodeByPath'

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 16:40:53 +03:00
Alexey Vanin 6b1b43a364 Release v0.28.0
/ Vulncheck (pull_request) Successful in 4m23s Details
/ DCO (pull_request) Successful in 4m25s Details
/ Builds (1.20) (pull_request) Successful in 6m12s Details
/ Builds (1.21) (pull_request) Successful in 5m58s Details
/ Lint (pull_request) Successful in 6m49s Details
/ Tests (1.20) (pull_request) Successful in 5m45s Details
/ Tests (1.21) (pull_request) Successful in 5m26s Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-12-07 15:47:31 +03:00