TrueCloudLab/frostfs-s3-gw
18
3
Fork 20
Code Issues 28 Pull requests 8 Projects Releases 19 Packages Activity Actions
1389 commits 5 branches 44 tags 23 MiB
Commit graph

71 commits

Author SHA1 Message Date
Denis Kirillov
a7ae88e1fb [#471] tree: Don't use sorted GetSubTree for nodes without FileName
All checks were successful
/ DCO (pull_request) Successful in 1m15s
Details
/ Vulncheck (pull_request) Successful in 1m17s
Details
/ Builds (1.21) (pull_request) Successful in 1m38s
Details
/ Builds (1.22) (pull_request) Successful in 1m36s
Details
/ Lint (pull_request) Successful in 2m49s
Details
/ Tests (1.21) (pull_request) Successful in 1m41s
Details
/ Tests (1.22) (pull_request) Successful in 1m42s
Details 
Sorted GetSubTree doesn't return nodes without FileName attribute
if there are more than 1000 nodes in subtree

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-21 15:25:58 +03:00
Marina Biryukova
2fefed842d [#439] Update SDK version 
New SDK version supports extended log records in pool component during inner nodes health check.

Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
(cherry picked from commit c506620199)
 2024-07-24 16:38:48 +03:00
Alex Vanin
ec349e4523 [#430] Adopt compatibility workarounds in Tree API 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-07-19 14:47:47 +03:00
Denis Kirillov
456319d2f1 [#430] Fix split tree 
Update tree service to fix split tree problem.
Tree intermediate nodes can be duplicated, so we must handle this.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-19 11:24:46 +03:00
Denis Kirillov
70eedfc077 [#414] authmate: Add register-user command
All checks were successful
/ Builds (1.20) (pull_request) Successful in 14m30s
Details
/ Builds (1.21) (pull_request) Successful in 14m25s
Details
/ DCO (pull_request) Successful in 6m47s
Details
/ Vulncheck (pull_request) Successful in 6m59s
Details
/ Lint (pull_request) Successful in 11m52s
Details
/ Tests (1.20) (pull_request) Successful in 8m24s
Details
/ Tests (1.21) (pull_request) Successful in 8m19s
Details 
New command allows register user in frostfsid and
set allowed rules in policy contract

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-08 14:13:00 +03:00
Denis Kirillov
465eaa816a [#372] Drop [e]ACL related code
All checks were successful
/ DCO (pull_request) Successful in 2m15s
Details
/ Vulncheck (pull_request) Successful in 2m55s
Details
/ Builds (1.20) (pull_request) Successful in 3m46s
Details
/ Builds (1.21) (pull_request) Successful in 3m48s
Details
/ Lint (pull_request) Successful in 5m26s
Details
/ Tests (1.20) (pull_request) Successful in 3m34s
Details
/ Tests (1.21) (pull_request) Successful in 3m18s
Details 
Always consider buckets as APE compatible

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-01 16:58:44 +03:00
Denis Kirillov
2b04fcb5ec [#406] Remove control api 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-06-21 06:36:56 +00:00
Anoke
58850f590e [#335] Improve determining AccessBox latest version 
Signed-off-by: Anoke <rustamgta1011@gmail.com>
 2024-06-06 12:35:48 +00:00
Alex Vanin
6bf6a3b1a3 [#362] Check user and groups during policy check
All checks were successful
/ DCO (pull_request) Successful in 4m8s
Details
/ Vulncheck (pull_request) Successful in 4m10s
Details
/ Builds (1.20) (pull_request) Successful in 5m33s
Details
/ Builds (1.21) (pull_request) Successful in 5m24s
Details
/ Lint (pull_request) Successful in 8m32s
Details
/ Tests (1.20) (pull_request) Successful in 5m9s
Details
/ Tests (1.21) (pull_request) Successful in 4m52s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-05-08 15:25:14 +03:00
Marina Biryukova
2ab655b909 [#380] Add test for credentials versioning 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-05-03 07:24:13 +00:00
Pavel Pogodaev
3c436d8de9 [#365] Include iam user tags in query
All checks were successful
/ Vulncheck (pull_request) Successful in 1m48s
Details
/ Builds (1.20) (pull_request) Successful in 2m30s
Details
/ Builds (1.21) (pull_request) Successful in 1m25s
Details
/ Lint (pull_request) Successful in 3m52s
Details
/ Tests (1.20) (pull_request) Successful in 2m24s
Details
/ Tests (1.21) (pull_request) Successful in 2m22s
Details
/ DCO (pull_request) Successful in 45s
Details 
Signed-off-by: Pavel Pogodaev <p.pogodaev@yadro.com>
 2024-04-22 10:47:43 +03:00
Marina Biryukova
e22ff52165 [#367] Add check of AccessBox attributes 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-04-19 06:25:26 +00:00
Denis Kirillov
5315f7b733 [#269] Create frostfsid wrapper with cache
All checks were successful
/ DCO (pull_request) Successful in 2m10s
Details
/ Vulncheck (pull_request) Successful in 2m0s
Details
/ Builds (1.20) (pull_request) Successful in 2m31s
Details
/ Builds (1.21) (pull_request) Successful in 1m31s
Details
/ Lint (pull_request) Successful in 3m34s
Details
/ Tests (1.20) (pull_request) Successful in 2m26s
Details
/ Tests (1.21) (pull_request) Successful in 2m21s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-18 09:32:30 +03:00
Denis Kirillov
29a2dae40c [#269] Move frostfsid client to separate package 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-17 12:11:23 +03:00
Alex Vanin
6da1acc554 [#360] Use 'c' prefix for bucket policies instead of 'n' 
With 'c' prefix, acl chains become shorter, thus gateway
receives shorter results and avoids sessions to neo-go.

There is still issue with many IAM rules.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-04-10 17:56:47 +03:00
Alex Vanin
cb83f7646f [#347] port: Explicitly specify sorting order of subtree for object listing
Some checks failed
/ DCO (pull_request) Successful in 1m56s
Details
/ Vulncheck (pull_request) Failing after 4m57s
Details
/ Builds (1.20) (pull_request) Successful in 5m54s
Details
/ Builds (1.21) (pull_request) Successful in 5m56s
Details
/ Lint (pull_request) Successful in 13m10s
Details
/ Tests (1.20) (pull_request) Successful in 5m34s
Details
/ Tests (1.21) (pull_request) Successful in 3m22s
Details 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2024-04-09 18:57:47 +03:00
Denis Kirillov
8407b3ea4c [#352] policy: Use iterators to list chains 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-04 12:51:12 +00:00
Denis Kirillov
8669bf6b50 [#346] acl: Update APE and fix using
All checks were successful
/ DCO (pull_request) Successful in 2m57s
Details
/ Vulncheck (pull_request) Successful in 3m33s
Details
/ Lint (pull_request) Successful in 4m44s
Details
/ Tests (1.20) (pull_request) Successful in 3m38s
Details
/ Tests (1.21) (pull_request) Successful in 3m29s
Details
/ Builds (1.20) (pull_request) Successful in 1m12s
Details
/ Builds (1.21) (pull_request) Successful in 3m23s
Details 
* Remove native policy when remove bucket policy
* Allow policies that contain only s3 compatible statements
(now deny rules cannot be converted to native rules)

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-04-02 12:43:04 +00:00
Marina Biryukova
70043c4800 [#324] Close nns resolver after use 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-03-04 09:06:26 +00:00
Denis Kirillov
8050ca2d51 [#306] Use session token for container read operations
All checks were successful
/ DCO (pull_request) Successful in 1m54s
Details
/ Vulncheck (pull_request) Successful in 1m55s
Details
/ Builds (1.20) (pull_request) Successful in 2m49s
Details
/ Builds (1.21) (pull_request) Successful in 1m56s
Details
/ Lint (pull_request) Successful in 3m59s
Details
/ Tests (1.20) (pull_request) Successful in 2m30s
Details
/ Tests (1.21) (pull_request) Successful in 2m19s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-03-01 18:14:33 +03:00
Denis Kirillov
56b50f2075 [#306] Remove flag to disable policy contract 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
8f89f275bd [#306] Save bucket policy as native chain 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
bac1b3fb2d [#306] Use zero basic acl to mark APE containers 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
c452d58ce2 [#306] Reduce number of policy contract invocations 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
d9d12debc3 [#306] Add tests 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Denis Kirillov
1f2cf0ed67 [#306] Use APE instead of eACL on bucket creation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-28 17:50:08 +03:00
Marina Biryukova
391fc9cbe3 [#311] Change object owner for anonymous put 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2024-02-21 15:03:16 +00:00
Denis Kirillov
4eb2c7fb7d [#290] Fix TestErrorTimeoutChecking test
All checks were successful
/ DCO (pull_request) Successful in 1m34s
Details
/ Vulncheck (pull_request) Successful in 1m37s
Details
/ Builds (1.20) (pull_request) Successful in 2m22s
Details
/ Builds (1.21) (pull_request) Successful in 1m38s
Details
/ Lint (pull_request) Successful in 3m45s
Details
/ Tests (1.20) (pull_request) Successful in 2m16s
Details
/ Tests (1.21) (pull_request) Successful in 2m9s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-20 11:39:49 +00:00
Denis Kirillov
5121c73d3f [#307] Update APE
Some checks failed
/ DCO (pull_request) Successful in 2m57s
Details
/ Vulncheck (pull_request) Successful in 3m22s
Details
/ Builds (1.20) (pull_request) Successful in 3m54s
Details
/ Builds (1.21) (pull_request) Successful in 3m23s
Details
/ Lint (pull_request) Failing after 4m15s
Details
/ Tests (1.20) (pull_request) Successful in 4m10s
Details
/ Tests (1.21) (pull_request) Successful in 3m48s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-07 12:24:13 +03:00
Denis Kirillov
4e15452853 [#165] Fix lint errors 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov
b52552e8c2 [#165] Add batching in streamin listing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov
29ac91dfd5 [#165] Support streaming listing 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-02-02 16:09:48 +03:00
Denis Kirillov
eae49908da [#292] authmate: Support custom attributes
All checks were successful
/ DCO (pull_request) Successful in 1m36s
Details
/ Builds (1.20) (pull_request) Successful in 2m2s
Details
/ Builds (1.21) (pull_request) Successful in 1m28s
Details
/ Vulncheck (pull_request) Successful in 1m53s
Details
/ Lint (pull_request) Successful in 3m19s
Details
/ Tests (1.20) (pull_request) Successful in 2m24s
Details
/ Tests (1.21) (pull_request) Successful in 2m11s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-01-22 10:02:43 +03:00
Denis Kirillov
899213b3f3 [#287] Support proxy for frostfsid and policy contracts
All checks were successful
/ Builds (1.20) (pull_request) Successful in 1m52s
Details
/ Builds (1.21) (pull_request) Successful in 1m12s
Details
/ DCO (pull_request) Successful in 1m46s
Details
/ Vulncheck (pull_request) Successful in 1m43s
Details
/ Lint (pull_request) Successful in 4m3s
Details
/ Tests (1.20) (pull_request) Successful in 2m24s
Details
/ Tests (1.21) (pull_request) Successful in 2m23s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-22 15:45:10 +03:00
Denis Kirillov
3b6d2bc522 [#287] authmate: Support frostfsid proxy and namespace 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-22 15:43:14 +03:00
Denis Kirillov
5698d5844e [#283] Support frostfsid groups in policy request checking 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-21 14:21:36 +03:00
Denis Kirillov
8273af8bf8 [#261] Make PutBucketPolicy handler use policy contract 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-18 15:49:54 +03:00
Denis Kirillov
6dbb07f0fa [#261] Update policy-engine dependency 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-14 17:52:13 +03:00
Denis Kirillov
9272f4e108 [#259] Support contract based policies
All checks were successful
/ DCO (pull_request) Successful in 1m21s
Details
/ Vulncheck (pull_request) Successful in 1m41s
Details
/ Builds (1.20) (pull_request) Successful in 2m19s
Details
/ Builds (1.21) (pull_request) Successful in 2m1s
Details
/ Lint (pull_request) Successful in 3m20s
Details
/ Tests (1.20) (pull_request) Successful in 2m14s
Details
/ Tests (1.21) (pull_request) Successful in 2m10s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-12-11 10:01:46 +03:00
Denis Kirillov
ff1ec56d24 [#260] Use namespace as domain when create bucket
All checks were successful
/ DCO (pull_request) Successful in 1m26s
Details
/ Vulncheck (pull_request) Successful in 2m6s
Details
/ Builds (1.20) (pull_request) Successful in 2m20s
Details
/ Builds (1.21) (pull_request) Successful in 2m21s
Details
/ Lint (pull_request) Successful in 3m15s
Details
/ Tests (1.20) (pull_request) Successful in 2m28s
Details
/ Tests (1.21) (pull_request) Successful in 2m17s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-11-27 15:30:12 +03:00
Denis Kirillov
a61ff3b8cb [#260] authmate: Support key registration in frostfsid contract 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-11-23 11:00:11 +03:00
Denis Kirillov
6304d7bfda [#260] Support frostfsid validation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-11-23 11:00:11 +03:00
Denis Kirillov
7de73f6b73 [#197] Disable homomorphic hash for PUT 
Disable TZ hash for PUT if it's disabled for container itself

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-10-11 12:32:48 +00:00
Denis Kirillov
631d9d83b6 [#185] Fix payload reader 
When we use io.CopyBuffer it check for exact io.EOF matching,
so we need keep original EOF error otherwise io.CopyBuffer returns error

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-08-24 18:01:08 +03:00
Denis Kirillov
6b1f365e65 [#192] Support client cut 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-08-23 06:26:55 +00:00
Marina Biryukova
012ece40bb [#180] Fix linter issues
All checks were successful
/ Builds (1.19) (pull_request) Successful in 2m55s
Details
/ Builds (1.20) (pull_request) Successful in 2m47s
Details
/ DCO (pull_request) Successful in 3m4s
Details
/ Vulncheck (pull_request) Successful in 3m39s
Details
/ Lint (pull_request) Successful in 4m19s
Details
/ Tests (1.19) (pull_request) Successful in 3m52s
Details
/ Tests (1.20) (pull_request) Successful in 3m18s
Details 
Signed-off-by: Marina Biryukova <m.biryukova@yadro.com>
 2023-08-21 17:23:24 +03:00
Artem Tataurov
94a42fa273 [#51] Update frostfs-sdk-go 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-08-17 14:26:25 +03:00
Roman Loginov
40d7f844e3 [#137] Refactor context data retrievers 
Signed-off-by: Roman Loginov <r.loginov@yadro.com>
 2023-08-16 14:05:38 +00:00
Denis Kirillov
18878b66d3 [#175] Use gate owner as object owner
Some checks failed
/ DCO (pull_request) Failing after 3s
Details
/ Vulncheck (pull_request) Failing after 2s
Details
/ Builds (1.19) (pull_request) Failing after 3s
Details
/ Builds (1.20) (pull_request) Successful in 7m47s
Details
/ Lint (pull_request) Failing after 4s
Details
/ Tests (1.19) (pull_request) Successful in 8m8s
Details
/ Tests (1.20) (pull_request) Failing after 3s
Details 
This is required because node check session token owner
TrueCloudLab/frostfs-node#528
For client cut TrueCloudLab/frostfs-sdk-go#114
such owner will be gate owner

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-08-08 12:22:33 +03:00
Denis Kirillov
fc90981c03 [#149] Update inner imports after moving middlewares 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-07-11 17:25:09 +03:00