dkirillov/frostfs-s3-gw
1
0
Fork 0
forked from TrueCloudLab/frostfs-s3-gw
Code Issues Pull requests Projects Releases Packages Wiki Activity
822 commits 15 branches 31 tags 21 MiB
Commit graph

822 commits

This branch
This branch
All branches
Author SHA1 Message Date
Stanislav Bogatyrev
06d0c506d9 [#579] Remove cache dir at cleanup 
Signed-off-by: Stanislav Bogatyrev <stanislav@nspcc.ru>
 2022-07-06 10:49:46 +03:00
Stanislav Bogatyrev
aaddc0a1f7 [#570] Fix docker image builds 
- Moving to Alpine as a base image
- Fix dirty image build
- Fix version format to match neofs-node

Signed-off-by: Stanislav Bogatyrev <stanislav@nspcc.ru>
 2022-07-05 15:12:33 +03:00
Leonard Lyubich
5bfc549746 [#564] neofs: Merge if with same condition in CreateContainer 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-07-04 23:42:50 +04:00
Leonard Lyubich
4a8a248f34 [#564] Upgrade NeoFS SDK Go with changed container API 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-07-04 23:42:50 +04:00
Angira Kekteeva
d2a3ba0c06 [#562] Rename authmate directory 
To generate neofs-s3-authmate instead of neofs-authmate

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-07-04 11:08:50 +03:00
Denis Kirillov
6e1a1f3839 [#522] Suppress CodeQL error 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-07-04 11:03:55 +03:00
Denis Kirillov
9f740b9683 [#289] Add detect mimetype by extension 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-29 19:13:16 +03:00
Leonard Lyubich
ef4550ba45 [#557] Upgrade NeoFS SDK Go with fixed policy parser 
Now policy parser doesn't print failures into stdout but returns the
first one in `error` value.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-28 17:50:24 +03:00
Denis Kirillov
f72bc538b9 [#551] Refactor notifications logs 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-27 17:31:17 +03:00
Denis Kirillov
e84ff96593 [#539] Fix nonce size computation 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-27 02:23:19 +04:00
Denis Kirillov
35f55c5af5 [#539] Fix tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-27 02:23:19 +04:00
Denis Kirillov
7ca519cb32 [#539] Add context to errors 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-27 02:23:19 +04:00
Leonard Lyubich
e1f1e6d960 [#541] Upgrade NeoFS SDK Go with changed basic ACL API 
SDK now provides dedicated type for basic ACL with convenient interface.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-24 16:43:50 +03:00
Leonard Lyubich
a8fc313ff5 [#544] layer: Remove no longer needed deleteContainer method 
Call `DeleteContainer` on `NeoFS` component directly.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-24 13:00:26 +03:00
Leonard Lyubich
f596c8be06 [#544] layer: Add session token parameter to DeleteBucketParams 
Add `DeleteBucketParams.SessionToken` field in order to unify the
parameters with `CreateBucketParams` and `PutBucketACLParams`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-24 13:00:26 +03:00
Leonard Lyubich
4fe833164e [#544] internal/neofs: Prevent potential NPE-panic in DeleteContainer 
Session token parameter of `NeoFS.DeleteContainer` method is optional
and can be `nil`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-24 13:00:26 +03:00
Leonard Lyubich
028a152e04 [#544] Upgrade NeoFS SDK Go with another approach of container sessions 
After recent changes in NeoFS SDK Go library session tokens aren't
embedded into `container.Container` and `eacl.Table` structures.
Instead, the operations of storing given values in NeoFS are
parameterized by elements of the corresponding type.

Add dedicated session parameters to operations of bucket and eACL
setting.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-24 13:00:26 +03:00
Denis Kirillov
8a1fc8ae3f [#543] Drop workflow dispatch 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-20 18:33:08 +03:00
Denis Kirillov
818176e7e1 [#528] Adopt aws v4signer 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-20 09:44:25 +03:00
Denis Kirillov
6ffac0c4d1 [#528] Add java sdk client configuration 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-20 09:44:25 +03:00
Leonard Lyubich
08a33ff2d9 [#539] authmate: Add context to the container creation failure 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-17 08:28:59 +03:00
Leonard Lyubich
f0749fd23e [#537] Upgrade NeoFS SDK Go with changed netmap package 
`PlacementPolicy` type now provides methods to work with QL-encoded
policies. System network parameters can be read using dedicated method
without iterating. Applications can work with `PlacementPolicy`
variables directly so there is no need to use pointers.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-17 08:28:59 +03:00
Angira Kekteeva
cfe7591cf7 [#523] Add putObjectACL notification 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-17 01:43:46 +04:00
Angira Kekteeva
dd0d21b690 [#523] Fix typo 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-17 01:43:46 +04:00
Angira Kekteeva
bd5fd041b7 [#523] Add object tagging notifications 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-17 01:43:46 +04:00
Denis Kirillov
809c12a571 [#529] Update doc 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-16 17:17:45 +03:00
Denis Kirillov
d521af2065 [#529] Add presign URLs support 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-16 17:17:45 +03:00
Alex Vanin
83967312e0 [#471] Tidy Makefile 
- Remove help target. Help target will always ignore variable
  targets, it is confusing.
- Remove goimports from format target. Gofmt is enough.
- Add linter image version variable.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-16 11:12:42 +03:00
Alex Vanin
f1a2611043 [#471] Add docker/* target in Makefile 
Allowed targets:
- docker/all
- docker/bin/neofs-s3-gw
- docker/bin/neofs-authmate
- docker/lint

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-16 11:12:42 +03:00
Leonard Lyubich
880ffe7108 [#492] layer: Don't parameterize basic ACL of created containers 
`CreateBucket` handler always creates containers with extended public
ACL, so there is no need to configure it in `NeoFS.CreateContainer`.

Make internal `NeoFS` implementation to create containers with
`eacl-public-read-write` basic ACL if corresponding parameter is unset.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-16 10:46:50 +03:00
Alex Vanin
0e27fea8f2 Revert "[#422] authmate: Fix extended ACL rules reading" 
This reverts commit 406e4db30b.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-09 10:30:57 +03:00
Alex Vanin
5485adc477 [#422] Update NeoFS SDK 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-09 10:30:57 +03:00
Alex Vanin
f438ac5aa2 [#454] Note sections which are not explicitly supported by s3-gw 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-07 17:37:05 +03:00
Alex Vanin
acbbbb5aa6 [#454] Update compatibility table 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-07 17:37:05 +03:00
Alex Vanin
51ff59af71 [#454] Support repeating tests in resulting file 
One test may be a part of several test
groups. See 'test_multipart_copy_versioned'.
This commit fixes result file parsing.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-07 17:37:05 +03:00
Angira Kekteeva
a8bff13801 [#495] Add acl to copy-object 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-07 17:36:12 +03:00
Denis Kirillov
de7281ac58 [#465] Unify log messages 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-07 17:20:26 +03:00
Denis Kirillov
300d4359d8 [#465] Handle cache cast failure 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-07 17:20:26 +03:00
Denis Kirillov
f00ca1b6c4 [#438] Drop layer/neofs package 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-07 13:59:45 +03:00
Denis Kirillov
40d8972fc6 [#466] Update CodeQL action to v2 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-03 17:35:37 +03:00
Alex Vanin
4ed939773b [#487] Use updated SDK method to get bearer issuer 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-03 11:20:47 +03:00
Angira Kekteeva
dbfac29171 [#487] Fix tests 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-03 10:57:56 +03:00
Angira Kekteeva
e904ed51c7 [#487] Optimize bucketInfo in initObjectPayloadReader 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-03 10:57:56 +03:00
Angira Kekteeva
4767eeed8c [#487] Remove attach of bearer token 
When bucket owner is not an issuer of the bearer token

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-03 10:57:56 +03:00
Leonard Lyubich
4f43aad495 [#485] Upgrade SDK with latest bearer package API 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-06-03 09:38:49 +03:00
Denis Kirillov
ea252421f5 [#484] Add tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-03 09:35:06 +03:00
Denis Kirillov
f282e877e2 [#484] Handle conditional headers 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-06-03 09:35:06 +03:00
Alex Vanin
ee0f3fb196 [#489] Avoid sensitive data logging 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-02 19:42:31 +04:00
Alex Vanin
12d9eb62cb [#489] Sanitize log records that may contain user input 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-06-02 19:42:31 +04:00
Angira Kekteeva
2ca4dbb190 [#482] authmate: Add wallet public key to output 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-06-01 09:40:10 +03:00