dkirillov/frostfs-s3-gw
1
0
Fork 0
forked from TrueCloudLab/frostfs-s3-gw
Code Issues Pull requests Projects Releases Packages Wiki Activity
916 commits 14 branches 31 tags 21 MiB
Commit graph

916 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alex Vanin
89ff89a32b [#463] Define default location constraint 
Fixes `test_bucket_get_location` from s3-tests.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-30 14:41:32 +03:00
Leonard Lyubich
087d500c5f [#458] *: Refactor working with NeoFS identities 
Pull latest changes from NeoFS SDK Go library. Decrease redundant and
unsafe usage of ID pointers. Use `EncodeToString` method in order to
calculate protocol strings.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-05-27 17:22:37 +04:00
Alex Vanin
3f0dbcc995 [#456] Fix binary name in build GitHub Action 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-25 22:44:48 +04:00
Alex Vanin
80c6122f55 [#450] Do not pass nil error to logAndSendError 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-25 00:36:42 +04:00
Alex Vanin
385437aace [#441] Don't produce extra object.Head request at regular object upload 
Hash can be calculated locally in S3 gateway.
Creation epoch used for versioning and will be
fetched during get and list requests. To avoid
conflicts, put method do not update cache anymore.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-20 10:56:36 +03:00
Alex Vanin
2575462daa [#439] Less cache misses for empty bucket setting 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-20 10:56:16 +03:00
Alex Vanin
1012a3c6a4 Release v0.21.1 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-16 15:29:35 +03:00
Alex Vanin
8a2460286f [#435] Sync homomorphic hash disabling with network config 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-16 15:16:39 +03:00
Angira Kekteeva
01fd43c1b0 [#434] Update go version to 1.17 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-05-16 10:49:51 +03:00
Kira
2d1512b82b Release 0.21.0 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-05-13 12:38:14 +03:00
Angira Kekteeva
7d69f9f74b [#432] Add get-object-attributes 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-05-13 11:42:43 +03:00
Alex Vanin
b778c2e072 [#431] Fix ETag value 
ETag is a string with SHA256 of NeoFS object payload.
Hash is taken from object header by neofs-sdk-go getter.
Checksum type in neofs-sdk-go has changes `String()`
output from `<hash>` to `SHA256:<hash>` in latest update.

S3 gateway should not be relied on unstable string format
implementations and use raw value.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-12 21:19:59 +04:00
Alex Vanin
1c33f06bfe [#428] Update SDK 
Includes:
- container removal fix
- new session token structure: authmate does not
  parse session context anymore, instead it is
  application defined flexible structure with
  container ID encoded in human-readable format

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-06 14:47:06 +04:00
Alex Vanin
9d3e6f75be [#391] Remove unused notification controller from app state 
Now controller is a part of handler.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-06 11:03:20 +03:00
Denis Kirillov
94caa2247e [#391] Refactor notifications 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-05-06 10:59:31 +03:00
Alex Vanin
ea8e1b3b19 [#426] internal/neofs: Use custom poll interval 
1 second interval drastically improves experience in
neofs-dev-env and does not produce much load in production.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-05-04 17:26:13 +04:00
Angira Kekteeva
20f846ea9b Release 0.20.0 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-29 16:38:20 +04:00
Alex Vanin
406e4db30b [#422] authmate: Fix extended ACL rules reading 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-29 00:05:09 +04:00
Alex Vanin
c9126fc0a9 [#409] authmate: Fix container ID parsing 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-29 00:04:47 +04:00
Denis Kirillov
58ce884eab [#406] Update docs 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-27 17:51:56 +03:00
Denis Kirillov
69a03c5bbe [#406] authmate: update default bearer rules 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-27 17:51:56 +03:00
Angira Kekteeva
4047a47457 [#412] Fix links in docs 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-27 16:58:10 +04:00
Denis Kirillov
e3c16a32dd [#409] Update SDK 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-26 12:51:52 +04:00
Denis Kirillov
6e91074b50 [#367] Check errors using status 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-22 15:30:42 +04:00
Elizaveta Chichindaeva
bf38007692 [#405] English Check 
Signed-off-by: Elizaveta Chichindaeva <elizaveta@nspcc.ru>
 2022-04-22 14:01:40 +03:00
Angira Kekteeva
a0a04a73bd [#347] Add setEACL session token checks 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-20 12:42:33 +03:00
Angira Kekteeva
f274747e83 [#400] Make multipart-upload parts system objects 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-19 12:51:04 +03:00
Angira Kekteeva
9f017b2bba [#396] Rename rpc-endpoint and resolve-order 
To make cli params more consistent
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-18 11:58:54 +03:00
Angira Kekteeva
8d9e473804 [#396] Rename params 
session-token -> session-tokens
rebalance_timer -> rebalance interval
request_timeout -> healthcheck_timeout

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-18 11:58:54 +03:00
Angira Kekteeva
0f3ae334e5 [#396] Remove unused parameters 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-18 11:58:54 +03:00
Angira Kekteeva
d3e71f567e [#396] Add .env and .yaml examples 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-18 11:58:54 +03:00
Angira Kekteeva
6a89ebb257 [#396] Update docs 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-18 11:58:54 +03:00
Denis Kirillov
3c5c2f20d8 [#399] Use bearer token for system objects 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-13 16:44:32 +04:00
Denis Kirillov
7710de39ec [#365] Update SDK 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-08 17:12:52 +03:00
Leonard Lyubich
83fb697f80 [#380] cmd/s3-gw: Write app name and version once on startup 
It's redundant to write app name and version in each log message, a
single entry at the start is enough.

Make `App.Wait` to write app name as `neofs-s3-gw` in `application
started` message. Do not add `app_name` and `app_version` fields to the
logger returned by `newLogger`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-04-06 17:31:01 +03:00
Leonard Lyubich
01c721ee53 [#380] cmd/s3-gw: Refactor logger 
Do not import `logger` package from NeoFS SDK Go. Discard unusable
`name` and `version` configuration values from `app` section. Discard
all unusable onfiguration values from `logger` section except `level`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-04-06 17:31:01 +03:00
Angira Kekteeva
f3df5ff633 [#395] Fix grantee in ACL 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-06 15:30:17 +03:00
Angira Kekteeva
ed47bc1596 Fixed deletes for failed tests 
test_multi_object_delete
test_multi_objectv2_delete

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-06 09:55:00 +03:00
Angira Kekteeva
e319f2422e [#357] Remove checks of bucket settings is not nil 
Via #389
Also fixed test

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
02bcbe9754 [#357] Replace prepareEvent params by struct 
By struct SendNotificationParams
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
a718b92652 [#357] Add ObjectDelete notifications 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
021f5d4dd0 [#357] Refactor delete objects 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
b7aac223df [#357] Add ObjectCreated notifications 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
67c1ba2c61 [#357] Add tests 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
371eb2feda [#357] Add events and sending of events 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
40e7dbf768 [#357] Add test events and check of bucket notif conf 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:57:19 +03:00
Angira Kekteeva
2b6843f8fa [#389] Fix checks of bucket settings 
In Put/CopyObject and PutBucketVersioning

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-04-01 14:22:10 +04:00
Denis Kirillov
c399cfbdda [#382] Refactor neofs related types 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-31 11:47:24 +03:00
Denis Kirillov
4322da90d8 [#387] authmate: fix parsing session rules 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-31 11:44:26 +03:00
Angira Kekteeva
83bb6fc020 [#384] Add check of Notificator interface value 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-03-30 10:29:28 +03:00