TrueCloudLab/frostfs-s3-gw
17
3
Fork 19
Code Issues 30 Pull requests 7 Projects Releases 19 Packages Activity Actions
855 commits 5 branches 44 tags 22 MiB
Commit graph

855 commits

This branch
This branch
All branches
Author SHA1 Message Date
Denis Kirillov
6cf01bed14 [#195] Add tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-23 14:32:13 +04:00
Denis Kirillov
7d6271be8a [#195] Implement PUT, GET locks to certain object 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-23 14:32:13 +04:00
Denis Kirillov
8553158b81 [#195] Add handling lock headers for PUT and COPY 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-23 14:32:13 +04:00
Denis Kirillov
fe9eb9cedc [#195] Add PUT and GET default lock configuration 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-23 14:32:13 +04:00
Denis Kirillov
b96c3c5a33 [#195] Refactor 
Using object settings to save bucket versioning

Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-23 14:32:13 +04:00
Denis Kirillov
3046d80b37 [#195] Check object locking when disable versioning 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-23 14:32:13 +04:00
Denis Kirillov
e98c663bd6 [#195] Support enabling object locking for bucket 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-23 14:32:13 +04:00
Denis Kirillov
40b6365afb Release v0.19.0 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-16 15:44:19 +03:00
Denis Kirillov
94406b08f3 [#376] Update NeoFS SDK to v1.0.0-rc.3 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-16 15:44:19 +03:00
Denis Kirillov
52f0af0ccc [#372] Check parameters before creating container 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-16 11:00:23 +03:00
Denis Kirillov
02f4524d67 [#368] Unify cache value deletion 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-16 10:59:42 +03:00
Denis Kirillov
e7b742df4d [#366] Add wait for container removed 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-04 10:41:15 +03:00
Leonard Lyubich
20b8e3d249 [#346] Upgrade NeoFS SDK Go to 2nd release candidate v1.0.0 
Avoid using the deprecated elements.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
ac0ffd6136 [#346] cmd/authmate: Fix NPE in createNeoFS 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
8fb3835250 [#346] api: Do not use io.Pipe in CompleteMultipartUpload 
Replace `layer.objectWritePayload` method with `initObjectPayloadReader`
which returns `io.Reader` of the object payload. Copy payload data to
the parameterized `io.Writer` in `layer.GetObject`. Remove `io.Pipe`
from `CompleteMultipartUpload` implementation and build analogue of
`io.MultiReader` for the part list.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
eac4c4d849 [#346] api: Remove unused and no longer needed layer.Get method 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
0cbe09d211 [#346] s3-gw: Reuse single neofs.NeoFS in application 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
1517b5c638 [#346] neofs: Fix belated updateCRDT2PSetHeaders call 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
e559312fbf [#346] neofs: Fix ReadObject implementation 
`ReadObject` method must read full object payload into memory when
`WithHeader` and `WithPayload` are set and write it into heading part.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
dc628aef22 [#346] Upgrade NeoFS SDK Go module 
Use `pool.ResObjectSearch.Iterate` method in `NeoFS.SelectObjects`
implementation.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
cd64f41ce8 [#346] *: Refactor communication with NeoFS at the protocol level 
Make `tokens`, `authmate` and `layer` packages to depend from locally
defined `NeoFS` interface of the virtual connection to NeoFS network.
Create internal `neofs` package and implement these interfaces through
`pool.Pool` there. Implement mediators between `NeoFS` interfaces and
`neofs.NeoFS` implementation.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Leonard Lyubich
34a221c5c9 [#346] Upgrade NeoFS SDK Go library 
Core changes:
  - `object.ID` moved to new package `oid`;
  - `object.Address` moved to new package `address`;
  - `pool.Object` interface changes.

Additionally:
  - Set container owner in `Agent.IssueSecret`.
  - Remove no longer needed fields from `GetObjectParams`
  - `Length` and `Offset` are never assigned. These values
  are set in `Range` field.
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 00:14:30 +03:00
Denis Kirillov
6a4fba4d09 [#364] Support placement policy overriding 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-03 18:12:20 +03:00
Angira Kekteeva
4454821285 [#340] Add notification configuration handlers 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-18 16:59:42 +03:00
Angira Kekteeva
4cbce87eac [#340] Make nats tls and ca params optional 
nats.Connect returned error when tls and ca files were not set, what
made these params required, but establishing of unsecured connection
for debug is acceptable.

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-18 16:59:42 +03:00
Angira Kekteeva
e0c6544567 [#340] Move notification controller to layer 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-18 16:59:42 +03:00
Angira Kekteeva
8529a7d80b [#352] Update README 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-17 12:34:20 +03:00
Angira Kekteeva
e7e71d6202 [#352] Add appending of SetEACL token in authmate 
If Put session context exists

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-17 12:34:20 +03:00
Angira Kekteeva
aa4c9d19f6 [#348] Wrap errors from buildSessionTokens func 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-17 09:15:42 +03:00
Angira Kekteeva
ee6c582ec8 [#348] Remove prefix to errors in authmate 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-17 09:15:42 +03:00
Denis Kirillov
f04815c32f [#354] Check container owner if bucket exists 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-02-15 17:08:46 +03:00
Angira Kekteeva
fdc07b8dc1 [#343] Replace default policy in authmate 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-07 12:48:54 +03:00
Angira Kekteeva
3277293bb3 [#341] Add notifications controller 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-04 14:41:22 +03:00
Angira Kekteeva
204835ace3 [#338] Remove redundant flag for session tokens in authmate 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-02 18:11:19 +03:00
Angira Kekteeva
2b4638f6bb [#336] Update default session token rules 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-02-01 12:40:41 +03:00
Denis Kirillov
77d731857c [#329] Update authmate docs 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-31 11:05:35 +03:00
Denis Kirillov
c383f332d5 [#329] Use suitable tokens for container requests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-31 11:05:35 +03:00
Denis Kirillov
cce79b612a [#329] Update accessbox protobuf 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-31 11:05:35 +03:00
Denis Kirillov
13664135c5 [#329] Add multiple session tokens in authmate 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-31 11:05:35 +03:00
Denis Kirillov
3686828577 [#312] Update test results 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-31 00:04:41 +03:00
Denis Kirillov
9be4bbbed4 [#312] Support Expires and Cache-Control headers 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-31 00:04:41 +03:00
Denis Kirillov
8fc19b11db [#333] Update sdk 
Update sdk to fix "invalid session token owner" error

Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-28 12:42:40 +03:00
Angira Kekteeva
badc94e904 [#313] Update test results 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-01-27 10:25:11 +03:00
Angira Kekteeva
1502857dba [#313] Remove extra QueryUnescapes 
Removed extra QueryUnescapes in search and objectPut

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-01-27 10:25:11 +03:00
Denis Kirillov
4f5b316211 [#319] Fix tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-26 16:22:58 +03:00
Denis Kirillov
f761759f64 [#319] Update test results 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-26 16:22:58 +03:00
Denis Kirillov
8985681493 [#319] Delete null versions in different modes 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-26 16:22:58 +03:00
Denis Kirillov
f5d365af1d [#319] Update CRDT headers 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-26 16:22:58 +03:00
Denis Kirillov
58df410111 [#319] Head and delete null versions 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-26 16:22:58 +03:00
Denis Kirillov
a46726a545 [#331] Use UTC Last-Modified time 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-01-26 16:04:14 +03:00