ironbee/frostfs-http-gw
1
0
Fork 0
forked from TrueCloudLab/frostfs-http-gw
Code Issues Pull requests Projects Releases Packages Wiki Activity
394 commits 2 branches 0 tags 926 KiB
Commit graph

394 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alex Vanin
1e3df95eed [#145] Use application context in NeoFS API requests 
It is meaningless to use RequestCtx as a context.Context
for NeoFS operation, because context won't be closed
until application shutdown. Moreover, it also triggers
data race detection, because server's done channel, which
is accessible for reading from RequestCtx, is set to `nil`.

Using application context doesn't change gateway behavior,
but it suppresses data race trigger at shutdown. It also
allows possibility to set configurable timeouts for NeoFS
networking if we will ever need them.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-22 15:33:11 +04:00
Alex Vanin
d906732ef4 [#146] Update default values for HTTP_GW_READ/WRITE_TIMEOUT 
10 minute upload and 5 minute download timeouts are long enough
to handle average size objects in the real networks. For big
data streams these timeouts should be disabled.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-22 15:21:42 +04:00
Denis Kirillov
4f2b21a14b [#144] Add more verbose error output 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-22 15:14:52 +04:00
Alex Vanin
2884abafd0 [#143] Update go to v1.17 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-21 13:33:06 +03:00
Alex Vanin
54151992ab [#143] Update testcontainers-go to v0.13.0 
This fixes vulnerabilities in indirect dependencies:
 - docker/distribution (CWE-843)
 - opencontainers/runc (CWE-190)
 - opencontainers/image-spec (CWE-843)

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-21 13:33:06 +03:00
Denis Kirillov
0b57b7add3 [#147] Update README 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-19 20:10:00 +04:00
Denis Kirillov
1c2fec8182 [#147] Download zip by FilePath attribute 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-19 20:10:00 +04:00
Denis Kirillov
48ce84e65f [#140] Fix typos 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-15 03:26:02 +04:00
Denis Kirillov
eacd7be33e [#140] Improve docs 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-15 03:26:02 +04:00
Denis Kirillov
baf425453d [#139] fix lint 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-08 00:23:12 +04:00
Denis Kirillov
5080b43a04 [#139] Update SDK 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-08 00:23:12 +04:00
Denis Kirillov
9475786df8 [#137] Refactor unused metrics code 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-29 10:15:59 +03:00
Denis Kirillov
d891c13cb3 [#137] Drop sdk logger 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-29 10:15:59 +03:00
Alex Vanin
d1bdef6f83 [#133] Replace go get with go install 
Since Go 1.16, go install can install a command at a version
specified on the command line while. Starting in Go 1.17,
installing executables with go get is deprecated.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-21 16:36:26 +03:00
Denis Kirillov
f572aeb6da Release v0.19.0 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-16 17:15:21 +03:00
Denis Kirillov
6d362894ad [#132] Update NeoFS SDK to v1.0.0-rc.3 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-16 17:15:21 +03:00
Denis Kirillov
acd8bbb34b [#129] Fix race condition tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-11 13:56:49 +03:00
Denis Kirillov
c4521300ac [#129] Update fasthttp to v1.34.0 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-11 13:56:49 +03:00
Leonard Lyubich
f6ab94027c [#128] downloader: Avoid var naming collision 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 13:43:34 +03:00
Leonard Lyubich
271451dc32 [#128] downloader: Simplify detecting the Content-Type from payload 
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-04 13:43:34 +03:00
Alex Vanin
f55edbb613 [#130] Remove race condition check in integration test 
Race condition checks are suitable for unit tests
but mostly useless in case of full-size integration
test with neofs-all-in-one test container.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-03-04 13:41:42 +03:00
Leonard Lyubich
03985f2eda [#126] Upgrade NeoFS SDK Go to 2nd release candidate v1.0.0 
Avoid using the deprecated elements.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 18:25:53 +03:00
Leonard Lyubich
c482bbd25a [#126] downloader: Replace Read with Iterate on ObjectListReader 
Make `Downloader.DownloadZipped` to call `Iterate` method instead of
`Read` one during processing the `ObjectListReader`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 18:25:53 +03:00
Leonard Lyubich
2b7e4a36fb [#126] Upgrade NeoFS SDK Go library 
Core changes:
  - `object.ID` moved to new package `oid`;
  - `object.Address` moved to new package `address`;
  - `pool.Object` interface changes.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 18:25:53 +03:00
Denis Kirillov
39c29c6d6a [#125] Set object ids in a separate function 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-02-15 12:21:42 +03:00
Denis Kirillov
2764fabf04 [#125] Use the same HEAD, GET headers formation 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-02-15 12:21:42 +03:00
Angira Kekteeva
9d085740e0 [#123] Add url-encoded queries for prefix values 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-01-27 16:51:11 +03:00
Angira Kekteeva
c11b2332f9 [#123] Add url-encoded queries for attributes 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2022-01-27 16:51:11 +03:00
Denis Kirillov
c21217bc62 [#120] Fix project name 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-12-27 16:36:09 +03:00
Angira Kekteeva
2110e924e9 Release v0.18.0 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-12-10 16:13:38 +03:00
Denis Kirillov
567f54d82d [#115] Fix tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-12-10 10:59:43 +03:00
Denis Kirillov
71e846a4fc [#115] Update sdk version to support priority 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-12-10 10:59:43 +03:00
Angira Kekteeva
1bb6c5f384 [#111] Fix X- headers 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-12-09 16:12:13 +03:00
Angira Kekteeva
d6dd244756 [#111] Fix expiration epoch headers 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-12-09 16:12:13 +03:00
Angira Kekteeva
dbbc9e05cf [#111] Move attributes to a separate file 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-12-09 16:12:13 +03:00
Denis Kirillov
79501077ff [#100] Update testcontainers version to 0.12.0 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-12-01 16:53:01 +03:00
Denis Kirillov
cd0633cda0 [#108] Add different expiration header formats 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-11-29 15:42:32 +03:00
Angira Kekteeva
06be798111 [#109] Add version to logs in start 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-11-29 13:56:36 +03:00
Alex Vanin
89e03f1280 Release v0.17.0 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-11-15 15:52:28 +03:00
Alex Vanin
c55c4a3557 [#106] Update neo-go to the latest version 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-11-15 14:46:50 +03:00
Alex Vanin
79765fb7cc [#106] Update neofs-sdk-go to the latest version 
Includes:
 - fix for unavailable endpoints of client pool,
 - session token cache with request retry in case
   of missing session token,
 - migrated neofs client.
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-11-15 14:46:50 +03:00
Denis Kirillov
6265fcb26a [#105] Add newline to errors 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-11-12 15:32:18 +03:00
Alex Vanin
3ef46151d2 [#102] test: Set up pool with SessionExpiration value 
neofs-node v0.26.1 release tracks session token expiration
more closely, so it has to be specified correctly.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-11-12 15:13:02 +03:00
Denis Kirillov
0d2621d346 [#94] Fix multiple testcontainer images 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-11-01 12:03:43 +03:00
Denis Kirillov
9b92c0146c [#96] Add zip compression 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-11-01 11:27:22 +03:00
Denis Kirillov
62dd8b1927 [#92] Use only the latest aio testcontainer 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-10-22 18:36:09 +03:00
Denis Kirillov
0b364504a7 [#92] Support zip download 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-10-22 18:36:09 +03:00
Angira Kekteeva
0e2861152d [#91] Replace golint by revive 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-10-04 12:38:17 +03:00
Denis Kirillov
0597c0c143 [#87] Allow canonical X-Attribute-Neofs-* headers 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-09-13 13:15:26 +03:00
Denis Kirillov
d2b0532929 [#85] Add integration tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-09-07 13:14:46 +03:00