Commit graph

394 commits

Author SHA1 Message Date
Alex Vanin
1e3df95eed [#145] Use application context in NeoFS API requests
It is meaningless to use RequestCtx as a context.Context
for NeoFS operation, because context won't be closed
until application shutdown. Moreover, it also triggers
data race detection, because server's done channel, which
is accessible for reading from RequestCtx, is set to `nil`.

Using application context doesn't change gateway behavior,
but it suppresses data race trigger at shutdown. It also
allows possibility to set configurable timeouts for NeoFS
networking if we will ever need them.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2022-04-22 15:33:11 +04:00
Alex Vanin
d906732ef4 [#146] Update default values for HTTP_GW_READ/WRITE_TIMEOUT
10 minute upload and 5 minute download timeouts are long enough
to handle average size objects in the real networks. For big
data streams these timeouts should be disabled.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2022-04-22 15:21:42 +04:00
Denis Kirillov
4f2b21a14b [#144] Add more verbose error output
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-04-22 15:14:52 +04:00
Alex Vanin
2884abafd0 [#143] Update go to v1.17
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2022-04-21 13:33:06 +03:00
Alex Vanin
54151992ab [#143] Update testcontainers-go to v0.13.0
This fixes vulnerabilities in indirect dependencies:
 - docker/distribution (CWE-843)
 - opencontainers/runc (CWE-190)
 - opencontainers/image-spec (CWE-843)

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2022-04-21 13:33:06 +03:00
Denis Kirillov
0b57b7add3 [#147] Update README
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-04-19 20:10:00 +04:00
Denis Kirillov
1c2fec8182 [#147] Download zip by FilePath attribute
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-04-19 20:10:00 +04:00
Denis Kirillov
48ce84e65f [#140] Fix typos
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-04-15 03:26:02 +04:00
Denis Kirillov
eacd7be33e [#140] Improve docs
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-04-15 03:26:02 +04:00
Denis Kirillov
baf425453d [#139] fix lint
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-04-08 00:23:12 +04:00
Denis Kirillov
5080b43a04 [#139] Update SDK
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-04-08 00:23:12 +04:00
Denis Kirillov
9475786df8 [#137] Refactor unused metrics code
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-03-29 10:15:59 +03:00
Denis Kirillov
d891c13cb3 [#137] Drop sdk logger
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-03-29 10:15:59 +03:00
Alex Vanin
d1bdef6f83 [#133] Replace go get with go install
Since Go 1.16, go install can install a command at a version
specified on the command line while. Starting in Go 1.17,
installing executables with go get is deprecated.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2022-03-21 16:36:26 +03:00
Denis Kirillov
f572aeb6da Release v0.19.0
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-03-16 17:15:21 +03:00
Denis Kirillov
6d362894ad [#132] Update NeoFS SDK to v1.0.0-rc.3
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-03-16 17:15:21 +03:00
Denis Kirillov
acd8bbb34b [#129] Fix race condition tests
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-03-11 13:56:49 +03:00
Denis Kirillov
c4521300ac [#129] Update fasthttp to v1.34.0
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-03-11 13:56:49 +03:00
Leonard Lyubich
f6ab94027c [#128] downloader: Avoid var naming collision
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
2022-03-04 13:43:34 +03:00
Leonard Lyubich
271451dc32 [#128] downloader: Simplify detecting the Content-Type from payload
Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
2022-03-04 13:43:34 +03:00
Alex Vanin
f55edbb613 [#130] Remove race condition check in integration test
Race condition checks are suitable for unit tests
but mostly useless in case of full-size integration
test with neofs-all-in-one test container.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2022-03-04 13:41:42 +03:00
Leonard Lyubich
03985f2eda [#126] Upgrade NeoFS SDK Go to 2nd release candidate v1.0.0
Avoid using the deprecated elements.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
2022-03-03 18:25:53 +03:00
Leonard Lyubich
c482bbd25a [#126] downloader: Replace Read with Iterate on ObjectListReader
Make `Downloader.DownloadZipped` to call `Iterate` method instead of
`Read` one during processing the `ObjectListReader`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
2022-03-03 18:25:53 +03:00
Leonard Lyubich
2b7e4a36fb [#126] Upgrade NeoFS SDK Go library
Core changes:
  - `object.ID` moved to new package `oid`;
  - `object.Address` moved to new package `address`;
  - `pool.Object` interface changes.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
2022-03-03 18:25:53 +03:00
Denis Kirillov
39c29c6d6a [#125] Set object ids in a separate function
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-02-15 12:21:42 +03:00
Denis Kirillov
2764fabf04 [#125] Use the same HEAD, GET headers formation
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2022-02-15 12:21:42 +03:00
Angira Kekteeva
9d085740e0 [#123] Add url-encoded queries for prefix values
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2022-01-27 16:51:11 +03:00
Angira Kekteeva
c11b2332f9 [#123] Add url-encoded queries for attributes
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2022-01-27 16:51:11 +03:00
Denis Kirillov
c21217bc62 [#120] Fix project name
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-12-27 16:36:09 +03:00
Angira Kekteeva
2110e924e9 Release v0.18.0
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2021-12-10 16:13:38 +03:00
Denis Kirillov
567f54d82d [#115] Fix tests
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-12-10 10:59:43 +03:00
Denis Kirillov
71e846a4fc [#115] Update sdk version to support priority
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-12-10 10:59:43 +03:00
Angira Kekteeva
1bb6c5f384 [#111] Fix X- headers
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2021-12-09 16:12:13 +03:00
Angira Kekteeva
d6dd244756 [#111] Fix expiration epoch headers
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2021-12-09 16:12:13 +03:00
Angira Kekteeva
dbbc9e05cf [#111] Move attributes to a separate file
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2021-12-09 16:12:13 +03:00
Denis Kirillov
79501077ff [#100] Update testcontainers version to 0.12.0
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-12-01 16:53:01 +03:00
Denis Kirillov
cd0633cda0 [#108] Add different expiration header formats
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-11-29 15:42:32 +03:00
Angira Kekteeva
06be798111 [#109] Add version to logs in start
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2021-11-29 13:56:36 +03:00
Alex Vanin
89e03f1280 Release v0.17.0
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2021-11-15 15:52:28 +03:00
Alex Vanin
c55c4a3557 [#106] Update neo-go to the latest version
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2021-11-15 14:46:50 +03:00
Alex Vanin
79765fb7cc [#106] Update neofs-sdk-go to the latest version
Includes:
 - fix for unavailable endpoints of client pool,
 - session token cache with request retry in case
   of missing session token,
 - migrated neofs client.
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2021-11-15 14:46:50 +03:00
Denis Kirillov
6265fcb26a [#105] Add newline to errors
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-11-12 15:32:18 +03:00
Alex Vanin
3ef46151d2 [#102] test: Set up pool with SessionExpiration value
neofs-node v0.26.1 release tracks session token expiration
more closely, so it has to be specified correctly.

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
2021-11-12 15:13:02 +03:00
Denis Kirillov
0d2621d346 [#94] Fix multiple testcontainer images
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-11-01 12:03:43 +03:00
Denis Kirillov
9b92c0146c [#96] Add zip compression
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-11-01 11:27:22 +03:00
Denis Kirillov
62dd8b1927 [#92] Use only the latest aio testcontainer
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-10-22 18:36:09 +03:00
Denis Kirillov
0b364504a7 [#92] Support zip download
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-10-22 18:36:09 +03:00
Angira Kekteeva
0e2861152d [#91] Replace golint by revive
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
2021-10-04 12:38:17 +03:00
Denis Kirillov
0597c0c143 [#87] Allow canonical X-Attribute-Neofs-* headers
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-09-13 13:15:26 +03:00
Denis Kirillov
d2b0532929 [#85] Add integration tests
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
2021-09-07 13:14:46 +03:00