TrueCloudLab/frostfs-http-gw
16
1
Fork 17
Code Issues 9 Pull requests 2 Projects Releases 9 Activity Actions
522 commits 6 branches 24 tags 3.8 MiB
Commit graph

117 commits

Author SHA1 Message Date
Denis Kirillov
2b780c1772 [#142] Update SDK 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-28 17:18:13 +03:00
Alex Vanin
2884abafd0 [#143] Update go to v1.17 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-21 13:33:06 +03:00
Alex Vanin
54151992ab [#143] Update testcontainers-go to v0.13.0 
This fixes vulnerabilities in indirect dependencies:
 - docker/distribution (CWE-843)
 - opencontainers/runc (CWE-190)
 - opencontainers/image-spec (CWE-843)

Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2022-04-21 13:33:06 +03:00
Denis Kirillov
5080b43a04 [#139] Update SDK 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-04-08 00:23:12 +04:00
Denis Kirillov
d891c13cb3 [#137] Drop sdk logger 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-29 10:15:59 +03:00
Denis Kirillov
6d362894ad [#132] Update NeoFS SDK to v1.0.0-rc.3 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-16 17:15:21 +03:00
Denis Kirillov
c4521300ac [#129] Update fasthttp to v1.34.0 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2022-03-11 13:56:49 +03:00
Leonard Lyubich
03985f2eda [#126] Upgrade NeoFS SDK Go to 2nd release candidate v1.0.0 
Avoid using the deprecated elements.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 18:25:53 +03:00
Leonard Lyubich
c482bbd25a [#126] downloader: Replace Read with Iterate on ObjectListReader 
Make `Downloader.DownloadZipped` to call `Iterate` method instead of
`Read` one during processing the `ObjectListReader`.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 18:25:53 +03:00
Leonard Lyubich
2b7e4a36fb [#126] Upgrade NeoFS SDK Go library 
Core changes:
  - `object.ID` moved to new package `oid`;
  - `object.Address` moved to new package `address`;
  - `pool.Object` interface changes.

Signed-off-by: Leonard Lyubich <leonard@nspcc.ru>
 2022-03-03 18:25:53 +03:00
Denis Kirillov
71e846a4fc [#115] Update sdk version to support priority 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-12-10 10:59:43 +03:00
Denis Kirillov
79501077ff [#100] Update testcontainers version to 0.12.0 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-12-01 16:53:01 +03:00
Denis Kirillov
cd0633cda0 [#108] Add different expiration header formats 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-11-29 15:42:32 +03:00
Alex Vanin
c55c4a3557 [#106] Update neo-go to the latest version 
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-11-15 14:46:50 +03:00
Alex Vanin
79765fb7cc [#106] Update neofs-sdk-go to the latest version 
Includes:
 - fix for unavailable endpoints of client pool,
 - session token cache with request retry in case
   of missing session token,
 - migrated neofs client.
Signed-off-by: Alex Vanin <alexey@nspcc.ru>
 2021-11-15 14:46:50 +03:00
Denis Kirillov
0b364504a7 [#92] Support zip download 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-10-22 18:36:09 +03:00
Denis Kirillov
d2b0532929 [#85] Add integration tests 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-09-07 13:14:46 +03:00
Denis Kirillov
eb6d46fe51 [#82] Update sdk-go 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-07-28 13:07:08 +03:00
Angira Kekteeva
67ea967ec8 Update dependencies versions 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-07-24 11:46:57 +03:00
Denis Kirillov
5eed0fd22d [#67] Added streaming to download 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-06-24 13:06:13 +03:00
Denis Kirillov
2d41fbc95e [#68] Support NEP-6 wallets 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-06-23 14:53:04 +03:00
Denis Kirillov
fffb0b2f12 [#63] Using client.Object from sdk 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-06-15 11:28:30 +03:00
Denis Kirillov
7734be609c [#60] Dropped grpc keepalive options 
Signed-off-by: Denis Kirillov <denis@nspcc.ru>
 2021-06-10 18:48:55 +03:00
Angira Kekteeva
124a30eec7 [#57] go.mod: Update api-go and sdk-go versions 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-06-04 15:55:02 +03:00
Roman Khimov
e8b94553c3 *: update to use unneofsed sdk-go 
Signed-off-by: Roman Khimov <roman@nspcc.ru>
 2021-05-31 23:07:01 +03:00
Angira Kekteeva
82b2126bfd [#46] *: Remove moved to sdk packages, refactoring 
Removed connections, logger, neofs because they were moved to sdk repo.
Made changes in downloader, uploader, main.go and app.go via
refactoring of neofs.
Replaced dependencies to removed packages by sdk packages.

Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-05-28 14:45:46 +03:00
masterSplinter01
8e76ec6a45
Merge pull request #45 from roman-khimov/bump-api-go 
[#44] go.mod: update neofs-api-go to 1.26.1
 2021-05-24 15:10:44 +03:00
Roman Khimov
51ede419af [#44] go.mod: update neofs-api-go to 1.26.1 
Fix compatibility with the latest NeoFS nodes (0.20.0). Fixes #44.

Signed-off-by: Roman Khimov <roman@nspcc.ru>
 2021-05-24 14:45:00 +03:00
Angira Kekteeva
33b1a28bf1 Replace http-gate by http-gw in files 
Signed-off-by: Angira Kekteeva <kira@nspcc.ru>
 2021-05-18 15:14:36 +03:00
Roman Khimov
685c229a97 go.mod: update neofs-api-go to 1.26.0 
Fix #39.

Signed-off-by: Roman Khimov <roman@nspcc.ru>
 2021-05-13 19:26:29 +03:00
Roman Khimov
afbb9d51f1 *: drop github.com/pkg/errors dependency 
Use standard error wrapping/unwrapping instead. The conversion is mostly
straightforward, but see grpc/grpc-go#2934 for GRPC `status.FromError`, it
doesn't currently support unwrapping/errors.As(), so we're unwrapping manually
here.
 2021-04-30 14:31:14 +03:00
Roman Khimov
88e0963240 go.mod: temporarily use nspcc-dev fork of valyala/fasthttp 
We need proper chunk processing.
 2021-04-30 14:31:14 +03:00
Roman Khimov
464a0134bd neofs: drop PrepareObjectOnsite option 
It's using NeoFS node internal packages which shouldn't ever be used in gate
code, it's not adding any value to the code we have (standard api-go
interfaces work fine).
 2021-04-30 14:31:14 +03:00
Pavel Korotkov
4c96885a42 [#19] Add a version with no cdn-sdk deps 
Signed-off-by: Pavel Korotkov <pavel@nspcc.ru>
 2021-04-06 12:19:21 +03:00
Pavel Korotkov
237c247ec4 [#13] Add bearer token usage in receive/upload methods 2021-02-16 16:22:25 +01:00
Evgeniy Kulikov
d09a1643e1
Update dependencies 
- update dependencies
  - github.com/nspcc-dev/cdn-sdk v0.3.4
  - github.com/nspcc-dev/neofs-api-go v1.23.0
  - github.com/valyala/fasthttp v1.20.0

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2021-02-12 12:19:43 +03:00
Evgeniy Kulikov
c2c225988d
Update NeoFS API an SDK for HTTP GW 
- github.com/nspcc-dev/cdn-sdk v0.3.3
- github.com/nspcc-dev/neofs-api-go v1.22.2

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2021-02-01 17:31:50 +03:00
Evgeniy Kulikov
b6d94ec9a5
Fixes around get_by_attribute 
Before, `attr_val` ignores attribute values that contains slashes in it value, now it's fixed.

Update to v0.3.2 with fixing status of connection pool.

Added debug log message when object not found, for debug reasons.

Update .test.env variables prefix, it was changed in one of previous releases.

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2021-01-23 16:28:12 +03:00
Evgeniy Kulikov
52812f7869
Release v0.14.1 with CDN SDK v0.3.1 and NeoFS API Go v1.22.1 2021-01-18 10:08:44 +03:00
Evgeniy Kulikov
c30b264beb
Migrate to SDK 0.3.0 
- update dependencies
  - github.com/fasthttp/router v1.3.5
  - github.com/nspcc-dev/cdn-sdk v0.3.0
  - github.com/nspcc-dev/neofs-api-go v1.22.0
  - github.com/prometheus/client_golang v1.9.0
  - github.com/valyala/fasthttp v1.19.0
  - google.golang.org/grpc v1.35.0

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2021-01-14 13:31:40 +03:00
Evgeniy Kulikov
ac8affff91
Migrate to new release SDK 2020-12-23 14:21:34 +03:00
Evgeniy Kulikov
a18e4200b0
Cleanup dependencies 
Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-12-02 12:25:18 +03:00
Evgeniy Kulikov
01f13ef210
Prepare to release 
- set output for flag set
- change env prefix for all environments
- migrate to CDN SDK release v0.1.0

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-12-02 12:25:18 +03:00
Evgeniy Kulikov
f75eb4b803
Update dependencies 
Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-11-27 16:38:58 +03:00
Evgeniy Kulikov
a4f7a2f962
Migrate to new release of NeoFS API 
- migrate to new release NeoFS API / CDN SDK
- add `Last-Modified` header

Signed-off-by: Evgeniy Kulikov <kim@nspcc.ru>
 2020-11-23 12:32:03 +03:00
Evgeniy Kulikov
f14e2b695e
Fixed NPE in CDN SDK 2020-11-13 21:01:10 +03:00
Evgeniy Kulikov
6226729e38
Migrate to CDN SDK 2020-11-10 14:46:28 +03:00
Evgeniy Kulikov
f2352f1e76
change module name 2020-08-21 02:50:14 +03:00
Evgeniy Kulikov
a9f4ee535a
Update dependencies 
- github.com/fasthttp/router v1.1.6
- github.com/nspcc-dev/neofs-api-go v1.0.0
- github.com/prometheus/client_golang v1.6.0
- github.com/prometheus/common v0.10.0
- github.com/spf13/viper v1.7.0
- github.com/valyala/fasthttp v1.14.0
- go.uber.org/zap v1.15.0
- google.golang.org/grpc v1.29.1
 2020-06-03 06:30:36 +03:00
Evgeniy Kulikov
12a3801f3d
errors: correct handling 404 2020-04-22 13:34:48 +03:00
Evgeniy Kulikov
96e24653f7
modules: update to neofs-api 0.7.1 2020-04-22 13:16:58 +03:00
Evgeniy Kulikov
ea4710eaba
update to new router 2020-04-15 11:10:42 +03:00
Evgeniy Kulikov
164b0870de
refactoring + moved to neofs-api-go 2020-03-31 11:37:10 +03:00
Evgeniy Kulikov
6abd79aa44
Update dependencies 
- github.com/nspcc-dev/neofs-api v0.4.1 // v0.4.0 => v0.4.1
- github.com/nspcc-dev/neofs-crypto v0.3.0 // v0.2.3 => v0.3.0
- github.com/prometheus/client_golang v1.5.0 // v1.4.1 => v1.5.0
 2020-03-10 14:13:01 +03:00
Evgeniy Kulikov
b8dc1097fb
update dependencies 2020-02-28 19:43:25 +03:00
Evgeniy Kulikov
2590784e3a
add replacements for debug 2020-02-25 18:41:19 +03:00
Evgeniy Kulikov
5512bd0b2f
debugging neofs-api 2020-02-20 17:36:44 +03:00
Evgeniy Kulikov
c3a23e9115
debugging gRPC 2020-02-20 17:26:37 +03:00
Evgeniy Kulikov
f86115bf6e
go.sum go.uber.org/atomic v1.5.0 2020-02-19 15:48:53 +03:00
Evgeniy Kulikov
f14401c0c0
Update dependencies 
- github.com/labstack/echo/v4 `v4.1.11 => v4.1.14`
- github.com/nspcc-dev/neofs-api `v0.2.14 => v0.3.1`
- github.com/pkg/errors `v0.8.1 => v0.9.1`
- github.com/prometheus/client_golang `v1.2.1 => v1.4.1`
- github.com/spf13/viper `v1.6.1 => v1.6.2`
- google.golang.org/grpc `v1.25.1 => v1.27.1`
 2020-02-07 18:04:02 +03:00
Evgeniy Kulikov
461a4acea0
Update to NeoFS API v0.2.14 2020-02-04 14:00:06 +03:00
Evgeniy Kulikov
590444459d
Migrate to NeoFS API 2020-02-04 13:35:25 +03:00
alexvanin
d807ede7c7 dep: Update neofs-proto to v0.2.11 
Object get and head requests have new `raw` field now.
 2020-01-22 17:24:15 +03:00
Evgeniy Kulikov
746946290c
NSPCC-762 Connection pool 
- implement connection pool
- wait until container creates
- refactoring gw service
- add config option to enable prometheus and pprof
- update neofs-proto to v0.2.8
 2019-12-21 13:26:14 +03:00
Evgeniy Kulikov
97d1a99f58
NSPCC-493 Separate repository for NeoFS GW 
- Update dependencies
- Update README (configuration: flags section)
- Add gRPC logger and flag to enable gRPC connection debugging
- Refactored settings (add flags, use defaults instead of yaml representation)
 2019-12-13 19:09:14 +03:00
Evgeniy Kulikov
3f8e696433
update proto / crypto / makefile 2019-11-18 19:59:59 +03:00
Evgeniy Kulikov
b4ac08d341
initial 2019-11-06 15:33:46 +03:00