TrueCloudLab
/
frostfs-s3-gw
15
2
Fork 14
Code Issues 20 Pull Requests 5 Actions Packages Releases 6 Activity
1,043 Commits
4 Branches
23 Tags
17 MiB
Commit Graph

1043 Commits (v0.27.0-rc.2)

Author SHA1 Message Date
Denis Kirillov b9baebbed7 [#74] tree: Simplify retry 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-21 12:02:42 +03:00
Denis Kirillov 0c1e17dca4 [#74] Add round tree retry 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-21 12:02:42 +03:00
Denis Kirillov 18c7d669e0 [#74] Update docs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-21 12:02:42 +03:00
Denis Kirillov cab758d8ce [#74] service/tree: Add logger 
Log error instead of failing when multiple unversioned nodes are found

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-21 12:02:42 +03:00
Denis Kirillov b60afd88c4 [#74] Support multiple tree endpoints 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-21 12:02:42 +03:00
Denis Kirillov 5d4304e204 [#83] Don't create extra delete marker 
We shouldn't create delete marker if:
1. object doesn't exist at all
2. last version is already a delete marker

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-19 17:55:52 +03:00
Denis Kirillov 17b8905b24 [#91] Update values for health metric 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-18 10:25:47 +03:00
Artem Tataurov a5c89b78bc [#79] Return X-Owner-Id in head-bucket response 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-04-17 10:12:25 +03:00
Artem Tataurov fb99b26209 [#57] api: Clean up List and Name caches when object is missing in Tree service 2023-04-04 17:15:04 +03:00
Denis Kirillov 01afa1cae4 [#75] Make grpc tree client implementation internal 
Since we have pkg 'internal/frostfs/services/tree' that is downloading
during build we cannot export any package that is depended on it.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-04-03 14:04:35 +03:00
Denis Kirillov 6c68e21777 [#69] Update SDK to fix handle request canceling 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-30 15:56:57 +03:00
Denis Kirillov a025f2e9c5 [#59] tree: Make interface for tree service client 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-29 09:34:10 +03:00
Denis Kirillov bd3164c57f [#68] Fix pre-commit issues 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-24 16:22:06 +03:00
Alexey Vanin fb90c0f52c [#65] Enable pre-commit 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-24 07:28:04 +00:00
Elizaveta Chichindaeva f2f90e260e [#66] Add Issue Template 
Add bug report and feature request templates

Signed-off-by: Liza <e.chichindaeva@yadro.com>
 2023-03-23 12:25:16 +03:00
Denis Kirillov a0937126cb [#64] Support new system attributes 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-22 11:46:58 +03:00
Alexey Vanin 655889a1a2 [#60] Update docs 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-22 11:22:11 +03:00
Alexey Vanin ef556bd8ac [#60] Use session token to set eACL during Complete Multipart Upload 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-22 11:22:11 +03:00
Alexey Vanin 5104683f68 [#60] Refactor start of periodic XML writer 
Reduce code duplication for error handling

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-22 11:02:16 +03:00
Alexey Vanin 8151753eeb [#60] Use periodic white space XML writer in Complete Multipart Upload 
This mechanism is used by Amazon S3 to keep client's
connection alive while object is being constructed from
the upload parts.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-20 13:34:22 +03:00
Alexey Vanin 2282c32822 [#60] Add *NoHeader functions 
Such functions should be used together with periodic white space
XML writer.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-20 12:07:36 +03:00
Alexey Vanin 43685e03d9 [#60] Implement flusher on all http.ResponseWriters 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-20 12:04:34 +03:00
Alexey Vanin cf18158da4 [#60] Implement periodic white space XML writer 
Periodic white space XML writer sends XML header
and white spaces to the io.Writer.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-20 12:04:34 +03:00
Denis Kirillov 5c62010331 [#35] Update SDK to not count error on client aborting 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-10 11:08:21 +03:00
Denis Kirillov 0af06c3bd9 [TrueCloudLab#40] Add param to configure xml decoder 
This parameter enables parsing xml body without
xmlns="http://s3.amazonaws.com/doc/2006-03-01/" attribute
for CompleteMultipartUpload requests

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-09 15:44:13 +03:00
Denis Kirillov 680c0dbe3d [#54] Update syncTree.sh due code relocation 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-09 14:59:32 +03:00
Denis Kirillov 596381c382 [TrueCloudLab#32] Update CHANGELOG.md 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-09 11:19:01 +00:00
Denis Kirillov 64e7356acc [TrueCloudLab#32] Add custom policy unmarshaler 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-09 11:19:01 +00:00
Denis Kirillov 32bf915502 [TrueCloudLab#37] Limit number of objects to delete 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-03-09 11:16:22 +00:00
Alexey Vanin 813aa2f173 Rename package name 
Due to source code relocation from GitHub.

Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-03-07 17:38:08 +03:00
Denis Kirillov 6eb7966800 [TrueCloudLab#34] Fix `resolve_bucket` format in docs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-20 19:23:11 +03:00
Denis Kirillov 2dcb3c283d [TrueCloudLab#36] Update CHANGELOG.md 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-20 19:22:48 +03:00
Denis Kirillov 740acadd37 [TrueCloudLab#36] Fix cors object payload 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-20 19:22:48 +03:00
Alexey Vanin 3ab77c8990 [TrueCloudLab#25] Update changelog 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-02-17 13:47:48 +03:00
Alexey Vanin d00163aadc [TrueCloudLab#25] Update docs and config example 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-02-17 13:47:48 +03:00
Alexey Vanin aadefd98b6 [TrueCloudLab#25] Process allow and deny lists of zones in bucket head requests 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-02-17 13:47:48 +03:00
Alexey Vanin 8ac630ee71 [TrueCloudLab#25] Add zone data to BucketInfo 
Signed-off-by: Alex Vanin <a.vanin@yadro.com>
 2023-02-17 13:47:48 +03:00
Aleksey Pastukhov 744b52322d [TrueCloudLab#28] Add generated deb builder files to gitignore, and fix typo 
Signed-off-by: Aleksey Pastukhov <a.pastukhov@yadro.com>
 2023-02-15 10:25:46 +03:00
Denis Kirillov 8d9d1f9235 [TrueCloudLab#29] Update billing metric label name 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-13 16:40:43 +03:00
Denis Kirillov 787d1a347a [TrueCloudLab#26] Update docs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-10 10:55:38 +03:00
Denis Kirillov 9f823bd65a [TrueCloudLab#26] Add billing metrics to separate registry 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-10 10:55:38 +03:00
Denis Kirillov 9dcacc230e [TrueCloudLab#23] Return error on unknown LocationConstraint 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-08 15:04:12 +03:00
Denis Kirillov 430f1e734f [TrueCloudLab#21] Update CHANGELOG.md 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-07 12:26:40 +03:00
Denis Kirillov 1ce8b8a30d [TrueCloudLab#21] Support multiple configs 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-07 12:26:40 +03:00
Denis Kirillov b35f146cec [TrueCloudLab#20] Renew tokens beforehand 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-02-03 16:59:49 +03:00
Artem Tataurov 5ee4bf80ae [#18] Return container name in head-bucket response 
Signed-off-by: Artem Tataurov <a.tataurov@yadro.com>
 2023-02-01 14:25:21 +03:00
Denis Kirillov f9f52ce8e0 [TrueCloudLab#5] Update CHANGELOG.md 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-01-25 11:02:23 +03:00
Denis Kirillov e278ab9362 [TrueCloudLab#5] Refactor middlewares 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-01-25 11:02:23 +03:00
Denis Kirillov c5570e661d [TrueCloudLab#5] Add traffic metrics per user 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-01-25 11:02:23 +03:00
Denis Kirillov fc5c09c084 [TrueCloudLab#5] Request metrics per user 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2023-01-25 11:02:23 +03:00