TrueCloudLab/frostfs-s3-lifecycler
12
0
Fork 4
Code Issues 1 Pull requests 1 Projects Releases 1 Packages Wiki Activity Actions
29 commits 1 branch 3 tags 486 KiB
Commit graph

29 commits

This branch
This branch
All branches
Author SHA1 Message Date
Denis Kirillov
52c2ec525c [#20] Fix go.sum
All checks were successful
/ DCO (pull_request) Successful in 42s
Details
/ Vulncheck (pull_request) Successful in 1m18s
Details
/ Builds (pull_request) Successful in 57s
Details
/ Lint (pull_request) Successful in 2m27s
Details
/ Tests (pull_request) Successful in 1m6s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-09-23 18:53:32 +03:00
Denis Kirillov
2f7a73ee36 [#20] Support logging with tags
Some checks failed
/ DCO (pull_request) Successful in 48s
Details
/ Vulncheck (pull_request) Successful in 1m17s
Details
/ Builds (pull_request) Failing after 1m5s
Details
/ Lint (pull_request) Successful in 2m32s
Details
/ Tests (pull_request) Successful in 1m7s
Details 
Allow to log additionally "tagged" log entries.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-09-23 17:39:09 +03:00
Denis Kirillov
4f250eba42 [#20] Add logs for processing container and deleting objects 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-09-23 17:20:51 +03:00
Denis Kirillov
5ffed0b96f [#20] Add log sampling configuration 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-09-23 16:27:27 +03:00
Denis Kirillov
fce631be59 [#19] fetcher: Don't user btoken for separate lifecycle container
All checks were successful
/ DCO (pull_request) Successful in 1m26s
Details
/ Builds (1.22) (pull_request) Successful in 1m26s
Details
/ Builds (1.23) (pull_request) Successful in 1m31s
Details
/ Vulncheck (pull_request) Successful in 1m47s
Details
/ Lint (pull_request) Successful in 2m31s
Details
/ Tests (1.22) (pull_request) Successful in 1m49s
Details
/ Tests (1.23) (pull_request) Successful in 1m46s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-09-03 15:32:42 +03:00
Nikita Zinkevich
a3089bc89e [#18] Update Go version
All checks were successful
/ DCO (pull_request) Successful in 1m17s
Details
/ Builds (1.22) (pull_request) Successful in 1m24s
Details
/ Builds (1.23) (pull_request) Successful in 1m26s
Details
/ Vulncheck (pull_request) Successful in 1m24s
Details
/ Lint (pull_request) Successful in 2m56s
Details
/ Tests (1.22) (pull_request) Successful in 1m36s
Details
/ Tests (1.23) (pull_request) Successful in 1m35s
Details 
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
 2024-08-29 08:36:11 +03:00
Denis Kirillov
17717ac42e [#17] go.mod: Update s3-gw to eliminate redundant logs
All checks were successful
/ DCO (pull_request) Successful in 1m15s
Details
/ Vulncheck (pull_request) Successful in 1m18s
Details
/ Builds (1.21) (pull_request) Successful in 1m35s
Details
/ Builds (1.22) (pull_request) Successful in 1m30s
Details
/ Lint (pull_request) Successful in 2m48s
Details
/ Tests (1.21) (pull_request) Successful in 1m32s
Details
/ Tests (1.22) (pull_request) Successful in 1m30s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-05 12:03:03 +03:00
Denis Kirillov
0e58ccbed7 [#17] executor: Don't create unnecessary delete markers 
Separate regular expiration from non-current versions removing

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-08-05 12:02:52 +03:00
Denis Kirillov
b3677cefbb [#16] frostfsid: Fix client invocation
All checks were successful
/ DCO (pull_request) Successful in 50s
Details
/ Vulncheck (pull_request) Successful in 1m4s
Details
/ Builds (1.21) (pull_request) Successful in 1m11s
Details
/ Builds (1.22) (pull_request) Successful in 1m9s
Details
/ Lint (pull_request) Successful in 2m7s
Details
/ Tests (1.21) (pull_request) Successful in 1m16s
Details
/ Tests (1.22) (pull_request) Successful in 1m14s
Details 
Previously we cannot switch to new client after connection was lost

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-31 14:19:02 +03:00
Denis Kirillov
aaa652de67 [#16] executor: Fix object expiration condition 
Wrong comparison operators (and values) were used.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-31 14:18:54 +03:00
Denis Kirillov
c9011f6da2 [#16] executor: Fix multipart expiration condition 
Wrong comparison operator was used.

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-31 12:03:04 +03:00
Denis Kirillov
ba26d975e0 [#16] fetcher: Remove bearer APE condition 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-31 12:01:56 +03:00
Denis Kirillov
04c5b65ad5 [#16] Allow to configure several sources
All checks were successful
/ DCO (pull_request) Successful in 54s
Details
/ Vulncheck (pull_request) Successful in 1m1s
Details
/ Builds (1.21) (pull_request) Successful in 1m22s
Details
/ Builds (1.22) (pull_request) Successful in 1m3s
Details
/ Lint (pull_request) Successful in 2m8s
Details
/ Tests (1.21) (pull_request) Successful in 1m31s
Details
/ Tests (1.22) (pull_request) Successful in 1m13s
Details 
Allow to explicitly specify which credential source use

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-31 11:56:54 +03:00
Denis Kirillov
b3374bb565 [#4] Fix applying disabled multipart rules
All checks were successful
/ DCO (pull_request) Successful in 2m8s
Details
/ Builds (1.21) (pull_request) Successful in 1m2s
Details
/ Builds (1.22) (pull_request) Successful in 1m8s
Details
/ Vulncheck (pull_request) Successful in 55s
Details
/ Lint (pull_request) Successful in 1m47s
Details
/ Tests (1.21) (pull_request) Successful in 1m5s
Details
/ Tests (1.22) (pull_request) Successful in 1m26s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 16:46:49 +03:00
Denis Kirillov
c4f259e68b [#3] Clean old jobs from fetcher jobs channel buffer 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 16:38:34 +03:00
Denis Kirillov
2613504b94 [#4] Don't check tags for multiparts 
Spec https://docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-configuration-examples.html#lc-expire-mpu
says: "When you use the AbortIncompleteMultipartUpload S3
 Lifecycle action, the rule cannot specify a tag-based filter."

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 16:38:30 +03:00
Denis Kirillov
15c9d55b03 [#4] Add more tests
All checks were successful
/ DCO (pull_request) Successful in 42s
Details
/ Vulncheck (pull_request) Successful in 1m19s
Details
/ Builds (1.21) (pull_request) Successful in 1m34s
Details
/ Builds (1.22) (pull_request) Successful in 1m32s
Details
/ Lint (pull_request) Successful in 2m3s
Details
/ Tests (1.21) (pull_request) Successful in 1m28s
Details
/ Tests (1.22) (pull_request) Successful in 1m41s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 14:52:24 +03:00
Denis Kirillov
3d5fc50d57 [#4] Use one object/multipart listing 
Don't init listing on every rule in configuration. Use just one

Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 14:52:24 +03:00
Denis Kirillov
1121da9d24 [#4] Support object expiration 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 14:52:19 +03:00
Denis Kirillov
d9f16604bc [#4] Update s3-gw (support CreationEpoch) 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 14:52:19 +03:00
Denis Kirillov
2ee8967547 [#4] Support aborting multiparts 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 14:52:16 +03:00
Denis Kirillov
2ece73b786 [#12] Use multi client for contract resolving 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-26 09:35:25 +00:00
Denis Kirillov
0190bbbde3 [#11] fetcher: Fix flaky TestFetcherCancel
All checks were successful
/ Builds (1.21) (pull_request) Successful in 1m42s
Details
/ Builds (1.22) (pull_request) Successful in 1m30s
Details
/ DCO (pull_request) Successful in 1m54s
Details
/ Vulncheck (pull_request) Successful in 2m13s
Details
/ Lint (pull_request) Successful in 2m46s
Details
/ Tests (1.21) (pull_request) Successful in 1m32s
Details
/ Tests (1.22) (pull_request) Successful in 1m30s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-25 16:57:55 +03:00
Denis Kirillov
84ed2f55e3 [#3] Update tree to handle split nodes
All checks were successful
/ DCO (pull_request) Successful in 1m43s
Details
/ Vulncheck (pull_request) Successful in 2m5s
Details
/ Builds (1.21) (pull_request) Successful in 2m20s
Details
/ Builds (1.22) (pull_request) Successful in 2m30s
Details
/ Lint (pull_request) Successful in 4m2s
Details
/ Tests (1.21) (pull_request) Successful in 3m38s
Details
/ Tests (1.22) (pull_request) Successful in 1m7s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-22 13:32:07 +03:00
Denis Kirillov
d8b5cd5fc2 [#3] Add job fetcher 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-22 13:32:04 +03:00
Denis Kirillov
f2893421a1 [#7] Add forgejo actions
Some checks failed
/ DCO (pull_request) Successful in 1m37s
Details
/ Builds (1.21) (pull_request) Successful in 1m51s
Details
/ Builds (1.22) (pull_request) Successful in 1m46s
Details
/ Vulncheck (pull_request) Failing after 44s
Details
/ Lint (pull_request) Failing after 31s
Details
/ Tests (1.21) (pull_request) Successful in 1m4s
Details
/ Tests (1.22) (pull_request) Successful in 1m32s
Details 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-09 09:57:57 +03:00
Denis Kirillov
d78861b148 [#2] Add FrostFS new epoch trigger 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-09 09:40:11 +03:00
Denis Kirillov
4e71fbeba6 [#1] Add basic repository structure 
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
 2024-07-02 12:14:51 +03:00
Denis Kirillov
27189a38bb [#1] Init commit 
Signed-off-by: Denis Kirillov <dkirillov@noreply.frostfs.info>
 2024-06-28 13:39:48 +00:00