8b6d93c94d
[ #20 ] Add metric to see number of dropped logs
...
/ DCO (pull_request) Successful in 48s
/ Builds (pull_request) Successful in 1m19s
/ Vulncheck (pull_request) Successful in 1m20s
/ Lint (pull_request) Successful in 1m40s
/ Tests (pull_request) Successful in 1m20s
Add new metric frostfs_s3_lifecycler_statistic_dropped_logs
Also, configuration sampling interval is added
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-09-24 17:47:03 +03:00
f3359f98f4
[ #20 ] Support prefixed tagging
...
Now different log messages can use the same tag:
* `tag:delete remove object`
* `tag:delete remove version`
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-09-24 15:14:14 +03:00
52c2ec525c
[ #20 ] Fix go.sum
...
/ DCO (pull_request) Successful in 42s
/ Vulncheck (pull_request) Successful in 1m18s
/ Builds (pull_request) Successful in 57s
/ Lint (pull_request) Successful in 2m27s
/ Tests (pull_request) Successful in 1m6s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-09-23 18:53:32 +03:00
2f7a73ee36
[ #20 ] Support logging with tags
...
/ DCO (pull_request) Successful in 48s
/ Vulncheck (pull_request) Successful in 1m17s
/ Builds (pull_request) Failing after 1m5s
/ Lint (pull_request) Successful in 2m32s
/ Tests (pull_request) Successful in 1m7s
Allow to log additionally "tagged" log entries.
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-09-23 17:39:09 +03:00
4f250eba42
[ #20 ] Add logs for processing container and deleting objects
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-09-23 17:20:51 +03:00
5ffed0b96f
[ #20 ] Add log sampling configuration
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-09-23 16:27:27 +03:00
fce631be59
[ #19 ] fetcher: Don't user btoken for separate lifecycle container
...
/ DCO (pull_request) Successful in 1m26s
/ Builds (1.22) (pull_request) Successful in 1m26s
/ Builds (1.23) (pull_request) Successful in 1m31s
/ Vulncheck (pull_request) Successful in 1m47s
/ Lint (pull_request) Successful in 2m31s
/ Tests (1.22) (pull_request) Successful in 1m49s
/ Tests (1.23) (pull_request) Successful in 1m46s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-09-03 15:32:42 +03:00
a3089bc89e
[ #18 ] Update Go version
...
/ DCO (pull_request) Successful in 1m17s
/ Builds (1.22) (pull_request) Successful in 1m24s
/ Builds (1.23) (pull_request) Successful in 1m26s
/ Vulncheck (pull_request) Successful in 1m24s
/ Lint (pull_request) Successful in 2m56s
/ Tests (1.22) (pull_request) Successful in 1m36s
/ Tests (1.23) (pull_request) Successful in 1m35s
Signed-off-by: Nikita Zinkevich <n.zinkevich@yadro.com>
2024-08-29 08:36:11 +03:00
17717ac42e
[ #17 ] go.mod: Update s3-gw to eliminate redundant logs
...
/ DCO (pull_request) Successful in 1m15s
/ Vulncheck (pull_request) Successful in 1m18s
/ Builds (1.21) (pull_request) Successful in 1m35s
/ Builds (1.22) (pull_request) Successful in 1m30s
/ Lint (pull_request) Successful in 2m48s
/ Tests (1.21) (pull_request) Successful in 1m32s
/ Tests (1.22) (pull_request) Successful in 1m30s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-08-05 12:03:03 +03:00
0e58ccbed7
[ #17 ] executor: Don't create unnecessary delete markers
...
Separate regular expiration from non-current versions removing
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-08-05 12:02:52 +03:00
b3677cefbb
[ #16 ] frostfsid: Fix client invocation
...
/ DCO (pull_request) Successful in 50s
/ Vulncheck (pull_request) Successful in 1m4s
/ Builds (1.21) (pull_request) Successful in 1m11s
/ Builds (1.22) (pull_request) Successful in 1m9s
/ Lint (pull_request) Successful in 2m7s
/ Tests (1.21) (pull_request) Successful in 1m16s
/ Tests (1.22) (pull_request) Successful in 1m14s
Previously we cannot switch to new client after connection was lost
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-31 14:19:02 +03:00
aaa652de67
[ #16 ] executor: Fix object expiration condition
...
Wrong comparison operators (and values) were used.
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-31 14:18:54 +03:00
c9011f6da2
[ #16 ] executor: Fix multipart expiration condition
...
Wrong comparison operator was used.
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-31 12:03:04 +03:00
ba26d975e0
[ #16 ] fetcher: Remove bearer APE condition
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-31 12:01:56 +03:00
04c5b65ad5
[ #16 ] Allow to configure several sources
...
/ DCO (pull_request) Successful in 54s
/ Vulncheck (pull_request) Successful in 1m1s
/ Builds (1.21) (pull_request) Successful in 1m22s
/ Builds (1.22) (pull_request) Successful in 1m3s
/ Lint (pull_request) Successful in 2m8s
/ Tests (1.21) (pull_request) Successful in 1m31s
/ Tests (1.22) (pull_request) Successful in 1m13s
Allow to explicitly specify which credential source use
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-31 11:56:54 +03:00
b3374bb565
[ #4 ] Fix applying disabled multipart rules
...
/ DCO (pull_request) Successful in 2m8s
/ Builds (1.21) (pull_request) Successful in 1m2s
/ Builds (1.22) (pull_request) Successful in 1m8s
/ Vulncheck (pull_request) Successful in 55s
/ Lint (pull_request) Successful in 1m47s
/ Tests (1.21) (pull_request) Successful in 1m5s
/ Tests (1.22) (pull_request) Successful in 1m26s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 16:46:49 +03:00
c4f259e68b
[ #3 ] Clean old jobs from fetcher jobs channel buffer
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 16:38:34 +03:00
2613504b94
[ #4 ] Don't check tags for multiparts
...
Spec https://docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-configuration-examples.html#lc-expire-mpu
says: "When you use the AbortIncompleteMultipartUpload S3
Lifecycle action, the rule cannot specify a tag-based filter."
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 16:38:30 +03:00
15c9d55b03
[ #4 ] Add more tests
...
/ DCO (pull_request) Successful in 42s
/ Vulncheck (pull_request) Successful in 1m19s
/ Builds (1.21) (pull_request) Successful in 1m34s
/ Builds (1.22) (pull_request) Successful in 1m32s
/ Lint (pull_request) Successful in 2m3s
/ Tests (1.21) (pull_request) Successful in 1m28s
/ Tests (1.22) (pull_request) Successful in 1m41s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 14:52:24 +03:00
3d5fc50d57
[ #4 ] Use one object/multipart listing
...
Don't init listing on every rule in configuration. Use just one
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 14:52:24 +03:00
1121da9d24
[ #4 ] Support object expiration
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 14:52:19 +03:00
d9f16604bc
[ #4 ] Update s3-gw (support CreationEpoch)
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 14:52:19 +03:00
2ee8967547
[ #4 ] Support aborting multiparts
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 14:52:16 +03:00
2ece73b786
[ #12 ] Use multi client for contract resolving
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-26 09:35:25 +00:00
0190bbbde3
[ #11 ] fetcher: Fix flaky TestFetcherCancel
...
/ Builds (1.21) (pull_request) Successful in 1m42s
/ Builds (1.22) (pull_request) Successful in 1m30s
/ DCO (pull_request) Successful in 1m54s
/ Vulncheck (pull_request) Successful in 2m13s
/ Lint (pull_request) Successful in 2m46s
/ Tests (1.21) (pull_request) Successful in 1m32s
/ Tests (1.22) (pull_request) Successful in 1m30s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-25 16:57:55 +03:00
84ed2f55e3
[ #3 ] Update tree to handle split nodes
...
/ DCO (pull_request) Successful in 1m43s
/ Vulncheck (pull_request) Successful in 2m5s
/ Builds (1.21) (pull_request) Successful in 2m20s
/ Builds (1.22) (pull_request) Successful in 2m30s
/ Lint (pull_request) Successful in 4m2s
/ Tests (1.21) (pull_request) Successful in 3m38s
/ Tests (1.22) (pull_request) Successful in 1m7s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-22 13:32:07 +03:00
d8b5cd5fc2
[ #3 ] Add job fetcher
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-22 13:32:04 +03:00
f2893421a1
[ #7 ] Add forgejo actions
...
/ DCO (pull_request) Successful in 1m37s
/ Builds (1.21) (pull_request) Successful in 1m51s
/ Builds (1.22) (pull_request) Successful in 1m46s
/ Vulncheck (pull_request) Failing after 44s
/ Lint (pull_request) Failing after 31s
/ Tests (1.21) (pull_request) Successful in 1m4s
/ Tests (1.22) (pull_request) Successful in 1m32s
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-09 09:57:57 +03:00
d78861b148
[ #2 ] Add FrostFS new epoch trigger
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-09 09:40:11 +03:00
4e71fbeba6
[ #1 ] Add basic repository structure
...
Signed-off-by: Denis Kirillov <d.kirillov@yadro.com>
2024-07-02 12:14:51 +03:00
27189a38bb
[ #1 ] Init commit
...
Signed-off-by: Denis Kirillov <dkirillov@noreply.frostfs.info>
2024-06-28 13:39:48 +00:00