Consider having archive extraction during upload #8

New issue

Open

opened 2025-01-29 08:00:14 +00:00 by alexvanin · 1 comment

alexvanin commented

2025-01-29 08:00:14 +00:00

Owner

In HTTP gateway we've implemented archive extraction during upload (see frostfs-http-gw#170). Consider adding similar feature to rclone so we can use it to upload allure reports and display them with HTTP gateway.

Challenges:

it is not clear how we should enable this feature, maybe different rclone command?
it didn't work out for zip archives, only for tar
we had issues with content-type of extracted files to display allure report (fixed in frostfs-http-gw#188)

In HTTP gateway we've implemented archive extraction during upload (see [frostfs-http-gw#170](https://git.frostfs.info/TrueCloudLab/frostfs-http-gw/issues/170)). Consider adding similar feature to rclone so we can use it to upload allure reports and display them with HTTP gateway. Challenges: * it is not clear how we should enable this feature, maybe different rclone command? * it didn't work out for zip archives, only for tar * we had issues with content-type of extracted files to display allure report (fixed in [frostfs-http-gw#188](https://git.frostfs.info/TrueCloudLab/frostfs-http-gw/issues/188))

KurlesHS was assigned by alexvanin

2025-01-29 08:00:14 +00:00

potyarkin commented

2025-01-29 08:41:28 +00:00

Member

rclone S3 provider implements --s3-decompress boolean option which decompresses gzip-encoded objects during download, opposite of what we attempt here. We can make a --frostfs-unarchive parameter which would accept a list of file extensions or mime types to extract during upload.

rclone S3 provider implements `--s3-decompress` boolean option which decompresses gzip-encoded objects during download, opposite of what we attempt here. We can make a `--frostfs-unarchive` parameter which would accept a list of file extensions or mime types to extract during upload.

👍 1

KurlesHS referenced this issue from a pull request that will close it,

2025-02-11 17:45:56 +00:00

WIP: [#8] Add extract command #12