Chunk payload support #106

New Issue

Closed

opened 2023-05-11 09:26:11 +00:00 by alexvanin · 0 comments

alexvanin commented

2023-05-11 09:26:11 +00:00

Owner

AWS S3 protocol supports chunked upload, where each chunk contains v4 signature

https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-streaming.html

Some libraries use this by default, e.g. minio-go library:

So maybe it worth to support that in FrostFS S3 Gateway

Describe the solution you'd like

Support v4 chunk reader, see:

Describe alternatives you've considered

Additional context

## Is your feature request related to a problem? Please describe. AWS S3 protocol supports chunked upload, where each chunk contains v4 signature https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-streaming.html Some libraries use this by default, e.g. `minio-go` library: - https://github.com/minio/minio-go/blob/60f5f057b22427e650a0652c418e0324510da817/api-put-object.go#L88 - https://stackoverflow.com/questions/55816844/aws-s3-get-after-put-includes-chunk-signature-data So maybe it worth to support that in FrostFS S3 Gateway ## Describe the solution you'd like Support v4 chunk reader, see: - https://github.com/seaweedfs/seaweedfs/blob/master/weed/s3api/chunked_reader_v4.go, - https://github.com/minio/minio/blob/a3d666356cdb2b07dce90e46ca6f5989a3e40224/cmd/streaming-signature-v4.go#L264 ## Describe alternatives you've considered  ## Additional context