includes tests for CRC64NVME, tests for selecting
COMPOSITE and FULL_OBJECT checksums
a decomposed matrix of tests for all checksum types
also removes the mixed checksum upload case that no longer
works in recent boto3
cleanups, add sha1
checksum validation failure (mismatch) returns BadDigest
multipart checksum matrix helper now validates checksum and checksum type
for all operations which can return them (complete-multipart, head-object,
and get-object-attributes)
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
this is to cover these checks:
* source bucket ownership
* "requester pays" on log bucket
that were added in: https://github.com/ceph/ceph/pull/62284
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
this commit needed to be able to run bucket logging regression
against: https://github.com/ceph/ceph/pull/62284
since target bucket requires policy for bucket logging to work
this only covers the positive cases from bucket logging policy
perspective
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
Check the allow_read_through values for cases test_lifecycle_cloud_transition
and test_read_through
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
rgw/restore: s3tests to test restore object functionality
Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
test_versioned_concurrent_object_create_concurrent_remove
as the associated tracker is marked as resolved and
the test also passes against main.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
This tests are added to tests temporary restore, permanent restore and
read through resotre object functionality, this includes zonegroup
parameters and checks.
Signed-off-by: shreyanshjain7174 <ssanchet@redhat.com>
Signed-off-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
boto update exposed some bugs in our checksum feature around multipart
copy and ranged requests. disabling them with fails_on_rgw until
https://tracker.ceph.com/issues/69936 is resolved
Signed-off-by: Casey Bodley <cbodley@redhat.com>
the test sends create_multipart_upload() with a requested checksum
algorithm, and upload_part() requests without. newer boto automatically
adds `x-amz-sdk-checksum-algorithm: CRC32` when nothing is specified,
so we have to explicitly disable that behavior via botocore config
Signed-off-by: Casey Bodley <cbodley@redhat.com>
the botocore.handlers.validate_bucket_name validation is enabled by
default, but we can disable it with unregister(). this avoids having to
mess with the signature or url
Signed-off-by: Casey Bodley <cbodley@redhat.com>
If the bucket is owned by a different account, the request fails with the HTTP status code 403 Forbidden (access denied).
PR: ceph/ceph#61215
Fixes: https://tracker.ceph.com/issues/64526
Signed-off-by: Raja Sharma <raja@ibm.com>
* multipart upload without checksums
* multipart upload with a single part
* pagination of multipart parts
* non-multipart upload with/without checksum
* versioned object, current and non-current
* sse-c encrypted object
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
