Commit graph

267 commits

Author SHA1 Message Date
Abhishek Lekshmanan
9e7b2ae53d lc: Give more flexibility for LC expiration times
Earlier values expected a lc debug interval of 2s, which is a pretty
short time window and can often lead to failures if the processing
didn't complete within the next day. This commit assumes the currently
configured LC debug interval of 10s, and gives time intervals using the
following logic:

Worst case:
LC start-time : 00:00
obj upload    : 00:01
LC run1       : 00:10 -> object not expired as it is only 9s old
LC run2       : 00:20 -> object will expire in this run, however we
can't exactly guess when this run will complete, for a moderate amount
of objects this can take anywhere between 1 to a max of 10s, let us give
it a wiggle room to complete around 8s, given the amount of objects in a
teuthology run, it should be mostly probable that the object is already
deleted within this time, so at 28s, we should have seen day1 objects being
expired.

Best case:
LC start-time: 00:00
obj upload : 00:09
LC run1 : 00:10
LC run2 : 00:20 -> obj expires, so elapsed time is around 11->19s (of
course it would almost close to 10s too), We should probably configure
the LC lock time to 10s as well just so as to ensure that the lock isn't
held for the default 60s in which case it is possible that the object
might expire in a time greater than the lock interval.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit 9204283def)
2017-09-20 09:49:45 +02:00
Abhishek Lekshmanan
7a6d52afd5 lc: add attr lifecycle_expiration for lc tests using expiration
Allows us to additionally filter out these tests which currently fail in
the teuthology runs

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit edeb956a82)
2017-09-20 09:49:30 +02:00
hechuang
d8fecfdc66 modify test_sse_kms_method_head() for aws standard
Signed-off-by: hechuang <hechuang@xsky.com>
(cherry picked from commit 1ca6a94e6a)
2017-08-30 08:56:55 -04:00
hechuang
af18c59d22 add test_sse_kms_read_declare() for aws standard
Signed-off-by: hechuang <hechuang@xsky.com>
(cherry picked from commit b554973239)
2017-08-30 08:56:55 -04:00
hechuang
2d7d79c95d rgw: Data encryption is not follow the AWS agreement
Encryption request headers should not be sent for GET requests and HEAD
requests if your object uses SSE-KMS/SSE-S3 or you’ll get an HTTP 400
BadRequest error.

Signed-off-by: hechuang <hechuang@xsky.com>
(cherry picked from commit 58944d0ba6)
2017-08-30 08:56:55 -04:00
Abhishek Lekshmanan
6086420b4b add tests for get/put/delete/post object tagging
- adds test for put obj with tagging query
- adds test for HEAD obj with x-amz-tagging-count verification
- adds test for put object tagging
- adds test for get object tagging
- adds test for post object tagging
- adds test for delete object tagging
- also verify& exceed the max tags
- add tagging condition to bucket acl

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-07-25 10:51:29 +02:00
yuliyang
d0dfee8ef1 add test case: test set policy with condition operator end with IfExists
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2017-07-08 07:27:04 +08:00
Yehuda Sadeh
0b45914f40 Merge pull request #174 from ceph/wip-underscore-prefix
Add test for bucket list with prefix with underscore

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-07-07 14:04:43 -07:00
Yehuda Sadeh
a872170316 Merge pull request #170 from zhangsw/lifecycle-date
add test case for lifecycle expiration date.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-07-07 13:59:34 -07:00
Yehuda Sadeh
d801534f99 Merge pull request #168 from zhangsw/lifecycle-expiration
modify the thread sleep time in lifecycle expiration test so that it can pass on ceph master branch.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-07-07 13:58:55 -07:00
Yehuda Sadeh
ed701f0c65 Merge pull request #163 from pritha-srivastava/wip-rgw-bucket-policy-tests
rgw: Adding tests for Bucket Policy.

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-07-07 13:56:25 -07:00
Orit Wasserman
1e2e60bd6c Add test for bucket list with prefix with underscore
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-07-06 15:30:52 +03:00
Zhang Shaowen
bba1b44d7b modify the thread sleep time in lifecycle expiration test so that it can
pass on ceph master branch.

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-06-20 16:32:24 +08:00
Zhang Shaowen
fe7d69cabc add test case for lifecycle expiration date.
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-06-20 16:07:03 +08:00
Casey Bodley
a358a840b6 clear key.version_id now that GET requests return x-amz-version-id header
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-06-14 13:42:57 -04:00
Pritha Srivastava
cd50db0260 rgw: Adding tests for Bucket Policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2017-06-09 19:58:51 +05:30
Yehuda Sadeh
d91b9c43a5 Merge pull request #157 from zhangsw/verionid-getobjectmeta
Add test case for getting version id when getting object and object's metadata

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-06 14:25:10 -07:00
Zhang Shaowen
113e6f9bf6 Test case for non-current expiration, multipart upload expiration and
delete marker expiration.

Fixes: http://tracker.ceph.com/issues/19519

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-05-04 15:57:46 +08:00
Zhang Shaowen
04ecc85d33 Add test case for getting version id when getting object and object's metadata
Fixes: http://tracker.ceph.com/issues/19565

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-04-10 17:58:26 +08:00
Casey Bodley
e49cf3ddab crypto: add key headers to valid HEAD requests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-03-28 10:03:59 -04:00
Adam Kupczyk
b27ddae9c4 Added tests for HEAD method for encrypted objects.
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-28 10:03:59 -04:00
Adam Kupczyk
05543b85b1 Modified aws kms tests to use config variable kms_keyid
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-28 10:03:59 -04:00
Adam Kupczyk
33deec9a77 A bit more test for kms
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-28 10:03:55 -04:00
Adam Kupczyk
f8761f855b Additional tests for server side encryption, S3 SSE-KMS mode.
All tests belong to group 'encryption'.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-10 15:15:26 -05:00
Adam Kupczyk
d92031ef16 Additional tests for server side encryption, S3 SSE-C mode.
All tests belong to group 'encryption'.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-10 15:15:24 -05:00
Yehuda Sadeh
4eec3bebc7 Merge pull request #136 from jkorvin/fix-ifmodifiedsince-failed
Fix 'If-Modified-Since' format string

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 13:47:44 -08:00
Yehuda Sadeh
297f3d9c8c Merge pull request #135 from jkorvin/fix
Fix If-Match test

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 13:46:16 -08:00
Evgenii Gorinov
217f0d520f Fix 'If-Modified-Since' format string
According to https://tools.ietf.org/html/rfc7232
header 'If-Modified-Since' should be a correct HTTP-date.
For example: `Tue, 15 Nov 1994 12:45:26 GMT`;
not `1994-11-15T12:45:26.000Z`.

Signed-off-by: Evgenii Gorinov <korvin.lucky@gmail.com>
2017-03-07 23:04:41 +03:00
Evgenii Gorinov
73fb771553 Fix If-Match test
According to https://tools.ietf.org/html/rfc7232, If-Match field should looks like QUOTES ETag QUOTES.

Signed-off-by: Evgenii Gorinov <korvin.lucky@gmail.com>
2017-03-07 23:00:09 +03:00
Yehuda Sadeh
ed691169c5 Merge pull request #152 from zhangsw/set-current-acl
Add a test case for setting acl on object with no version id specified.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 11:48:39 -08:00
Zhang Shaowen
d6435f4f5f Add a test case for setting acl on object with no version id specified.
Fixes: http://tracker.ceph.com/issues/18923

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-02-14 16:16:51 +08:00
Zhang Shaowen
fba689ac1e add lifecycle validate test cases.
Fixes: http://tracker.ceph.com/issues/18541
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-01-17 10:50:28 +08:00
Orit Wasserman
e856cbcee6 test multi-delete with object with ending underscore
Fixes: http://tracker.ceph.com/issues/18023
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-12-01 11:03:52 +01:00
Yehuda Sadeh
f2d087ed8a rgw: adjust tests annotations
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-11-02 11:52:16 -07:00
Yehuda Sadeh
39db936348 Merge pull request #133 from ceph/wip-more-multipart-copy
more multipart copy tests
2016-11-02 11:45:06 -07:00
Yehuda Sadeh
26b505a12d Merge pull request #132 from ceph/wip-17635
add a test for post object with empty conditions
2016-11-02 11:44:54 -07:00
Yehuda Sadeh
f135d2fc1a Merge pull request #129 from ceph/wip-16930
Wip 16930
2016-11-02 11:44:28 -07:00
Yehuda Sadeh
9a2e9bbd02 fix broken test
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-11-01 16:09:09 -07:00
Yehuda Sadeh
634d96f5c6 add a test for post object with empty conditions
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-20 12:21:46 -07:00
Yehuda Sadeh
b9aab7cb1c more multipart copy tests
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-20 11:46:40 -07:00
Orit Wasserman
14da8e5b9d test set_acl for keys with special characters
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-10-20 12:11:08 +02:00
Yehuda Sadeh
e6a6ec1cd9 test concurrent bucket set acl
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-04 15:37:43 -07:00
Yehuda Sadeh
5bc2f21564 Merge pull request #124 from tipabu/complete-multipart
Complete multi-part upload during dry-run

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-10-04 09:56:17 -07:00
Tim Burke
316a814b59 Complete multi-part upload during dry-run
While it may be valuable to verify that deleting a non-existent key
is OK, that doesn't seem to be the point of this test.

Signed-off-by: Tim Burke <tim.burke@gmail.com>
2016-09-30 17:00:57 -07:00
Yehuda Sadeh
05f11d4c32 Merge pull request #127 from ceph/fix_copy_obj_versioned_bucket
Fix copy obj versioned bucket

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-09-29 19:05:54 -07:00
Daniel Gryniewicz
e33a2f6fb9 S3 lifecycle tests
Test S3 lifecycle expiration.  This requires the test harnass code in
RGW to make sure it doesn't take days so expire anything.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2016-09-26 13:34:44 -04:00
Orit Wasserman
c62e264e89 test copy object on a multipart object
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-09-16 11:41:52 +02:00
Orit Wasserman
7a437905f2 fix test_object_copy_versioned_bucket
Do not use _create_key_with_random_content as it creates a new bucket.
Check objects content and size

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-09-14 14:23:49 +02:00
Yehuda Sadeh
6ca6f7c70e Merge pull request #125 from ceph/versioned_copy_obj
Add testing for copy object to/from a versioned bucket

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-09-14 03:45:10 -07:00
Orit Wasserman
c961cdd10e Add testing for copy object to/from a versioned bucket
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-09-14 12:31:07 +02:00