Commit graph

599 commits

Author SHA1 Message Date
Yehuda Sadeh
c82bd9a403 Merge pull request #187 from theanalyst/wip-lc-fixes
add the LC fixes to ceph-master

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-10-04 07:37:21 -07:00
Abhishek Lekshmanan
d46175f31e lifecycle: add test cases using filter & no id
Added test cases for LC policies with no ID in xml, no prefix and an
empty and non empty Filter.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit cc2d6f076f)
2017-09-20 09:55:17 +02:00
Abhishek Lekshmanan
9e7b2ae53d lc: Give more flexibility for LC expiration times
Earlier values expected a lc debug interval of 2s, which is a pretty
short time window and can often lead to failures if the processing
didn't complete within the next day. This commit assumes the currently
configured LC debug interval of 10s, and gives time intervals using the
following logic:

Worst case:
LC start-time : 00:00
obj upload    : 00:01
LC run1       : 00:10 -> object not expired as it is only 9s old
LC run2       : 00:20 -> object will expire in this run, however we
can't exactly guess when this run will complete, for a moderate amount
of objects this can take anywhere between 1 to a max of 10s, let us give
it a wiggle room to complete around 8s, given the amount of objects in a
teuthology run, it should be mostly probable that the object is already
deleted within this time, so at 28s, we should have seen day1 objects being
expired.

Best case:
LC start-time: 00:00
obj upload : 00:09
LC run1 : 00:10
LC run2 : 00:20 -> obj expires, so elapsed time is around 11->19s (of
course it would almost close to 10s too), We should probably configure
the LC lock time to 10s as well just so as to ensure that the lock isn't
held for the default 60s in which case it is possible that the object
might expire in a time greater than the lock interval.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit 9204283def)
2017-09-20 09:49:45 +02:00
Abhishek Lekshmanan
7a6d52afd5 lc: add attr lifecycle_expiration for lc tests using expiration
Allows us to additionally filter out these tests which currently fail in
the teuthology runs

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit edeb956a82)
2017-09-20 09:49:30 +02:00
hechuang
d8fecfdc66 modify test_sse_kms_method_head() for aws standard
Signed-off-by: hechuang <hechuang@xsky.com>
(cherry picked from commit 1ca6a94e6a)
2017-08-30 08:56:55 -04:00
hechuang
af18c59d22 add test_sse_kms_read_declare() for aws standard
Signed-off-by: hechuang <hechuang@xsky.com>
(cherry picked from commit b554973239)
2017-08-30 08:56:55 -04:00
hechuang
2d7d79c95d rgw: Data encryption is not follow the AWS agreement
Encryption request headers should not be sent for GET requests and HEAD
requests if your object uses SSE-KMS/SSE-S3 or you’ll get an HTTP 400
BadRequest error.

Signed-off-by: hechuang <hechuang@xsky.com>
(cherry picked from commit 58944d0ba6)
2017-08-30 08:56:55 -04:00
Matt Benjamin
1f9f9d461f Merge pull request #159 from theanalyst/wip-tagging
add tests for tagging functionality
2017-07-25 13:27:14 -04:00
Abhishek Lekshmanan
6086420b4b add tests for get/put/delete/post object tagging
- adds test for put obj with tagging query
- adds test for HEAD obj with x-amz-tagging-count verification
- adds test for put object tagging
- adds test for get object tagging
- adds test for post object tagging
- adds test for delete object tagging
- also verify& exceed the max tags
- add tagging condition to bucket acl

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-07-25 10:51:29 +02:00
Yehuda Sadeh
425d2cd698 Merge pull request #167 from joke-lee/PolicyConditionOpEndWithifExist
add test case: test set policy with condition operator end with IfExists

Reviewed-By: Adam C. Emerson <aemerson@redhat.com>
2017-07-07 17:08:51 -07:00
yuliyang
d0dfee8ef1 add test case: test set policy with condition operator end with IfExists
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2017-07-08 07:27:04 +08:00
Yehuda Sadeh
0b45914f40 Merge pull request #174 from ceph/wip-underscore-prefix
Add test for bucket list with prefix with underscore

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-07-07 14:04:43 -07:00
Yehuda Sadeh
a872170316 Merge pull request #170 from zhangsw/lifecycle-date
add test case for lifecycle expiration date.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-07-07 13:59:34 -07:00
Yehuda Sadeh
d801534f99 Merge pull request #168 from zhangsw/lifecycle-expiration
modify the thread sleep time in lifecycle expiration test so that it can pass on ceph master branch.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-07-07 13:58:55 -07:00
Yehuda Sadeh
ed701f0c65 Merge pull request #163 from pritha-srivastava/wip-rgw-bucket-policy-tests
rgw: Adding tests for Bucket Policy.

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-07-07 13:56:25 -07:00
Orit Wasserman
1e2e60bd6c Add test for bucket list with prefix with underscore
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-07-06 15:30:52 +03:00
Yehuda Sadeh
5342557f59 Merge pull request #166 from cbodley/wip-get-version
clear key.version_id now that GET requests return x-amz-version-id header

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-20 10:47:49 -07:00
Zhang Shaowen
bba1b44d7b modify the thread sleep time in lifecycle expiration test so that it can
pass on ceph master branch.

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-06-20 16:32:24 +08:00
Zhang Shaowen
fe7d69cabc add test case for lifecycle expiration date.
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-06-20 16:07:03 +08:00
Casey Bodley
a358a840b6 clear key.version_id now that GET requests return x-amz-version-id header
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-06-14 13:42:57 -04:00
Pritha Srivastava
cd50db0260 rgw: Adding tests for Bucket Policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2017-06-09 19:58:51 +05:30
Yehuda Sadeh
d91b9c43a5 Merge pull request #157 from zhangsw/verionid-getobjectmeta
Add test case for getting version id when getting object and object's metadata

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-06 14:25:10 -07:00
Yehuda Sadeh
77241f587f Merge pull request #158 from zhangsw/lifecycle-noncurrent
Test case for non-current expiration,multipart upload expiration and delete marker expiration

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-05-04 09:37:12 -07:00
Zhang Shaowen
113e6f9bf6 Test case for non-current expiration, multipart upload expiration and
delete marker expiration.

Fixes: http://tracker.ceph.com/issues/19519

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-05-04 15:57:46 +08:00
Zhang Shaowen
04ecc85d33 Add test case for getting version id when getting object and object's metadata
Fixes: http://tracker.ceph.com/issues/19565

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-04-10 17:58:26 +08:00
Yehuda Sadeh
289eff57ec Merge pull request #154 from ceph/wip-pr-118
functional tests for server side encryption

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-03-28 09:08:12 -07:00
Casey Bodley
e49cf3ddab crypto: add key headers to valid HEAD requests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-03-28 10:03:59 -04:00
Adam Kupczyk
b27ddae9c4 Added tests for HEAD method for encrypted objects.
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-28 10:03:59 -04:00
Adam Kupczyk
fa597a5bf1 Added micro instuction how to configure tests for KMS (barbican) integration
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-28 10:03:59 -04:00
Adam Kupczyk
05543b85b1 Modified aws kms tests to use config variable kms_keyid
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-28 10:03:59 -04:00
Adam Kupczyk
33deec9a77 A bit more test for kms
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-28 10:03:55 -04:00
Adam Kupczyk
f8761f855b Additional tests for server side encryption, S3 SSE-KMS mode.
All tests belong to group 'encryption'.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-10 15:15:26 -05:00
Adam Kupczyk
d92031ef16 Additional tests for server side encryption, S3 SSE-C mode.
All tests belong to group 'encryption'.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
2017-03-10 15:15:24 -05:00
Yehuda Sadeh
4eec3bebc7 Merge pull request #136 from jkorvin/fix-ifmodifiedsince-failed
Fix 'If-Modified-Since' format string

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 13:47:44 -08:00
Yehuda Sadeh
297f3d9c8c Merge pull request #135 from jkorvin/fix
Fix If-Match test

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 13:46:16 -08:00
Evgenii Gorinov
217f0d520f Fix 'If-Modified-Since' format string
According to https://tools.ietf.org/html/rfc7232
header 'If-Modified-Since' should be a correct HTTP-date.
For example: `Tue, 15 Nov 1994 12:45:26 GMT`;
not `1994-11-15T12:45:26.000Z`.

Signed-off-by: Evgenii Gorinov <korvin.lucky@gmail.com>
2017-03-07 23:04:41 +03:00
Evgenii Gorinov
73fb771553 Fix If-Match test
According to https://tools.ietf.org/html/rfc7232, If-Match field should looks like QUOTES ETag QUOTES.

Signed-off-by: Evgenii Gorinov <korvin.lucky@gmail.com>
2017-03-07 23:00:09 +03:00
Yehuda Sadeh
ed691169c5 Merge pull request #152 from zhangsw/set-current-acl
Add a test case for setting acl on object with no version id specified.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-07 11:48:39 -08:00
Yehuda Sadeh
f15a7f13fe Merge pull request #138 from zhangsw/lifecycle-validate
add lifecycle validate test cases.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-03-07 11:05:21 -08:00
Yehuda Sadeh
16384c37d8 Merge pull request #128 from ceph/wip-multipart-copy
Wip multipart copy
2017-02-27 10:25:04 -08:00
Zhang Shaowen
d6435f4f5f Add a test case for setting acl on object with no version id specified.
Fixes: http://tracker.ceph.com/issues/18923

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-02-14 16:16:51 +08:00
Ken Dreyer
0f5c7665af Merge pull request #150 from ceph/wip-remove-pip
remove python2 pip
2017-02-07 12:05:42 -07:00
vasukulkarni
2228b3ad82 remove python2 pip
python2-pip doesn't exist in rhel and python-virtualenv ships pip in its package.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2017-02-02 16:33:42 -08:00
Matt Benjamin
7de92b8756 Merge pull request #145 from mdw-at-linuxbox/master-setupfix
Use non-broken version of setuptools, and fix bootstrap to be more portable
2017-01-26 11:07:04 -05:00
Marcus Watts
ddc150439d Use non-broken version of setuptools, and fix bootstrap to be more portable.
Most recent version of setuptools breaks when asked to load requests 0.14.0.
symptom, complains about not being able to import filterfalse thus:
        from six.moves import map, filter, filterfalse
this comes from setuptools, and older versions of setuptools don't have
this problem.

Various versions of centos7 and fedora have interesting names for packages,
	centos7: python-pip is python2-pip
	fedora24: python-virtualenv is python2-virtualenv
This is somewhat masked by using sudo yum: if the actual package
is installed, rpm knows that the capability is there and does nothing.
But, if the package isn't there, or you haven't chosen to set up
sudo to work that way, this does not work.

Signed-off-by: Marcus Watts <mwatts@redhat.com>
2017-01-26 04:17:41 -05:00
Yehuda Sadeh
60f71aee50 Merge pull request #139 from linuxbox2/wip-setuptools
bootstrap:  force new setuptools

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-01-25 13:04:03 -08:00
Matt Benjamin
53b9284431 bootstrap: force new setuptools
Deal setuptools upgrade problem discussed here:
 https://github.com/pypa/setuptools/issues/940

Now follows the same formula as upstream teuthology.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-25 13:32:53 -05:00
Zhang Shaowen
fba689ac1e add lifecycle validate test cases.
Fixes: http://tracker.ceph.com/issues/18541
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-01-17 10:50:28 +08:00
Yehuda Sadeh
735c55654c Merge pull request #137 from ceph/wip-delete-multi-underscore
test multi-delete with object with ending underscore

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-01-09 15:42:09 -08:00
Orit Wasserman
e856cbcee6 test multi-delete with object with ending underscore
Fixes: http://tracker.ceph.com/issues/18023
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-12-01 11:03:52 +01:00