dkirillov/s3-tests
1
0
Fork 0
forked from TrueCloudLab/s3-tests
Code Pull requests Activity
655 commits 127 branches 0 tags 8.9 MiB
Commit graph

655 commits

This branch
This branch
All branches
Author SHA1 Message Date
Abhishek Lekshmanan
9204283def lc: Give more flexibility for LC expiration times 
Earlier values expected a lc debug interval of 2s, which is a pretty
short time window and can often lead to failures if the processing
didn't complete within the next day. This commit assumes the currently
configured LC debug interval of 10s, and gives time intervals using the
following logic:

Worst case:
LC start-time : 00:00
obj upload    : 00:01
LC run1       : 00:10 -> object not expired as it is only 9s old
LC run2       : 00:20 -> object will expire in this run, however we
can't exactly guess when this run will complete, for a moderate amount
of objects this can take anywhere between 1 to a max of 10s, let us give
it a wiggle room to complete around 8s, given the amount of objects in a
teuthology run, it should be mostly probable that the object is already
deleted within this time, so at 28s, we should have seen day1 objects being
expired.

Best case:
LC start-time: 00:00
obj upload : 00:09
LC run1 : 00:10
LC run2 : 00:20 -> obj expires, so elapsed time is around 11->19s (of
course it would almost close to 10s too), We should probably configure
the LC lock time to 10s as well just so as to ensure that the lock isn't
held for the default 60s in which case it is possible that the object
might expire in a time greater than the lock interval.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2017-09-07 11:50:00 +02:00
Yehuda Sadeh
b5e72953fa Merge pull request #173 from chuang-he/fix_decrypt 
Data encryption is not follow the AWS agreement

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2017-08-30 15:53:36 +03:00
hechuang
1ca6a94e6a modify test_sse_kms_method_head() for aws standard 
Signed-off-by: hechuang <hechuang@xsky.com>
 2017-08-17 12:07:41 +08:00
hechuang
b554973239 add test_sse_kms_read_declare() for aws standard 
Signed-off-by: hechuang <hechuang@xsky.com>
 2017-08-17 12:07:06 +08:00
hechuang
58944d0ba6 rgw: Data encryption is not follow the AWS agreement 
Encryption request headers should not be sent for GET requests and HEAD
requests if your object uses SSE-KMS/SSE-S3 or you’ll get an HTTP 400
BadRequest error.

Signed-off-by: hechuang <hechuang@xsky.com>
 2017-08-17 12:04:53 +08:00
Andrew Gaul
a1b139c608 Add missing versioning tag 
Signed-off-by: Andrew Gaul <andrew@gaul.org>
 2017-08-16 14:08:58 -07:00
Yehuda Sadeh
425d209989 Merge pull request #179 from andrewgaul/copy-part-invalid-range 
Add test for invalid copy part range

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-08-16 09:36:07 -07:00
Yehuda Sadeh
4ff6b044c2 Merge pull request #181 from theanalyst/lc-expir-disable 
lc: set attribute as lifecycle_time for lc tests using timing ops

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2017-08-15 08:43:53 -07:00
Abhishek Lekshmanan
edeb956a82 lc: add attr lifecycle_expiration for lc tests using expiration 
Allows us to additionally filter out these tests which currently fail in
the teuthology runs

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2017-08-15 10:42:00 +02:00
Yehuda Sadeh
ca754b02f2 Merge pull request #180 from theanalyst/lc-filter 
lifecycle: add test cases using filter & no id

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-08-14 23:06:36 -07:00
Abhishek Lekshmanan
cc2d6f076f lifecycle: add test cases using filter & no id 
Added test cases for LC policies with no ID in xml, no prefix and an
empty and non empty Filter.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2017-08-11 13:52:21 +02:00
Andrew Gaul
b068a07301 Add test for invalid copy part range 
References kahing/goofys#212.

Signed-off-by: Andrew Gaul <andrew@gaul.org>
 2017-08-01 19:03:31 -07:00
Matt Benjamin
1f9f9d461f Merge pull request #159 from theanalyst/wip-tagging 
add tests for tagging functionality
 2017-07-25 13:27:14 -04:00
Abhishek Lekshmanan
6086420b4b add tests for get/put/delete/post object tagging 
- adds test for put obj with tagging query
- adds test for HEAD obj with x-amz-tagging-count verification
- adds test for put object tagging
- adds test for get object tagging
- adds test for post object tagging
- adds test for delete object tagging
- also verify& exceed the max tags
- add tagging condition to bucket acl

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
 2017-07-25 10:51:29 +02:00
Yehuda Sadeh
425d2cd698 Merge pull request #167 from joke-lee/PolicyConditionOpEndWithifExist 
add test case: test set policy with condition operator end with IfExists

Reviewed-By: Adam C. Emerson <aemerson@redhat.com>
 2017-07-07 17:08:51 -07:00
yuliyang
d0dfee8ef1 add test case: test set policy with condition operator end with IfExists 
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
 2017-07-08 07:27:04 +08:00
Yehuda Sadeh
0b45914f40 Merge pull request #174 from ceph/wip-underscore-prefix 
Add test for bucket list with prefix with underscore

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-07-07 14:04:43 -07:00
Yehuda Sadeh
a872170316 Merge pull request #170 from zhangsw/lifecycle-date 
add test case for lifecycle expiration date.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
 2017-07-07 13:59:34 -07:00
Yehuda Sadeh
d801534f99 Merge pull request #168 from zhangsw/lifecycle-expiration 
modify the thread sleep time in lifecycle expiration test so that it can pass on ceph master branch.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
 2017-07-07 13:58:55 -07:00
Yehuda Sadeh
ed701f0c65 Merge pull request #163 from pritha-srivastava/wip-rgw-bucket-policy-tests 
rgw: Adding tests for Bucket Policy.

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
 2017-07-07 13:56:25 -07:00
Orit Wasserman
1e2e60bd6c Add test for bucket list with prefix with underscore 
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
 2017-07-06 15:30:52 +03:00
Casey Bodley
a2f73f6a84 check precedence of Date and X-Amz-Date in signatures 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-06-21 10:19:12 -04:00
Yehuda Sadeh
5342557f59 Merge pull request #166 from cbodley/wip-get-version 
clear key.version_id now that GET requests return x-amz-version-id header

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-06-20 10:47:49 -07:00
Zhang Shaowen
bba1b44d7b modify the thread sleep time in lifecycle expiration test so that it can 
pass on ceph master branch.

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2017-06-20 16:32:24 +08:00
Zhang Shaowen
fe7d69cabc add test case for lifecycle expiration date. 
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2017-06-20 16:07:03 +08:00
Casey Bodley
a358a840b6 clear key.version_id now that GET requests return x-amz-version-id header 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-06-14 13:42:57 -04:00
Pritha Srivastava
cd50db0260 rgw: Adding tests for Bucket Policy. 
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
 2017-06-09 19:58:51 +05:30
Yehuda Sadeh
d91b9c43a5 Merge pull request #157 from zhangsw/verionid-getobjectmeta 
Add test case for getting version id when getting object and object's metadata

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-06-06 14:25:10 -07:00
Yehuda Sadeh
77241f587f Merge pull request #158 from zhangsw/lifecycle-noncurrent 
Test case for non-current expiration，multipart upload expiration and delete marker expiration

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
 2017-05-04 09:37:12 -07:00
Zhang Shaowen
113e6f9bf6 Test case for non-current expiration, multipart upload expiration and 
delete marker expiration.

Fixes: http://tracker.ceph.com/issues/19519

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2017-05-04 15:57:46 +08:00
Zhang Shaowen
04ecc85d33 Add test case for getting version id when getting object and object's metadata 
Fixes: http://tracker.ceph.com/issues/19565

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2017-04-10 17:58:26 +08:00
Yehuda Sadeh
289eff57ec Merge pull request #154 from ceph/wip-pr-118 
functional tests for server side encryption

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
 2017-03-28 09:08:12 -07:00
Casey Bodley
e49cf3ddab crypto: add key headers to valid HEAD requests 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2017-03-28 10:03:59 -04:00
Adam Kupczyk
b27ddae9c4 Added tests for HEAD method for encrypted objects. 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2017-03-28 10:03:59 -04:00
Adam Kupczyk
fa597a5bf1 Added micro instuction how to configure tests for KMS (barbican) integration 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2017-03-28 10:03:59 -04:00
Adam Kupczyk
05543b85b1 Modified aws kms tests to use config variable kms_keyid 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2017-03-28 10:03:59 -04:00
Adam Kupczyk
33deec9a77 A bit more test for kms 
Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2017-03-28 10:03:55 -04:00
Adam Kupczyk
f8761f855b Additional tests for server side encryption, S3 SSE-KMS mode. 
All tests belong to group 'encryption'.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2017-03-10 15:15:26 -05:00
Adam Kupczyk
d92031ef16 Additional tests for server side encryption, S3 SSE-C mode. 
All tests belong to group 'encryption'.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>
 2017-03-10 15:15:24 -05:00
Yehuda Sadeh
4eec3bebc7 Merge pull request #136 from jkorvin/fix-ifmodifiedsince-failed 
Fix 'If-Modified-Since' format string

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-03-07 13:47:44 -08:00
Yehuda Sadeh
297f3d9c8c Merge pull request #135 from jkorvin/fix 
Fix If-Match test

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-03-07 13:46:16 -08:00
Evgenii Gorinov
217f0d520f Fix 'If-Modified-Since' format string 
According to https://tools.ietf.org/html/rfc7232
header 'If-Modified-Since' should be a correct HTTP-date.
For example: `Tue, 15 Nov 1994 12:45:26 GMT`;
not `1994-11-15T12:45:26.000Z`.

Signed-off-by: Evgenii Gorinov <korvin.lucky@gmail.com>
 2017-03-07 23:04:41 +03:00
Evgenii Gorinov
73fb771553 Fix If-Match test 
According to https://tools.ietf.org/html/rfc7232, If-Match field should looks like QUOTES ETag QUOTES.

Signed-off-by: Evgenii Gorinov <korvin.lucky@gmail.com>
 2017-03-07 23:00:09 +03:00
Yehuda Sadeh
ed691169c5 Merge pull request #152 from zhangsw/set-current-acl 
Add a test case for setting acl on object with no version id specified.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
 2017-03-07 11:48:39 -08:00
Yehuda Sadeh
f15a7f13fe Merge pull request #138 from zhangsw/lifecycle-validate 
add lifecycle validate test cases.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
 2017-03-07 11:05:21 -08:00
Yehuda Sadeh
16384c37d8 Merge pull request #128 from ceph/wip-multipart-copy 
Wip multipart copy
 2017-02-27 10:25:04 -08:00
Zhang Shaowen
d6435f4f5f Add a test case for setting acl on object with no version id specified. 
Fixes: http://tracker.ceph.com/issues/18923

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2017-02-14 16:16:51 +08:00
Ken Dreyer
0f5c7665af Merge pull request #150 from ceph/wip-remove-pip 
remove python2 pip
 2017-02-07 12:05:42 -07:00
vasukulkarni
2228b3ad82 remove python2 pip 
python2-pip doesn't exist in rhel and python-virtualenv ships pip in its package.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
 2017-02-02 16:33:42 -08:00
Matt Benjamin
7de92b8756 Merge pull request #145 from mdw-at-linuxbox/master-setupfix 
Use non-broken version of setuptools, and fix bootstrap to be more portable
 2017-01-26 11:07:04 -05:00